2024-01-25T14:53:20.207 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f 2024-01-25T14:53:20.207 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} --name vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi --archive /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531486 --verbose --owner scheduled_vshankar@teuthology -- /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531486/orig.config.yaml 2024-01-25T14:53:20.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T14:53:20.342 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531486 branch: wip-vshankar-testing-20240125.044502 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} email: vshankar@redhat.com first_in_suite: false job_id: '7531486' kernel: client: sha1: distro flavor: default kdb: true sha1: cd42140e628558a450ba1d39a9d0835a2fa62cda ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240125.044502 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 661946e7044723130c03627323f6a879a9848cb5 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 661946e7044723130c03627323f6a879a9848cb5 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240125.044502 sha1: 661946e7044723130c03627323f6a879a9848cb5 owner: scheduled_vshankar@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 9619 sha1: 661946e7044723130c03627323f6a879a9848cb5 sleep_before_teardown: 0 subset: 293/1024 suite: fs suite_branch: wip-vshankar-testing-20240125.044502 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 661946e7044723130c03627323f6a879a9848cb5 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi029.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPh5hJ2R9FHK3+NsMdR3AgyHxkkEsnxPtPiQ8l6qvu/oE0SJX8++UVrWzsSQ3EfDctSFfFFX7sOGw7RRgLQAIqo= smithi052.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUzhAxUidfqU8imDHbFUGBRHXVVI0YbSSg4pBnLQGVADVRqT6yDdKF1qMRXF5NWubV5/Xd9OgXmQo/77EmvWtE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: c856e0f9244dd29a50697123b480d63f16a4ed81 timestamp: 2024-01-25_13:52:19 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-25T14:53:20.342 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa; will attempt to use it 2024-01-25T14:53:20.343 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks 2024-01-25T14:53:20.343 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-25T14:53:20.345 INFO:teuthology.task.internal:Checking packages... 2024-01-25T14:53:20.368 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '661946e7044723130c03627323f6a879a9848cb5' 2024-01-25T14:53:20.368 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-25T14:53:20.368 INFO:teuthology.packaging:ref: None 2024-01-25T14:53:20.368 INFO:teuthology.packaging:tag: None 2024-01-25T14:53:20.369 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240125.044502 2024-01-25T14:53:20.369 INFO:teuthology.packaging:sha1: 661946e7044723130c03627323f6a879a9848cb5 2024-01-25T14:53:20.369 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240125.044502 2024-01-25T14:53:20.576 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-885.g661946e7 2024-01-25T14:53:20.578 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-25T14:53:20.585 INFO:teuthology.task.internal:no buildpackages task found 2024-01-25T14:53:20.585 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-25T14:53:20.605 INFO:teuthology.task.internal:Saving configuration 2024-01-25T14:53:20.621 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-25T14:53:20.632 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-25T14:53:20.658 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531486', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-25 14:47:59.748700', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPh5hJ2R9FHK3+NsMdR3AgyHxkkEsnxPtPiQ8l6qvu/oE0SJX8++UVrWzsSQ3EfDctSFfFFX7sOGw7RRgLQAIqo='} 2024-01-25T14:53:20.681 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531486', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-25 14:47:59.750671', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUzhAxUidfqU8imDHbFUGBRHXVVI0YbSSg4pBnLQGVADVRqT6yDdKF1qMRXF5NWubV5/Xd9OgXmQo/77EmvWtE='} 2024-01-25T14:53:20.681 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-25T14:53:20.688 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-01-25T14:53:20.689 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-01-25T14:53:20.689 INFO:teuthology.run_tasks:Running task console_log... 2024-01-25T14:53:20.768 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd7b8448f70>, signals=[15]) 2024-01-25T14:53:20.769 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-25T14:53:20.776 INFO:teuthology.task.internal:Opening connections... 2024-01-25T14:53:20.776 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi029.front.sepia.ceph.com 2024-01-25T14:53:20.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T14:53:20.887 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2024-01-25T14:53:20.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T14:53:20.998 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-25T14:53:21.005 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2024-01-25T14:53:21.024 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2024-01-25T14:53:21.024 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-01-25T14:53:21.082 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2024-01-25T14:53:21.082 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9" 2024-01-25T14:53:21.082 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2024-01-25T14:53:21.082 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2024-01-25T14:53:21.082 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9" 2024-01-25T14:53:21.082 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9" 2024-01-25T14:53:21.083 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-25T14:53:21.083 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-01-25T14:53:21.083 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon" 2024-01-25T14:53:21.083 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-25T14:53:21.083 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2024-01-25T14:53:21.083 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-25T14:53:21.083 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-25T14:53:21.083 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-25T14:53:21.084 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-01-25T14:53:21.108 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2024-01-25T14:53:21.128 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2024-01-25T14:53:21.129 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2024-01-25T14:53:21.194 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2024-01-25T14:53:21.195 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9" 2024-01-25T14:53:21.195 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2024-01-25T14:53:21.195 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2024-01-25T14:53:21.195 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9" 2024-01-25T14:53:21.195 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9" 2024-01-25T14:53:21.195 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-25T14:53:21.195 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2024-01-25T14:53:21.195 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon" 2024-01-25T14:53:21.195 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-25T14:53:21.195 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2024-01-25T14:53:21.195 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-25T14:53:21.195 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-25T14:53:21.196 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-25T14:53:21.196 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2024-01-25T14:53:21.216 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-25T14:53:21.270 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-25T14:53:21.308 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-25T14:53:21.308 DEBUG:teuthology.orchestra.run.smithi029:> test '!' -e /home/ubuntu/cephtest 2024-01-25T14:53:21.312 DEBUG:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2024-01-25T14:53:21.333 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-25T14:53:21.350 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-25T14:53:21.350 DEBUG:teuthology.orchestra.run.smithi029:> test -z $(ls -A /var/lib/ceph) 2024-01-25T14:53:21.372 DEBUG:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2024-01-25T14:53:21.406 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-25T14:53:21.554 INFO:teuthology.run_tasks:Running task kernel... 2024-01-25T14:53:21.658 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd42140e628558a450ba1d39a9d0835a2fa62cda'} 2024-01-25T14:53:21.658 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}} 2024-01-25T14:53:21.658 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-01-25T14:53:21.659 DEBUG:teuthology.orchestra.run.smithi029:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-25T14:53:21.659 DEBUG:teuthology.orchestra.run.smithi052:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-25T14:53:21.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T14:53:21.680 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-01-25T14:53:21.681 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T14:53:21.681 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-01-25T14:53:21.740 INFO:teuthology.orchestra.run.smithi052.stdout:5.14.0-361.el9.x86_64 2024-01-25T14:53:21.741 INFO:teuthology.task.kernel:Running kernel on smithi052: 5.14.0-361.el9.x86_64 2024-01-25T14:53:21.741 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum install -y kernel 2024-01-25T14:53:21.743 INFO:teuthology.orchestra.run.smithi029.stdout:5.14.0-361.el9.x86_64 2024-01-25T14:53:21.743 INFO:teuthology.task.kernel:Running kernel on smithi029: 5.14.0-361.el9.x86_64 2024-01-25T14:53:21.743 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum install -y kernel 2024-01-25T14:53:24.191 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS-9 - AppStream 8.4 MB/s | 6.4 MB 00:00 2024-01-25T14:53:24.895 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS-9 - AppStream 13 MB/s | 6.4 MB 00:00 2024-01-25T14:53:25.683 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS-9 - BaseOS 5.1 MB/s | 2.0 MB 00:00 2024-01-25T14:53:26.329 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS-9 - BaseOS 6.0 MB/s | 2.0 MB 00:00 2024-01-25T14:53:26.807 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.0 MB 00:00 2024-01-25T14:53:27.339 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-01-25T14:53:28.917 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-01-25T14:53:29.983 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - AppStream 13 MB/s | 19 MB 00:01 2024-01-25T14:53:34.751 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 5.9 MB 00:02 2024-01-25T14:53:35.072 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 5.9 MB 00:01 2024-01-25T14:53:36.618 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 15 kB 00:00 2024-01-25T14:53:37.430 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 15 kB 00:01 2024-01-25T14:53:37.847 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2024-01-25T14:53:38.542 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 21 MB/s | 20 MB 00:00 2024-01-25T14:53:42.944 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 50 kB/s | 1.7 kB 00:00 2024-01-25T14:53:43.643 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-01-25T14:53:45.326 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-01-25T14:53:45.327 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-01-25T14:53:45.428 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-01-25T14:53:45.435 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-01-25T14:53:45.435 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-01-25T14:53:45.435 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-01-25T14:53:45.435 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-01-25T14:53:45.436 INFO:teuthology.orchestra.run.smithi052.stdout: kernel x86_64 5.14.0-411.el9 CentOS-BaseOS 6.0 M 2024-01-25T14:53:45.436 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-01-25T14:53:45.436 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-core x86_64 5.14.0-411.el9 CentOS-BaseOS 21 M 2024-01-25T14:53:45.436 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules x86_64 5.14.0-411.el9 CentOS-BaseOS 39 M 2024-01-25T14:53:45.436 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules-core x86_64 5.14.0-411.el9 CentOS-BaseOS 33 M 2024-01-25T14:53:45.436 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T14:53:45.436 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-01-25T14:53:45.436 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-01-25T14:53:45.436 INFO:teuthology.orchestra.run.smithi052.stdout:Install 4 Packages 2024-01-25T14:53:45.436 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T14:53:45.437 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 99 M 2024-01-25T14:53:45.437 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 122 M 2024-01-25T14:53:45.437 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-01-25T14:53:45.921 INFO:teuthology.orchestra.run.smithi052.stdout:(1/4): kernel-5.14.0-411.el9.x86_64.rpm 12 MB/s | 6.0 MB 00:00 2024-01-25T14:53:46.050 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-01-25T14:53:46.050 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-01-25T14:53:46.155 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-01-25T14:53:46.170 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-01-25T14:53:46.170 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-01-25T14:53:46.170 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-01-25T14:53:46.170 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-01-25T14:53:46.170 INFO:teuthology.orchestra.run.smithi029.stdout: kernel x86_64 5.14.0-411.el9 CentOS-BaseOS 6.0 M 2024-01-25T14:53:46.170 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-01-25T14:53:46.170 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-core x86_64 5.14.0-411.el9 CentOS-BaseOS 21 M 2024-01-25T14:53:46.171 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules x86_64 5.14.0-411.el9 CentOS-BaseOS 39 M 2024-01-25T14:53:46.171 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-core x86_64 5.14.0-411.el9 CentOS-BaseOS 33 M 2024-01-25T14:53:46.171 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T14:53:46.171 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-01-25T14:53:46.171 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-01-25T14:53:46.171 INFO:teuthology.orchestra.run.smithi029.stdout:Install 4 Packages 2024-01-25T14:53:46.171 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T14:53:46.171 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 99 M 2024-01-25T14:53:46.172 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 122 M 2024-01-25T14:53:46.172 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-01-25T14:53:46.896 INFO:teuthology.orchestra.run.smithi052.stdout:(2/4): kernel-core-5.14.0-411.el9.x86_64.rpm 14 MB/s | 21 MB 00:01 2024-01-25T14:53:47.022 INFO:teuthology.orchestra.run.smithi029.stdout:(1/4): kernel-5.14.0-411.el9.x86_64.rpm 7.1 MB/s | 6.0 MB 00:00 2024-01-25T14:53:47.822 INFO:teuthology.orchestra.run.smithi029.stdout:(2/4): kernel-core-5.14.0-411.el9.x86_64.rpm 13 MB/s | 21 MB 00:01 2024-01-25T14:53:48.113 INFO:teuthology.orchestra.run.smithi052.stdout:(3/4): kernel-modules-core-5.14.0-411.el9.x86_6 15 MB/s | 33 MB 00:02 2024-01-25T14:53:48.796 INFO:teuthology.orchestra.run.smithi052.stdout:(4/4): kernel-modules-5.14.0-411.el9.x86_64.rpm 12 MB/s | 39 MB 00:03 2024-01-25T14:53:48.799 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-01-25T14:53:48.799 INFO:teuthology.orchestra.run.smithi052.stdout:Total 29 MB/s | 99 MB 00:03 2024-01-25T14:53:48.800 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-01-25T14:53:48.964 INFO:teuthology.orchestra.run.smithi029.stdout:(3/4): kernel-modules-5.14.0-411.el9.x86_64.rpm 14 MB/s | 39 MB 00:02 2024-01-25T14:53:49.256 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-01-25T14:53:49.256 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-01-25T14:53:49.690 INFO:teuthology.orchestra.run.smithi029.stdout:(4/4): kernel-modules-core-5.14.0-411.el9.x86_6 13 MB/s | 33 MB 00:02 2024-01-25T14:53:49.693 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-01-25T14:53:49.693 INFO:teuthology.orchestra.run.smithi029.stdout:Total 28 MB/s | 99 MB 00:03 2024-01-25T14:53:49.693 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-01-25T14:53:50.196 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-01-25T14:53:50.196 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-01-25T14:53:50.298 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-01-25T14:53:50.299 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-01-25T14:53:51.236 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-01-25T14:53:51.236 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-01-25T14:53:52.850 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-01-25T14:53:53.548 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-modules-core-5.14.0-411.el9.x86_64 1/4 2024-01-25T14:53:53.681 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-core-5.14.0-411.el9.x86_64 2/4 2024-01-25T14:53:53.789 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-01-25T14:53:54.605 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-modules-core-5.14.0-411.el9.x86_64 1/4 2024-01-25T14:53:54.788 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-core-5.14.0-411.el9.x86_64 2/4 2024-01-25T14:53:56.580 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-core-5.14.0-411.el9.x86_64 2/4 2024-01-25T14:53:56.767 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-modules-5.14.0-411.el9.x86_64 3/4 2024-01-25T14:53:57.693 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-core-5.14.0-411.el9.x86_64 2/4 2024-01-25T14:53:57.981 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-modules-5.14.0-411.el9.x86_64 3/4 2024-01-25T14:54:01.819 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-modules-5.14.0-411.el9.x86_64 3/4 2024-01-25T14:54:01.922 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-5.14.0-411.el9.x86_64 4/4 2024-01-25T14:54:03.430 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-5.14.0-411.el9.x86_64 3/4 2024-01-25T14:54:05.734 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-5.14.0-411.el9.x86_64 4/4 2024-01-25T14:54:07.009 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-modules-core-5.14.0-411.el9.x86_64 4/4 2024-01-25T14:54:10.820 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-core-5.14.0-411.el9.x86_64 4/4 2024-01-25T14:54:37.482 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-core-5.14.0-411.el9.x86_64 4/4 2024-01-25T14:54:37.483 INFO:teuthology.orchestra.run.smithi052.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-25T14:54:37.483 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T14:54:37.553 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-modules-5.14.0-411.el9.x86_64 4/4 2024-01-25T14:54:37.987 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-5.14.0-411.el9.x86_64 4/4 2024-01-25T14:54:37.987 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-5.14.0-411.el9.x86_64 1/4 2024-01-25T14:54:37.987 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-core-5.14.0-411.el9.x86_64 2/4 2024-01-25T14:54:37.987 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-modules-5.14.0-411.el9.x86_64 3/4 2024-01-25T14:54:38.420 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-modules-core-5.14.0-411.el9.x86_64 4/4 2024-01-25T14:54:38.421 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T14:54:38.421 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-01-25T14:54:38.421 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-5.14.0-411.el9.x86_64 2024-01-25T14:54:38.421 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-core-5.14.0-411.el9.x86_64 2024-01-25T14:54:38.421 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules-5.14.0-411.el9.x86_64 2024-01-25T14:54:38.421 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules-core-5.14.0-411.el9.x86_64 2024-01-25T14:54:38.421 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T14:54:38.421 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-01-25T14:54:38.938 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q kernel | sort -rV | head -n 1 2024-01-25T14:54:39.077 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-5.14.0-411.el9.x86_64 2024-01-25T14:54:39.077 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-411.el9.x86_64 2024-01-25T14:54:39.077 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-411.el9.x86_64 2024-01-25T14:54:39.077 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-01-25T14:54:39.077 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-01-25T14:54:39.077 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-01-25T14:54:39.078 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi052.front.sepia.ceph.com, path=None, version=distro) 2024-01-25T14:54:39.078 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q kernel | sort -rV | head -n 1 2024-01-25T14:54:39.189 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-5.14.0-411.el9.x86_64 2024-01-25T14:54:39.189 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-411.el9.x86_64 2024-01-25T14:54:39.189 DEBUG:teuthology.orchestra.run.smithi052:> sudo rpm -qi grub2-tools 2024-01-25T14:54:39.232 INFO:teuthology.orchestra.run.smithi052.stdout:Name : grub2-tools 2024-01-25T14:54:39.232 INFO:teuthology.orchestra.run.smithi052.stdout:Epoch : 1 2024-01-25T14:54:39.232 INFO:teuthology.orchestra.run.smithi052.stdout:Version : 2.06 2024-01-25T14:54:39.232 INFO:teuthology.orchestra.run.smithi052.stdout:Release : 68.el9 2024-01-25T14:54:39.232 INFO:teuthology.orchestra.run.smithi052.stdout:Architecture: x86_64 2024-01-25T14:54:39.232 INFO:teuthology.orchestra.run.smithi052.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-01-25T14:54:39.232 INFO:teuthology.orchestra.run.smithi052.stdout:Group : Unspecified 2024-01-25T14:54:39.232 INFO:teuthology.orchestra.run.smithi052.stdout:Size : 8264254 2024-01-25T14:54:39.232 INFO:teuthology.orchestra.run.smithi052.stdout:License : GPLv3+ 2024-01-25T14:54:39.232 INFO:teuthology.orchestra.run.smithi052.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-01-25T14:54:39.232 INFO:teuthology.orchestra.run.smithi052.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-01-25T14:54:39.232 INFO:teuthology.orchestra.run.smithi052.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-01-25T14:54:39.232 INFO:teuthology.orchestra.run.smithi052.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-01-25T14:54:39.233 INFO:teuthology.orchestra.run.smithi052.stdout:Packager : builder@centos.org 2024-01-25T14:54:39.233 INFO:teuthology.orchestra.run.smithi052.stdout:Vendor : CentOS 2024-01-25T14:54:39.233 INFO:teuthology.orchestra.run.smithi052.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-25T14:54:39.233 INFO:teuthology.orchestra.run.smithi052.stdout:Summary : Support tools for GRUB. 2024-01-25T14:54:39.233 INFO:teuthology.orchestra.run.smithi052.stdout:Description : 2024-01-25T14:54:39.233 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T14:54:39.233 INFO:teuthology.orchestra.run.smithi052.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-25T14:54:39.233 INFO:teuthology.orchestra.run.smithi052.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-25T14:54:39.233 INFO:teuthology.orchestra.run.smithi052.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-25T14:54:39.233 INFO:teuthology.orchestra.run.smithi052.stdout:hardware devices. 2024-01-25T14:54:39.233 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T14:54:39.233 INFO:teuthology.orchestra.run.smithi052.stdout:This subpackage provides tools for support of all platforms. 2024-01-25T14:54:39.234 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-25T14:54:39.234 INFO:teuthology.task.kernel:Updating grub on smithi052 to boot 5.14.0-411.el9.x86_64 2024-01-25T14:54:39.234 DEBUG:teuthology.orchestra.run.smithi052:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-25T14:54:39.927 INFO:teuthology.orchestra.run.smithi052.stderr:Generating grub configuration file ... 2024-01-25T14:54:41.318 INFO:teuthology.orchestra.run.smithi052.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-01-25T14:54:41.361 INFO:teuthology.orchestra.run.smithi052.stderr:done 2024-01-25T14:54:41.364 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-01-25T14:54:41.379 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.kBN3GFZFxW 2024-01-25T14:54:41.380 DEBUG:teuthology.orchestra.run.smithi052:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.kBN3GFZFxW 2024-01-25T14:54:41.451 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.kBN3GFZFxW 2024-01-25T14:54:41.591 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.kBN3GFZFxW is 6KB 2024-01-25T14:54:41.639 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.kBN3GFZFxW 2024-01-25T14:54:41.654 DEBUG:teuthology.orchestra.run.smithi052:> sudo /bin/ls /boot/loader/entries || true 2024-01-25T14:54:41.730 INFO:teuthology.orchestra.run.smithi052.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-01-25T14:54:41.731 INFO:teuthology.orchestra.run.smithi052.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-01-25T14:54:41.731 INFO:teuthology.orchestra.run.smithi052.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-01-25T14:54:41.731 INFO:teuthology.orchestra.run.smithi052.stdout:15949e3c88704300882482eddfd7baae-5.14.0-411.el9.x86_64.conf 2024-01-25T14:54:41.732 DEBUG:teuthology.orchestra.run.smithi052:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-411.el9.x86_64 2024-01-25T14:54:41.900 DEBUG:teuthology.orchestra.run.smithi052:> sudo shutdown -r now 2024-01-25T14:54:44.120 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-core-5.14.0-411.el9.x86_64 4/4 2024-01-25T14:54:44.121 INFO:teuthology.orchestra.run.smithi029.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-25T14:54:44.121 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T14:54:44.196 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-5.14.0-411.el9.x86_64 4/4 2024-01-25T14:54:44.697 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-5.14.0-411.el9.x86_64 4/4 2024-01-25T14:54:44.697 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-5.14.0-411.el9.x86_64 1/4 2024-01-25T14:54:44.697 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-core-5.14.0-411.el9.x86_64 2/4 2024-01-25T14:54:44.698 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-modules-5.14.0-411.el9.x86_64 3/4 2024-01-25T14:54:45.176 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-modules-core-5.14.0-411.el9.x86_64 4/4 2024-01-25T14:54:45.176 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T14:54:45.176 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-01-25T14:54:45.176 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-5.14.0-411.el9.x86_64 2024-01-25T14:54:45.176 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-core-5.14.0-411.el9.x86_64 2024-01-25T14:54:45.176 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-5.14.0-411.el9.x86_64 2024-01-25T14:54:45.176 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-core-5.14.0-411.el9.x86_64 2024-01-25T14:54:45.176 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T14:54:45.176 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-01-25T14:54:45.927 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2024-01-25T14:54:46.104 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-5.14.0-411.el9.x86_64 2024-01-25T14:54:46.104 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-411.el9.x86_64 2024-01-25T14:54:46.104 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-411.el9.x86_64 2024-01-25T14:54:46.104 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-01-25T14:54:46.104 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-01-25T14:54:46.104 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-01-25T14:54:46.105 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi029.front.sepia.ceph.com, path=None, version=distro) 2024-01-25T14:54:46.105 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2024-01-25T14:54:46.219 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-5.14.0-411.el9.x86_64 2024-01-25T14:54:46.219 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-411.el9.x86_64 2024-01-25T14:54:46.219 DEBUG:teuthology.orchestra.run.smithi029:> sudo rpm -qi grub2-tools 2024-01-25T14:54:46.265 INFO:teuthology.orchestra.run.smithi029.stdout:Name : grub2-tools 2024-01-25T14:54:46.266 INFO:teuthology.orchestra.run.smithi029.stdout:Epoch : 1 2024-01-25T14:54:46.266 INFO:teuthology.orchestra.run.smithi029.stdout:Version : 2.06 2024-01-25T14:54:46.266 INFO:teuthology.orchestra.run.smithi029.stdout:Release : 68.el9 2024-01-25T14:54:46.266 INFO:teuthology.orchestra.run.smithi029.stdout:Architecture: x86_64 2024-01-25T14:54:46.266 INFO:teuthology.orchestra.run.smithi029.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-01-25T14:54:46.266 INFO:teuthology.orchestra.run.smithi029.stdout:Group : Unspecified 2024-01-25T14:54:46.266 INFO:teuthology.orchestra.run.smithi029.stdout:Size : 8264254 2024-01-25T14:54:46.266 INFO:teuthology.orchestra.run.smithi029.stdout:License : GPLv3+ 2024-01-25T14:54:46.266 INFO:teuthology.orchestra.run.smithi029.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-01-25T14:54:46.266 INFO:teuthology.orchestra.run.smithi029.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-01-25T14:54:46.266 INFO:teuthology.orchestra.run.smithi029.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-01-25T14:54:46.266 INFO:teuthology.orchestra.run.smithi029.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-01-25T14:54:46.267 INFO:teuthology.orchestra.run.smithi029.stdout:Packager : builder@centos.org 2024-01-25T14:54:46.267 INFO:teuthology.orchestra.run.smithi029.stdout:Vendor : CentOS 2024-01-25T14:54:46.267 INFO:teuthology.orchestra.run.smithi029.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-25T14:54:46.267 INFO:teuthology.orchestra.run.smithi029.stdout:Summary : Support tools for GRUB. 2024-01-25T14:54:46.267 INFO:teuthology.orchestra.run.smithi029.stdout:Description : 2024-01-25T14:54:46.267 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T14:54:46.267 INFO:teuthology.orchestra.run.smithi029.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-25T14:54:46.267 INFO:teuthology.orchestra.run.smithi029.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-25T14:54:46.267 INFO:teuthology.orchestra.run.smithi029.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-25T14:54:46.267 INFO:teuthology.orchestra.run.smithi029.stdout:hardware devices. 2024-01-25T14:54:46.267 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T14:54:46.267 INFO:teuthology.orchestra.run.smithi029.stdout:This subpackage provides tools for support of all platforms. 2024-01-25T14:54:46.268 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-25T14:54:46.268 INFO:teuthology.task.kernel:Updating grub on smithi029 to boot 5.14.0-411.el9.x86_64 2024-01-25T14:54:46.268 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-25T14:54:47.052 INFO:teuthology.orchestra.run.smithi029.stderr:Generating grub configuration file ... 2024-01-25T14:54:48.629 INFO:teuthology.orchestra.run.smithi029.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-01-25T14:54:48.655 INFO:teuthology.orchestra.run.smithi029.stderr:done 2024-01-25T14:54:48.657 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-01-25T14:54:48.673 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.AHHyMYq2mS 2024-01-25T14:54:48.673 DEBUG:teuthology.orchestra.run.smithi029:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.AHHyMYq2mS 2024-01-25T14:54:48.745 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.AHHyMYq2mS 2024-01-25T14:54:48.894 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.AHHyMYq2mS is 6KB 2024-01-25T14:54:48.914 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.AHHyMYq2mS 2024-01-25T14:54:48.929 DEBUG:teuthology.orchestra.run.smithi029:> sudo /bin/ls /boot/loader/entries || true 2024-01-25T14:54:48.997 INFO:teuthology.orchestra.run.smithi029.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-01-25T14:54:48.997 INFO:teuthology.orchestra.run.smithi029.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-01-25T14:54:48.997 INFO:teuthology.orchestra.run.smithi029.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-01-25T14:54:48.997 INFO:teuthology.orchestra.run.smithi029.stdout:15949e3c88704300882482eddfd7baae-5.14.0-411.el9.x86_64.conf 2024-01-25T14:54:48.998 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-411.el9.x86_64 2024-01-25T14:54:49.159 DEBUG:teuthology.orchestra.run.smithi029:> sudo shutdown -r now 2024-01-25T14:55:11.924 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-01-25T14:55:11.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-01-25T14:55:11.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T14:55:19.169 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-01-25T14:55:19.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-01-25T14:55:19.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T14:55:30.364 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.52 2024-01-25T14:55:37.536 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-01-25T14:55:39.367 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-01-25T14:55:39.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T14:55:46.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-01-25T14:55:46.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T14:56:04.924 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-01-25T14:56:16.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-01-25T14:56:16.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T14:56:20.000 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-01-25T14:56:35.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-01-25T14:56:35.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T14:56:36.555 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-01-25T14:56:37.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-01-25T14:56:37.100 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-411.el9.x86_64"... 2024-01-25T14:56:37.100 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-01-25T14:56:37.114 INFO:teuthology.orchestra.run.smithi029.stdout:5.14.0-411.el9.x86_64 2024-01-25T14:56:37.114 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-411.el9.x86_64 vs 5.14.0-411.el9.x86_64 2024-01-25T14:56:37.114 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-25T14:56:37.114 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-01-25T14:56:38.115 DEBUG:teuthology.parallel:result is None 2024-01-25T14:56:39.371 DEBUG:teuthology.orchestra.remote:timed out 2024-01-25T14:56:51.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-01-25T14:56:51.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T14:56:51.769 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-01-25T14:56:52.167 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-01-25T14:56:52.167 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-411.el9.x86_64"... 2024-01-25T14:56:52.167 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-01-25T14:56:52.186 INFO:teuthology.orchestra.run.smithi052.stdout:5.14.0-411.el9.x86_64 2024-01-25T14:56:52.186 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-411.el9.x86_64 vs 5.14.0-411.el9.x86_64 2024-01-25T14:56:52.186 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-25T14:56:52.186 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-01-25T14:56:53.187 DEBUG:teuthology.parallel:result is None 2024-01-25T14:56:53.187 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-25T14:56:53.195 INFO:teuthology.task.internal:Creating test directory... 2024-01-25T14:56:53.195 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-25T14:56:53.198 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-25T14:56:53.215 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-25T14:56:53.222 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-25T14:56:53.230 INFO:teuthology.task.internal:Creating archive directory... 2024-01-25T14:56:53.230 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-25T14:56:53.256 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-25T14:56:53.286 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-25T14:56:53.292 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-25T14:56:53.292 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-25T14:56:53.320 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-25T14:56:53.415 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-25T14:56:53.452 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-25T14:56:53.453 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-25T14:56:53.498 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-25T14:56:53.500 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-25T14:56:53.507 INFO:teuthology.task.internal:Configuring sudo... 2024-01-25T14:56:53.507 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-25T14:56:53.510 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-25T14:56:53.540 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-25T14:56:53.549 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-25T14:56:53.549 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-25T14:56:53.581 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-25T14:56:53.599 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-25T14:56:53.681 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-25T14:56:53.731 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-25T14:56:53.821 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-25T14:56:53.860 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T14:56:53.860 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-25T14:56:53.930 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-25T14:56:53.973 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-25T14:56:54.030 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-25T14:56:54.114 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-25T14:56:54.159 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T14:56:54.159 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-25T14:56:54.228 DEBUG:teuthology.orchestra.run.smithi029:> sudo service rsyslog restart 2024-01-25T14:56:54.230 DEBUG:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2024-01-25T14:56:54.292 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-25T14:56:54.312 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-25T14:56:54.744 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-25T14:56:54.752 INFO:teuthology.task.internal:Starting timer... 2024-01-25T14:56:54.752 INFO:teuthology.run_tasks:Running task pcp... 2024-01-25T14:56:54.768 INFO:teuthology.run_tasks:Running task selinux... 2024-01-25T14:56:54.779 DEBUG:teuthology.orchestra.run.smithi029:> sudo service auditd rotate 2024-01-25T14:56:54.869 INFO:teuthology.orchestra.run.smithi029.stdout:Rotating logs: 2024-01-25T14:56:54.871 DEBUG:teuthology.orchestra.run.smithi052:> sudo service auditd rotate 2024-01-25T14:56:54.922 INFO:teuthology.orchestra.run.smithi052.stdout:Rotating logs: 2024-01-25T14:56:54.924 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-25T14:56:54.924 DEBUG:teuthology.orchestra.run.smithi029:> /usr/sbin/getenforce 2024-01-25T14:56:54.946 INFO:teuthology.orchestra.run.smithi029.stdout:Permissive 2024-01-25T14:56:54.946 DEBUG:teuthology.orchestra.run.smithi052:> /usr/sbin/getenforce 2024-01-25T14:56:54.971 INFO:teuthology.orchestra.run.smithi052.stdout:Permissive 2024-01-25T14:56:54.971 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi029.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi052.front.sepia.ceph.com': 'permissive'} 2024-01-25T14:56:54.971 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-25T14:56:55.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T14:56:55.016 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-25T14:56:55.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T14:56:55.045 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-25T14:56:55.045 DEBUG:teuthology.orchestra.run.smithi029:> sudo /usr/sbin/setenforce permissive 2024-01-25T14:56:55.099 DEBUG:teuthology.orchestra.run.smithi052:> sudo /usr/sbin/setenforce permissive 2024-01-25T14:56:55.131 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-25T14:56:55.141 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-01-25T14:56:55.146 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-01-25T14:56:55.378 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-25T14:56:55.392 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-25T14:56:55.393 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi029.front.sepia.ceph.com,smithi052.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-25T15:01:10.425 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi029.front.sepia.ceph.com'), Remote(name='ubuntu@smithi052.front.sepia.ceph.com')] 2024-01-25T15:01:10.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-01-25T15:01:10.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T15:01:10.521 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-01-25T15:01:10.595 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-01-25T15:01:10.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-01-25T15:01:10.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T15:01:10.686 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-01-25T15:01:10.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-01-25T15:01:10.765 INFO:teuthology.run_tasks:Running task clock... 2024-01-25T15:01:10.776 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-25T15:01:10.776 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-25T15:01:10.776 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-25T15:01:10.779 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-25T15:01:10.779 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-25T15:01:10.808 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-25T15:01:10.825 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-25T15:01:10.837 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-25T15:01:10.854 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-25T15:01:10.855 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: ntpd: command not found 2024-01-25T15:01:10.869 INFO:teuthology.orchestra.run.smithi029.stdout:506 Cannot talk to daemon 2024-01-25T15:01:10.885 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: ntpd: command not found 2024-01-25T15:01:10.885 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-25T15:01:10.898 INFO:teuthology.orchestra.run.smithi052.stdout:506 Cannot talk to daemon 2024-01-25T15:01:10.901 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-25T15:01:10.915 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-25T15:01:10.932 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-25T15:01:10.954 INFO:teuthology.orchestra.run.smithi029.stderr:bash: line 1: ntpq: command not found 2024-01-25T15:01:10.957 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-25T15:01:10.957 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2024-01-25T15:01:10.957 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T15:01:10.958 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T15:01:10.958 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T15:01:10.958 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T15:01:10.986 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-01-25T15:01:10.989 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-25T15:01:10.989 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-01-25T15:01:10.989 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T15:01:10.989 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T15:01:10.989 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T15:01:10.989 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T15:01:10.990 INFO:teuthology.run_tasks:Running task install... 2024-01-25T15:01:10.998 DEBUG:teuthology.task.install:project ceph 2024-01-25T15:01:10.998 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '661946e7044723130c03627323f6a879a9848cb5'}} 2024-01-25T15:01:10.998 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '661946e7044723130c03627323f6a879a9848cb5'} 2024-01-25T15:01:10.998 INFO:teuthology.task.install:Using flavor: default 2024-01-25T15:01:11.004 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-01-25T15:01:11.004 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-01-25T15:01:11.004 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '661946e7044723130c03627323f6a879a9848cb5', 'tag': None, 'wait_for_package': False} 2024-01-25T15:01:11.005 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-25T15:01:11.007 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '661946e7044723130c03627323f6a879a9848cb5', 'tag': None, 'wait_for_package': False} 2024-01-25T15:01:11.007 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-25T15:01:11.231 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/ 2024-01-25T15:01:11.232 INFO:teuthology.task.install.rpm:Package version is 19.0.0-885.g661946e7 2024-01-25T15:01:11.250 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/ 2024-01-25T15:01:11.250 INFO:teuthology.task.install.rpm:Package version is 19.0.0-885.g661946e7 2024-01-25T15:01:11.362 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-25T15:01:11.362 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:01:11.363 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-25T15:01:11.391 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-01-25T15:01:11.391 DEBUG:teuthology.orchestra.run.smithi052:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/661946e7044723130c03627323f6a879a9848cb5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-25T15:01:11.398 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-25T15:01:11.398 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:01:11.398 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-25T15:01:11.426 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-01-25T15:01:11.427 DEBUG:teuthology.orchestra.run.smithi029:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/661946e7044723130c03627323f6a879a9848cb5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-25T15:01:11.459 DEBUG:teuthology.orchestra.run.smithi052:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-25T15:01:11.495 DEBUG:teuthology.orchestra.run.smithi029:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-25T15:01:11.539 DEBUG:teuthology.orchestra.run.smithi052:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-25T15:01:11.577 DEBUG:teuthology.orchestra.run.smithi029:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-25T15:01:11.605 INFO:teuthology.orchestra.run.smithi052.stdout:check_obsoletes = 1 2024-01-25T15:01:11.607 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum clean all 2024-01-25T15:01:11.644 INFO:teuthology.orchestra.run.smithi029.stdout:check_obsoletes = 1 2024-01-25T15:01:11.646 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum clean all 2024-01-25T15:01:11.847 INFO:teuthology.orchestra.run.smithi052.stdout:74 files removed 2024-01-25T15:01:11.874 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-01-25T15:01:11.896 INFO:teuthology.orchestra.run.smithi029.stdout:74 files removed 2024-01-25T15:01:11.923 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-01-25T15:01:12.621 INFO:teuthology.orchestra.run.smithi052.stdout:ceph packages for x86_64 191 kB/s | 80 kB 00:00 2024-01-25T15:01:12.719 INFO:teuthology.orchestra.run.smithi029.stdout:ceph packages for x86_64 169 kB/s | 80 kB 00:00 2024-01-25T15:01:13.012 INFO:teuthology.orchestra.run.smithi052.stdout:ceph noarch packages 28 kB/s | 9.5 kB 00:00 2024-01-25T15:01:13.137 INFO:teuthology.orchestra.run.smithi029.stdout:ceph noarch packages 26 kB/s | 9.5 kB 00:00 2024-01-25T15:01:13.496 INFO:teuthology.orchestra.run.smithi052.stdout:ceph source packages 4.2 kB/s | 1.9 kB 00:00 2024-01-25T15:01:13.597 INFO:teuthology.orchestra.run.smithi029.stdout:ceph source packages 4.5 kB/s | 1.9 kB 00:00 2024-01-25T15:01:14.242 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS-9 - AppStream 11 MB/s | 6.4 MB 00:00 2024-01-25T15:01:14.474 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS-9 - AppStream 6.8 MB/s | 6.4 MB 00:00 2024-01-25T15:01:15.860 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS-9 - BaseOS 3.9 MB/s | 2.0 MB 00:00 2024-01-25T15:01:16.074 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS-9 - BaseOS 4.0 MB/s | 2.0 MB 00:00 2024-01-25T15:01:16.973 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-01-25T15:01:17.061 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - BaseOS 9.3 MB/s | 8.0 MB 00:00 2024-01-25T15:01:18.980 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-01-25T15:01:19.108 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-01-25T15:01:23.267 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - CRB 9.1 MB/s | 5.9 MB 00:00 2024-01-25T15:01:24.261 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 5.9 MB 00:01 2024-01-25T15:01:25.238 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 15 kB 00:00 2024-01-25T15:01:25.884 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 15 kB 00:00 2024-01-25T15:01:29.702 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 5.5 MB/s | 20 MB 00:03 2024-01-25T15:01:32.481 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 2.9 MB/s | 20 MB 00:07 2024-01-25T15:01:34.869 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-01-25T15:01:37.532 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-01-25T15:01:37.552 INFO:teuthology.orchestra.run.smithi052.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-25T15:01:37.552 INFO:teuthology.orchestra.run.smithi052.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-25T15:01:37.566 INFO:teuthology.orchestra.run.smithi052.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-01-25T15:01:37.567 INFO:teuthology.orchestra.run.smithi052.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-01-25T15:01:37.567 INFO:teuthology.orchestra.run.smithi052.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-01-25T15:01:37.569 INFO:teuthology.orchestra.run.smithi052.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-01-25T15:01:37.570 INFO:teuthology.orchestra.run.smithi052.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-01-25T15:01:37.573 INFO:teuthology.orchestra.run.smithi052.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-01-25T15:01:37.574 INFO:teuthology.orchestra.run.smithi052.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-01-25T15:01:37.654 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-01-25T15:01:37.670 INFO:teuthology.orchestra.run.smithi052.stdout:=========================================================================================== 2024-01-25T15:01:37.670 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-01-25T15:01:37.670 INFO:teuthology.orchestra.run.smithi052.stdout:=========================================================================================== 2024-01-25T15:01:37.670 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-01-25T15:01:37.670 INFO:teuthology.orchestra.run.smithi052.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-01-25T15:01:37.670 INFO:teuthology.orchestra.run.smithi052.stdout: ceph x86_64 2:19.0.0-885.g661946e7.el9 ceph 6.5 k 2024-01-25T15:01:37.670 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base x86_64 2:19.0.0-885.g661946e7.el9 ceph 5.1 M 2024-01-25T15:01:37.670 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse x86_64 2:19.0.0-885.g661946e7.el9 ceph 886 k 2024-01-25T15:01:37.670 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-885.g661946e7.el9 ceph 145 k 2024-01-25T15:01:37.670 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr x86_64 2:19.0.0-885.g661946e7.el9 ceph 1.5 M 2024-01-25T15:01:37.671 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 133 k 2024-01-25T15:01:37.671 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 1.7 M 2024-01-25T15:01:37.671 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 7.4 M 2024-01-25T15:01:37.671 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 51 k 2024-01-25T15:01:37.671 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw x86_64 2:19.0.0-885.g661946e7.el9 ceph 8.7 M 2024-01-25T15:01:37.671 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test x86_64 2:19.0.0-885.g661946e7.el9 ceph 46 M 2024-01-25T15:01:37.671 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 262 k 2024-01-25T15:01:37.671 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 742 k 2024-01-25T15:01:37.671 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-mirror x86_64 2:19.0.0-885.g661946e7.el9 ceph 217 k 2024-01-25T15:01:37.671 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-shell x86_64 2:19.0.0-885.g661946e7.el9 ceph 27 k 2024-01-25T15:01:37.671 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-top noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 18 k 2024-01-25T15:01:37.671 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-01-25T15:01:37.671 INFO:teuthology.orchestra.run.smithi052.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-01-25T15:01:37.672 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-01-25T15:01:37.672 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel x86_64 2:19.0.0-885.g661946e7.el9 ceph 31 k 2024-01-25T15:01:37.672 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 743 k 2024-01-25T15:01:37.672 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel x86_64 2:19.0.0-885.g661946e7.el9 ceph 127 k 2024-01-25T15:01:37.672 INFO:teuthology.orchestra.run.smithi052.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-01-25T15:01:37.672 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2024-01-25T15:01:37.672 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-01-25T15:01:37.672 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-01-25T15:01:37.672 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-01-25T15:01:37.672 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-01-25T15:01:37.672 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs x86_64 2:19.0.0-885.g661946e7.el9 ceph 162 k 2024-01-25T15:01:37.672 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados x86_64 2:19.0.0-885.g661946e7.el9 ceph 321 k 2024-01-25T15:01:37.672 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd x86_64 2:19.0.0-885.g661946e7.el9 ceph 298 k 2024-01-25T15:01:37.673 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw x86_64 2:19.0.0-885.g661946e7.el9 ceph 99 k 2024-01-25T15:01:37.673 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse x86_64 2:19.0.0-885.g661946e7.el9 ceph 85 k 2024-01-25T15:01:37.673 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.1 M 2024-01-25T15:01:37.673 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd x86_64 2:19.0.0-885.g661946e7.el9 ceph 170 k 2024-01-25T15:01:37.673 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-01-25T15:01:37.673 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrading: 2024-01-25T15:01:37.673 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager x86_64 1:1.45.10-1.el9 CentOS-BaseOS 2.2 M 2024-01-25T15:01:37.673 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-libnm x86_64 1:1.45.10-1.el9 CentOS-BaseOS 1.8 M 2024-01-25T15:01:37.673 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-team x86_64 1:1.45.10-1.el9 CentOS-BaseOS 42 k 2024-01-25T15:01:37.673 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-tui x86_64 1:1.45.10-1.el9 CentOS-BaseOS 246 k 2024-01-25T15:01:37.673 INFO:teuthology.orchestra.run.smithi052.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-01-25T15:01:37.673 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-01-25T15:01:37.673 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-01-25T15:01:37.674 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-01-25T15:01:37.674 INFO:teuthology.orchestra.run.smithi052.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-01-25T15:01:37.674 INFO:teuthology.orchestra.run.smithi052.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-01-25T15:01:37.674 INFO:teuthology.orchestra.run.smithi052.stdout: librados2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.4 M 2024-01-25T15:01:37.674 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1 x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.1 M 2024-01-25T15:01:37.674 INFO:teuthology.orchestra.run.smithi052.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-01-25T15:01:37.674 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-01-25T15:01:37.674 INFO:teuthology.orchestra.run.smithi052.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-01-25T15:01:37.674 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-01-25T15:01:37.674 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-01-25T15:01:37.674 INFO:teuthology.orchestra.run.smithi052.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-01-25T15:01:37.674 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-01-25T15:01:37.675 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common x86_64 2:19.0.0-885.g661946e7.el9 ceph 19 M 2024-01-25T15:01:37.675 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 28 k 2024-01-25T15:01:37.675 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds x86_64 2:19.0.0-885.g661946e7.el9 ceph 2.1 M 2024-01-25T15:01:37.675 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 245 k 2024-01-25T15:01:37.675 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon x86_64 2:19.0.0-885.g661946e7.el9 ceph 4.7 M 2024-01-25T15:01:37.675 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd x86_64 2:19.0.0-885.g661946e7.el9 ceph 17 M 2024-01-25T15:01:37.675 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 15 k 2024-01-25T15:01:37.675 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux x86_64 2:19.0.0-885.g661946e7.el9 ceph 25 k 2024-01-25T15:01:37.675 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-01-25T15:01:37.675 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-01-25T15:01:37.675 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-01-25T15:01:37.675 INFO:teuthology.orchestra.run.smithi052.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-01-25T15:01:37.675 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-25T15:01:37.676 INFO:teuthology.orchestra.run.smithi052.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-01-25T15:01:37.676 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-25T15:01:37.676 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-25T15:01:37.676 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite x86_64 2:19.0.0-885.g661946e7.el9 ceph 163 k 2024-01-25T15:01:37.676 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-01-25T15:01:37.676 INFO:teuthology.orchestra.run.smithi052.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-25T15:01:37.676 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-01-25T15:01:37.676 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-01-25T15:01:37.676 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-01-25T15:01:37.676 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1 x86_64 2:19.0.0-885.g661946e7.el9 ceph 499 k 2024-01-25T15:01:37.676 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-01-25T15:01:37.676 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 4.8 M 2024-01-25T15:01:37.676 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-25T15:01:37.677 INFO:teuthology.orchestra.run.smithi052.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-01-25T15:01:37.677 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-01-25T15:01:37.677 INFO:teuthology.orchestra.run.smithi052.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-01-25T15:01:37.677 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-25T15:01:37.677 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-25T15:01:37.677 INFO:teuthology.orchestra.run.smithi052.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-01-25T15:01:37.677 INFO:teuthology.orchestra.run.smithi052.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-01-25T15:01:37.677 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-01-25T15:01:37.677 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-25T15:01:37.677 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-01-25T15:01:37.677 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-25T15:01:37.677 INFO:teuthology.orchestra.run.smithi052.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-01-25T15:01:37.677 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-01-25T15:01:37.678 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-25T15:01:37.678 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-25T15:01:37.678 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse x86_64 2:19.0.0-885.g661946e7.el9 ceph 45 k 2024-01-25T15:01:37.678 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common x86_64 2:19.0.0-885.g661946e7.el9 ceph 130 k 2024-01-25T15:01:37.678 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-25T15:01:37.678 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-01-25T15:01:37.678 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-25T15:01:37.678 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-25T15:01:37.678 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-01-25T15:01:37.678 INFO:teuthology.orchestra.run.smithi052.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-01-25T15:01:37.678 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-01-25T15:01:37.678 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-25T15:01:37.678 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth noarch 1:2.26.2-1.el9 epel 202 k 2024-01-25T15:01:37.678 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-25T15:01:37.678 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-25T15:01:37.679 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-25T15:01:37.679 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-25T15:01:37.679 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-25T15:01:37.679 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2024-01-25T15:01:37.679 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-01-25T15:01:37.679 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-01-25T15:01:37.679 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-25T15:01:37.679 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-25T15:01:37.679 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-01-25T15:01:37.679 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-01-25T15:01:37.679 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-25T15:01:37.679 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-25T15:01:37.679 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-01-25T15:01:37.680 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-01-25T15:01:37.680 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-01-25T15:01:37.680 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-25T15:01:37.680 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-01-25T15:01:37.680 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-25T15:01:37.680 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-01-25T15:01:37.680 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-25T15:01:37.680 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-01-25T15:01:37.680 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-01-25T15:01:37.680 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-01-25T15:01:37.680 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-01-25T15:01:37.680 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-01-25T15:01:37.680 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-25T15:01:37.680 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2024-01-25T15:01:37.681 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-01-25T15:01:37.681 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-25T15:01:37.681 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-25T15:01:37.681 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-01-25T15:01:37.681 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-25T15:01:37.681 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-01-25T15:01:37.681 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-25T15:01:37.681 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-01-25T15:01:37.681 INFO:teuthology.orchestra.run.smithi052.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-01-25T15:01:37.681 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-25T15:01:37.681 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-25T15:01:37.681 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-25T15:01:37.681 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-25T15:01:37.681 INFO:teuthology.orchestra.run.smithi052.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-25T15:01:37.682 INFO:teuthology.orchestra.run.smithi052.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-01-25T15:01:37.682 INFO:teuthology.orchestra.run.smithi052.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-25T15:01:37.682 INFO:teuthology.orchestra.run.smithi052.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-01-25T15:01:37.682 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-01-25T15:01:37.682 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-01-25T15:01:37.682 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:01:37.682 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-01-25T15:01:37.682 INFO:teuthology.orchestra.run.smithi052.stdout:=========================================================================================== 2024-01-25T15:01:37.682 INFO:teuthology.orchestra.run.smithi052.stdout:Install 139 Packages 2024-01-25T15:01:37.682 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrade 16 Packages 2024-01-25T15:01:37.682 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:01:37.683 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 209 M 2024-01-25T15:01:37.683 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-01-25T15:01:40.299 INFO:teuthology.orchestra.run.smithi029.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-25T15:01:40.300 INFO:teuthology.orchestra.run.smithi029.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-25T15:01:40.312 INFO:teuthology.orchestra.run.smithi029.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-01-25T15:01:40.313 INFO:teuthology.orchestra.run.smithi029.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-01-25T15:01:40.314 INFO:teuthology.orchestra.run.smithi029.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-01-25T15:01:40.315 INFO:teuthology.orchestra.run.smithi029.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-01-25T15:01:40.316 INFO:teuthology.orchestra.run.smithi029.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-01-25T15:01:40.319 INFO:teuthology.orchestra.run.smithi029.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-01-25T15:01:40.320 INFO:teuthology.orchestra.run.smithi029.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-01-25T15:01:40.399 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-01-25T15:01:40.425 INFO:teuthology.orchestra.run.smithi029.stdout:=========================================================================================== 2024-01-25T15:01:40.425 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-01-25T15:01:40.425 INFO:teuthology.orchestra.run.smithi029.stdout:=========================================================================================== 2024-01-25T15:01:40.425 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-01-25T15:01:40.425 INFO:teuthology.orchestra.run.smithi029.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-01-25T15:01:40.425 INFO:teuthology.orchestra.run.smithi029.stdout: ceph x86_64 2:19.0.0-885.g661946e7.el9 ceph 6.5 k 2024-01-25T15:01:40.426 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base x86_64 2:19.0.0-885.g661946e7.el9 ceph 5.1 M 2024-01-25T15:01:40.426 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse x86_64 2:19.0.0-885.g661946e7.el9 ceph 886 k 2024-01-25T15:01:40.426 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-885.g661946e7.el9 ceph 145 k 2024-01-25T15:01:40.426 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr x86_64 2:19.0.0-885.g661946e7.el9 ceph 1.5 M 2024-01-25T15:01:40.426 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 133 k 2024-01-25T15:01:40.426 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 1.7 M 2024-01-25T15:01:40.426 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 7.4 M 2024-01-25T15:01:40.426 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 51 k 2024-01-25T15:01:40.426 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw x86_64 2:19.0.0-885.g661946e7.el9 ceph 8.7 M 2024-01-25T15:01:40.426 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test x86_64 2:19.0.0-885.g661946e7.el9 ceph 46 M 2024-01-25T15:01:40.426 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 262 k 2024-01-25T15:01:40.426 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 742 k 2024-01-25T15:01:40.426 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-mirror x86_64 2:19.0.0-885.g661946e7.el9 ceph 217 k 2024-01-25T15:01:40.427 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-shell x86_64 2:19.0.0-885.g661946e7.el9 ceph 27 k 2024-01-25T15:01:40.427 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-top noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 18 k 2024-01-25T15:01:40.427 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-01-25T15:01:40.427 INFO:teuthology.orchestra.run.smithi029.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-01-25T15:01:40.427 INFO:teuthology.orchestra.run.smithi029.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-01-25T15:01:40.427 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel x86_64 2:19.0.0-885.g661946e7.el9 ceph 31 k 2024-01-25T15:01:40.427 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 743 k 2024-01-25T15:01:40.427 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel x86_64 2:19.0.0-885.g661946e7.el9 ceph 127 k 2024-01-25T15:01:40.427 INFO:teuthology.orchestra.run.smithi029.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-01-25T15:01:40.427 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2024-01-25T15:01:40.427 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-01-25T15:01:40.427 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-01-25T15:01:40.427 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-01-25T15:01:40.427 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-01-25T15:01:40.428 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs x86_64 2:19.0.0-885.g661946e7.el9 ceph 162 k 2024-01-25T15:01:40.428 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados x86_64 2:19.0.0-885.g661946e7.el9 ceph 321 k 2024-01-25T15:01:40.428 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd x86_64 2:19.0.0-885.g661946e7.el9 ceph 298 k 2024-01-25T15:01:40.428 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw x86_64 2:19.0.0-885.g661946e7.el9 ceph 99 k 2024-01-25T15:01:40.428 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse x86_64 2:19.0.0-885.g661946e7.el9 ceph 85 k 2024-01-25T15:01:40.428 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.1 M 2024-01-25T15:01:40.428 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd x86_64 2:19.0.0-885.g661946e7.el9 ceph 170 k 2024-01-25T15:01:40.428 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-01-25T15:01:40.428 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrading: 2024-01-25T15:01:40.428 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager x86_64 1:1.45.10-1.el9 CentOS-BaseOS 2.2 M 2024-01-25T15:01:40.428 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-libnm x86_64 1:1.45.10-1.el9 CentOS-BaseOS 1.8 M 2024-01-25T15:01:40.428 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-team x86_64 1:1.45.10-1.el9 CentOS-BaseOS 42 k 2024-01-25T15:01:40.428 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-tui x86_64 1:1.45.10-1.el9 CentOS-BaseOS 246 k 2024-01-25T15:01:40.428 INFO:teuthology.orchestra.run.smithi029.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-01-25T15:01:40.429 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-01-25T15:01:40.429 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-01-25T15:01:40.429 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-01-25T15:01:40.429 INFO:teuthology.orchestra.run.smithi029.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-01-25T15:01:40.429 INFO:teuthology.orchestra.run.smithi029.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-01-25T15:01:40.429 INFO:teuthology.orchestra.run.smithi029.stdout: librados2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.4 M 2024-01-25T15:01:40.429 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1 x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.1 M 2024-01-25T15:01:40.429 INFO:teuthology.orchestra.run.smithi029.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-01-25T15:01:40.429 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-01-25T15:01:40.429 INFO:teuthology.orchestra.run.smithi029.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-01-25T15:01:40.429 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-01-25T15:01:40.429 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-01-25T15:01:40.429 INFO:teuthology.orchestra.run.smithi029.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-01-25T15:01:40.429 INFO:teuthology.orchestra.run.smithi029.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-01-25T15:01:40.430 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common x86_64 2:19.0.0-885.g661946e7.el9 ceph 19 M 2024-01-25T15:01:40.430 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 28 k 2024-01-25T15:01:40.430 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds x86_64 2:19.0.0-885.g661946e7.el9 ceph 2.1 M 2024-01-25T15:01:40.430 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 245 k 2024-01-25T15:01:40.430 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon x86_64 2:19.0.0-885.g661946e7.el9 ceph 4.7 M 2024-01-25T15:01:40.430 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd x86_64 2:19.0.0-885.g661946e7.el9 ceph 17 M 2024-01-25T15:01:40.430 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 15 k 2024-01-25T15:01:40.430 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux x86_64 2:19.0.0-885.g661946e7.el9 ceph 25 k 2024-01-25T15:01:40.430 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-01-25T15:01:40.430 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-01-25T15:01:40.430 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-01-25T15:01:40.430 INFO:teuthology.orchestra.run.smithi029.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-01-25T15:01:40.430 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-25T15:01:40.430 INFO:teuthology.orchestra.run.smithi029.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-01-25T15:01:40.430 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-25T15:01:40.431 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-25T15:01:40.431 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite x86_64 2:19.0.0-885.g661946e7.el9 ceph 163 k 2024-01-25T15:01:40.431 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-01-25T15:01:40.431 INFO:teuthology.orchestra.run.smithi029.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-25T15:01:40.431 INFO:teuthology.orchestra.run.smithi029.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-01-25T15:01:40.431 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-01-25T15:01:40.431 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-01-25T15:01:40.431 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1 x86_64 2:19.0.0-885.g661946e7.el9 ceph 499 k 2024-01-25T15:01:40.431 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-01-25T15:01:40.431 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 4.8 M 2024-01-25T15:01:40.431 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-25T15:01:40.431 INFO:teuthology.orchestra.run.smithi029.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-01-25T15:01:40.431 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-01-25T15:01:40.431 INFO:teuthology.orchestra.run.smithi029.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-01-25T15:01:40.432 INFO:teuthology.orchestra.run.smithi029.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-25T15:01:40.432 INFO:teuthology.orchestra.run.smithi029.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-25T15:01:40.432 INFO:teuthology.orchestra.run.smithi029.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-01-25T15:01:40.432 INFO:teuthology.orchestra.run.smithi029.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-01-25T15:01:40.432 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-01-25T15:01:40.432 INFO:teuthology.orchestra.run.smithi029.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-25T15:01:40.432 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-01-25T15:01:40.432 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-25T15:01:40.432 INFO:teuthology.orchestra.run.smithi029.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-01-25T15:01:40.432 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-01-25T15:01:40.432 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-25T15:01:40.432 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-25T15:01:40.433 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse x86_64 2:19.0.0-885.g661946e7.el9 ceph 45 k 2024-01-25T15:01:40.433 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common x86_64 2:19.0.0-885.g661946e7.el9 ceph 130 k 2024-01-25T15:01:40.433 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-25T15:01:40.433 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-01-25T15:01:40.433 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-25T15:01:40.433 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-25T15:01:40.433 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-01-25T15:01:40.433 INFO:teuthology.orchestra.run.smithi029.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-01-25T15:01:40.433 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-01-25T15:01:40.433 INFO:teuthology.orchestra.run.smithi029.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-25T15:01:40.433 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth noarch 1:2.26.2-1.el9 epel 202 k 2024-01-25T15:01:40.433 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-25T15:01:40.433 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-25T15:01:40.433 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-25T15:01:40.433 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-25T15:01:40.433 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-25T15:01:40.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2024-01-25T15:01:40.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-01-25T15:01:40.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-01-25T15:01:40.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-25T15:01:40.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-25T15:01:40.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-01-25T15:01:40.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-01-25T15:01:40.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-25T15:01:40.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-25T15:01:40.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-01-25T15:01:40.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-01-25T15:01:40.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-01-25T15:01:40.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-25T15:01:40.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-01-25T15:01:40.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-25T15:01:40.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-01-25T15:01:40.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-25T15:01:40.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-01-25T15:01:40.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-01-25T15:01:40.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-01-25T15:01:40.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-01-25T15:01:40.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-01-25T15:01:40.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-25T15:01:40.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2024-01-25T15:01:40.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-01-25T15:01:40.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-25T15:01:40.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-25T15:01:40.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-01-25T15:01:40.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-25T15:01:40.436 INFO:teuthology.orchestra.run.smithi029.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-01-25T15:01:40.436 INFO:teuthology.orchestra.run.smithi029.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-25T15:01:40.436 INFO:teuthology.orchestra.run.smithi029.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-01-25T15:01:40.436 INFO:teuthology.orchestra.run.smithi029.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-01-25T15:01:40.436 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-25T15:01:40.436 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-25T15:01:40.436 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-25T15:01:40.436 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-25T15:01:40.436 INFO:teuthology.orchestra.run.smithi029.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-25T15:01:40.436 INFO:teuthology.orchestra.run.smithi029.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-01-25T15:01:40.436 INFO:teuthology.orchestra.run.smithi029.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-25T15:01:40.436 INFO:teuthology.orchestra.run.smithi029.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-01-25T15:01:40.436 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-01-25T15:01:40.436 INFO:teuthology.orchestra.run.smithi029.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-01-25T15:01:40.437 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:01:40.437 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-01-25T15:01:40.437 INFO:teuthology.orchestra.run.smithi029.stdout:=========================================================================================== 2024-01-25T15:01:40.437 INFO:teuthology.orchestra.run.smithi029.stdout:Install 139 Packages 2024-01-25T15:01:40.437 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrade 16 Packages 2024-01-25T15:01:40.437 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:01:40.437 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 209 M 2024-01-25T15:01:40.438 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-01-25T15:01:51.903 INFO:teuthology.orchestra.run.smithi052.stdout:(1/155): ceph-19.0.0-885.g661946e7.el9.x86_64.r 38 kB/s | 6.5 kB 00:00 2024-01-25T15:01:52.145 INFO:teuthology.orchestra.run.smithi052.stdout:(2/155): ceph-fuse-19.0.0-885.g661946e7.el9.x86 3.6 MB/s | 886 kB 00:00 2024-01-25T15:01:52.220 INFO:teuthology.orchestra.run.smithi052.stdout:(3/155): ceph-immutable-object-cache-19.0.0-885 1.9 MB/s | 145 kB 00:00 2024-01-25T15:01:52.628 INFO:teuthology.orchestra.run.smithi052.stdout:(4/155): ceph-mds-19.0.0-885.g661946e7.el9.x86_ 5.2 MB/s | 2.1 MB 00:00 2024-01-25T15:01:52.829 INFO:teuthology.orchestra.run.smithi052.stdout:(5/155): ceph-mgr-19.0.0-885.g661946e7.el9.x86_ 7.4 MB/s | 1.5 MB 00:00 2024-01-25T15:01:53.046 INFO:teuthology.orchestra.run.smithi052.stdout:(6/155): ceph-base-19.0.0-885.g661946e7.el9.x86 3.9 MB/s | 5.1 MB 00:01 2024-01-25T15:01:53.279 INFO:teuthology.orchestra.run.smithi052.stdout:(7/155): ceph-common-19.0.0-885.g661946e7.el9.x 13 MB/s | 19 MB 00:01 2024-01-25T15:01:53.363 INFO:teuthology.orchestra.run.smithi052.stdout:(8/155): ceph-mon-19.0.0-885.g661946e7.el9.x86_ 8.8 MB/s | 4.7 MB 00:00 2024-01-25T15:01:53.446 INFO:teuthology.orchestra.run.smithi052.stdout:(9/155): ceph-selinux-19.0.0-885.g661946e7.el9. 303 kB/s | 25 kB 00:00 2024-01-25T15:01:53.980 INFO:teuthology.orchestra.run.smithi052.stdout:(10/155): ceph-radosgw-19.0.0-885.g661946e7.el9 12 MB/s | 8.7 MB 00:00 2024-01-25T15:01:54.055 INFO:teuthology.orchestra.run.smithi052.stdout:(11/155): cephfs-mirror-19.0.0-885.g661946e7.el 2.8 MB/s | 217 kB 00:00 2024-01-25T15:01:54.123 INFO:teuthology.orchestra.run.smithi052.stdout:(12/155): cephfs-shell-19.0.0-885.g661946e7.el9 406 kB/s | 27 kB 00:00 2024-01-25T15:01:54.189 INFO:teuthology.orchestra.run.smithi052.stdout:(13/155): libcephfs-devel-19.0.0-885.g661946e7. 469 kB/s | 31 kB 00:00 2024-01-25T15:01:54.322 INFO:teuthology.orchestra.run.smithi052.stdout:(14/155): libcephfs2-19.0.0-885.g661946e7.el9.x 5.4 MB/s | 743 kB 00:00 2024-01-25T15:01:54.398 INFO:teuthology.orchestra.run.smithi052.stdout:(15/155): libcephsqlite-19.0.0-885.g661946e7.el 2.1 MB/s | 163 kB 00:00 2024-01-25T15:01:54.482 INFO:teuthology.orchestra.run.smithi052.stdout:(16/155): librados-devel-19.0.0-885.g661946e7.e 1.5 MB/s | 127 kB 00:00 2024-01-25T15:01:54.557 INFO:teuthology.orchestra.run.smithi052.stdout:(17/155): libradosstriper1-19.0.0-885.g661946e7 6.5 MB/s | 499 kB 00:00 2024-01-25T15:01:55.057 INFO:teuthology.orchestra.run.smithi052.stdout:(18/155): librgw2-19.0.0-885.g661946e7.el9.x86_ 9.6 MB/s | 4.8 MB 00:00 2024-01-25T15:01:55.124 INFO:teuthology.orchestra.run.smithi052.stdout:(19/155): python3-ceph-argparse-19.0.0-885.g661 679 kB/s | 45 kB 00:00 2024-01-25T15:01:55.199 INFO:teuthology.orchestra.run.smithi052.stdout:(20/155): python3-ceph-common-19.0.0-885.g66194 1.7 MB/s | 130 kB 00:00 2024-01-25T15:01:55.274 INFO:teuthology.orchestra.run.smithi052.stdout:(21/155): python3-cephfs-19.0.0-885.g661946e7.e 2.1 MB/s | 162 kB 00:00 2024-01-25T15:01:55.350 INFO:teuthology.orchestra.run.smithi052.stdout:(22/155): python3-rados-19.0.0-885.g661946e7.el 4.2 MB/s | 321 kB 00:00 2024-01-25T15:01:55.425 INFO:teuthology.orchestra.run.smithi052.stdout:(23/155): python3-rbd-19.0.0-885.g661946e7.el9. 3.9 MB/s | 298 kB 00:00 2024-01-25T15:01:55.500 INFO:teuthology.orchestra.run.smithi052.stdout:(24/155): python3-rgw-19.0.0-885.g661946e7.el9. 1.3 MB/s | 99 kB 00:00 2024-01-25T15:01:55.583 INFO:teuthology.orchestra.run.smithi052.stdout:(25/155): rbd-fuse-19.0.0-885.g661946e7.el9.x86 1.0 MB/s | 85 kB 00:00 2024-01-25T15:01:55.951 INFO:teuthology.orchestra.run.smithi052.stdout:(26/155): rbd-mirror-19.0.0-885.g661946e7.el9.x 8.4 MB/s | 3.1 MB 00:00 2024-01-25T15:01:56.026 INFO:teuthology.orchestra.run.smithi052.stdout:(27/155): rbd-nbd-19.0.0-885.g661946e7.el9.x86_ 2.2 MB/s | 170 kB 00:00 2024-01-25T15:01:56.218 INFO:teuthology.orchestra.run.smithi052.stdout:(28/155): ceph-osd-19.0.0-885.g661946e7.el9.x86 5.3 MB/s | 17 MB 00:03 2024-01-25T15:01:56.243 INFO:teuthology.orchestra.run.smithi052.stdout:(29/155): ceph-grafana-dashboards-19.0.0-885.g6 131 kB/s | 28 kB 00:00 2024-01-25T15:01:56.660 INFO:teuthology.orchestra.run.smithi052.stdout:(30/155): ceph-test-19.0.0-885.g661946e7.el9.x8 14 MB/s | 46 MB 00:03 2024-01-25T15:01:56.685 INFO:teuthology.orchestra.run.smithi052.stdout:(31/155): ceph-mgr-cephadm-19.0.0-885.g661946e7 284 kB/s | 133 kB 00:00 2024-01-25T15:01:56.736 INFO:teuthology.orchestra.run.smithi052.stdout:(32/155): ceph-mgr-dashboard-19.0.0-885.g661946 3.5 MB/s | 1.7 MB 00:00 2024-01-25T15:01:56.786 INFO:teuthology.orchestra.run.smithi052.stdout:(33/155): ceph-mgr-modules-core-19.0.0-885.g661 2.4 MB/s | 245 kB 00:00 2024-01-25T15:01:56.811 INFO:teuthology.orchestra.run.smithi052.stdout:(34/155): ceph-mgr-rook-19.0.0-885.g661946e7.el 676 kB/s | 51 kB 00:00 2024-01-25T15:01:56.862 INFO:teuthology.orchestra.run.smithi052.stdout:(35/155): ceph-prometheus-alerts-19.0.0-885.g66 201 kB/s | 15 kB 00:00 2024-01-25T15:01:56.887 INFO:teuthology.orchestra.run.smithi052.stdout:(36/155): ceph-volume-19.0.0-885.g661946e7.el9. 3.4 MB/s | 262 kB 00:00 2024-01-25T15:01:56.954 INFO:teuthology.orchestra.run.smithi052.stdout:(37/155): cephfs-top-19.0.0-885.g661946e7.el9.n 274 kB/s | 18 kB 00:00 2024-01-25T15:01:57.046 INFO:teuthology.orchestra.run.smithi052.stdout:(38/155): cephadm-19.0.0-885.g661946e7.el9.noar 3.9 MB/s | 742 kB 00:00 2024-01-25T15:01:57.138 INFO:teuthology.orchestra.run.smithi052.stdout:(39/155): ceph-mgr-diskprediction-local-19.0.0- 15 MB/s | 7.4 MB 00:00 2024-01-25T15:01:57.263 INFO:teuthology.orchestra.run.smithi052.stdout:(40/155): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 662 kB 00:00 2024-01-25T15:01:57.330 INFO:teuthology.orchestra.run.smithi052.stdout:(41/155): boost-program-options-1.75.0-8.el9.x8 553 kB/s | 106 kB 00:00 2024-01-25T15:01:57.363 INFO:teuthology.orchestra.run.smithi052.stdout:(42/155): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 920 kB 00:00 2024-01-25T15:01:57.389 INFO:teuthology.orchestra.run.smithi052.stdout:(43/155): elfutils-libelf-devel-0.190-2.el9.x86 163 kB/s | 20 kB 00:00 2024-01-25T15:01:57.414 INFO:teuthology.orchestra.run.smithi052.stdout:(44/155): flex-2.6.4-9.el9.x86_64.rpm 3.6 MB/s | 307 kB 00:00 2024-01-25T15:01:57.481 INFO:teuthology.orchestra.run.smithi052.stdout:(45/155): flexiblas-3.0.4-8.el9.x86_64.rpm 347 kB/s | 32 kB 00:00 2024-01-25T15:01:57.506 INFO:teuthology.orchestra.run.smithi052.stdout:(46/155): flexiblas-openblas-openmp-3.0.4-8.el9 188 kB/s | 17 kB 00:00 2024-01-25T15:01:57.557 INFO:teuthology.orchestra.run.smithi052.stdout:(47/155): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2024-01-25T15:01:57.582 INFO:teuthology.orchestra.run.smithi052.stdout:(48/155): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 10 kB 00:00 2024-01-25T15:01:57.607 INFO:teuthology.orchestra.run.smithi052.stdout:(49/155): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 159 kB 00:00 2024-01-25T15:01:57.632 INFO:teuthology.orchestra.run.smithi052.stdout:(50/155): librabbitmq-0.11.0-7.el9.x86_64.rpm 888 kB/s | 44 kB 00:00 2024-01-25T15:01:57.657 INFO:teuthology.orchestra.run.smithi052.stdout:(51/155): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2024-01-25T15:01:57.691 INFO:teuthology.orchestra.run.smithi052.stdout:(52/155): libtool-2.4.6-45.el9.x86_64.rpm 6.9 MB/s | 578 kB 00:00 2024-01-25T15:01:57.716 INFO:teuthology.orchestra.run.smithi052.stdout:(53/155): libuuid-devel-2.37.4-15.el9.x86_64.rp 297 kB/s | 24 kB 00:00 2024-01-25T15:01:57.742 INFO:teuthology.orchestra.run.smithi052.stdout:(54/155): libzstd-devel-1.5.1-2.el9.x86_64.rpm 926 kB/s | 46 kB 00:00 2024-01-25T15:01:57.767 INFO:teuthology.orchestra.run.smithi052.stdout:(55/155): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2024-01-25T15:01:57.792 INFO:teuthology.orchestra.run.smithi052.stdout:(56/155): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 187 kB 00:00 2024-01-25T15:01:57.817 INFO:teuthology.orchestra.run.smithi052.stdout:(57/155): openblas-0.3.21-2.el9.x86_64.rpm 687 kB/s | 34 kB 00:00 2024-01-25T15:01:57.961 INFO:teuthology.orchestra.run.smithi052.stdout:(58/155): openblas-openmp-0.3.21-2.el9.x86_64.r 24 MB/s | 4.7 MB 00:00 2024-01-25T15:01:58.037 INFO:teuthology.orchestra.run.smithi052.stdout:(59/155): openssl-devel-3.0.7-25.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2024-01-25T15:01:58.120 INFO:teuthology.orchestra.run.smithi052.stdout:(60/155): postgresql-13.11-1.el9.x86_64.rpm 5.1 MB/s | 1.5 MB 00:00 2024-01-25T15:01:58.154 INFO:teuthology.orchestra.run.smithi052.stdout:(61/155): postgresql-contrib-13.11-1.el9.x86_64 4.2 MB/s | 811 kB 00:00 2024-01-25T15:01:58.179 INFO:teuthology.orchestra.run.smithi052.stdout:(62/155): postgresql-private-libs-13.11-1.el9.x 965 kB/s | 134 kB 00:00 2024-01-25T15:01:58.319 INFO:teuthology.orchestra.run.smithi029.stdout:(1/155): ceph-19.0.0-885.g661946e7.el9.x86_64.r 18 kB/s | 6.5 kB 00:00 2024-01-25T15:01:58.338 INFO:teuthology.orchestra.run.smithi052.stdout:(63/155): python3-attrs-20.3.0-7.el9.noarch.rpm 425 kB/s | 78 kB 00:00 2024-01-25T15:01:58.413 INFO:teuthology.orchestra.run.smithi052.stdout:(64/155): postgresql-server-13.11-1.el9.x86_64. 22 MB/s | 5.7 MB 00:00 2024-01-25T15:01:58.538 INFO:teuthology.orchestra.run.smithi052.stdout:(65/155): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 5.8 MB 00:00 2024-01-25T15:01:58.563 INFO:teuthology.orchestra.run.smithi052.stdout:(66/155): python3-jinja2-2.11.3-4.el9.noarch.rp 1.0 MB/s | 228 kB 00:00 2024-01-25T15:01:58.589 INFO:teuthology.orchestra.run.smithi052.stdout:(67/155): python3-jsonpatch-1.21-16.el9.noarch. 141 kB/s | 24 kB 00:00 2024-01-25T15:01:58.614 INFO:teuthology.orchestra.run.smithi052.stdout:(68/155): python3-jsonpointer-2.0-4.el9.noarch. 242 kB/s | 18 kB 00:00 2024-01-25T15:01:58.639 INFO:teuthology.orchestra.run.smithi052.stdout:(69/155): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-01-25T15:01:58.664 INFO:teuthology.orchestra.run.smithi052.stdout:(70/155): python3-markupsafe-1.1.1-12.el9.x86_6 421 kB/s | 32 kB 00:00 2024-01-25T15:01:58.865 INFO:teuthology.orchestra.run.smithi052.stdout:(71/155): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 4.8 MB 00:00 2024-01-25T15:01:58.890 INFO:teuthology.orchestra.run.smithi052.stdout:(72/155): python3-numpy-f2py-1.20.1-5.el9.x86_6 869 kB/s | 217 kB 00:00 2024-01-25T15:01:58.915 INFO:teuthology.orchestra.run.smithi052.stdout:(73/155): python3-oauthlib-3.1.1-5.el9.noarch.r 703 kB/s | 174 kB 00:00 2024-01-25T15:01:58.949 INFO:teuthology.orchestra.run.smithi052.stdout:(74/155): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2024-01-25T15:01:58.974 INFO:teuthology.orchestra.run.smithi052.stdout:(75/155): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2024-01-25T15:01:58.999 INFO:teuthology.orchestra.run.smithi052.stdout:(76/155): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 211 kB 00:00 2024-01-25T15:01:59.051 INFO:teuthology.orchestra.run.smithi052.stdout:(77/155): python3-pytz-2021.1-5.el9.noarch.rpm 465 kB/s | 47 kB 00:00 2024-01-25T15:01:59.250 INFO:teuthology.orchestra.run.smithi052.stdout:(78/155): python3-requests-oauthlib-1.3.0-12.el 171 kB/s | 43 kB 00:00 2024-01-25T15:01:59.336 INFO:teuthology.orchestra.run.smithi029.stdout:(2/155): ceph-fuse-19.0.0-885.g661946e7.el9.x86 871 kB/s | 886 kB 00:01 2024-01-25T15:01:59.658 INFO:teuthology.orchestra.run.smithi052.stdout:(79/155): python3-toml-0.10.2-6.el9.noarch.rpm 64 kB/s | 39 kB 00:00 2024-01-25T15:01:59.729 INFO:teuthology.orchestra.run.smithi029.stdout:(3/155): ceph-immutable-object-cache-19.0.0-885 371 kB/s | 145 kB 00:00 2024-01-25T15:01:59.917 INFO:teuthology.orchestra.run.smithi052.stdout:(80/155): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-01-25T15:01:59.942 INFO:teuthology.orchestra.run.smithi052.stdout:(81/155): python3-wcwidth-0.2.5-8.el9.noarch.rp 59 kB/s | 41 kB 00:00 2024-01-25T15:01:59.967 INFO:teuthology.orchestra.run.smithi052.stdout:(82/155): socat-1.7.4.1-5.el9.x86_64.rpm 976 kB/s | 300 kB 00:00 2024-01-25T15:01:59.992 INFO:teuthology.orchestra.run.smithi052.stdout:(83/155): uuid-1.6.2-55.el9.x86_64.rpm 757 kB/s | 56 kB 00:00 2024-01-25T15:02:00.018 INFO:teuthology.orchestra.run.smithi052.stdout:(84/155): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-01-25T15:02:00.043 INFO:teuthology.orchestra.run.smithi052.stdout:(85/155): xmlstarlet-1.6.1-20.el9.x86_64.rpm 834 kB/s | 63 kB 00:00 2024-01-25T15:02:00.068 INFO:teuthology.orchestra.run.smithi052.stdout:(86/155): zlib-devel-1.2.11-40.el9.x86_64.rpm 586 kB/s | 44 kB 00:00 2024-01-25T15:02:00.094 INFO:teuthology.orchestra.run.smithi052.stdout:(87/155): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-01-25T15:02:00.198 INFO:teuthology.orchestra.run.smithi052.stdout:(88/155): jq-1.6-16.el9.x86_64.rpm 1.2 MB/s | 186 kB 00:00 2024-01-25T15:02:00.227 INFO:teuthology.orchestra.run.smithi052.stdout:(89/155): libgfortran-11.4.1-3.el9.x86_64.rpm 5.0 MB/s | 802 kB 00:00 2024-01-25T15:02:00.253 INFO:teuthology.orchestra.run.smithi052.stdout:(90/155): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 194 kB 00:00 2024-01-25T15:02:00.378 INFO:teuthology.orchestra.run.smithi052.stdout:(91/155): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.2 MB/s | 217 kB 00:00 2024-01-25T15:02:00.403 INFO:teuthology.orchestra.run.smithi052.stdout:(92/155): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 241 kB 00:00 2024-01-25T15:02:00.445 INFO:teuthology.orchestra.run.smithi052.stdout:(93/155): python3-cryptography-36.0.1-4.el9.x86 6.0 MB/s | 1.1 MB 00:00 2024-01-25T15:02:00.471 INFO:teuthology.orchestra.run.smithi052.stdout:(94/155): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2024-01-25T15:02:00.496 INFO:teuthology.orchestra.run.smithi052.stdout:(95/155): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 124 kB 00:00 2024-01-25T15:02:00.521 INFO:teuthology.orchestra.run.smithi052.stdout:(96/155): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2024-01-25T15:02:00.563 INFO:teuthology.orchestra.run.smithi052.stdout:(97/155): python3-urllib3-1.26.5-5.el9.noarch.r 2.8 MB/s | 187 kB 00:00 2024-01-25T15:02:00.613 INFO:teuthology.orchestra.run.smithi052.stdout:(98/155): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-01-25T15:02:00.888 INFO:teuthology.orchestra.run.smithi052.stdout:(99/155): gperftools-libs-2.9.1-2.el9.x86_64.rp 950 kB/s | 309 kB 00:00 2024-01-25T15:02:00.939 INFO:teuthology.orchestra.run.smithi052.stdout:(100/155): libarrow-doc-9.0.0-10.el9.noarch.rpm 519 kB/s | 26 kB 00:00 2024-01-25T15:02:00.998 INFO:teuthology.orchestra.run.smithi052.stdout:(101/155): liboath-2.6.7-2.el9.x86_64.rpm 835 kB/s | 49 kB 00:00 2024-01-25T15:02:01.056 INFO:teuthology.orchestra.run.smithi052.stdout:(102/155): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-01-25T15:02:01.089 INFO:teuthology.orchestra.run.smithi052.stdout:(103/155): python3-devel-3.9.17-2.el9.x86_64.rp 414 kB/s | 245 kB 00:00 2024-01-25T15:02:01.115 INFO:teuthology.orchestra.run.smithi052.stdout:(104/155): luarocks-3.9.2-1.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-01-25T15:02:01.121 INFO:teuthology.orchestra.run.smithi029.stdout:(4/155): ceph-common-19.0.0-885.g661946e7.el9.x 6.1 MB/s | 19 MB 00:03 2024-01-25T15:02:01.215 INFO:teuthology.orchestra.run.smithi052.stdout:(105/155): python3-asyncssh-2.13.2-3.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-01-25T15:02:01.246 INFO:teuthology.orchestra.run.smithi029.stdout:(5/155): ceph-mgr-19.0.0-885.g661946e7.el9.x86_ 12 MB/s | 1.5 MB 00:00 2024-01-25T15:02:01.265 INFO:teuthology.orchestra.run.smithi052.stdout:(106/155): python3-bcrypt-3.2.2-1.el9.x86_64.rp 898 kB/s | 43 kB 00:00 2024-01-25T15:02:01.316 INFO:teuthology.orchestra.run.smithi052.stdout:(107/155): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-01-25T15:02:01.374 INFO:teuthology.orchestra.run.smithi052.stdout:(108/155): libarrow-9.0.0-10.el9.x86_64.rpm 6.0 MB/s | 4.4 MB 00:00 2024-01-25T15:02:01.399 INFO:teuthology.orchestra.run.smithi052.stdout:(109/155): python3-certifi-2021.10.8-2.el9.noar 180 kB/s | 15 kB 00:00 2024-01-25T15:02:01.433 INFO:teuthology.orchestra.run.smithi052.stdout:(110/155): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-01-25T15:02:01.467 INFO:teuthology.orchestra.run.smithi052.stdout:(111/155): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-01-25T15:02:01.509 INFO:teuthology.orchestra.run.smithi052.stdout:(112/155): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.0 MB/s | 838 kB 00:00 2024-01-25T15:02:01.534 INFO:teuthology.orchestra.run.smithi052.stdout:(113/155): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.9 MB/s | 303 kB 00:00 2024-01-25T15:02:01.559 INFO:teuthology.orchestra.run.smithi052.stdout:(114/155): python3-colorama-0.4.4-12.el9.noarch 383 kB/s | 35 kB 00:00 2024-01-25T15:02:01.576 INFO:teuthology.orchestra.run.smithi052.stdout:(115/155): python3-google-auth-2.26.2-1.el9.noa 2.9 MB/s | 202 kB 00:00 2024-01-25T15:02:01.588 INFO:teuthology.orchestra.run.smithi029.stdout:(6/155): ceph-mon-19.0.0-885.g661946e7.el9.x86_ 14 MB/s | 4.7 MB 00:00 2024-01-25T15:02:01.601 INFO:teuthology.orchestra.run.smithi052.stdout:(116/155): python3-jaraco-8.2.1-3.el9.noarch.rp 159 kB/s | 11 kB 00:00 2024-01-25T15:02:01.627 INFO:teuthology.orchestra.run.smithi052.stdout:(117/155): python3-jaraco-classes-3.2.1-5.el9.n 263 kB/s | 18 kB 00:00 2024-01-25T15:02:01.652 INFO:teuthology.orchestra.run.smithi052.stdout:(118/155): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2024-01-25T15:02:01.677 INFO:teuthology.orchestra.run.smithi052.stdout:(119/155): python3-jaraco-functools-3.5.0-2.el9 257 kB/s | 19 kB 00:00 2024-01-25T15:02:01.703 INFO:teuthology.orchestra.run.smithi052.stdout:(120/155): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-01-25T15:02:01.736 INFO:teuthology.orchestra.run.smithi052.stdout:(121/155): python3-logutils-0.3.5-21.el9.noarch 793 kB/s | 46 kB 00:00 2024-01-25T15:02:01.761 INFO:teuthology.orchestra.run.smithi052.stdout:(122/155): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-01-25T15:02:01.795 INFO:teuthology.orchestra.run.smithi052.stdout:(123/155): python3-natsort-7.1.1-5.el9.noarch.r 980 kB/s | 58 kB 00:00 2024-01-25T15:02:01.820 INFO:teuthology.orchestra.run.smithi052.stdout:(124/155): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-01-25T15:02:01.862 INFO:teuthology.orchestra.run.smithi052.stdout:(125/155): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2024-01-25T15:02:01.888 INFO:teuthology.orchestra.run.smithi052.stdout:(126/155): python3-portend-3.1.0-2.el9.noarch.r 178 kB/s | 16 kB 00:00 2024-01-25T15:02:01.905 INFO:teuthology.orchestra.run.smithi052.stdout:(127/155): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-01-25T15:02:01.930 INFO:teuthology.orchestra.run.smithi052.stdout:(128/155): python3-pyperclip-1.8.2-2.el9.noarch 420 kB/s | 28 kB 00:00 2024-01-25T15:02:01.955 INFO:teuthology.orchestra.run.smithi052.stdout:(129/155): python3-repoze-lru-0.7-16.el9.noarch 458 kB/s | 31 kB 00:00 2024-01-25T15:02:01.981 INFO:teuthology.orchestra.run.smithi052.stdout:(130/155): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-01-25T15:02:02.006 INFO:teuthology.orchestra.run.smithi052.stdout:(131/155): python3-rsa-4.9-2.el9.noarch.rpm 783 kB/s | 59 kB 00:00 2024-01-25T15:02:02.031 INFO:teuthology.orchestra.run.smithi052.stdout:(132/155): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2024-01-25T15:02:02.056 INFO:teuthology.orchestra.run.smithi052.stdout:(133/155): python3-typing-extensions-4.4.0-2.el 675 kB/s | 51 kB 00:00 2024-01-25T15:02:02.081 INFO:teuthology.orchestra.run.smithi052.stdout:(134/155): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-01-25T15:02:02.107 INFO:teuthology.orchestra.run.smithi052.stdout:(135/155): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-01-25T15:02:02.132 INFO:teuthology.orchestra.run.smithi052.stdout:(136/155): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-01-25T15:02:02.157 INFO:teuthology.orchestra.run.smithi052.stdout:(137/155): python3-zc-lockfile-2.0-10.el9.noarc 264 kB/s | 20 kB 00:00 2024-01-25T15:02:02.183 INFO:teuthology.orchestra.run.smithi052.stdout:(138/155): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-01-25T15:02:02.316 INFO:teuthology.orchestra.run.smithi052.stdout:(139/155): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-01-25T15:02:02.350 INFO:teuthology.orchestra.run.smithi052.stdout:(140/155): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2024-01-25T15:02:02.467 INFO:teuthology.orchestra.run.smithi052.stdout:(141/155): NetworkManager-1.45.10-1.el9.x86_64. 19 MB/s | 2.2 MB 00:00 2024-01-25T15:02:02.514 INFO:teuthology.orchestra.run.smithi029.stdout:(7/155): ceph-base-19.0.0-885.g661946e7.el9.x86 1.1 MB/s | 5.1 MB 00:04 2024-01-25T15:02:02.550 INFO:teuthology.orchestra.run.smithi052.stdout:(142/155): NetworkManager-libnm-1.45.10-1.el9.x 22 MB/s | 1.8 MB 00:00 2024-01-25T15:02:02.584 INFO:teuthology.orchestra.run.smithi052.stdout:(143/155): NetworkManager-team-1.45.10-1.el9.x8 1.2 MB/s | 42 kB 00:00 2024-01-25T15:02:02.626 INFO:teuthology.orchestra.run.smithi052.stdout:(144/155): NetworkManager-tui-1.45.10-1.el9.x86 5.8 MB/s | 246 kB 00:00 2024-01-25T15:02:02.651 INFO:teuthology.orchestra.run.smithi052.stdout:(145/155): acl-2.3.1-4.el9.x86_64.rpm 2.7 MB/s | 69 kB 00:00 2024-01-25T15:02:02.676 INFO:teuthology.orchestra.run.smithi052.stdout:(146/155): elfutils-debuginfod-client-0.190-2.e 1.4 MB/s | 35 kB 00:00 2024-01-25T15:02:02.710 INFO:teuthology.orchestra.run.smithi052.stdout:(147/155): elfutils-libelf-0.190-2.el9.x86_64.r 5.6 MB/s | 191 kB 00:00 2024-01-25T15:02:02.760 INFO:teuthology.orchestra.run.smithi052.stdout:(148/155): elfutils-libs-0.190-2.el9.x86_64.rpm 5.0 MB/s | 254 kB 00:00 2024-01-25T15:02:02.827 INFO:teuthology.orchestra.run.smithi052.stdout:(149/155): librados2-19.0.0-885.g661946e7.el9.x 5.0 MB/s | 3.4 MB 00:00 2024-01-25T15:02:02.844 INFO:teuthology.orchestra.run.smithi052.stdout:(150/155): libacl-2.3.1-4.el9.x86_64.rpm 263 kB/s | 22 kB 00:00 2024-01-25T15:02:02.886 INFO:teuthology.orchestra.run.smithi052.stdout:(151/155): openssl-3.0.7-25.el9.x86_64.rpm 20 MB/s | 1.2 MB 00:00 2024-01-25T15:02:02.945 INFO:teuthology.orchestra.run.smithi052.stdout:(152/155): openssl-libs-3.0.7-25.el9.x86_64.rpm 22 MB/s | 2.1 MB 00:00 2024-01-25T15:02:02.970 INFO:teuthology.orchestra.run.smithi052.stdout:(153/155): xfsdump-3.1.12-4.el9.x86_64.rpm 3.9 MB/s | 321 kB 00:00 2024-01-25T15:02:02.989 INFO:teuthology.orchestra.run.smithi029.stdout:(8/155): ceph-osd-19.0.0-885.g661946e7.el9.x86_ 12 MB/s | 17 MB 00:01 2024-01-25T15:02:03.029 INFO:teuthology.orchestra.run.smithi052.stdout:(154/155): xfsprogs-6.3.0-1.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-01-25T15:02:03.048 INFO:teuthology.orchestra.run.smithi029.stdout:(9/155): ceph-mds-19.0.0-885.g661946e7.el9.x86_ 654 kB/s | 2.1 MB 00:03 2024-01-25T15:02:03.074 INFO:teuthology.orchestra.run.smithi029.stdout:(10/155): ceph-selinux-19.0.0-885.g661946e7.el9 300 kB/s | 25 kB 00:00 2024-01-25T15:02:03.124 INFO:teuthology.orchestra.run.smithi029.stdout:(11/155): cephfs-mirror-19.0.0-885.g661946e7.el 4.2 MB/s | 217 kB 00:00 2024-01-25T15:02:03.283 INFO:teuthology.orchestra.run.smithi029.stdout:(12/155): cephfs-shell-19.0.0-885.g661946e7.el9 171 kB/s | 27 kB 00:00 2024-01-25T15:02:03.335 INFO:teuthology.orchestra.run.smithi029.stdout:(13/155): libcephfs-devel-19.0.0-885.g661946e7. 600 kB/s | 31 kB 00:00 2024-01-25T15:02:03.379 INFO:teuthology.orchestra.run.smithi052.stdout:(155/155): librbd1-19.0.0-885.g661946e7.el9.x86 2.6 MB/s | 3.1 MB 00:01 2024-01-25T15:02:03.386 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-01-25T15:02:03.386 INFO:teuthology.orchestra.run.smithi052.stdout:Total 8.1 MB/s | 209 MB 00:25 2024-01-25T15:02:03.414 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-01-25T15:02:03.419 INFO:teuthology.orchestra.run.smithi029.stdout:(14/155): libcephfs2-19.0.0-885.g661946e7.el9.x 8.7 MB/s | 743 kB 00:00 2024-01-25T15:02:03.470 INFO:teuthology.orchestra.run.smithi029.stdout:(15/155): libcephsqlite-19.0.0-885.g661946e7.el 3.2 MB/s | 163 kB 00:00 2024-01-25T15:02:03.520 INFO:teuthology.orchestra.run.smithi029.stdout:(16/155): librados-devel-19.0.0-885.g661946e7.e 2.5 MB/s | 127 kB 00:00 2024-01-25T15:02:03.588 INFO:teuthology.orchestra.run.smithi029.stdout:(17/155): libradosstriper1-19.0.0-885.g661946e7 7.3 MB/s | 499 kB 00:00 2024-01-25T15:02:03.710 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-01-25T15:02:03.710 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-01-25T15:02:03.913 INFO:teuthology.orchestra.run.smithi029.stdout:(18/155): librgw2-19.0.0-885.g661946e7.el9.x86_ 15 MB/s | 4.8 MB 00:00 2024-01-25T15:02:03.955 INFO:teuthology.orchestra.run.smithi029.stdout:(19/155): python3-ceph-argparse-19.0.0-885.g661 1.1 MB/s | 45 kB 00:00 2024-01-25T15:02:04.006 INFO:teuthology.orchestra.run.smithi029.stdout:(20/155): python3-ceph-common-19.0.0-885.g66194 2.5 MB/s | 130 kB 00:00 2024-01-25T15:02:04.057 INFO:teuthology.orchestra.run.smithi029.stdout:(21/155): python3-cephfs-19.0.0-885.g661946e7.e 3.2 MB/s | 162 kB 00:00 2024-01-25T15:02:04.124 INFO:teuthology.orchestra.run.smithi029.stdout:(22/155): python3-rados-19.0.0-885.g661946e7.el 4.7 MB/s | 321 kB 00:00 2024-01-25T15:02:04.183 INFO:teuthology.orchestra.run.smithi029.stdout:(23/155): python3-rbd-19.0.0-885.g661946e7.el9. 5.0 MB/s | 298 kB 00:00 2024-01-25T15:02:04.242 INFO:teuthology.orchestra.run.smithi029.stdout:(24/155): python3-rgw-19.0.0-885.g661946e7.el9. 1.7 MB/s | 99 kB 00:00 2024-01-25T15:02:04.292 INFO:teuthology.orchestra.run.smithi029.stdout:(25/155): rbd-fuse-19.0.0-885.g661946e7.el9.x86 1.7 MB/s | 85 kB 00:00 2024-01-25T15:02:04.511 INFO:teuthology.orchestra.run.smithi029.stdout:(26/155): rbd-mirror-19.0.0-885.g661946e7.el9.x 14 MB/s | 3.1 MB 00:00 2024-01-25T15:02:04.570 INFO:teuthology.orchestra.run.smithi029.stdout:(27/155): rbd-nbd-19.0.0-885.g661946e7.el9.x86_ 2.8 MB/s | 170 kB 00:00 2024-01-25T15:02:04.612 INFO:teuthology.orchestra.run.smithi029.stdout:(28/155): ceph-grafana-dashboards-19.0.0-885.g6 681 kB/s | 28 kB 00:00 2024-01-25T15:02:04.666 INFO:teuthology.orchestra.run.smithi029.stdout:(29/155): ceph-mgr-cephadm-19.0.0-885.g661946e7 2.6 MB/s | 133 kB 00:00 2024-01-25T15:02:04.805 INFO:teuthology.orchestra.run.smithi029.stdout:(30/155): ceph-mgr-dashboard-19.0.0-885.g661946 12 MB/s | 1.7 MB 00:00 2024-01-25T15:02:05.273 INFO:teuthology.orchestra.run.smithi029.stdout:(31/155): ceph-mgr-diskprediction-local-19.0.0- 16 MB/s | 7.4 MB 00:00 2024-01-25T15:02:05.331 INFO:teuthology.orchestra.run.smithi029.stdout:(32/155): ceph-mgr-modules-core-19.0.0-885.g661 4.1 MB/s | 245 kB 00:00 2024-01-25T15:02:05.382 INFO:teuthology.orchestra.run.smithi029.stdout:(33/155): ceph-mgr-rook-19.0.0-885.g661946e7.el 1.0 MB/s | 51 kB 00:00 2024-01-25T15:02:05.424 INFO:teuthology.orchestra.run.smithi029.stdout:(34/155): ceph-prometheus-alerts-19.0.0-885.g66 361 kB/s | 15 kB 00:00 2024-01-25T15:02:05.483 INFO:teuthology.orchestra.run.smithi029.stdout:(35/155): ceph-volume-19.0.0-885.g661946e7.el9. 4.4 MB/s | 262 kB 00:00 2024-01-25T15:02:05.567 INFO:teuthology.orchestra.run.smithi029.stdout:(36/155): cephadm-19.0.0-885.g661946e7.el9.noar 8.7 MB/s | 742 kB 00:00 2024-01-25T15:02:05.617 INFO:teuthology.orchestra.run.smithi029.stdout:(37/155): cephfs-top-19.0.0-885.g661946e7.el9.n 365 kB/s | 18 kB 00:00 2024-01-25T15:02:05.653 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-01-25T15:02:05.654 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-01-25T15:02:05.885 INFO:teuthology.orchestra.run.smithi029.stdout:(38/155): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 662 kB 00:00 2024-01-25T15:02:05.977 INFO:teuthology.orchestra.run.smithi029.stdout:(39/155): bison-3.7.4-5.el9.x86_64.rpm 9.8 MB/s | 920 kB 00:00 2024-01-25T15:02:06.019 INFO:teuthology.orchestra.run.smithi029.stdout:(40/155): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2024-01-25T15:02:06.063 INFO:teuthology.orchestra.run.smithi029.stdout:(41/155): elfutils-libelf-devel-0.190-2.el9.x86 469 kB/s | 20 kB 00:00 2024-01-25T15:02:06.105 INFO:teuthology.orchestra.run.smithi029.stdout:(42/155): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2024-01-25T15:02:06.139 INFO:teuthology.orchestra.run.smithi029.stdout:(43/155): flexiblas-3.0.4-8.el9.x86_64.rpm 941 kB/s | 32 kB 00:00 2024-01-25T15:02:06.282 INFO:teuthology.orchestra.run.smithi029.stdout:(44/155): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-01-25T15:02:06.316 INFO:teuthology.orchestra.run.smithi029.stdout:(45/155): flexiblas-openblas-openmp-3.0.4-8.el9 509 kB/s | 17 kB 00:00 2024-01-25T15:02:06.349 INFO:teuthology.orchestra.run.smithi029.stdout:(46/155): libaio-devel-0.3.111-13.el9.x86_64.rp 300 kB/s | 10 kB 00:00 2024-01-25T15:02:06.392 INFO:teuthology.orchestra.run.smithi029.stdout:(47/155): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2024-01-25T15:02:06.427 INFO:teuthology.orchestra.run.smithi029.stdout:(48/155): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-01-25T15:02:06.476 INFO:teuthology.orchestra.run.smithi029.stdout:(49/155): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-01-25T15:02:06.535 INFO:teuthology.orchestra.run.smithi029.stdout:(50/155): libtool-2.4.6-45.el9.x86_64.rpm 9.7 MB/s | 578 kB 00:00 2024-01-25T15:02:06.569 INFO:teuthology.orchestra.run.smithi029.stdout:(51/155): libuuid-devel-2.37.4-15.el9.x86_64.rp 728 kB/s | 24 kB 00:00 2024-01-25T15:02:06.611 INFO:teuthology.orchestra.run.smithi029.stdout:(52/155): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 46 kB 00:00 2024-01-25T15:02:06.670 INFO:teuthology.orchestra.run.smithi029.stdout:(53/155): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 282 kB 00:00 2024-01-25T15:02:06.713 INFO:teuthology.orchestra.run.smithi029.stdout:(54/155): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2024-01-25T15:02:06.756 INFO:teuthology.orchestra.run.smithi029.stdout:(55/155): openblas-0.3.21-2.el9.x86_64.rpm 789 kB/s | 34 kB 00:00 2024-01-25T15:02:06.940 INFO:teuthology.orchestra.run.smithi029.stdout:(56/155): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-01-25T15:02:07.091 INFO:teuthology.orchestra.run.smithi029.stdout:(57/155): openssl-devel-3.0.7-25.el9.x86_64.rpm 20 MB/s | 3.0 MB 00:00 2024-01-25T15:02:07.183 INFO:teuthology.orchestra.run.smithi029.stdout:(58/155): postgresql-13.11-1.el9.x86_64.rpm 17 MB/s | 1.5 MB 00:00 2024-01-25T15:02:07.243 INFO:teuthology.orchestra.run.smithi029.stdout:(59/155): postgresql-contrib-13.11-1.el9.x86_64 14 MB/s | 811 kB 00:00 2024-01-25T15:02:07.284 INFO:teuthology.orchestra.run.smithi029.stdout:(60/155): postgresql-private-libs-13.11-1.el9.x 3.1 MB/s | 134 kB 00:00 2024-01-25T15:02:07.493 INFO:teuthology.orchestra.run.smithi029.stdout:(61/155): postgresql-server-13.11-1.el9.x86_64. 27 MB/s | 5.7 MB 00:00 2024-01-25T15:02:07.552 INFO:teuthology.orchestra.run.smithi029.stdout:(62/155): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-01-25T15:02:07.819 INFO:teuthology.orchestra.run.smithi029.stdout:(63/155): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 5.8 MB 00:00 2024-01-25T15:02:07.978 INFO:teuthology.orchestra.run.smithi029.stdout:(64/155): ceph-radosgw-19.0.0-885.g661946e7.el9 1.6 MB/s | 8.7 MB 00:05 2024-01-25T15:02:08.020 INFO:teuthology.orchestra.run.smithi029.stdout:(65/155): python3-jinja2-2.11.3-4.el9.noarch.rp 1.1 MB/s | 228 kB 00:00 2024-01-25T15:02:08.046 INFO:teuthology.orchestra.run.smithi029.stdout:(66/155): python3-jsonpatch-1.21-16.el9.noarch. 363 kB/s | 24 kB 00:00 2024-01-25T15:02:08.088 INFO:teuthology.orchestra.run.smithi029.stdout:(67/155): python3-jsonpointer-2.0-4.el9.noarch. 268 kB/s | 18 kB 00:00 2024-01-25T15:02:08.122 INFO:teuthology.orchestra.run.smithi029.stdout:(68/155): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2024-01-25T15:02:08.158 INFO:teuthology.orchestra.run.smithi029.stdout:(69/155): python3-markupsafe-1.1.1-12.el9.x86_6 458 kB/s | 32 kB 00:00 2024-01-25T15:02:08.767 INFO:teuthology.orchestra.run.smithi029.stdout:(70/155): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.4 MB/s | 4.8 MB 00:00 2024-01-25T15:02:08.801 INFO:teuthology.orchestra.run.smithi029.stdout:(71/155): python3-numpy-f2py-1.20.1-5.el9.x86_6 338 kB/s | 217 kB 00:00 2024-01-25T15:02:08.851 INFO:teuthology.orchestra.run.smithi029.stdout:(72/155): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 174 kB 00:00 2024-01-25T15:02:08.877 INFO:teuthology.orchestra.run.smithi029.stdout:(73/155): python3-prettytable-0.7.2-27.el9.noar 544 kB/s | 41 kB 00:00 2024-01-25T15:02:08.911 INFO:teuthology.orchestra.run.smithi029.stdout:(74/155): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2024-01-25T15:02:08.945 INFO:teuthology.orchestra.run.smithi029.stdout:(75/155): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 211 kB 00:00 2024-01-25T15:02:08.970 INFO:teuthology.orchestra.run.smithi029.stdout:(76/155): python3-pytz-2021.1-5.el9.noarch.rpm 807 kB/s | 47 kB 00:00 2024-01-25T15:02:09.004 INFO:teuthology.orchestra.run.smithi029.stdout:(77/155): python3-requests-oauthlib-1.3.0-12.el 726 kB/s | 43 kB 00:00 2024-01-25T15:02:09.546 INFO:teuthology.orchestra.run.smithi029.stdout:(78/155): python3-toml-0.10.2-6.el9.noarch.rpm 71 kB/s | 39 kB 00:00 2024-01-25T15:02:09.980 INFO:teuthology.orchestra.run.smithi029.stdout:(79/155): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:01 2024-01-25T15:02:10.005 INFO:teuthology.orchestra.run.smithi029.stdout:(80/155): python3-wcwidth-0.2.5-8.el9.noarch.rp 89 kB/s | 41 kB 00:00 2024-01-25T15:02:10.056 INFO:teuthology.orchestra.run.smithi029.stdout:(81/155): socat-1.7.4.1-5.el9.x86_64.rpm 3.9 MB/s | 300 kB 00:00 2024-01-25T15:02:10.090 INFO:teuthology.orchestra.run.smithi029.stdout:(82/155): uuid-1.6.2-55.el9.x86_64.rpm 670 kB/s | 56 kB 00:00 2024-01-25T15:02:10.134 INFO:teuthology.orchestra.run.smithi029.stdout:(83/155): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2024-01-25T15:02:10.159 INFO:teuthology.orchestra.run.smithi029.stdout:(84/155): xmlstarlet-1.6.1-20.el9.x86_64.rpm 907 kB/s | 63 kB 00:00 2024-01-25T15:02:10.193 INFO:teuthology.orchestra.run.smithi029.stdout:(85/155): zlib-devel-1.2.11-40.el9.x86_64.rpm 748 kB/s | 44 kB 00:00 2024-01-25T15:02:10.219 INFO:teuthology.orchestra.run.smithi029.stdout:(86/155): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-01-25T15:02:10.261 INFO:teuthology.orchestra.run.smithi029.stdout:(87/155): jq-1.6-16.el9.x86_64.rpm 2.7 MB/s | 186 kB 00:00 2024-01-25T15:02:10.312 INFO:teuthology.orchestra.run.smithi029.stdout:(88/155): libgfortran-11.4.1-3.el9.x86_64.rpm 8.5 MB/s | 802 kB 00:00 2024-01-25T15:02:10.346 INFO:teuthology.orchestra.run.smithi029.stdout:(89/155): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 194 kB 00:00 2024-01-25T15:02:10.380 INFO:teuthology.orchestra.run.smithi029.stdout:(90/155): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.2 MB/s | 217 kB 00:00 2024-01-25T15:02:10.422 INFO:teuthology.orchestra.run.smithi029.stdout:(91/155): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-01-25T15:02:10.560 INFO:teuthology.orchestra.run.smithi029.stdout:(92/155): python3-cryptography-36.0.1-4.el9.x86 6.5 MB/s | 1.1 MB 00:00 2024-01-25T15:02:10.582 INFO:teuthology.orchestra.run.smithi029.stdout:(93/155): python3-ply-3.11-14.el9.noarch.rpm 646 kB/s | 103 kB 00:00 2024-01-25T15:02:10.799 INFO:teuthology.orchestra.run.smithi029.stdout:(94/155): python3-pycparser-2.20-6.el9.noarch.r 512 kB/s | 124 kB 00:00 2024-01-25T15:02:10.966 INFO:teuthology.orchestra.run.smithi029.stdout:(95/155): python3-requests-2.25.1-7.el9.noarch. 293 kB/s | 113 kB 00:00 2024-01-25T15:02:11.235 INFO:teuthology.orchestra.run.smithi029.stdout:(96/155): python3-urllib3-1.26.5-5.el9.noarch.r 429 kB/s | 187 kB 00:00 2024-01-25T15:02:11.269 INFO:teuthology.orchestra.run.smithi029.stdout:(97/155): python3-devel-3.9.17-2.el9.x86_64.rpm 812 kB/s | 245 kB 00:00 2024-01-25T15:02:11.403 INFO:teuthology.orchestra.run.smithi029.stdout:(98/155): lua-devel-5.4.4-4.el9.x86_64.rpm 133 kB/s | 22 kB 00:00 2024-01-25T15:02:11.804 INFO:teuthology.orchestra.run.smithi029.stdout:(99/155): gperftools-libs-2.9.1-2.el9.x86_64.rp 578 kB/s | 309 kB 00:00 2024-01-25T15:02:11.888 INFO:teuthology.orchestra.run.smithi029.stdout:(100/155): libarrow-doc-9.0.0-10.el9.noarch.rpm 311 kB/s | 26 kB 00:00 2024-01-25T15:02:11.980 INFO:teuthology.orchestra.run.smithi029.stdout:(101/155): liboath-2.6.7-2.el9.x86_64.rpm 529 kB/s | 49 kB 00:00 2024-01-25T15:02:12.080 INFO:teuthology.orchestra.run.smithi029.stdout:(102/155): libunwind-1.6.2-1.el9.x86_64.rpm 672 kB/s | 67 kB 00:00 2024-01-25T15:02:12.110 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-01-25T15:02:12.208 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/171 2024-01-25T15:02:12.252 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/171 2024-01-25T15:02:12.273 INFO:teuthology.orchestra.run.smithi029.stdout:(103/155): libarrow-9.0.0-10.el9.x86_64.rpm 5.1 MB/s | 4.4 MB 00:00 2024-01-25T15:02:12.306 INFO:teuthology.orchestra.run.smithi029.stdout:(104/155): luarocks-3.9.2-1.el9.noarch.rpm 669 kB/s | 151 kB 00:00 2024-01-25T15:02:12.310 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/171 2024-01-25T15:02:12.350 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/171 2024-01-25T15:02:12.375 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/171 2024-01-25T15:02:12.398 INFO:teuthology.orchestra.run.smithi029.stdout:(105/155): parquet-libs-9.0.0-10.el9.x86_64.rpm 6.5 MB/s | 838 kB 00:00 2024-01-25T15:02:12.431 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/171 2024-01-25T15:02:12.491 INFO:teuthology.orchestra.run.smithi029.stdout:(106/155): python3-bcrypt-3.2.2-1.el9.x86_64.rp 473 kB/s | 43 kB 00:00 2024-01-25T15:02:12.533 INFO:teuthology.orchestra.run.smithi029.stdout:(107/155): python3-asyncssh-2.13.2-3.el9.noarch 2.4 MB/s | 548 kB 00:00 2024-01-25T15:02:12.608 INFO:teuthology.orchestra.run.smithi029.stdout:(108/155): python3-cachetools-4.2.4-1.el9.noarc 274 kB/s | 32 kB 00:00 2024-01-25T15:02:12.643 INFO:teuthology.orchestra.run.smithi029.stdout:(109/155): python3-certifi-2021.10.8-2.el9.noar 137 kB/s | 15 kB 00:00 2024-01-25T15:02:12.718 INFO:teuthology.orchestra.run.smithi029.stdout:(110/155): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-01-25T15:02:12.768 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/171 2024-01-25T15:02:12.779 INFO:teuthology.orchestra.run.smithi029.stdout:(111/155): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2024-01-25T15:02:12.827 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librados2-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-25T15:02:12.837 INFO:teuthology.orchestra.run.smithi029.stdout:(112/155): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-01-25T15:02:12.872 INFO:teuthology.orchestra.run.smithi029.stdout:(113/155): python3-colorama-0.4.4-12.el9.noarch 381 kB/s | 35 kB 00:00 2024-01-25T15:02:12.947 INFO:teuthology.orchestra.run.smithi029.stdout:(114/155): python3-google-auth-2.26.2-1.el9.noa 1.8 MB/s | 202 kB 00:00 2024-01-25T15:02:12.973 INFO:teuthology.orchestra.run.smithi029.stdout:(115/155): python3-jaraco-8.2.1-3.el9.noarch.rp 106 kB/s | 11 kB 00:00 2024-01-25T15:02:12.984 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-25T15:02:13.011 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-25T15:02:13.031 INFO:teuthology.orchestra.run.smithi029.stdout:(116/155): python3-jaraco-classes-3.2.1-5.el9.n 211 kB/s | 18 kB 00:00 2024-01-25T15:02:13.057 INFO:teuthology.orchestra.run.smithi029.stdout:(117/155): python3-jaraco-collections-3.0.0-8.e 275 kB/s | 23 kB 00:00 2024-01-25T15:02:13.104 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-25T15:02:13.116 INFO:teuthology.orchestra.run.smithi029.stdout:(118/155): python3-jaraco-functools-3.5.0-2.el9 231 kB/s | 19 kB 00:00 2024-01-25T15:02:13.136 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 10/171 2024-01-25T15:02:13.141 INFO:teuthology.orchestra.run.smithi029.stdout:(119/155): python3-jaraco-text-3.2.0-6.el9.noar 234 kB/s | 20 kB 00:00 2024-01-25T15:02:13.228 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/171 2024-01-25T15:02:13.234 INFO:teuthology.orchestra.run.smithi029.stdout:(120/155): python3-logutils-0.3.5-21.el9.noarch 503 kB/s | 46 kB 00:00 2024-01-25T15:02:13.315 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/171 2024-01-25T15:02:13.318 INFO:teuthology.orchestra.run.smithi029.stdout:(121/155): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2024-01-25T15:02:13.344 INFO:teuthology.orchestra.run.smithi029.stdout:(122/155): python3-more-itertools-8.12.0-2.el9. 722 kB/s | 79 kB 00:00 2024-01-25T15:02:13.403 INFO:teuthology.orchestra.run.smithi029.stdout:(123/155): python3-natsort-7.1.1-5.el9.noarch.r 686 kB/s | 58 kB 00:00 2024-01-25T15:02:13.436 INFO:teuthology.orchestra.run.smithi029.stdout:(124/155): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-01-25T15:02:13.488 INFO:teuthology.orchestra.run.smithi029.stdout:(125/155): python3-portend-3.1.0-2.el9.noarch.r 192 kB/s | 16 kB 00:00 2024-01-25T15:02:13.492 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/171 2024-01-25T15:02:13.530 INFO:teuthology.orchestra.run.smithi029.stdout:(126/155): python3-pyOpenSSL-21.0.0-1.el9.noarc 957 kB/s | 90 kB 00:00 2024-01-25T15:02:13.541 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/171 2024-01-25T15:02:13.568 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 15/171 2024-01-25T15:02:13.573 INFO:teuthology.orchestra.run.smithi029.stdout:(127/155): python3-pyperclip-1.8.2-2.el9.noarch 335 kB/s | 28 kB 00:00 2024-01-25T15:02:13.615 INFO:teuthology.orchestra.run.smithi029.stdout:(128/155): python3-repoze-lru-0.7-16.el9.noarch 365 kB/s | 31 kB 00:00 2024-01-25T15:02:13.665 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 15/171 2024-01-25T15:02:13.674 INFO:teuthology.orchestra.run.smithi029.stdout:(129/155): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-01-25T15:02:13.699 INFO:teuthology.orchestra.run.smithi029.stdout:(130/155): python3-rsa-4.9-2.el9.noarch.rpm 703 kB/s | 59 kB 00:00 2024-01-25T15:02:13.703 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 16/171 2024-01-25T15:02:13.758 INFO:teuthology.orchestra.run.smithi029.stdout:(131/155): python3-tempora-5.0.0-2.el9.noarch.r 425 kB/s | 36 kB 00:00 2024-01-25T15:02:13.764 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 16/171 2024-01-25T15:02:13.784 INFO:teuthology.orchestra.run.smithi029.stdout:(132/155): python3-typing-extensions-4.4.0-2.el 606 kB/s | 51 kB 00:00 2024-01-25T15:02:13.860 INFO:teuthology.orchestra.run.smithi029.stdout:(133/155): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-01-25T15:02:13.893 INFO:teuthology.orchestra.run.smithi029.stdout:(134/155): python3-websocket-client-1.2.3-2.el9 821 kB/s | 90 kB 00:00 2024-01-25T15:02:13.923 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/171 2024-01-25T15:02:13.977 INFO:teuthology.orchestra.run.smithi029.stdout:(135/155): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-01-25T15:02:14.003 INFO:teuthology.orchestra.run.smithi029.stdout:(136/155): python3-zc-lockfile-2.0-10.el9.noarc 183 kB/s | 20 kB 00:00 2024-01-25T15:02:14.048 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-25T15:02:14.078 INFO:teuthology.orchestra.run.smithi029.stdout:(137/155): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-01-25T15:02:14.092 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-25T15:02:14.154 INFO:teuthology.orchestra.run.smithi029.stdout:(138/155): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-01-25T15:02:14.194 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-25T15:02:14.243 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-25T15:02:14.473 INFO:teuthology.orchestra.run.smithi029.stdout:(139/155): librbd1-19.0.0-885.g661946e7.el9.x86 9.8 MB/s | 3.1 MB 00:00 2024-01-25T15:02:14.510 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-25T15:02:14.539 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/171 2024-01-25T15:02:14.610 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/171 2024-01-25T15:02:14.632 INFO:teuthology.orchestra.run.smithi029.stdout:(140/155): libacl-devel-2.3.1-4.el9.x86_64.rpm 427 kB/s | 68 kB 00:00 2024-01-25T15:02:14.662 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 22/171 2024-01-25T15:02:14.692 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/171 2024-01-25T15:02:14.737 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 24/171 2024-01-25T15:02:14.784 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 25/171 2024-01-25T15:02:14.850 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/171 2024-01-25T15:02:14.883 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/171 2024-01-25T15:02:14.918 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/171 2024-01-25T15:02:14.945 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/171 2024-01-25T15:02:15.016 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/171 2024-01-25T15:02:15.050 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-common-2:19.0.0-885.g661946e7.el9.x 31/171 2024-01-25T15:02:15.104 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-argparse-2:19.0.0-885.g661946e7.el9 32/171 2024-01-25T15:02:15.130 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 33/171 2024-01-25T15:02:15.202 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/171 2024-01-25T15:02:15.287 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/171 2024-01-25T15:02:15.423 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/171 2024-01-25T15:02:15.481 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/171 2024-01-25T15:02:15.599 INFO:teuthology.orchestra.run.smithi029.stdout:(141/155): librados2-19.0.0-885.g661946e7.el9.x 2.2 MB/s | 3.4 MB 00:01 2024-01-25T15:02:16.032 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/171 2024-01-25T15:02:16.110 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/171 2024-01-25T15:02:16.149 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 40/171 2024-01-25T15:02:16.198 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 41/171 2024-01-25T15:02:16.208 INFO:teuthology.orchestra.run.smithi029.stdout:(142/155): NetworkManager-1.45.10-1.el9.x86_64. 1.4 MB/s | 2.2 MB 00:01 2024-01-25T15:02:16.236 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 42/171 2024-01-25T15:02:16.279 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/171 2024-01-25T15:02:16.432 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 44/171 2024-01-25T15:02:16.487 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 45/171 2024-01-25T15:02:16.598 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : re2-1:20211101-3.el9.x86_64 46/171 2024-01-25T15:02:16.632 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 47/171 2024-01-25T15:02:16.687 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/171 2024-01-25T15:02:16.708 INFO:teuthology.orchestra.run.smithi029.stdout:(143/155): NetworkManager-libnm-1.45.10-1.el9.x 1.6 MB/s | 1.8 MB 00:01 2024-01-25T15:02:16.742 INFO:teuthology.orchestra.run.smithi029.stdout:(144/155): NetworkManager-team-1.45.10-1.el9.x8 79 kB/s | 42 kB 00:00 2024-01-25T15:02:16.761 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/171 2024-01-25T15:02:16.793 INFO:teuthology.orchestra.run.smithi029.stdout:(145/155): NetworkManager-tui-1.45.10-1.el9.x86 2.9 MB/s | 246 kB 00:00 2024-01-25T15:02:16.807 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 50/171 2024-01-25T15:02:16.819 INFO:teuthology.orchestra.run.smithi029.stdout:(146/155): acl-2.3.1-4.el9.x86_64.rpm 911 kB/s | 69 kB 00:00 2024-01-25T15:02:16.836 INFO:teuthology.orchestra.run.smithi029.stdout:(147/155): elfutils-debuginfod-client-0.190-2.e 836 kB/s | 35 kB 00:00 2024-01-25T15:02:16.843 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 51/171 2024-01-25T15:02:16.886 INFO:teuthology.orchestra.run.smithi029.stdout:(148/155): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 191 kB 00:00 2024-01-25T15:02:16.891 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/171 2024-01-25T15:02:16.920 INFO:teuthology.orchestra.run.smithi029.stdout:(149/155): elfutils-libs-0.190-2.el9.x86_64.rpm 3.0 MB/s | 254 kB 00:00 2024-01-25T15:02:16.926 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/171 2024-01-25T15:02:16.946 INFO:teuthology.orchestra.run.smithi029.stdout:(150/155): libacl-2.3.1-4.el9.x86_64.rpm 374 kB/s | 22 kB 00:00 2024-01-25T15:02:16.970 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 54/171 2024-01-25T15:02:17.012 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 55/171 2024-01-25T15:02:17.121 INFO:teuthology.orchestra.run.smithi029.stdout:(151/155): openssl-3.0.7-25.el9.x86_64.rpm 5.8 MB/s | 1.2 MB 00:00 2024-01-25T15:02:17.150 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 56/171 2024-01-25T15:02:17.192 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 57/171 2024-01-25T15:02:17.222 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 58/171 2024-01-25T15:02:17.264 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 59/171 2024-01-25T15:02:17.358 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 60/171 2024-01-25T15:02:17.364 INFO:teuthology.orchestra.run.smithi029.stdout:(152/155): openssl-libs-3.0.7-25.el9.x86_64.rpm 5.2 MB/s | 2.1 MB 00:00 2024-01-25T15:02:17.399 INFO:teuthology.orchestra.run.smithi029.stdout:(153/155): xfsdump-3.1.12-4.el9.x86_64.rpm 1.1 MB/s | 321 kB 00:00 2024-01-25T15:02:17.409 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-google-auth-1:2.26.2-1.el9.noarch 61/171 2024-01-25T15:02:17.446 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 62/171 2024-01-25T15:02:17.490 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 63/171 2024-01-25T15:02:17.516 INFO:teuthology.orchestra.run.smithi029.stdout:(154/155): xfsprogs-6.3.0-1.el9.x86_64.rpm 7.0 MB/s | 1.1 MB 00:00 2024-01-25T15:02:17.594 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 64/171 2024-01-25T15:02:17.632 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 65/171 2024-01-25T15:02:17.690 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ply-3.11-14.el9.noarch 66/171 2024-01-25T15:02:17.745 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 67/171 2024-01-25T15:02:17.953 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 68/171 2024-01-25T15:02:18.002 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 69/171 2024-01-25T15:02:18.144 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 70/171 2024-01-25T15:02:18.186 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 71/171 2024-01-25T15:02:18.216 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 72/171 2024-01-25T15:02:18.248 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 73/171 2024-01-25T15:02:18.284 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : jq-1.6-16.el9.x86_64 74/171 2024-01-25T15:02:18.314 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : fuse-2.9.9-15.el9.x86_64 75/171 2024-01-25T15:02:18.342 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 76/171 2024-01-25T15:02:18.386 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 77/171 2024-01-25T15:02:18.424 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : uuid-1.6.2-55.el9.x86_64 78/171 2024-01-25T15:02:18.456 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 79/171 2024-01-25T15:02:18.488 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 80/171 2024-01-25T15:02:18.566 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 81/171 2024-01-25T15:02:18.599 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 82/171 2024-01-25T15:02:18.631 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 83/171 2024-01-25T15:02:18.673 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 84/171 2024-01-25T15:02:18.707 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 85/171 2024-01-25T15:02:18.799 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 86/171 2024-01-25T15:02:18.835 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 87/171 2024-01-25T15:02:18.940 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 88/171 2024-01-25T15:02:18.994 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 89/171 2024-01-25T15:02:19.752 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 90/171 2024-01-25T15:02:19.808 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 91/171 2024-01-25T15:02:19.842 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 92/171 2024-01-25T15:02:19.890 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 93/171 2024-01-25T15:02:19.980 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 94/171 2024-01-25T15:02:20.018 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 95/171 2024-01-25T15:02:20.204 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-0.3.21-2.el9.x86_64 96/171 2024-01-25T15:02:20.232 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 97/171 2024-01-25T15:02:20.313 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/171 2024-01-25T15:02:20.986 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/171 2024-01-25T15:02:21.092 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 100/171 2024-01-25T15:02:21.492 INFO:teuthology.orchestra.run.smithi029.stdout:(155/155): ceph-test-19.0.0-885.g661946e7.el9.x 2.5 MB/s | 46 MB 00:18 2024-01-25T15:02:21.497 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-01-25T15:02:21.497 INFO:teuthology.orchestra.run.smithi029.stdout:Total 5.1 MB/s | 209 MB 00:41 2024-01-25T15:02:21.527 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-01-25T15:02:21.824 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-01-25T15:02:21.824 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-01-25T15:02:22.389 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 101/171 2024-01-25T15:02:22.448 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 102/171 2024-01-25T15:02:22.476 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 103/171 2024-01-25T15:02:22.509 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 104/171 2024-01-25T15:02:22.841 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/171 2024-01-25T15:02:22.880 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librbd1-2:19.0.0-885.g661946e7.el9.x86_64 106/171 2024-01-25T15:02:22.971 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:19.0.0-885.g661946e7.el9.x86_64 106/171 2024-01-25T15:02:23.001 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 107/171 2024-01-25T15:02:23.038 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/171 2024-01-25T15:02:23.490 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 109/171 2024-01-25T15:02:23.516 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librgw2-2:19.0.0-885.g661946e7.el9.x86_64 110/171 2024-01-25T15:02:23.587 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librgw2-2:19.0.0-885.g661946e7.el9.x86_64 110/171 2024-01-25T15:02:23.609 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 111/171 2024-01-25T15:02:23.784 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-01-25T15:02:23.785 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-01-25T15:02:25.796 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 112/171 2024-01-25T15:02:25.831 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 112/171 2024-01-25T15:02:26.388 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 112/171 2024-01-25T15:02:26.425 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 113/171 2024-01-25T15:02:26.498 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 113/171 2024-01-25T15:02:26.499 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-25T15:02:26.499 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-25T15:02:26.499 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:02:26.543 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 114/171 2024-01-25T15:02:30.005 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-01-25T15:02:30.173 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/171 2024-01-25T15:02:30.221 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/171 2024-01-25T15:02:30.294 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/171 2024-01-25T15:02:30.343 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/171 2024-01-25T15:02:30.377 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/171 2024-01-25T15:02:30.438 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/171 2024-01-25T15:02:30.840 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/171 2024-01-25T15:02:30.898 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librados2-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-25T15:02:31.022 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-25T15:02:31.059 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-25T15:02:31.152 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-25T15:02:31.195 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 10/171 2024-01-25T15:02:31.296 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/171 2024-01-25T15:02:31.411 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/171 2024-01-25T15:02:31.604 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/171 2024-01-25T15:02:31.671 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/171 2024-01-25T15:02:31.708 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 15/171 2024-01-25T15:02:31.813 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 15/171 2024-01-25T15:02:31.851 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 16/171 2024-01-25T15:02:31.914 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 16/171 2024-01-25T15:02:32.225 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/171 2024-01-25T15:02:32.386 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-25T15:02:32.447 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-25T15:02:32.591 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-25T15:02:32.652 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-25T15:02:32.964 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-25T15:02:33.006 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/171 2024-01-25T15:02:33.086 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/171 2024-01-25T15:02:33.150 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 22/171 2024-01-25T15:02:33.188 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/171 2024-01-25T15:02:33.233 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 24/171 2024-01-25T15:02:33.281 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 25/171 2024-01-25T15:02:33.356 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/171 2024-01-25T15:02:33.398 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/171 2024-01-25T15:02:33.451 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/171 2024-01-25T15:02:33.488 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/171 2024-01-25T15:02:33.568 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/171 2024-01-25T15:02:33.610 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-common-2:19.0.0-885.g661946e7.el9.x 31/171 2024-01-25T15:02:33.655 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-argparse-2:19.0.0-885.g661946e7.el9 32/171 2024-01-25T15:02:33.691 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 33/171 2024-01-25T15:02:33.772 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/171 2024-01-25T15:02:33.859 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/171 2024-01-25T15:02:34.007 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/171 2024-01-25T15:02:34.064 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/171 2024-01-25T15:02:34.628 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/171 2024-01-25T15:02:34.721 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/171 2024-01-25T15:02:34.761 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 40/171 2024-01-25T15:02:34.811 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 41/171 2024-01-25T15:02:34.849 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 42/171 2024-01-25T15:02:34.900 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/171 2024-01-25T15:02:35.039 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 44/171 2024-01-25T15:02:35.093 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 45/171 2024-01-25T15:02:35.213 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : re2-1:20211101-3.el9.x86_64 46/171 2024-01-25T15:02:35.255 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 47/171 2024-01-25T15:02:35.312 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/171 2024-01-25T15:02:35.393 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/171 2024-01-25T15:02:35.433 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 50/171 2024-01-25T15:02:35.470 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 51/171 2024-01-25T15:02:35.528 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/171 2024-01-25T15:02:35.572 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/171 2024-01-25T15:02:35.624 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 54/171 2024-01-25T15:02:35.684 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 55/171 2024-01-25T15:02:35.821 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 56/171 2024-01-25T15:02:35.876 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 57/171 2024-01-25T15:02:35.915 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 58/171 2024-01-25T15:02:35.966 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 59/171 2024-01-25T15:02:36.063 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 60/171 2024-01-25T15:02:36.108 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-google-auth-1:2.26.2-1.el9.noarch 61/171 2024-01-25T15:02:36.150 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 62/171 2024-01-25T15:02:36.185 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 63/171 2024-01-25T15:02:36.302 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 64/171 2024-01-25T15:02:36.361 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 65/171 2024-01-25T15:02:36.420 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ply-3.11-14.el9.noarch 66/171 2024-01-25T15:02:36.492 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 67/171 2024-01-25T15:02:36.706 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 68/171 2024-01-25T15:02:36.763 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 69/171 2024-01-25T15:02:36.905 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 70/171 2024-01-25T15:02:36.953 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 71/171 2024-01-25T15:02:36.995 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 72/171 2024-01-25T15:02:37.030 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 73/171 2024-01-25T15:02:37.063 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : jq-1.6-16.el9.x86_64 74/171 2024-01-25T15:02:37.103 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : fuse-2.9.9-15.el9.x86_64 75/171 2024-01-25T15:02:37.142 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 76/171 2024-01-25T15:02:37.195 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 77/171 2024-01-25T15:02:37.242 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : uuid-1.6.2-55.el9.x86_64 78/171 2024-01-25T15:02:37.282 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 79/171 2024-01-25T15:02:37.321 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 80/171 2024-01-25T15:02:37.409 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 81/171 2024-01-25T15:02:37.449 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 82/171 2024-01-25T15:02:37.484 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 83/171 2024-01-25T15:02:37.526 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 84/171 2024-01-25T15:02:37.570 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 85/171 2024-01-25T15:02:37.672 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 86/171 2024-01-25T15:02:37.715 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 87/171 2024-01-25T15:02:37.831 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 88/171 2024-01-25T15:02:37.895 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 89/171 2024-01-25T15:02:38.183 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 114/171 2024-01-25T15:02:38.183 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /sys 2024-01-25T15:02:38.183 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /proc 2024-01-25T15:02:38.183 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /mnt 2024-01-25T15:02:38.184 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /var/tmp 2024-01-25T15:02:38.184 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /home 2024-01-25T15:02:38.184 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /root 2024-01-25T15:02:38.184 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /tmp 2024-01-25T15:02:38.184 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:02:38.350 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 115/171 2024-01-25T15:02:38.365 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 115/171 2024-01-25T15:02:38.365 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T15:02:38.366 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-25T15:02:38.366 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:02:38.660 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 90/171 2024-01-25T15:02:38.713 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 91/171 2024-01-25T15:02:38.756 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 92/171 2024-01-25T15:02:38.814 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 93/171 2024-01-25T15:02:38.904 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 94/171 2024-01-25T15:02:38.950 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 95/171 2024-01-25T15:02:39.136 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-0.3.21-2.el9.x86_64 96/171 2024-01-25T15:02:39.174 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 97/171 2024-01-25T15:02:39.265 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/171 2024-01-25T15:02:39.888 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 116/171 2024-01-25T15:02:39.913 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 116/171 2024-01-25T15:02:39.914 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T15:02:39.914 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-25T15:02:39.914 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-25T15:02:39.914 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-25T15:02:39.914 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:02:39.979 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/171 2024-01-25T15:02:40.109 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 100/171 2024-01-25T15:02:40.138 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 117/171 2024-01-25T15:02:40.160 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 117/171 2024-01-25T15:02:40.161 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T15:02:40.161 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-25T15:02:40.161 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-25T15:02:40.161 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-25T15:02:40.161 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:02:40.622 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 118/171 2024-01-25T15:02:40.645 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 118/171 2024-01-25T15:02:40.645 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T15:02:40.645 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-25T15:02:40.645 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-25T15:02:40.645 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-25T15:02:40.646 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:02:40.732 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : automake-1.16.2-8.el9.noarch 119/171 2024-01-25T15:02:41.154 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:19.0.0-885.g661946e7.el9.noarch 120/171 2024-01-25T15:02:41.180 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephadm-2:19.0.0-885.g661946e7.el9.noarch 120/171 2024-01-25T15:02:41.211 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el 121/171 2024-01-25T15:02:41.291 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-885.g661946e7.e 122/171 2024-01-25T15:02:41.320 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 123/171 2024-01-25T15:02:41.408 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 101/171 2024-01-25T15:02:41.511 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 102/171 2024-01-25T15:02:41.548 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 103/171 2024-01-25T15:02:41.554 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 123/171 2024-01-25T15:02:41.581 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 104/171 2024-01-25T15:02:41.588 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 124/171 2024-01-25T15:02:41.906 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/171 2024-01-25T15:02:41.945 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librbd1-2:19.0.0-885.g661946e7.el9.x86_64 106/171 2024-01-25T15:02:42.039 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-2:19.0.0-885.g661946e7.el9.x86_64 106/171 2024-01-25T15:02:42.069 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 107/171 2024-01-25T15:02:42.124 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/171 2024-01-25T15:02:42.584 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 109/171 2024-01-25T15:02:42.602 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 124/171 2024-01-25T15:02:42.619 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librgw2-2:19.0.0-885.g661946e7.el9.x86_64 110/171 2024-01-25T15:02:42.630 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 125/171 2024-01-25T15:02:42.700 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librgw2-2:19.0.0-885.g661946e7.el9.x86_64 110/171 2024-01-25T15:02:42.731 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 111/171 2024-01-25T15:02:42.733 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 125/171 2024-01-25T15:02:42.899 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9 126/171 2024-01-25T15:02:42.924 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 127/171 2024-01-25T15:02:42.947 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 127/171 2024-01-25T15:02:42.947 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T15:02:42.947 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-25T15:02:42.947 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-25T15:02:42.947 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-25T15:02:42.947 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:02:42.991 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 128/171 2024-01-25T15:02:43.001 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 128/171 2024-01-25T15:02:43.058 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-2:19.0.0-885.g661946e7.el9.x86_64 129/171 2024-01-25T15:02:43.876 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/171 2024-01-25T15:02:43.901 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 131/171 2024-01-25T15:02:43.923 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 131/171 2024-01-25T15:02:43.923 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T15:02:43.923 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-25T15:02:43.923 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-25T15:02:43.923 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-25T15:02:43.924 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:02:43.968 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-885.g661946 132/171 2024-01-25T15:02:43.990 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-885.g661946 132/171 2024-01-25T15:02:43.990 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T15:02:43.990 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-25T15:02:43.990 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:02:44.035 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 133/171 2024-01-25T15:02:44.057 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 133/171 2024-01-25T15:02:44.058 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T15:02:44.058 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-01-25T15:02:44.058 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-25T15:02:44.058 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-25T15:02:44.058 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:02:44.378 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 134/171 2024-01-25T15:02:44.400 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 134/171 2024-01-25T15:02:44.400 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T15:02:44.401 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-25T15:02:44.401 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-25T15:02:44.401 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-25T15:02:44.401 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:02:45.000 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 112/171 2024-01-25T15:02:45.046 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 112/171 2024-01-25T15:02:45.593 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 112/171 2024-01-25T15:02:45.646 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 113/171 2024-01-25T15:02:45.734 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 113/171 2024-01-25T15:02:45.735 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-25T15:02:45.735 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-25T15:02:45.735 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:02:45.782 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 114/171 2024-01-25T15:02:48.964 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 135/171 2024-01-25T15:02:49.006 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 136/171 2024-01-25T15:02:49.047 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 137/171 2024-01-25T15:02:49.078 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 138/171 2024-01-25T15:02:49.106 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 139/171 2024-01-25T15:02:49.309 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 140/171 2024-01-25T15:02:49.426 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 141/171 2024-01-25T15:02:49.461 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 142/171 2024-01-25T15:02:49.494 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_6 143/171 2024-01-25T15:02:49.526 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 144/171 2024-01-25T15:02:49.555 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-team-1:1.45.10-1.el9.x86_64 145/171 2024-01-25T15:02:49.646 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-tui-1:1.45.10-1.el9.x86_64 146/171 2024-01-25T15:02:49.703 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 147/171 2024-01-25T15:02:49.736 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 148/171 2024-01-25T15:02:50.348 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-25T15:02:50.385 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-25T15:02:50.421 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-25T15:02:50.482 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 150/171 2024-01-25T15:02:51.347 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 151/171 2024-01-25T15:02:51.414 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/171 2024-01-25T15:02:51.456 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 153/171 2024-01-25T15:02:51.539 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flex-2.6.4-9.el9.x86_64 154/171 2024-01-25T15:02:51.567 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : bison-3.7.4-5.el9.x86_64 155/171 2024-01-25T15:02:51.592 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 156/171 2024-01-25T15:02:51.618 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2024-01-25T15:02:51.644 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 158/171 2024-01-25T15:02:51.644 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-25T15:02:51.737 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-25T15:02:51.764 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 160/171 2024-01-25T15:02:51.795 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 161/171 2024-01-25T15:02:51.820 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/171 2024-01-25T15:02:51.845 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 163/171 2024-01-25T15:02:51.845 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-25T15:02:51.930 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-25T15:02:51.963 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 165/171 2024-01-25T15:02:51.970 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-25T15:02:51.970 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-25T15:02:52.149 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-25T15:02:52.149 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-25T15:02:52.233 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-25T15:02:52.257 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/171 2024-01-25T15:02:52.284 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 169/171 2024-01-25T15:02:52.317 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 170/171 2024-01-25T15:02:52.384 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-25T15:02:57.267 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-25T15:02:57.268 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-2:19.0.0-885.g661946e7.el9.x86_64 1/171 2024-01-25T15:02:57.268 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 2/171 2024-01-25T15:02:57.268 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 3/171 2024-01-25T15:02:57.268 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 4/171 2024-01-25T15:02:57.268 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-885.g661946 5/171 2024-01-25T15:02:57.268 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 6/171 2024-01-25T15:02:57.268 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 7/171 2024-01-25T15:02:57.268 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-25T15:02:57.268 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-25T15:02:57.268 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 10/171 2024-01-25T15:02:57.268 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 11/171 2024-01-25T15:02:57.268 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 12/171 2024-01-25T15:02:57.269 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 13/171 2024-01-25T15:02:57.269 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 14/171 2024-01-25T15:02:57.269 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_6 15/171 2024-01-25T15:02:57.269 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 16/171 2024-01-25T15:02:57.269 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 17/171 2024-01-25T15:02:57.269 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 18/171 2024-01-25T15:02:57.269 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 19/171 2024-01-25T15:02:57.269 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librgw2-2:19.0.0-885.g661946e7.el9.x86_64 20/171 2024-01-25T15:02:57.269 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-argparse-2:19.0.0-885.g661946e7.el9 21/171 2024-01-25T15:02:57.269 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-common-2:19.0.0-885.g661946e7.el9.x 22/171 2024-01-25T15:02:57.269 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 23/171 2024-01-25T15:02:57.269 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 24/171 2024-01-25T15:02:57.269 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 25/171 2024-01-25T15:02:57.269 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 26/171 2024-01-25T15:02:57.270 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 27/171 2024-01-25T15:02:57.270 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 28/171 2024-01-25T15:02:57.270 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 29/171 2024-01-25T15:02:57.270 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-885.g661946e7.e 30/171 2024-01-25T15:02:57.270 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 31/171 2024-01-25T15:02:57.270 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 32/171 2024-01-25T15:02:57.270 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 33/171 2024-01-25T15:02:57.270 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9 34/171 2024-01-25T15:02:57.270 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 35/171 2024-01-25T15:02:57.270 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el 36/171 2024-01-25T15:02:57.271 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 37/171 2024-01-25T15:02:57.271 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephadm-2:19.0.0-885.g661946e7.el9.noarch 38/171 2024-01-25T15:02:57.271 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 39/171 2024-01-25T15:02:57.271 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/171 2024-01-25T15:02:57.271 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/171 2024-01-25T15:02:57.271 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/171 2024-01-25T15:02:57.271 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/171 2024-01-25T15:02:57.271 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/171 2024-01-25T15:02:57.271 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/171 2024-01-25T15:02:57.271 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/171 2024-01-25T15:02:57.271 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/171 2024-01-25T15:02:57.271 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/171 2024-01-25T15:02:57.271 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/171 2024-01-25T15:02:57.271 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/171 2024-01-25T15:02:57.272 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/171 2024-01-25T15:02:57.272 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/171 2024-01-25T15:02:57.272 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/171 2024-01-25T15:02:57.272 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/171 2024-01-25T15:02:57.272 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/171 2024-01-25T15:02:57.272 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/171 2024-01-25T15:02:57.272 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/171 2024-01-25T15:02:57.272 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/171 2024-01-25T15:02:57.272 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/171 2024-01-25T15:02:57.272 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/171 2024-01-25T15:02:57.273 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/171 2024-01-25T15:02:57.273 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/171 2024-01-25T15:02:57.273 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/171 2024-01-25T15:02:57.273 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/171 2024-01-25T15:02:57.273 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/171 2024-01-25T15:02:57.273 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/171 2024-01-25T15:02:57.273 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/171 2024-01-25T15:02:57.273 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/171 2024-01-25T15:02:57.273 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/171 2024-01-25T15:02:57.273 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/171 2024-01-25T15:02:57.273 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/171 2024-01-25T15:02:57.273 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/171 2024-01-25T15:02:57.273 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/171 2024-01-25T15:02:57.273 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/171 2024-01-25T15:02:57.273 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/171 2024-01-25T15:02:57.273 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/171 2024-01-25T15:02:57.274 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/171 2024-01-25T15:02:57.274 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/171 2024-01-25T15:02:57.274 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/171 2024-01-25T15:02:57.274 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/171 2024-01-25T15:02:57.274 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/171 2024-01-25T15:02:57.274 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/171 2024-01-25T15:02:57.274 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/171 2024-01-25T15:02:57.274 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 84/171 2024-01-25T15:02:57.274 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/171 2024-01-25T15:02:57.274 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/171 2024-01-25T15:02:57.274 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/171 2024-01-25T15:02:57.274 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : jq-1.6-16.el9.x86_64 88/171 2024-01-25T15:02:57.274 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 89/171 2024-01-25T15:02:57.274 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 90/171 2024-01-25T15:02:57.275 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 91/171 2024-01-25T15:02:57.275 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 92/171 2024-01-25T15:02:57.275 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 93/171 2024-01-25T15:02:57.275 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ply-3.11-14.el9.noarch 94/171 2024-01-25T15:02:57.275 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 95/171 2024-01-25T15:02:57.275 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 96/171 2024-01-25T15:02:57.275 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 97/171 2024-01-25T15:02:57.275 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 98/171 2024-01-25T15:02:57.275 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 99/171 2024-01-25T15:02:57.275 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 100/171 2024-01-25T15:02:57.275 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 101/171 2024-01-25T15:02:57.275 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 102/171 2024-01-25T15:02:57.275 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 103/171 2024-01-25T15:02:57.275 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 104/171 2024-01-25T15:02:57.276 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 105/171 2024-01-25T15:02:57.276 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 106/171 2024-01-25T15:02:57.276 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 107/171 2024-01-25T15:02:57.276 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 108/171 2024-01-25T15:02:57.276 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 109/171 2024-01-25T15:02:57.276 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 110/171 2024-01-25T15:02:57.276 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 111/171 2024-01-25T15:02:57.276 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 112/171 2024-01-25T15:02:57.276 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 113/171 2024-01-25T15:02:57.276 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 114/171 2024-01-25T15:02:57.276 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-google-auth-1:2.26.2-1.el9.noarch 115/171 2024-01-25T15:02:57.276 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 116/171 2024-01-25T15:02:57.276 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 117/171 2024-01-25T15:02:57.277 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 118/171 2024-01-25T15:02:57.277 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 119/171 2024-01-25T15:02:57.277 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 120/171 2024-01-25T15:02:57.277 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/171 2024-01-25T15:02:57.277 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/171 2024-01-25T15:02:57.277 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/171 2024-01-25T15:02:57.277 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/171 2024-01-25T15:02:57.277 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/171 2024-01-25T15:02:57.277 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/171 2024-01-25T15:02:57.277 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/171 2024-01-25T15:02:57.277 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/171 2024-01-25T15:02:57.277 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/171 2024-01-25T15:02:57.277 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/171 2024-01-25T15:02:57.277 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/171 2024-01-25T15:02:57.277 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/171 2024-01-25T15:02:57.277 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/171 2024-01-25T15:02:57.278 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/171 2024-01-25T15:02:57.278 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/171 2024-01-25T15:02:57.278 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/171 2024-01-25T15:02:57.278 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/171 2024-01-25T15:02:57.278 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/171 2024-01-25T15:02:57.278 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/171 2024-01-25T15:02:57.278 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:19.0.0-885.g661946e7.el9.x86_64 140/171 2024-01-25T15:02:57.278 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/171 2024-01-25T15:02:57.278 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:19.0.0-885.g661946e7.el9.x86_64 142/171 2024-01-25T15:02:57.278 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/171 2024-01-25T15:02:57.278 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/171 2024-01-25T15:02:57.278 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/171 2024-01-25T15:02:57.278 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-1:1.45.10-1.el9.x86_64 146/171 2024-01-25T15:02:57.278 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 147/171 2024-01-25T15:02:57.278 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 148/171 2024-01-25T15:02:57.279 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/171 2024-01-25T15:02:57.279 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-team-1:1.45.10-1.el9.x86_64 150/171 2024-01-25T15:02:57.279 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 151/171 2024-01-25T15:02:57.279 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-tui-1:1.45.10-1.el9.x86_64 152/171 2024-01-25T15:02:57.279 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 153/171 2024-01-25T15:02:57.279 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : acl-2.3.1-4.el9.x86_64 154/171 2024-01-25T15:02:57.279 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : acl-2.3.1-3.el9.x86_64 155/171 2024-01-25T15:02:57.279 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 156/171 2024-01-25T15:02:57.279 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2024-01-25T15:02:57.279 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 158/171 2024-01-25T15:02:57.279 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 159/171 2024-01-25T15:02:57.279 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 160/171 2024-01-25T15:02:57.279 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 161/171 2024-01-25T15:02:57.279 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 162/171 2024-01-25T15:02:57.279 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 163/171 2024-01-25T15:02:57.280 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 164/171 2024-01-25T15:02:57.280 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 165/171 2024-01-25T15:02:57.280 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 166/171 2024-01-25T15:02:57.280 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 167/171 2024-01-25T15:02:57.280 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 168/171 2024-01-25T15:02:57.280 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 169/171 2024-01-25T15:02:57.280 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 170/171 2024-01-25T15:02:59.778 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 171/171 2024-01-25T15:02:59.779 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:02:59.779 INFO:teuthology.orchestra.run.smithi052.stdout:Upgraded: 2024-01-25T15:02:59.779 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-1:1.45.10-1.el9.x86_64 2024-01-25T15:02:59.779 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 2024-01-25T15:02:59.779 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-team-1:1.45.10-1.el9.x86_64 2024-01-25T15:02:59.779 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-tui-1:1.45.10-1.el9.x86_64 2024-01-25T15:02:59.779 INFO:teuthology.orchestra.run.smithi052.stdout: acl-2.3.1-4.el9.x86_64 2024-01-25T15:02:59.779 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-01-25T15:02:59.779 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-01-25T15:02:59.779 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-01-25T15:02:59.779 INFO:teuthology.orchestra.run.smithi052.stdout: libacl-2.3.1-4.el9.x86_64 2024-01-25T15:02:59.780 INFO:teuthology.orchestra.run.smithi052.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-01-25T15:02:59.780 INFO:teuthology.orchestra.run.smithi052.stdout: librados2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.780 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.780 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-01-25T15:02:59.780 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-01-25T15:02:59.780 INFO:teuthology.orchestra.run.smithi052.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-01-25T15:02:59.780 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-01-25T15:02:59.780 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-01-25T15:02:59.780 INFO:teuthology.orchestra.run.smithi052.stdout: automake-1.16.2-8.el9.noarch 2024-01-25T15:02:59.780 INFO:teuthology.orchestra.run.smithi052.stdout: bison-3.7.4-5.el9.x86_64 2024-01-25T15:02:59.780 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-25T15:02:59.780 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.780 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.780 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.781 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.781 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T15:02:59.781 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.781 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.781 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.781 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T15:02:59.781 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T15:02:59.781 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T15:02:59.781 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T15:02:59.781 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T15:02:59.781 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.781 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.781 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T15:02:59.781 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.782 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.782 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.782 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T15:02:59.782 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T15:02:59.782 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.782 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.782 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T15:02:59.782 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-01-25T15:02:59.782 INFO:teuthology.orchestra.run.smithi052.stdout: flex-2.6.4-9.el9.x86_64 2024-01-25T15:02:59.782 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-25T15:02:59.782 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-25T15:02:59.782 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-25T15:02:59.782 INFO:teuthology.orchestra.run.smithi052.stdout: fuse-2.9.9-15.el9.x86_64 2024-01-25T15:02:59.782 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-25T15:02:59.783 INFO:teuthology.orchestra.run.smithi052.stdout: jq-1.6-16.el9.x86_64 2024-01-25T15:02:59.783 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-01-25T15:02:59.783 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-25T15:02:59.783 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-25T15:02:59.783 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.783 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.783 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.783 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-25T15:02:59.783 INFO:teuthology.orchestra.run.smithi052.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-25T15:02:59.783 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-25T15:02:59.783 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-25T15:02:59.783 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-25T15:02:59.783 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.783 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.784 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-25T15:02:59.784 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.784 INFO:teuthology.orchestra.run.smithi052.stdout: libtool-2.4.6-45.el9.x86_64 2024-01-25T15:02:59.784 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-25T15:02:59.784 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-01-25T15:02:59.784 INFO:teuthology.orchestra.run.smithi052.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-01-25T15:02:59.784 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-25T15:02:59.784 INFO:teuthology.orchestra.run.smithi052.stdout: lua-5.4.4-4.el9.x86_64 2024-01-25T15:02:59.784 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-25T15:02:59.784 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-25T15:02:59.784 INFO:teuthology.orchestra.run.smithi052.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-01-25T15:02:59.784 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-25T15:02:59.784 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-25T15:02:59.785 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-01-25T15:02:59.785 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-25T15:02:59.785 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-13.11-1.el9.x86_64 2024-01-25T15:02:59.785 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-01-25T15:02:59.785 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-01-25T15:02:59.785 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-server-13.11-1.el9.x86_64 2024-01-25T15:02:59.785 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-25T15:02:59.785 INFO:teuthology.orchestra.run.smithi052.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-01-25T15:02:59.785 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-25T15:02:59.785 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-25T15:02:59.785 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-25T15:02:59.785 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.785 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.786 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.786 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-25T15:02:59.786 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-25T15:02:59.786 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-25T15:02:59.786 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-25T15:02:59.786 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-01-25T15:02:59.786 INFO:teuthology.orchestra.run.smithi052.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-01-25T15:02:59.786 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-25T15:02:59.786 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-25T15:02:59.786 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth-1:2.26.2-1.el9.noarch 2024-01-25T15:02:59.786 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-25T15:02:59.786 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-25T15:02:59.786 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-25T15:02:59.787 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-25T15:02:59.787 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-25T15:02:59.787 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-25T15:02:59.787 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-25T15:02:59.787 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-25T15:02:59.787 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-25T15:02:59.787 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-25T15:02:59.787 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-25T15:02:59.787 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-25T15:02:59.787 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-25T15:02:59.787 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-25T15:02:59.787 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-25T15:02:59.787 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-25T15:02:59.787 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-25T15:02:59.788 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-25T15:02:59.788 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply-3.11-14.el9.noarch 2024-01-25T15:02:59.788 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-25T15:02:59.788 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-25T15:02:59.788 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-25T15:02:59.788 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-25T15:02:59.788 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-25T15:02:59.788 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-25T15:02:59.788 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-01-25T15:02:59.788 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-25T15:02:59.788 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.788 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.789 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-25T15:02:59.789 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-2.25.1-7.el9.noarch 2024-01-25T15:02:59.789 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-25T15:02:59.789 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.789 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-25T15:02:59.789 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-25T15:02:59.789 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-25T15:02:59.789 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-25T15:02:59.789 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-25T15:02:59.789 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-25T15:02:59.789 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-25T15:02:59.789 INFO:teuthology.orchestra.run.smithi052.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-01-25T15:02:59.789 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-25T15:02:59.789 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-25T15:02:59.789 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-25T15:02:59.790 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-25T15:02:59.790 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.790 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.790 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:02:59.790 INFO:teuthology.orchestra.run.smithi052.stdout: re2-1:20211101-3.el9.x86_64 2024-01-25T15:02:59.790 INFO:teuthology.orchestra.run.smithi052.stdout: socat-1.7.4.1-5.el9.x86_64 2024-01-25T15:02:59.790 INFO:teuthology.orchestra.run.smithi052.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-25T15:02:59.790 INFO:teuthology.orchestra.run.smithi052.stdout: uuid-1.6.2-55.el9.x86_64 2024-01-25T15:02:59.790 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-01-25T15:02:59.790 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-01-25T15:02:59.791 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-01-25T15:02:59.791 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:02:59.791 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-01-25T15:03:00.208 DEBUG:teuthology.parallel:result is None 2024-01-25T15:03:01.672 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 114/171 2024-01-25T15:03:01.672 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /sys 2024-01-25T15:03:01.672 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /proc 2024-01-25T15:03:01.672 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /mnt 2024-01-25T15:03:01.673 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /var/tmp 2024-01-25T15:03:01.673 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /home 2024-01-25T15:03:01.673 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /root 2024-01-25T15:03:01.673 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /tmp 2024-01-25T15:03:01.673 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:01.850 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 115/171 2024-01-25T15:03:01.865 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 115/171 2024-01-25T15:03:01.865 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T15:03:01.865 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-25T15:03:01.865 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:03.399 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 116/171 2024-01-25T15:03:03.425 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 116/171 2024-01-25T15:03:03.425 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T15:03:03.425 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-25T15:03:03.425 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-25T15:03:03.425 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-25T15:03:03.425 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:03.658 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 117/171 2024-01-25T15:03:03.681 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 117/171 2024-01-25T15:03:03.681 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T15:03:03.681 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-25T15:03:03.682 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-25T15:03:03.682 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-25T15:03:03.682 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:04.152 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 118/171 2024-01-25T15:03:04.174 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 118/171 2024-01-25T15:03:04.175 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T15:03:04.175 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-25T15:03:04.175 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-25T15:03:04.175 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-25T15:03:04.175 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:04.282 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : automake-1.16.2-8.el9.noarch 119/171 2024-01-25T15:03:04.714 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephadm-2:19.0.0-885.g661946e7.el9.noarch 120/171 2024-01-25T15:03:04.752 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephadm-2:19.0.0-885.g661946e7.el9.noarch 120/171 2024-01-25T15:03:04.790 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el 121/171 2024-01-25T15:03:04.863 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-885.g661946e7.e 122/171 2024-01-25T15:03:04.901 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 123/171 2024-01-25T15:03:05.136 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 123/171 2024-01-25T15:03:05.177 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 124/171 2024-01-25T15:03:06.201 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 124/171 2024-01-25T15:03:06.237 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 125/171 2024-01-25T15:03:06.340 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 125/171 2024-01-25T15:03:06.519 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9 126/171 2024-01-25T15:03:06.559 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 127/171 2024-01-25T15:03:06.581 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 127/171 2024-01-25T15:03:06.581 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T15:03:06.581 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-25T15:03:06.581 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-25T15:03:06.581 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-25T15:03:06.581 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:06.635 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 128/171 2024-01-25T15:03:06.645 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 128/171 2024-01-25T15:03:06.741 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-2:19.0.0-885.g661946e7.el9.x86_64 129/171 2024-01-25T15:03:07.572 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/171 2024-01-25T15:03:07.614 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 131/171 2024-01-25T15:03:07.636 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 131/171 2024-01-25T15:03:07.636 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T15:03:07.636 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-25T15:03:07.637 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-25T15:03:07.637 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-25T15:03:07.637 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:07.690 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-885.g661946 132/171 2024-01-25T15:03:07.712 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-885.g661946 132/171 2024-01-25T15:03:07.712 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T15:03:07.712 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-25T15:03:07.712 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:07.768 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 133/171 2024-01-25T15:03:07.790 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 133/171 2024-01-25T15:03:07.790 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T15:03:07.790 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-01-25T15:03:07.790 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-25T15:03:07.790 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-25T15:03:07.790 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:08.111 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 134/171 2024-01-25T15:03:08.134 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 134/171 2024-01-25T15:03:08.134 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T15:03:08.134 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-25T15:03:08.134 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-25T15:03:08.134 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-25T15:03:08.134 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:12.754 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 135/171 2024-01-25T15:03:12.804 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 136/171 2024-01-25T15:03:12.854 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 137/171 2024-01-25T15:03:12.886 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 138/171 2024-01-25T15:03:12.922 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 139/171 2024-01-25T15:03:13.114 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 140/171 2024-01-25T15:03:13.250 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 141/171 2024-01-25T15:03:13.294 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 142/171 2024-01-25T15:03:13.327 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_6 143/171 2024-01-25T15:03:13.360 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 144/171 2024-01-25T15:03:13.399 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : NetworkManager-team-1:1.45.10-1.el9.x86_64 145/171 2024-01-25T15:03:13.479 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : NetworkManager-tui-1:1.45.10-1.el9.x86_64 146/171 2024-01-25T15:03:13.545 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 147/171 2024-01-25T15:03:13.585 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 148/171 2024-01-25T15:03:14.229 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-25T15:03:14.286 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-25T15:03:14.340 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-25T15:03:14.401 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 150/171 2024-01-25T15:03:15.279 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 151/171 2024-01-25T15:03:15.404 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/171 2024-01-25T15:03:15.447 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 153/171 2024-01-25T15:03:15.541 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flex-2.6.4-9.el9.x86_64 154/171 2024-01-25T15:03:15.579 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : bison-3.7.4-5.el9.x86_64 155/171 2024-01-25T15:03:15.613 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 156/171 2024-01-25T15:03:15.647 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2024-01-25T15:03:15.674 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 158/171 2024-01-25T15:03:15.674 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-25T15:03:15.769 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-25T15:03:15.808 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 160/171 2024-01-25T15:03:15.844 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 161/171 2024-01-25T15:03:15.887 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/171 2024-01-25T15:03:15.921 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 163/171 2024-01-25T15:03:15.921 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-25T15:03:16.015 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-25T15:03:16.048 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 165/171 2024-01-25T15:03:16.055 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-25T15:03:16.056 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-25T15:03:16.245 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-25T15:03:16.245 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-25T15:03:16.346 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-25T15:03:16.379 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/171 2024-01-25T15:03:16.415 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 169/171 2024-01-25T15:03:16.448 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 170/171 2024-01-25T15:03:16.525 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-25T15:03:25.672 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-25T15:03:25.673 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-2:19.0.0-885.g661946e7.el9.x86_64 1/171 2024-01-25T15:03:25.673 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 2/171 2024-01-25T15:03:25.673 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 3/171 2024-01-25T15:03:25.673 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 4/171 2024-01-25T15:03:25.673 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-885.g661946 5/171 2024-01-25T15:03:25.673 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 6/171 2024-01-25T15:03:25.673 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 7/171 2024-01-25T15:03:25.673 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-25T15:03:25.673 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-25T15:03:25.674 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 10/171 2024-01-25T15:03:25.674 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 11/171 2024-01-25T15:03:25.674 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 12/171 2024-01-25T15:03:25.674 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 13/171 2024-01-25T15:03:25.674 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 14/171 2024-01-25T15:03:25.674 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_6 15/171 2024-01-25T15:03:25.675 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 16/171 2024-01-25T15:03:25.675 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 17/171 2024-01-25T15:03:25.675 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 18/171 2024-01-25T15:03:25.675 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 19/171 2024-01-25T15:03:25.675 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librgw2-2:19.0.0-885.g661946e7.el9.x86_64 20/171 2024-01-25T15:03:25.675 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-argparse-2:19.0.0-885.g661946e7.el9 21/171 2024-01-25T15:03:25.675 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-common-2:19.0.0-885.g661946e7.el9.x 22/171 2024-01-25T15:03:25.675 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 23/171 2024-01-25T15:03:25.675 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 24/171 2024-01-25T15:03:25.675 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 25/171 2024-01-25T15:03:25.675 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 26/171 2024-01-25T15:03:25.676 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 27/171 2024-01-25T15:03:25.692 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 28/171 2024-01-25T15:03:25.692 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 29/171 2024-01-25T15:03:25.692 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-885.g661946e7.e 30/171 2024-01-25T15:03:25.692 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 31/171 2024-01-25T15:03:25.692 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 32/171 2024-01-25T15:03:25.692 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 33/171 2024-01-25T15:03:25.692 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9 34/171 2024-01-25T15:03:25.692 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 35/171 2024-01-25T15:03:25.692 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el 36/171 2024-01-25T15:03:25.692 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 37/171 2024-01-25T15:03:25.693 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephadm-2:19.0.0-885.g661946e7.el9.noarch 38/171 2024-01-25T15:03:25.693 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 39/171 2024-01-25T15:03:25.693 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/171 2024-01-25T15:03:25.693 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/171 2024-01-25T15:03:25.693 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/171 2024-01-25T15:03:25.693 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/171 2024-01-25T15:03:25.693 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/171 2024-01-25T15:03:25.693 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/171 2024-01-25T15:03:25.693 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/171 2024-01-25T15:03:25.693 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/171 2024-01-25T15:03:25.693 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/171 2024-01-25T15:03:25.693 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/171 2024-01-25T15:03:25.694 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/171 2024-01-25T15:03:25.694 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/171 2024-01-25T15:03:25.694 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/171 2024-01-25T15:03:25.694 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/171 2024-01-25T15:03:25.694 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/171 2024-01-25T15:03:25.694 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/171 2024-01-25T15:03:25.694 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/171 2024-01-25T15:03:25.694 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/171 2024-01-25T15:03:25.694 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/171 2024-01-25T15:03:25.694 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/171 2024-01-25T15:03:25.694 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/171 2024-01-25T15:03:25.694 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/171 2024-01-25T15:03:25.694 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/171 2024-01-25T15:03:25.694 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/171 2024-01-25T15:03:25.695 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/171 2024-01-25T15:03:25.695 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/171 2024-01-25T15:03:25.695 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/171 2024-01-25T15:03:25.695 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/171 2024-01-25T15:03:25.695 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/171 2024-01-25T15:03:25.695 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/171 2024-01-25T15:03:25.695 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/171 2024-01-25T15:03:25.695 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/171 2024-01-25T15:03:25.695 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/171 2024-01-25T15:03:25.695 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/171 2024-01-25T15:03:25.695 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/171 2024-01-25T15:03:25.695 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/171 2024-01-25T15:03:25.696 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/171 2024-01-25T15:03:25.696 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/171 2024-01-25T15:03:25.696 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/171 2024-01-25T15:03:25.696 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/171 2024-01-25T15:03:25.696 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/171 2024-01-25T15:03:25.696 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/171 2024-01-25T15:03:25.696 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/171 2024-01-25T15:03:25.696 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/171 2024-01-25T15:03:25.696 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 84/171 2024-01-25T15:03:25.696 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/171 2024-01-25T15:03:25.696 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/171 2024-01-25T15:03:25.697 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/171 2024-01-25T15:03:25.697 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : jq-1.6-16.el9.x86_64 88/171 2024-01-25T15:03:25.697 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 89/171 2024-01-25T15:03:25.697 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 90/171 2024-01-25T15:03:25.697 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 91/171 2024-01-25T15:03:25.697 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 92/171 2024-01-25T15:03:25.697 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 93/171 2024-01-25T15:03:25.697 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ply-3.11-14.el9.noarch 94/171 2024-01-25T15:03:25.697 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 95/171 2024-01-25T15:03:25.697 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 96/171 2024-01-25T15:03:25.697 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 97/171 2024-01-25T15:03:25.697 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 98/171 2024-01-25T15:03:25.697 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 99/171 2024-01-25T15:03:25.697 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 100/171 2024-01-25T15:03:25.698 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 101/171 2024-01-25T15:03:25.698 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 102/171 2024-01-25T15:03:25.698 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 103/171 2024-01-25T15:03:25.698 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 104/171 2024-01-25T15:03:25.698 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 105/171 2024-01-25T15:03:25.698 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 106/171 2024-01-25T15:03:25.698 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 107/171 2024-01-25T15:03:25.698 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 108/171 2024-01-25T15:03:25.698 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 109/171 2024-01-25T15:03:25.698 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 110/171 2024-01-25T15:03:25.698 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 111/171 2024-01-25T15:03:25.698 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 112/171 2024-01-25T15:03:25.698 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 113/171 2024-01-25T15:03:25.698 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 114/171 2024-01-25T15:03:25.699 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-google-auth-1:2.26.2-1.el9.noarch 115/171 2024-01-25T15:03:25.699 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 116/171 2024-01-25T15:03:25.699 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 117/171 2024-01-25T15:03:25.699 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 118/171 2024-01-25T15:03:25.699 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 119/171 2024-01-25T15:03:25.699 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 120/171 2024-01-25T15:03:25.699 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/171 2024-01-25T15:03:25.699 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/171 2024-01-25T15:03:25.699 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/171 2024-01-25T15:03:25.699 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/171 2024-01-25T15:03:25.699 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/171 2024-01-25T15:03:25.699 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/171 2024-01-25T15:03:25.699 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/171 2024-01-25T15:03:25.699 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/171 2024-01-25T15:03:25.699 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/171 2024-01-25T15:03:25.700 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/171 2024-01-25T15:03:25.700 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/171 2024-01-25T15:03:25.700 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/171 2024-01-25T15:03:25.700 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/171 2024-01-25T15:03:25.700 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/171 2024-01-25T15:03:25.700 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/171 2024-01-25T15:03:25.700 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/171 2024-01-25T15:03:25.700 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/171 2024-01-25T15:03:25.700 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/171 2024-01-25T15:03:25.700 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/171 2024-01-25T15:03:25.700 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-2:19.0.0-885.g661946e7.el9.x86_64 140/171 2024-01-25T15:03:25.700 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/171 2024-01-25T15:03:25.700 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-2:19.0.0-885.g661946e7.el9.x86_64 142/171 2024-01-25T15:03:25.700 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/171 2024-01-25T15:03:25.701 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/171 2024-01-25T15:03:25.701 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/171 2024-01-25T15:03:25.701 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-1:1.45.10-1.el9.x86_64 146/171 2024-01-25T15:03:25.701 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 147/171 2024-01-25T15:03:25.701 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 148/171 2024-01-25T15:03:25.701 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/171 2024-01-25T15:03:25.701 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-team-1:1.45.10-1.el9.x86_64 150/171 2024-01-25T15:03:25.701 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 151/171 2024-01-25T15:03:25.701 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-tui-1:1.45.10-1.el9.x86_64 152/171 2024-01-25T15:03:25.701 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 153/171 2024-01-25T15:03:25.701 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : acl-2.3.1-4.el9.x86_64 154/171 2024-01-25T15:03:25.701 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : acl-2.3.1-3.el9.x86_64 155/171 2024-01-25T15:03:25.701 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 156/171 2024-01-25T15:03:25.701 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2024-01-25T15:03:25.701 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 158/171 2024-01-25T15:03:25.701 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 159/171 2024-01-25T15:03:25.702 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 160/171 2024-01-25T15:03:25.702 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 161/171 2024-01-25T15:03:25.702 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 162/171 2024-01-25T15:03:25.702 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 163/171 2024-01-25T15:03:25.702 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 164/171 2024-01-25T15:03:25.702 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 165/171 2024-01-25T15:03:25.702 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 166/171 2024-01-25T15:03:25.702 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 167/171 2024-01-25T15:03:25.702 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 168/171 2024-01-25T15:03:25.702 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 169/171 2024-01-25T15:03:25.702 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 170/171 2024-01-25T15:03:28.427 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 171/171 2024-01-25T15:03:28.427 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:28.427 INFO:teuthology.orchestra.run.smithi029.stdout:Upgraded: 2024-01-25T15:03:28.427 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-1:1.45.10-1.el9.x86_64 2024-01-25T15:03:28.428 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 2024-01-25T15:03:28.428 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-team-1:1.45.10-1.el9.x86_64 2024-01-25T15:03:28.428 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-tui-1:1.45.10-1.el9.x86_64 2024-01-25T15:03:28.428 INFO:teuthology.orchestra.run.smithi029.stdout: acl-2.3.1-4.el9.x86_64 2024-01-25T15:03:28.428 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-01-25T15:03:28.428 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-01-25T15:03:28.428 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-01-25T15:03:28.428 INFO:teuthology.orchestra.run.smithi029.stdout: libacl-2.3.1-4.el9.x86_64 2024-01-25T15:03:28.428 INFO:teuthology.orchestra.run.smithi029.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-01-25T15:03:28.428 INFO:teuthology.orchestra.run.smithi029.stdout: librados2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.428 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.428 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-01-25T15:03:28.429 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-01-25T15:03:28.429 INFO:teuthology.orchestra.run.smithi029.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-01-25T15:03:28.429 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-01-25T15:03:28.429 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-01-25T15:03:28.429 INFO:teuthology.orchestra.run.smithi029.stdout: automake-1.16.2-8.el9.noarch 2024-01-25T15:03:28.429 INFO:teuthology.orchestra.run.smithi029.stdout: bison-3.7.4-5.el9.x86_64 2024-01-25T15:03:28.429 INFO:teuthology.orchestra.run.smithi029.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-25T15:03:28.429 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.429 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.429 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.429 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.429 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T15:03:28.429 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.429 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.429 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.430 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T15:03:28.430 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T15:03:28.430 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T15:03:28.430 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T15:03:28.430 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T15:03:28.430 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.430 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.430 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T15:03:28.430 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.430 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.430 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.430 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T15:03:28.430 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T15:03:28.430 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.430 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.431 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T15:03:28.431 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-01-25T15:03:28.431 INFO:teuthology.orchestra.run.smithi029.stdout: flex-2.6.4-9.el9.x86_64 2024-01-25T15:03:28.431 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-25T15:03:28.431 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-25T15:03:28.431 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-25T15:03:28.431 INFO:teuthology.orchestra.run.smithi029.stdout: fuse-2.9.9-15.el9.x86_64 2024-01-25T15:03:28.431 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-25T15:03:28.431 INFO:teuthology.orchestra.run.smithi029.stdout: jq-1.6-16.el9.x86_64 2024-01-25T15:03:28.431 INFO:teuthology.orchestra.run.smithi029.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-01-25T15:03:28.431 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-25T15:03:28.431 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-25T15:03:28.431 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.431 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.431 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.432 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-25T15:03:28.432 INFO:teuthology.orchestra.run.smithi029.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-25T15:03:28.432 INFO:teuthology.orchestra.run.smithi029.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-25T15:03:28.432 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-25T15:03:28.432 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-25T15:03:28.432 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.432 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.432 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-25T15:03:28.432 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.432 INFO:teuthology.orchestra.run.smithi029.stdout: libtool-2.4.6-45.el9.x86_64 2024-01-25T15:03:28.432 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-25T15:03:28.432 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-01-25T15:03:28.432 INFO:teuthology.orchestra.run.smithi029.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-01-25T15:03:28.432 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-25T15:03:28.433 INFO:teuthology.orchestra.run.smithi029.stdout: lua-5.4.4-4.el9.x86_64 2024-01-25T15:03:28.433 INFO:teuthology.orchestra.run.smithi029.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-25T15:03:28.433 INFO:teuthology.orchestra.run.smithi029.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-25T15:03:28.433 INFO:teuthology.orchestra.run.smithi029.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-01-25T15:03:28.433 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-25T15:03:28.433 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-25T15:03:28.433 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-01-25T15:03:28.433 INFO:teuthology.orchestra.run.smithi029.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-25T15:03:28.433 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-13.11-1.el9.x86_64 2024-01-25T15:03:28.433 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-01-25T15:03:28.433 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-01-25T15:03:28.433 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-server-13.11-1.el9.x86_64 2024-01-25T15:03:28.433 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-25T15:03:28.433 INFO:teuthology.orchestra.run.smithi029.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-01-25T15:03:28.433 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-25T15:03:28.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-25T15:03:28.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-25T15:03:28.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-25T15:03:28.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-25T15:03:28.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-25T15:03:28.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-25T15:03:28.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-01-25T15:03:28.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-01-25T15:03:28.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-25T15:03:28.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-25T15:03:28.434 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth-1:2.26.2-1.el9.noarch 2024-01-25T15:03:28.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-25T15:03:28.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-25T15:03:28.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-25T15:03:28.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-25T15:03:28.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-25T15:03:28.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-25T15:03:28.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-25T15:03:28.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-25T15:03:28.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-25T15:03:28.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-25T15:03:28.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-25T15:03:28.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-25T15:03:28.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-25T15:03:28.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-25T15:03:28.435 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-25T15:03:28.436 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-25T15:03:28.436 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-25T15:03:28.436 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-25T15:03:28.436 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ply-3.11-14.el9.noarch 2024-01-25T15:03:28.436 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-25T15:03:28.436 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-25T15:03:28.436 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-25T15:03:28.436 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-25T15:03:28.436 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-25T15:03:28.436 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-25T15:03:28.436 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-01-25T15:03:28.436 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-25T15:03:28.436 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.436 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.437 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-25T15:03:28.437 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-2.25.1-7.el9.noarch 2024-01-25T15:03:28.437 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-25T15:03:28.437 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.437 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-25T15:03:28.437 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-25T15:03:28.437 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-25T15:03:28.437 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-25T15:03:28.437 INFO:teuthology.orchestra.run.smithi029.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-25T15:03:28.437 INFO:teuthology.orchestra.run.smithi029.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-25T15:03:28.437 INFO:teuthology.orchestra.run.smithi029.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-25T15:03:28.437 INFO:teuthology.orchestra.run.smithi029.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-01-25T15:03:28.437 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-25T15:03:28.437 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-25T15:03:28.437 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-25T15:03:28.438 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-25T15:03:28.438 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.438 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.438 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T15:03:28.438 INFO:teuthology.orchestra.run.smithi029.stdout: re2-1:20211101-3.el9.x86_64 2024-01-25T15:03:28.438 INFO:teuthology.orchestra.run.smithi029.stdout: socat-1.7.4.1-5.el9.x86_64 2024-01-25T15:03:28.438 INFO:teuthology.orchestra.run.smithi029.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-25T15:03:28.438 INFO:teuthology.orchestra.run.smithi029.stdout: uuid-1.6.2-55.el9.x86_64 2024-01-25T15:03:28.438 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-01-25T15:03:28.438 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-01-25T15:03:28.439 INFO:teuthology.orchestra.run.smithi029.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-01-25T15:03:28.439 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:28.439 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-01-25T15:03:29.000 DEBUG:teuthology.parallel:result is None 2024-01-25T15:03:29.001 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-25T15:03:29.218 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-25T15:03:29.242 INFO:teuthology.orchestra.run.smithi029.stdout:19.0.0-885.g661946e7.el9 2024-01-25T15:03:29.242 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-885.g661946e7.el9 2024-01-25T15:03:29.242 INFO:teuthology.task.install:The correct ceph version 19.0.0-885.g661946e7 is installed. 2024-01-25T15:03:29.244 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-25T15:03:29.386 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-25T15:03:29.412 INFO:teuthology.orchestra.run.smithi052.stdout:19.0.0-885.g661946e7.el9 2024-01-25T15:03:29.412 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-885.g661946e7.el9 2024-01-25T15:03:29.412 INFO:teuthology.task.install:The correct ceph version 19.0.0-885.g661946e7 is installed. 2024-01-25T15:03:29.414 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-25T15:03:29.414 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:03:29.414 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-25T15:03:29.449 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:03:29.449 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-25T15:03:29.486 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-25T15:03:29.486 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:03:29.486 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/daemon-helper 2024-01-25T15:03:29.519 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-25T15:03:29.589 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:03:29.589 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/daemon-helper 2024-01-25T15:03:29.619 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-25T15:03:29.688 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-25T15:03:29.688 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:03:29.689 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-25T15:03:29.717 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-25T15:03:29.786 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:03:29.786 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-25T15:03:29.815 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-25T15:03:29.884 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-25T15:03:29.885 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:03:29.885 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/stdin-killer 2024-01-25T15:03:29.913 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-25T15:03:29.982 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:03:29.982 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/stdin-killer 2024-01-25T15:03:30.009 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-25T15:03:30.076 INFO:teuthology.run_tasks:Running task ceph... 2024-01-25T15:03:30.163 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-25T15:03:30.163 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 777 /var/log/ceph 2024-01-25T15:03:30.165 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 777 /var/log/ceph 2024-01-25T15:03:30.192 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-25T15:03:30.193 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-25T15:03:30.234 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-25T15:03:30.264 INFO:tasks.ceph:Creating extra log directories... 2024-01-25T15:03:30.264 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-25T15:03:30.304 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-25T15:03:30.339 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-01-25T15:03:30.339 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-01-25T15:03:30.339 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-01-25T15:03:30.339 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:03:30.339 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-25T15:03:30.386 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-25T15:03:30.505 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-01-25T15:03:30.533 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:03:30.533 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-25T15:03:30.548 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-25T15:03:30.668 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-01-25T15:03:30.700 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-25T15:03:30.700 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-25T15:03:30.701 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531486', 'branch': 'wip-vshankar-testing-20240125.044502', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7531486', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd42140e628558a450ba1d39a9d0835a2fa62cda'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240125.044502'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '661946e7044723130c03627323f6a879a9848cb5'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '661946e7044723130c03627323f6a879a9848cb5'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240125.044502', 'sha1': '661946e7044723130c03627323f6a879a9848cb5'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 9619, 'sha1': '661946e7044723130c03627323f6a879a9848cb5', 'sleep_before_teardown': 0, 'subset': '293/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20240125.044502', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '661946e7044723130c03627323f6a879a9848cb5', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi029.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPh5hJ2R9FHK3+NsMdR3AgyHxkkEsnxPtPiQ8l6qvu/oE0SJX8++UVrWzsSQ3EfDctSFfFFX7sOGw7RRgLQAIqo=', 'smithi052.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUzhAxUidfqU8imDHbFUGBRHXVVI0YbSSg4pBnLQGVADVRqT6yDdKF1qMRXF5NWubV5/Xd9OgXmQo/77EmvWtE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd42140e628558a450ba1d39a9d0835a2fa62cda'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '661946e7044723130c03627323f6a879a9848cb5'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '661946e7044723130c03627323f6a879a9848cb5', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'c856e0f9244dd29a50697123b480d63f16a4ed81', 'timestamp': '2024-01-25_13:52:19', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-25T15:03:30.701 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-25T15:03:30.704 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-25T15:03:30.749 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/run/ceph 2024-01-25T15:03:30.759 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/run/ceph 2024-01-25T15:03:30.815 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:03:30.815 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/scratch_devs of=/dev/stdout 2024-01-25T15:03:30.842 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-25T15:03:30.842 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_1 2024-01-25T15:03:30.898 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-25T15:03:30.898 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-25T15:03:30.898 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-01-25T15:03:30.898 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-25T15:03:30.898 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-01-25T15:03:30.898 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-01-25 15:03:16.862178151 +0000 2024-01-25T15:03:30.898 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-01-25 15:00:47.670223890 +0000 2024-01-25T15:03:30.898 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-01-25 15:00:47.670223890 +0000 2024-01-25T15:03:30.898 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-01-25 15:00:47.670223890 +0000 2024-01-25T15:03:30.899 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-25T15:03:30.965 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-01-25T15:03:30.965 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-01-25T15:03:30.965 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000100128 s, 5.1 MB/s 2024-01-25T15:03:30.966 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-25T15:03:31.022 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_2 2024-01-25T15:03:31.077 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-25T15:03:31.077 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-25T15:03:31.077 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-01-25T15:03:31.077 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-25T15:03:31.077 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-01-25T15:03:31.077 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-01-25 15:03:16.862178151 +0000 2024-01-25T15:03:31.078 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-01-25 15:00:48.004218426 +0000 2024-01-25T15:03:31.078 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-01-25 15:00:48.004218426 +0000 2024-01-25T15:03:31.078 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-01-25 15:00:48.004218426 +0000 2024-01-25T15:03:31.078 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-25T15:03:31.143 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-01-25T15:03:31.143 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-01-25T15:03:31.143 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 9.0849e-05 s, 5.6 MB/s 2024-01-25T15:03:31.144 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-25T15:03:31.200 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_3 2024-01-25T15:03:31.255 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-25T15:03:31.255 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-25T15:03:31.255 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-01-25T15:03:31.255 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-25T15:03:31.255 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-01-25T15:03:31.255 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-01-25 15:03:16.863178135 +0000 2024-01-25T15:03:31.255 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-01-25 15:00:48.335213012 +0000 2024-01-25T15:03:31.256 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-01-25 15:00:48.335213012 +0000 2024-01-25T15:03:31.256 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-01-25 15:00:48.335213012 +0000 2024-01-25T15:03:31.256 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-25T15:03:31.320 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-01-25T15:03:31.320 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-01-25T15:03:31.320 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 9.2709e-05 s, 5.5 MB/s 2024-01-25T15:03:31.321 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-25T15:03:31.377 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_4 2024-01-25T15:03:31.432 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-25T15:03:31.432 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-25T15:03:31.432 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-01-25T15:03:31.432 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-25T15:03:31.432 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-01-25T15:03:31.432 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-01-25 15:03:16.863178135 +0000 2024-01-25T15:03:31.432 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-01-25 15:00:48.664207631 +0000 2024-01-25T15:03:31.432 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-01-25 15:00:48.664207631 +0000 2024-01-25T15:03:31.432 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-01-25 15:00:48.664207631 +0000 2024-01-25T15:03:31.433 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-25T15:03:31.497 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-01-25T15:03:31.497 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-01-25T15:03:31.497 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 7.4803e-05 s, 6.8 MB/s 2024-01-25T15:03:31.499 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-25T15:03:31.554 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-25T15:03:31.554 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:03:31.554 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/scratch_devs of=/dev/stdout 2024-01-25T15:03:31.570 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-25T15:03:31.571 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_1 2024-01-25T15:03:31.627 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-25T15:03:31.627 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-25T15:03:31.627 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-01-25T15:03:31.627 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-25T15:03:31.627 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-01-25T15:03:31.628 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-01-25 15:02:52.718362951 +0000 2024-01-25T15:03:31.628 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-01-25 15:00:41.324207826 +0000 2024-01-25T15:03:31.628 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-01-25 15:00:41.324207826 +0000 2024-01-25T15:03:31.628 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-01-25 15:00:41.324207826 +0000 2024-01-25T15:03:31.629 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-25T15:03:31.694 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-01-25T15:03:31.694 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-01-25T15:03:31.694 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 9.1375e-05 s, 5.6 MB/s 2024-01-25T15:03:31.696 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-25T15:03:31.753 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_2 2024-01-25T15:03:31.808 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-25T15:03:31.808 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-25T15:03:31.808 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-01-25T15:03:31.808 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-25T15:03:31.808 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-01-25T15:03:31.809 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-01-25 15:02:52.718362951 +0000 2024-01-25T15:03:31.809 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-01-25 15:00:41.784202253 +0000 2024-01-25T15:03:31.809 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-01-25 15:00:41.784202253 +0000 2024-01-25T15:03:31.809 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-01-25 15:00:41.784202253 +0000 2024-01-25T15:03:31.809 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-25T15:03:31.874 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-01-25T15:03:31.874 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-01-25T15:03:31.874 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 8.9658e-05 s, 5.7 MB/s 2024-01-25T15:03:31.875 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-25T15:03:31.931 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_3 2024-01-25T15:03:31.986 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-25T15:03:31.986 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-25T15:03:31.987 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-01-25T15:03:31.987 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-25T15:03:31.987 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-01-25T15:03:31.987 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-01-25 15:02:52.719362939 +0000 2024-01-25T15:03:31.987 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-01-25 15:00:42.133198026 +0000 2024-01-25T15:03:31.987 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-01-25 15:00:42.133198026 +0000 2024-01-25T15:03:31.988 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-01-25 15:00:42.133198026 +0000 2024-01-25T15:03:31.988 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-25T15:03:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-01-25T15:03:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-01-25T15:03:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 9.4837e-05 s, 5.4 MB/s 2024-01-25T15:03:32.053 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-25T15:03:32.109 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_4 2024-01-25T15:03:32.164 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-25T15:03:32.164 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-25T15:03:32.164 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-01-25T15:03:32.164 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-25T15:03:32.164 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-01-25T15:03:32.164 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-01-25 15:02:52.719362939 +0000 2024-01-25T15:03:32.165 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-01-25 15:00:42.484193792 +0000 2024-01-25T15:03:32.165 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-01-25 15:00:42.484193792 +0000 2024-01-25T15:03:32.165 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-01-25 15:00:42.484193792 +0000 2024-01-25T15:03:32.165 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-25T15:03:32.229 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-01-25T15:03:32.230 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-01-25T15:03:32.230 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 9.4619e-05 s, 5.4 MB/s 2024-01-25T15:03:32.231 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-25T15:03:32.286 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-25T15:03:32.286 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-25T15:03:32.287 INFO:tasks.ceph:Generating config... 2024-01-25T15:03:32.288 INFO:tasks.ceph:[client] client mount timeout = 600 2024-01-25T15:03:32.288 INFO:tasks.ceph:[client] debug client = 20 2024-01-25T15:03:32.288 INFO:tasks.ceph:[client] debug ms = 1 2024-01-25T15:03:32.288 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-01-25T15:03:32.288 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-01-25T15:03:32.288 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-01-25T15:03:32.288 INFO:tasks.ceph:[mds] debug mds = 20 2024-01-25T15:03:32.288 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-01-25T15:03:32.288 INFO:tasks.ceph:[mds] debug ms = 1 2024-01-25T15:03:32.288 INFO:tasks.ceph:[mds] mds debug frag = True 2024-01-25T15:03:32.288 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-01-25T15:03:32.289 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-01-25T15:03:32.289 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-01-25T15:03:32.289 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-01-25T15:03:32.289 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-01-25T15:03:32.289 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-01-25T15:03:32.289 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-25T15:03:32.289 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-25T15:03:32.289 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-25T15:03:32.289 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-25T15:03:32.289 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-25T15:03:32.289 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-01-25T15:03:32.289 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-01-25T15:03:32.289 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-01-25T15:03:32.289 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-01-25T15:03:32.289 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-01-25T15:03:32.290 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-25T15:03:32.290 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-25T15:03:32.290 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-01-25T15:03:32.290 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-01-25T15:03:32.290 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-01-25T15:03:32.290 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-01-25T15:03:32.290 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-01-25T15:03:32.290 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-01-25T15:03:32.290 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-01-25T15:03:32.290 INFO:tasks.ceph:Setting up mon.a... 2024-01-25T15:03:32.291 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-25T15:03:32.349 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.keyring 2024-01-25T15:03:32.351 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-25T15:03:32.399 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-25T15:03:32.427 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.29'), ('mon.b', '172.21.15.52'), ('mon.c', '[v2:172.21.15.52:3301,v1:172.21.15.52:6790]')] 2024-01-25T15:03:32.427 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.29,172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-01-25T15:03:32.428 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:03:32.428 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-25T15:03:32.482 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.29 --add b 172.21.15.52 --addv c '[v2:172.21.15.52:3301,v1:172.21.15.52:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-01-25T15:03:32.567 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-25T15:03:32.568 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: generated fsid 3f65c5fb-9e8c-471f-b2c4-a9841e901c7a 2024-01-25T15:03:32.568 INFO:teuthology.orchestra.run.smithi029.stdout:setting min_mon_release = quincy 2024-01-25T15:03:32.568 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 0 2024-01-25T15:03:32.568 INFO:teuthology.orchestra.run.smithi029.stdout:fsid 3f65c5fb-9e8c-471f-b2c4-a9841e901c7a 2024-01-25T15:03:32.568 INFO:teuthology.orchestra.run.smithi029.stdout:last_changed 2024-01-25T15:03:32.568207+0000 2024-01-25T15:03:32.568 INFO:teuthology.orchestra.run.smithi029.stdout:created 2024-01-25T15:03:32.568207+0000 2024-01-25T15:03:32.568 INFO:teuthology.orchestra.run.smithi029.stdout:min_mon_release 17 (quincy) 2024-01-25T15:03:32.568 INFO:teuthology.orchestra.run.smithi029.stdout:election_strategy: 1 2024-01-25T15:03:32.568 INFO:teuthology.orchestra.run.smithi029.stdout:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-01-25T15:03:32.568 INFO:teuthology.orchestra.run.smithi029.stdout:1: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.b 2024-01-25T15:03:32.568 INFO:teuthology.orchestra.run.smithi029.stdout:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2024-01-25T15:03:32.569 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-01-25T15:03:32.570 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-25T15:03:32.584 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3f65c5fb-9e8c-471f-b2c4-a9841e901c7a... 2024-01-25T15:03:32.585 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-25T15:03:32.627 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-25T15:03:32.674 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2024-01-25T15:03:32.675 INFO:teuthology.orchestra.run.smithi029.stdout: chdir = "" 2024-01-25T15:03:32.675 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-25T15:03:32.675 INFO:teuthology.orchestra.run.smithi029.stdout: auth supported = cephx 2024-01-25T15:03:32.675 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.675 INFO:teuthology.orchestra.run.smithi029.stdout: filestore xattr use omap = true 2024-01-25T15:03:32.675 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.675 INFO:teuthology.orchestra.run.smithi029.stdout: mon clock drift allowed = 1.000 2024-01-25T15:03:32.675 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.675 INFO:teuthology.orchestra.run.smithi029.stdout: osd crush chooseleaf type = 0 2024-01-25T15:03:32.675 INFO:teuthology.orchestra.run.smithi029.stdout: auth debug = true 2024-01-25T15:03:32.675 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.675 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on old message = true 2024-01-25T15:03:32.675 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on bug = true 2024-01-25T15:03:32.675 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.675 INFO:teuthology.orchestra.run.smithi029.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-25T15:03:32.676 INFO:teuthology.orchestra.run.smithi029.stdout: mon pg warn max object skew = 0 2024-01-25T15:03:32.676 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.676 INFO:teuthology.orchestra.run.smithi029.stdout: # disable pg_autoscaler by default for new pools 2024-01-25T15:03:32.676 INFO:teuthology.orchestra.run.smithi029.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-25T15:03:32.676 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.676 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default size = 2 2024-01-25T15:03:32.676 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.676 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow primary affinity = true 2024-01-25T15:03:32.676 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow pg remap = true 2024-01-25T15:03:32.676 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on legacy crush tunables = false 2024-01-25T15:03:32.676 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on crush straw calc version zero = false 2024-01-25T15:03:32.676 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on no sortbitwise = false 2024-01-25T15:03:32.676 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on osd down out interval zero = false 2024-01-25T15:03:32.676 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on too few osds = false 2024-01-25T15:03:32.677 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-25T15:03:32.677 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-25T15:03:32.677 INFO:teuthology.orchestra.run.smithi029.stdout: mon_allow_pool_size_one = true 2024-01-25T15:03:32.677 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.677 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-25T15:03:32.677 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.677 INFO:teuthology.orchestra.run.smithi029.stdout: osd default data pool replay window = 5 2024-01-25T15:03:32.677 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.677 INFO:teuthology.orchestra.run.smithi029.stdout: mon allow pool delete = true 2024-01-25T15:03:32.677 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.677 INFO:teuthology.orchestra.run.smithi029.stdout: mon cluster log file level = debug 2024-01-25T15:03:32.677 INFO:teuthology.orchestra.run.smithi029.stdout: debug asserts on shutdown = true 2024-01-25T15:03:32.677 INFO:teuthology.orchestra.run.smithi029.stdout: mon health detail to clog = false 2024-01-25T15:03:32.677 INFO:teuthology.orchestra.run.smithi029.stdout: mon host = "172.21.15.29,172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790]" 2024-01-25T15:03:32.677 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on skipped message = False 2024-01-25T15:03:32.677 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = 3f65c5fb-9e8c-471f-b2c4-a9841e901c7a 2024-01-25T15:03:32.678 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.678 INFO:teuthology.orchestra.run.smithi029.stdout:[osd] 2024-01-25T15:03:32.678 INFO:teuthology.orchestra.run.smithi029.stdout: osd journal size = 100 2024-01-25T15:03:32.678 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.678 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub load threshold = 5.0 2024-01-25T15:03:32.678 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub max interval = 600 2024-01-25T15:03:32.678 INFO:teuthology.orchestra.run.smithi029.stdout: osd mclock profile = high_recovery_ops 2024-01-25T15:03:32.678 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.678 INFO:teuthology.orchestra.run.smithi029.stdout: osd recover clone overlap = true 2024-01-25T15:03:32.678 INFO:teuthology.orchestra.run.smithi029.stdout: osd recovery max chunk = 1048576 2024-01-25T15:03:32.678 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.678 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug shutdown = true 2024-01-25T15:03:32.678 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug op order = true 2024-01-25T15:03:32.678 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug verify stray on activate = true 2024-01-25T15:03:32.678 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug trim objects = true 2024-01-25T15:03:32.679 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.679 INFO:teuthology.orchestra.run.smithi029.stdout: osd open classes on start = true 2024-01-25T15:03:32.679 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug pg log writeout = true 2024-01-25T15:03:32.679 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.679 INFO:teuthology.orchestra.run.smithi029.stdout: osd deep scrub update digest min age = 30 2024-01-25T15:03:32.679 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.679 INFO:teuthology.orchestra.run.smithi029.stdout: osd map max advance = 10 2024-01-25T15:03:32.679 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.679 INFO:teuthology.orchestra.run.smithi029.stdout: journal zero on create = true 2024-01-25T15:03:32.679 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.679 INFO:teuthology.orchestra.run.smithi029.stdout: filestore ondisk finisher threads = 3 2024-01-25T15:03:32.679 INFO:teuthology.orchestra.run.smithi029.stdout: filestore apply finisher threads = 3 2024-01-25T15:03:32.679 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.680 INFO:teuthology.orchestra.run.smithi029.stdout: bdev debug aio = true 2024-01-25T15:03:32.680 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug misdirected ops = true 2024-01-25T15:03:32.680 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore block size = 96636764160 2024-01-25T15:03:32.680 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore fsck on mount = True 2024-01-25T15:03:32.680 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluefs = 20 2024-01-25T15:03:32.680 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluestore = 20 2024-01-25T15:03:32.680 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-01-25T15:03:32.680 INFO:teuthology.orchestra.run.smithi029.stdout: debug osd = 20 2024-01-25T15:03:32.680 INFO:teuthology.orchestra.run.smithi029.stdout: debug rocksdb = 10 2024-01-25T15:03:32.680 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd backfillfull_ratio = 0.85 2024-01-25T15:03:32.680 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd full ratio = 0.9 2024-01-25T15:03:32.680 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd nearfull ratio = 0.8 2024-01-25T15:03:32.680 INFO:teuthology.orchestra.run.smithi029.stdout: osd failsafe full ratio = 0.95 2024-01-25T15:03:32.680 INFO:teuthology.orchestra.run.smithi029.stdout: osd objectstore = bluestore 2024-01-25T15:03:32.681 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2024-01-25T15:03:32.681 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.681 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr] 2024-01-25T15:03:32.681 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-01-25T15:03:32.681 INFO:teuthology.orchestra.run.smithi029.stdout: debug mgr = 20 2024-01-25T15:03:32.681 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2024-01-25T15:03:32.681 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2024-01-25T15:03:32.681 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2024-01-25T15:03:32.681 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2024-01-25T15:03:32.681 INFO:teuthology.orchestra.run.smithi029.stdout: mgr/telemetry/nag = false 2024-01-25T15:03:32.681 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.681 INFO:teuthology.orchestra.run.smithi029.stdout:[mon] 2024-01-25T15:03:32.681 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-01-25T15:03:32.681 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2024-01-25T15:03:32.681 INFO:teuthology.orchestra.run.smithi029.stdout: debug paxos = 20 2024-01-25T15:03:32.681 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2024-01-25T15:03:32.682 INFO:teuthology.orchestra.run.smithi029.stdout: mon data avail warn = 5 2024-01-25T15:03:32.682 INFO:teuthology.orchestra.run.smithi029.stdout: mon mgr mkfs grace = 240 2024-01-25T15:03:32.682 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2024-01-25T15:03:32.682 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd reporter subtree level = osd 2024-01-25T15:03:32.682 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd prime pg temp = true 2024-01-25T15:03:32.682 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2024-01-25T15:03:32.682 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.682 INFO:teuthology.orchestra.run.smithi029.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-25T15:03:32.682 INFO:teuthology.orchestra.run.smithi029.stdout: auth mon ticket ttl = 660 # 11m 2024-01-25T15:03:32.682 INFO:teuthology.orchestra.run.smithi029.stdout: auth service ticket ttl = 240 # 4m 2024-01-25T15:03:32.682 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.682 INFO:teuthology.orchestra.run.smithi029.stdout: # don't complain about insecure global_id in the test suite 2024-01-25T15:03:32.682 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-25T15:03:32.682 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-25T15:03:32.682 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.683 INFO:teuthology.orchestra.run.smithi029.stdout: # 1m isn't quite enough 2024-01-25T15:03:32.683 INFO:teuthology.orchestra.run.smithi029.stdout: mon_down_mkfs_grace = 2m 2024-01-25T15:03:32.683 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.683 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_filestore_osds = false 2024-01-25T15:03:32.683 INFO:teuthology.orchestra.run.smithi029.stdout: mon op complaint time = 120 2024-01-25T15:03:32.683 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:03:32.683 INFO:teuthology.orchestra.run.smithi029.stdout:[client] 2024-01-25T15:03:32.683 INFO:teuthology.orchestra.run.smithi029.stdout: rgw cache enabled = true 2024-01-25T15:03:32.683 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable ops log = true 2024-01-25T15:03:32.683 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable usage log = true 2024-01-25T15:03:32.683 INFO:teuthology.orchestra.run.smithi029.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-25T15:03:32.683 INFO:teuthology.orchestra.run.smithi029.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-25T15:03:32.683 INFO:teuthology.orchestra.run.smithi029.stdout: client mount timeout = 600 2024-01-25T15:03:32.683 INFO:teuthology.orchestra.run.smithi029.stdout: debug client = 20 2024-01-25T15:03:32.683 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-01-25T15:03:32.683 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2024-01-25T15:03:32.684 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2024-01-25T15:03:32.684 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.a] 2024-01-25T15:03:32.684 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.b] 2024-01-25T15:03:32.684 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.c] 2024-01-25T15:03:32.684 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2024-01-25T15:03:32.684 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.c] 2024-01-25T15:03:32.684 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b] 2024-01-25T15:03:32.684 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.d] 2024-01-25T15:03:32.684 INFO:teuthology.orchestra.run.smithi029.stdout:[mds] 2024-01-25T15:03:32.684 INFO:teuthology.orchestra.run.smithi029.stdout: debug mds = 20 2024-01-25T15:03:32.684 INFO:teuthology.orchestra.run.smithi029.stdout: debug mds balancer = 20 2024-01-25T15:03:32.684 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-01-25T15:03:32.684 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug frag = True 2024-01-25T15:03:32.684 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug scatterstat = True 2024-01-25T15:03:32.684 INFO:teuthology.orchestra.run.smithi029.stdout: mds op complaint time = 180 2024-01-25T15:03:32.685 INFO:teuthology.orchestra.run.smithi029.stdout: mds verify scatter = True 2024-01-25T15:03:32.685 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2024-01-25T15:03:32.685 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2024-01-25T15:03:32.685 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2024-01-25T15:03:32.685 INFO:teuthology.orchestra.run.smithi052.stdout:[global] 2024-01-25T15:03:32.685 INFO:teuthology.orchestra.run.smithi052.stdout: chdir = "" 2024-01-25T15:03:32.685 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-25T15:03:32.685 INFO:teuthology.orchestra.run.smithi052.stdout: auth supported = cephx 2024-01-25T15:03:32.686 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.686 INFO:teuthology.orchestra.run.smithi052.stdout: filestore xattr use omap = true 2024-01-25T15:03:32.686 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.686 INFO:teuthology.orchestra.run.smithi052.stdout: mon clock drift allowed = 1.000 2024-01-25T15:03:32.686 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.686 INFO:teuthology.orchestra.run.smithi052.stdout: osd crush chooseleaf type = 0 2024-01-25T15:03:32.686 INFO:teuthology.orchestra.run.smithi052.stdout: auth debug = true 2024-01-25T15:03:32.686 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.686 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on old message = true 2024-01-25T15:03:32.686 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on bug = true 2024-01-25T15:03:32.686 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.686 INFO:teuthology.orchestra.run.smithi052.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-25T15:03:32.686 INFO:teuthology.orchestra.run.smithi052.stdout: mon pg warn max object skew = 0 2024-01-25T15:03:32.686 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.686 INFO:teuthology.orchestra.run.smithi052.stdout: # disable pg_autoscaler by default for new pools 2024-01-25T15:03:32.687 INFO:teuthology.orchestra.run.smithi052.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-25T15:03:32.687 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.687 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default size = 2 2024-01-25T15:03:32.687 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.687 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow primary affinity = true 2024-01-25T15:03:32.687 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow pg remap = true 2024-01-25T15:03:32.687 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on legacy crush tunables = false 2024-01-25T15:03:32.687 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on crush straw calc version zero = false 2024-01-25T15:03:32.687 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on no sortbitwise = false 2024-01-25T15:03:32.687 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on osd down out interval zero = false 2024-01-25T15:03:32.687 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on too few osds = false 2024-01-25T15:03:32.687 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-25T15:03:32.687 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-25T15:03:32.687 INFO:teuthology.orchestra.run.smithi052.stdout: mon_allow_pool_size_one = true 2024-01-25T15:03:32.687 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.688 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-25T15:03:32.688 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.688 INFO:teuthology.orchestra.run.smithi052.stdout: osd default data pool replay window = 5 2024-01-25T15:03:32.688 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.688 INFO:teuthology.orchestra.run.smithi052.stdout: mon allow pool delete = true 2024-01-25T15:03:32.688 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.688 INFO:teuthology.orchestra.run.smithi052.stdout: mon cluster log file level = debug 2024-01-25T15:03:32.688 INFO:teuthology.orchestra.run.smithi052.stdout: debug asserts on shutdown = true 2024-01-25T15:03:32.688 INFO:teuthology.orchestra.run.smithi052.stdout: mon health detail to clog = false 2024-01-25T15:03:32.688 INFO:teuthology.orchestra.run.smithi052.stdout: mon host = "172.21.15.29,172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790]" 2024-01-25T15:03:32.688 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on skipped message = False 2024-01-25T15:03:32.688 INFO:teuthology.orchestra.run.smithi052.stdout: fsid = 3f65c5fb-9e8c-471f-b2c4-a9841e901c7a 2024-01-25T15:03:32.688 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.688 INFO:teuthology.orchestra.run.smithi052.stdout:[osd] 2024-01-25T15:03:32.688 INFO:teuthology.orchestra.run.smithi052.stdout: osd journal size = 100 2024-01-25T15:03:32.689 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.689 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub load threshold = 5.0 2024-01-25T15:03:32.689 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub max interval = 600 2024-01-25T15:03:32.689 INFO:teuthology.orchestra.run.smithi052.stdout: osd mclock profile = high_recovery_ops 2024-01-25T15:03:32.689 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.689 INFO:teuthology.orchestra.run.smithi052.stdout: osd recover clone overlap = true 2024-01-25T15:03:32.689 INFO:teuthology.orchestra.run.smithi052.stdout: osd recovery max chunk = 1048576 2024-01-25T15:03:32.689 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.689 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug shutdown = true 2024-01-25T15:03:32.689 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug op order = true 2024-01-25T15:03:32.689 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify stray on activate = true 2024-01-25T15:03:32.689 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug trim objects = true 2024-01-25T15:03:32.689 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.689 INFO:teuthology.orchestra.run.smithi052.stdout: osd open classes on start = true 2024-01-25T15:03:32.689 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug pg log writeout = true 2024-01-25T15:03:32.690 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.690 INFO:teuthology.orchestra.run.smithi052.stdout: osd deep scrub update digest min age = 30 2024-01-25T15:03:32.690 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.690 INFO:teuthology.orchestra.run.smithi052.stdout: osd map max advance = 10 2024-01-25T15:03:32.690 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.690 INFO:teuthology.orchestra.run.smithi052.stdout: journal zero on create = true 2024-01-25T15:03:32.690 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.690 INFO:teuthology.orchestra.run.smithi052.stdout: filestore ondisk finisher threads = 3 2024-01-25T15:03:32.690 INFO:teuthology.orchestra.run.smithi052.stdout: filestore apply finisher threads = 3 2024-01-25T15:03:32.690 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.690 INFO:teuthology.orchestra.run.smithi052.stdout: bdev debug aio = true 2024-01-25T15:03:32.690 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug misdirected ops = true 2024-01-25T15:03:32.690 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore block size = 96636764160 2024-01-25T15:03:32.690 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore fsck on mount = True 2024-01-25T15:03:32.690 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluefs = 20 2024-01-25T15:03:32.691 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluestore = 20 2024-01-25T15:03:32.691 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-01-25T15:03:32.691 INFO:teuthology.orchestra.run.smithi052.stdout: debug osd = 20 2024-01-25T15:03:32.691 INFO:teuthology.orchestra.run.smithi052.stdout: debug rocksdb = 10 2024-01-25T15:03:32.691 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd backfillfull_ratio = 0.85 2024-01-25T15:03:32.691 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd full ratio = 0.9 2024-01-25T15:03:32.691 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd nearfull ratio = 0.8 2024-01-25T15:03:32.691 INFO:teuthology.orchestra.run.smithi052.stdout: osd failsafe full ratio = 0.95 2024-01-25T15:03:32.691 INFO:teuthology.orchestra.run.smithi052.stdout: osd objectstore = bluestore 2024-01-25T15:03:32.691 INFO:teuthology.orchestra.run.smithi052.stdout: osd op complaint time = 180 2024-01-25T15:03:32.691 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.691 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr] 2024-01-25T15:03:32.691 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-01-25T15:03:32.691 INFO:teuthology.orchestra.run.smithi052.stdout: debug mgr = 20 2024-01-25T15:03:32.691 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-01-25T15:03:32.692 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-01-25T15:03:32.692 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-01-25T15:03:32.692 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-01-25T15:03:32.692 INFO:teuthology.orchestra.run.smithi052.stdout: mgr/telemetry/nag = false 2024-01-25T15:03:32.692 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.692 INFO:teuthology.orchestra.run.smithi052.stdout:[mon] 2024-01-25T15:03:32.692 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-01-25T15:03:32.692 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-01-25T15:03:32.692 INFO:teuthology.orchestra.run.smithi052.stdout: debug paxos = 20 2024-01-25T15:03:32.692 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-01-25T15:03:32.692 INFO:teuthology.orchestra.run.smithi052.stdout: mon data avail warn = 5 2024-01-25T15:03:32.692 INFO:teuthology.orchestra.run.smithi052.stdout: mon mgr mkfs grace = 240 2024-01-25T15:03:32.692 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-01-25T15:03:32.692 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd reporter subtree level = osd 2024-01-25T15:03:32.692 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd prime pg temp = true 2024-01-25T15:03:32.693 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-01-25T15:03:32.693 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.693 INFO:teuthology.orchestra.run.smithi052.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-25T15:03:32.693 INFO:teuthology.orchestra.run.smithi052.stdout: auth mon ticket ttl = 660 # 11m 2024-01-25T15:03:32.693 INFO:teuthology.orchestra.run.smithi052.stdout: auth service ticket ttl = 240 # 4m 2024-01-25T15:03:32.693 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.693 INFO:teuthology.orchestra.run.smithi052.stdout: # don't complain about insecure global_id in the test suite 2024-01-25T15:03:32.693 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-25T15:03:32.693 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-25T15:03:32.693 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.693 INFO:teuthology.orchestra.run.smithi052.stdout: # 1m isn't quite enough 2024-01-25T15:03:32.693 INFO:teuthology.orchestra.run.smithi052.stdout: mon_down_mkfs_grace = 2m 2024-01-25T15:03:32.693 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.693 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_filestore_osds = false 2024-01-25T15:03:32.693 INFO:teuthology.orchestra.run.smithi052.stdout: mon op complaint time = 120 2024-01-25T15:03:32.694 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-01-25T15:03:32.694 INFO:teuthology.orchestra.run.smithi052.stdout:[client] 2024-01-25T15:03:32.694 INFO:teuthology.orchestra.run.smithi052.stdout: rgw cache enabled = true 2024-01-25T15:03:32.694 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable ops log = true 2024-01-25T15:03:32.694 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable usage log = true 2024-01-25T15:03:32.694 INFO:teuthology.orchestra.run.smithi052.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-25T15:03:32.694 INFO:teuthology.orchestra.run.smithi052.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-25T15:03:32.694 INFO:teuthology.orchestra.run.smithi052.stdout: client mount timeout = 600 2024-01-25T15:03:32.694 INFO:teuthology.orchestra.run.smithi052.stdout: debug client = 20 2024-01-25T15:03:32.694 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-01-25T15:03:32.694 INFO:teuthology.orchestra.run.smithi052.stdout: rados mon op timeout = 900 2024-01-25T15:03:32.694 INFO:teuthology.orchestra.run.smithi052.stdout: rados osd op timeout = 900 2024-01-25T15:03:32.694 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.a] 2024-01-25T15:03:32.694 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.b] 2024-01-25T15:03:32.694 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.c] 2024-01-25T15:03:32.694 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2024-01-25T15:03:32.695 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.c] 2024-01-25T15:03:32.695 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.b] 2024-01-25T15:03:32.695 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.d] 2024-01-25T15:03:32.695 INFO:teuthology.orchestra.run.smithi052.stdout:[mds] 2024-01-25T15:03:32.695 INFO:teuthology.orchestra.run.smithi052.stdout: debug mds = 20 2024-01-25T15:03:32.695 INFO:teuthology.orchestra.run.smithi052.stdout: debug mds balancer = 20 2024-01-25T15:03:32.695 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-01-25T15:03:32.695 INFO:teuthology.orchestra.run.smithi052.stdout: mds debug frag = True 2024-01-25T15:03:32.695 INFO:teuthology.orchestra.run.smithi052.stdout: mds debug scatterstat = True 2024-01-25T15:03:32.695 INFO:teuthology.orchestra.run.smithi052.stdout: mds op complaint time = 180 2024-01-25T15:03:32.695 INFO:teuthology.orchestra.run.smithi052.stdout: mds verify scatter = True 2024-01-25T15:03:32.695 INFO:teuthology.orchestra.run.smithi052.stdout: osd op complaint time = 180 2024-01-25T15:03:32.695 INFO:teuthology.orchestra.run.smithi052.stdout: rados mon op timeout = 900 2024-01-25T15:03:32.695 INFO:teuthology.orchestra.run.smithi052.stdout: rados osd op timeout = 900 2024-01-25T15:03:32.697 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-25T15:03:32.697 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-25T15:03:32.793 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-25T15:03:32.793 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:03:32.793 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-25T15:03:32.808 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:03:32.808 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-25T15:03:32.863 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi029.front.sepia.ceph.com 2024-01-25T15:03:32.863 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:03:32.863 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-25T15:03:32.863 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-25T15:03:32.941 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:03:32.941 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-25T15:03:32.995 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi052.front.sepia.ceph.com 2024-01-25T15:03:32.995 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:03:32.996 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-25T15:03:32.996 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-25T15:03:33.036 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:03:33.036 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-25T15:03:33.091 INFO:tasks.ceph:Setting up mon nodes... 2024-01-25T15:03:33.091 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-25T15:03:33.091 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-01-25T15:03:33.145 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-01-25T15:03:33.148 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-25T15:03:33.216 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-25T15:03:33.219 INFO:tasks.ceph:Setting up mds nodes... 2024-01-25T15:03:33.219 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-01-25T15:03:33.274 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-01-25T15:03:33.276 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-01-25T15:03:33.303 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-01-25T15:03:33.398 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-01-25T15:03:33.400 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-01-25T15:03:33.426 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-01-25T15:03:33.482 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-01-25T15:03:33.484 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-01-25T15:03:33.511 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-01-25T15:03:33.605 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-01-25T15:03:33.608 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-01-25T15:03:33.634 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-25T15:03:33.635 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-25T15:03:33.677 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-25T15:03:33.692 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-01-25T15:03:33.735 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-01-25T15:03:33.750 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-25T15:03:33.750 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-25T15:03:33.750 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-25T15:03:33.776 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-25T15:03:33.776 INFO:tasks.ceph:role: osd.0 2024-01-25T15:03:33.776 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com 2024-01-25T15:03:33.777 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-25T15:03:33.842 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-25T15:03:33.842 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-25T15:03:33.843 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-25T15:03:33.843 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-25T15:03:33.843 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-25T15:03:33.843 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-01-25T15:03:33.843 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-25T15:03:33.843 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-25T15:03:33.843 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-25T15:03:33.843 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-25T15:03:33.875 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-01-25T15:03:33.876 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-01-25T15:03:33.877 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-25T15:03:33.947 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-25T15:03:34.022 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-25T15:03:34.088 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-25T15:03:34.088 INFO:tasks.ceph:role: osd.1 2024-01-25T15:03:34.088 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi029.front.sepia.ceph.com 2024-01-25T15:03:34.088 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-25T15:03:34.154 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-25T15:03:34.154 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-25T15:03:34.154 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-25T15:03:34.154 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-25T15:03:34.154 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-25T15:03:34.154 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-01-25T15:03:34.154 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-25T15:03:34.154 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-25T15:03:34.154 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-25T15:03:34.154 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-25T15:03:34.186 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-01-25T15:03:34.188 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-01-25T15:03:34.188 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-25T15:03:34.258 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-25T15:03:34.330 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-25T15:03:34.397 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-25T15:03:34.398 INFO:tasks.ceph:role: osd.2 2024-01-25T15:03:34.398 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi029.front.sepia.ceph.com 2024-01-25T15:03:34.398 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-25T15:03:34.465 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-25T15:03:34.465 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-25T15:03:34.465 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-25T15:03:34.465 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-25T15:03:34.465 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-25T15:03:34.465 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-01-25T15:03:34.465 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-25T15:03:34.465 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-25T15:03:34.465 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-25T15:03:34.465 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-25T15:03:34.497 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-01-25T15:03:34.499 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-01-25T15:03:34.499 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-01-25T15:03:34.580 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-25T15:03:34.652 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-25T15:03:34.720 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-25T15:03:34.720 INFO:tasks.ceph:role: osd.3 2024-01-25T15:03:34.720 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi029.front.sepia.ceph.com 2024-01-25T15:03:34.720 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-25T15:03:34.787 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-25T15:03:34.787 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-25T15:03:34.787 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-25T15:03:34.788 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-25T15:03:34.788 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-25T15:03:34.788 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-01-25T15:03:34.788 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-25T15:03:34.788 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-25T15:03:34.788 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-25T15:03:34.788 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-25T15:03:34.819 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-01-25T15:03:34.821 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-01-25T15:03:34.821 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-01-25T15:03:34.892 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-25T15:03:34.963 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-25T15:03:35.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:35.055+0000 7fa4faad5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-01-25T15:03:35.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:35.056+0000 7fa4faad5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-01-25T15:03:35.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:35.056+0000 7fa4faad5640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-25T15:03:35.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:35.056+0000 7fa4faad5640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-25T15:03:35.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:35.056+0000 7fa4faad5640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-25T15:03:35.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:35.056+0000 7fa4faad5640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-01-25T15:03:37.902 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-25T15:03:37.934 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-25T15:03:38.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:38.024+0000 7f9476cae640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-01-25T15:03:38.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:38.024+0000 7f9476cae640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-01-25T15:03:38.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:38.024+0000 7f9476cae640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-25T15:03:38.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:38.024+0000 7f9476cae640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-25T15:03:38.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:38.024+0000 7f9476cae640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-25T15:03:38.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:38.025+0000 7f9476cae640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-01-25T15:03:40.873 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-25T15:03:40.903 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-25T15:03:40.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:40.994+0000 7f7ba6a19640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-01-25T15:03:40.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:40.994+0000 7f7ba6a19640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-01-25T15:03:40.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:40.994+0000 7f7ba6a19640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-25T15:03:40.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:40.994+0000 7f7ba6a19640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-25T15:03:40.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:40.994+0000 7f7ba6a19640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-25T15:03:40.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:40.994+0000 7f7ba6a19640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-01-25T15:03:43.851 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-25T15:03:43.882 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-25T15:03:43.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:43.973+0000 7fceb820d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-01-25T15:03:43.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:43.973+0000 7fceb820d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-01-25T15:03:43.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:43.973+0000 7fceb820d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-25T15:03:43.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:43.973+0000 7fceb820d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-25T15:03:43.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:43.973+0000 7fceb820d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-25T15:03:43.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:03:43.974+0000 7fceb820d640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-01-25T15:03:46.818 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-25T15:03:46.849 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-01-25T15:03:46.881 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-25T15:03:46.881 INFO:tasks.ceph:role: osd.4 2024-01-25T15:03:46.881 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com 2024-01-25T15:03:46.881 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-25T15:03:46.952 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-25T15:03:46.952 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-25T15:03:46.952 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-25T15:03:46.952 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-25T15:03:46.952 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-25T15:03:46.952 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-01-25T15:03:46.952 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-25T15:03:46.952 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-25T15:03:46.952 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-25T15:03:46.952 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-25T15:03:46.984 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-01-25T15:03:46.986 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-01-25T15:03:46.986 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-01-25T15:03:47.060 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-01-25T15:03:47.133 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-01-25T15:03:47.200 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-25T15:03:47.201 INFO:tasks.ceph:role: osd.5 2024-01-25T15:03:47.201 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi052.front.sepia.ceph.com 2024-01-25T15:03:47.201 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-25T15:03:47.266 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-25T15:03:47.266 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-25T15:03:47.267 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-25T15:03:47.267 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-25T15:03:47.267 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-25T15:03:47.267 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-01-25T15:03:47.267 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-25T15:03:47.267 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-25T15:03:47.267 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-25T15:03:47.267 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-25T15:03:47.299 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-01-25T15:03:47.301 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-01-25T15:03:47.301 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-01-25T15:03:47.371 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-01-25T15:03:47.442 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-01-25T15:03:47.509 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-25T15:03:47.510 INFO:tasks.ceph:role: osd.6 2024-01-25T15:03:47.510 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi052.front.sepia.ceph.com 2024-01-25T15:03:47.510 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-25T15:03:47.575 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-25T15:03:47.575 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-25T15:03:47.575 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-25T15:03:47.575 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-25T15:03:47.575 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-25T15:03:47.575 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-01-25T15:03:47.575 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-25T15:03:47.575 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-25T15:03:47.575 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-25T15:03:47.575 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-25T15:03:47.606 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-01-25T15:03:47.608 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-01-25T15:03:47.608 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-01-25T15:03:47.678 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-01-25T15:03:47.749 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-01-25T15:03:47.815 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-25T15:03:47.815 INFO:tasks.ceph:role: osd.7 2024-01-25T15:03:47.816 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi052.front.sepia.ceph.com 2024-01-25T15:03:47.816 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-25T15:03:47.882 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-25T15:03:47.882 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-25T15:03:47.882 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-25T15:03:47.882 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-25T15:03:47.882 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-25T15:03:47.882 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-01-25T15:03:47.883 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-25T15:03:47.883 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-25T15:03:47.883 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-25T15:03:47.883 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-25T15:03:47.914 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-01-25T15:03:47.916 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-01-25T15:03:47.916 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-01-25T15:03:47.986 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-01-25T15:03:48.056 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-25T15:03:48.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:48.153+0000 7f4c5838f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-01-25T15:03:48.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:48.153+0000 7f4c5838f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-01-25T15:03:48.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:48.153+0000 7f4c5838f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-25T15:03:48.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:48.153+0000 7f4c5838f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-25T15:03:48.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:48.153+0000 7f4c5838f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-25T15:03:48.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:48.153+0000 7f4c5838f640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-01-25T15:03:51.005 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-25T15:03:51.036 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-25T15:03:51.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:51.128+0000 7f99f1f06640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-01-25T15:03:51.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:51.128+0000 7f99f1f06640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-01-25T15:03:51.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:51.128+0000 7f99f1f06640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-25T15:03:51.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:51.128+0000 7f99f1f06640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-25T15:03:51.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:51.128+0000 7f99f1f06640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-25T15:03:51.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:51.128+0000 7f99f1f06640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-01-25T15:03:53.972 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-25T15:03:54.004 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-25T15:03:54.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:54.096+0000 7f0ea6311640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-01-25T15:03:54.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:54.096+0000 7f0ea6311640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-01-25T15:03:54.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:54.096+0000 7f0ea6311640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-25T15:03:54.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:54.096+0000 7f0ea6311640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-25T15:03:54.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:54.096+0000 7f0ea6311640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-25T15:03:54.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:54.096+0000 7f0ea6311640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-01-25T15:03:56.947 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-25T15:03:56.978 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-25T15:03:57.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:57.069+0000 7ff271d2a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-01-25T15:03:57.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:57.069+0000 7ff271d2a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-01-25T15:03:57.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:57.069+0000 7ff271d2a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-25T15:03:57.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:57.069+0000 7ff271d2a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-25T15:03:57.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:57.069+0000 7ff271d2a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-25T15:03:57.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:03:57.069+0000 7ff271d2a640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-01-25T15:03:59.916 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-25T15:03:59.947 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-25T15:03:59.947 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:03:59.948 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-01-25T15:03:59.980 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:03:59.980 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-01-25T15:04:00.053 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:04:00.053 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-01-25T15:04:00.124 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:04:00.124 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-25T15:04:00.194 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:04:00.194 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-25T15:04:00.263 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:04:00.263 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-25T15:04:00.332 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:04:00.332 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-25T15:04:00.400 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:04:00.400 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-25T15:04:00.431 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:04:00.431 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-01-25T15:04:00.503 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:04:00.503 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-01-25T15:04:00.571 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:04:00.572 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-01-25T15:04:00.640 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:04:00.640 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-01-25T15:04:00.703 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-25T15:04:00.705 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-25T15:04:00.709 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:04:00.710 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-01-25T15:04:00.777 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:04:00.777 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-01-25T15:04:00.845 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:04:00.845 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-25T15:04:00.861 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:04:00.861 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-01-25T15:04:00.900 INFO:tasks.ceph:Adding keys to all mons... 2024-01-25T15:04:00.900 DEBUG:teuthology.orchestra.run.smithi029:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-25T15:04:00.903 DEBUG:teuthology.orchestra.run.smithi052:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-25T15:04:00.943 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.y] 2024-01-25T15:04:00.943 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBFeLJl3V+0CBAAPL5xKbXhI141dBDvyNagLg== 2024-01-25T15:04:00.943 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2024-01-25T15:04:00.943 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBFeLJltFBjEBAA9c2uxalPVQBtlaMa+THPRg== 2024-01-25T15:04:00.943 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.c] 2024-01-25T15:04:00.944 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBFeLJlxbXBFxAAbR1zjpuLeqNc6gSZKaTRsw== 2024-01-25T15:04:00.944 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.0] 2024-01-25T15:04:00.944 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBHeLJlo8xiAxAArEnwBhVoN1iHgTYZqWSzfA== 2024-01-25T15:04:00.944 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.1] 2024-01-25T15:04:00.944 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBKeLJlHtSFARAABKQrjF8zyiLLBZkfB/d30A== 2024-01-25T15:04:00.944 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.2] 2024-01-25T15:04:00.944 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBMeLJllxxROxAAxycfXfVvwFxipwi43Pfw8w== 2024-01-25T15:04:00.944 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.3] 2024-01-25T15:04:00.944 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBPeLJlkm0UOhAA9OmT8g7n7OEYOScexJhcNA== 2024-01-25T15:04:00.944 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.x] 2024-01-25T15:04:00.944 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBFeLJlV6/zDBAA8lku/GJQ9lDaDqc6cdMhzQ== 2024-01-25T15:04:00.944 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b] 2024-01-25T15:04:00.944 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBFeLJlyXXCHBAAIffuIQAitqv4JSfhTUnafA== 2024-01-25T15:04:00.945 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.d] 2024-01-25T15:04:00.945 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBFeLJlCP8kJBAA+MiuxyeER080vaH4rjB2lA== 2024-01-25T15:04:00.945 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.4] 2024-01-25T15:04:00.945 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBUeLJlekcxCRAAZ9e1sBf6qgsawkBe2Nkb/g== 2024-01-25T15:04:00.945 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.5] 2024-01-25T15:04:00.945 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBXeLJlZbqwBxAAg+KhkzocDaUrb/R/6g7TRg== 2024-01-25T15:04:00.945 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.6] 2024-01-25T15:04:00.945 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBaeLJlg77KBRAAGMq+pUtKE3cXEDKkdksvHA== 2024-01-25T15:04:00.945 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.7] 2024-01-25T15:04:00.945 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBdeLJlm+gtBBAAyyTEYFJoqNcktTyN5AmCkg== 2024-01-25T15:04:00.945 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2024-01-25T15:04:00.945 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBFeLJlQhBmKBAAC5MC37SsgxDRQlM8EpzhHQ== 2024-01-25T15:04:00.945 INFO:teuthology.orchestra.run.smithi029.stdout:[client.1] 2024-01-25T15:04:00.945 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBFeLJlX8/WKxAA0Acmb/XM79+7u0ZYjqLfSw== 2024-01-25T15:04:00.966 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.y] 2024-01-25T15:04:00.966 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBFeLJl3V+0CBAAPL5xKbXhI141dBDvyNagLg== 2024-01-25T15:04:00.966 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2024-01-25T15:04:00.966 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBFeLJltFBjEBAA9c2uxalPVQBtlaMa+THPRg== 2024-01-25T15:04:00.966 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.c] 2024-01-25T15:04:00.966 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBFeLJlxbXBFxAAbR1zjpuLeqNc6gSZKaTRsw== 2024-01-25T15:04:00.966 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.0] 2024-01-25T15:04:00.966 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBHeLJlo8xiAxAArEnwBhVoN1iHgTYZqWSzfA== 2024-01-25T15:04:00.966 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.1] 2024-01-25T15:04:00.966 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBKeLJlHtSFARAABKQrjF8zyiLLBZkfB/d30A== 2024-01-25T15:04:00.966 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.2] 2024-01-25T15:04:00.966 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBMeLJllxxROxAAxycfXfVvwFxipwi43Pfw8w== 2024-01-25T15:04:00.967 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.3] 2024-01-25T15:04:00.967 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBPeLJlkm0UOhAA9OmT8g7n7OEYOScexJhcNA== 2024-01-25T15:04:00.967 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.x] 2024-01-25T15:04:00.967 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBFeLJlV6/zDBAA8lku/GJQ9lDaDqc6cdMhzQ== 2024-01-25T15:04:00.967 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.b] 2024-01-25T15:04:00.967 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBFeLJlyXXCHBAAIffuIQAitqv4JSfhTUnafA== 2024-01-25T15:04:00.967 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.d] 2024-01-25T15:04:00.967 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBFeLJlCP8kJBAA+MiuxyeER080vaH4rjB2lA== 2024-01-25T15:04:00.967 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.4] 2024-01-25T15:04:00.967 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBUeLJlekcxCRAAZ9e1sBf6qgsawkBe2Nkb/g== 2024-01-25T15:04:00.967 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.5] 2024-01-25T15:04:00.967 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBXeLJlZbqwBxAAg+KhkzocDaUrb/R/6g7TRg== 2024-01-25T15:04:00.967 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.6] 2024-01-25T15:04:00.967 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBaeLJlg77KBRAAGMq+pUtKE3cXEDKkdksvHA== 2024-01-25T15:04:00.967 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.7] 2024-01-25T15:04:00.967 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBdeLJlm+gtBBAAyyTEYFJoqNcktTyN5AmCkg== 2024-01-25T15:04:00.968 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-01-25T15:04:00.968 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBFeLJlQhBmKBAAC5MC37SsgxDRQlM8EpzhHQ== 2024-01-25T15:04:00.968 INFO:teuthology.orchestra.run.smithi052.stdout:[client.1] 2024-01-25T15:04:00.968 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBFeLJlX8/WKxAA0Acmb/XM79+7u0ZYjqLfSw== 2024-01-25T15:04:00.969 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-25T15:04:00.988 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-25T15:04:01.061 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-25T15:04:01.063 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-25T15:04:01.117 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-25T15:04:01.120 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-25T15:04:01.175 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-25T15:04:01.177 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-25T15:04:01.229 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-25T15:04:01.231 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-25T15:04:01.282 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-25T15:04:01.284 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-25T15:04:01.336 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-25T15:04:01.339 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-25T15:04:01.390 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-25T15:04:01.392 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-25T15:04:01.443 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-25T15:04:01.445 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-25T15:04:01.499 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-25T15:04:01.501 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-25T15:04:01.555 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-25T15:04:01.557 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-25T15:04:01.609 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-25T15:04:01.611 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-25T15:04:01.663 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-25T15:04:01.665 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-25T15:04:01.716 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-25T15:04:01.718 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-25T15:04:01.770 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-25T15:04:01.772 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-25T15:04:01.827 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-25T15:04:01.829 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-25T15:04:01.883 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-25T15:04:01.883 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-25T15:04:01.909 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-25T15:04:02.005 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-25T15:04:02.032 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-01-25T15:04:02.059 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-25T15:04:02.156 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-01-25T15:04:02.182 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-01-25T15:04:02.248 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-25T15:04:02.344 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-01-25T15:04:02.370 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-25T15:04:02.373 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-25T15:04:02.425 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-25T15:04:02.425 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-25T15:04:02.425 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-01-25T15:04:02.428 INFO:tasks.ceph.mon.a:Started 2024-01-25T15:04:02.428 INFO:tasks.ceph.mon.b:Restarting daemon 2024-01-25T15:04:02.428 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-01-25T15:04:02.467 INFO:tasks.ceph.mon.b:Started 2024-01-25T15:04:02.467 INFO:tasks.ceph.mon.c:Restarting daemon 2024-01-25T15:04:02.467 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-01-25T15:04:02.469 INFO:tasks.ceph.mon.c:Started 2024-01-25T15:04:02.469 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-25T15:04:02.470 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-25T15:04:02.470 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-01-25T15:04:02.472 INFO:tasks.ceph.mgr.y:Started 2024-01-25T15:04:02.472 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-25T15:04:02.472 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-01-25T15:04:02.474 INFO:tasks.ceph.mgr.x:Started 2024-01-25T15:04:02.474 INFO:tasks.ceph:Setting crush tunables to default 2024-01-25T15:04:02.475 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd crush tunables default 2024-01-25T15:04:02.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.575+0000 7f96cb9c9640 1 Processor -- start 2024-01-25T15:04:02.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.575+0000 7f96cb9c9640 1 -- start start 2024-01-25T15:04:02.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.576+0000 7f96cb9c9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f96c40c3170 0x7f96c41548b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:02.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.576+0000 7f96cb9c9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f96c40c6ef0 0x7f96c40c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:02.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.576+0000 7f96cb9c9640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c4158190 con 0x7f96c4151ff0 2024-01-25T15:04:02.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.576+0000 7f96cb9c9640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c40c7490 con 0x7f96c40c3170 2024-01-25T15:04:02.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.576+0000 7f96cb9c9640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c4070e40 con 0x7f96c40c6ef0 2024-01-25T15:04:02.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.576+0000 7f96c8f64640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f96c40c3170 0x7f96c41548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:02.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.576+0000 7f96c8f64640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f96c40c3170 0x7f96c41548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42258/0 (socket says 172.21.15.29:42258) 2024-01-25T15:04:02.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.576+0000 7f96c8f64640 1 -- 172.21.15.29:0/978921901 learned_addr learned my addr 172.21.15.29:0/978921901 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:02.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.576+0000 7f96c9f66640 1 --2- 172.21.15.29:0/978921901 >> v2:172.21.15.52:3300/0 conn(0x7f96c40c6ef0 0x7f96c40c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:02.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.576+0000 7f96c8f64640 1 -- 172.21.15.29:0/978921901 >> v2:172.21.15.29:3300/0 conn(0x7f96c40c3170 msgr2=0x7f96c41548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-25T15:04:02.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.576+0000 7f96c8f64640 1 -- 172.21.15.29:0/978921901 >> v2:172.21.15.29:3300/0 conn(0x7f96c40c3170 msgr2=0x7f96c41548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-25T15:04:02.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.576+0000 7f96c8f64640 1 --2- 172.21.15.29:0/978921901 >> v2:172.21.15.29:3300/0 conn(0x7f96c40c3170 0x7f96c41548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-25T15:04:02.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.576+0000 7f96c8f64640 1 --2- 172.21.15.29:0/978921901 >> v2:172.21.15.29:3300/0 conn(0x7f96c40c3170 0x7f96c41548b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-25T15:04:02.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.576+0000 7f96c9f66640 1 -- 172.21.15.29:0/978921901 >> v2:172.21.15.52:3300/0 conn(0x7f96c40c6ef0 msgr2=0x7f96c40c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-01-25T15:04:02.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.576+0000 7f96c9f66640 1 -- 172.21.15.29:0/978921901 >> v2:172.21.15.52:3300/0 conn(0x7f96c40c6ef0 msgr2=0x7f96c40c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-25T15:04:02.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.576+0000 7f96c9f66640 1 --2- 172.21.15.29:0/978921901 >> v2:172.21.15.52:3300/0 conn(0x7f96c40c6ef0 0x7f96c40c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-25T15:04:02.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.576+0000 7f96c9f66640 1 --2- 172.21.15.29:0/978921901 >> v2:172.21.15.52:3300/0 conn(0x7f96c40c6ef0 0x7f96c40c4a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-25T15:04:02.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.743+0000 7f96bbfff640 1 -- 172.21.15.29:0/978921901 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555199430 0 0) 0x7f96c4158190 con 0x7f96c4151ff0 2024-01-25T15:04:02.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.743+0000 7f96bbfff640 1 -- 172.21.15.29:0/978921901 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96b0003520 con 0x7f96c4151ff0 2024-01-25T15:04:02.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96bbfff640 1 -- 172.21.15.29:0/978921901 <== mon.1 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2597692316 0 0) 0x7f96b0003520 con 0x7f96c4151ff0 2024-01-25T15:04:02.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96bbfff640 1 -- 172.21.15.29:0/978921901 >> v2:172.21.15.52:3300/0 conn(0x7f96c40c6ef0 msgr2=0x7f96c40c4a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-25T15:04:02.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96bbfff640 1 --2- 172.21.15.29:0/978921901 >> v2:172.21.15.52:3300/0 conn(0x7f96c40c6ef0 0x7f96c40c4a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:02.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96bbfff640 1 -- 172.21.15.29:0/978921901 >> v2:172.21.15.29:3300/0 conn(0x7f96c40c3170 msgr2=0x7f96c41548b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-25T15:04:02.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96bbfff640 1 --2- 172.21.15.29:0/978921901 >> v2:172.21.15.29:3300/0 conn(0x7f96c40c3170 0x7f96c41548b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:02.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96bbfff640 1 -- 172.21.15.29:0/978921901 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c4158d30 con 0x7f96c4151ff0 2024-01-25T15:04:02.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96bbfff640 1 -- 172.21.15.29:0/978921901 <== mon.1 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f96c00019f0 con 0x7f96c4151ff0 2024-01-25T15:04:02.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96bbfff640 1 -- 172.21.15.29:0/978921901 >> v1:172.21.15.52:6789/0 conn(0x7f96c4151ff0 legacy=0x7f96c4158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:02.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96bbfff640 1 --2- 172.21.15.29:0/978921901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96b00039e0 0x7f96b0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:02.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96bbfff640 1 --2- 172.21.15.29:0/978921901 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96b00047c0 0x7f96b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:02.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96bbfff640 1 --2- 172.21.15.29:0/978921901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96b00051d0 0x7f96b000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:02.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96bbfff640 1 -- 172.21.15.29:0/978921901 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40c7490 con 0x7f96b00039e0 2024-01-25T15:04:02.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96bbfff640 1 -- 172.21.15.29:0/978921901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c4070e40 con 0x7f96b00051d0 2024-01-25T15:04:02.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96bbfff640 1 -- 172.21.15.29:0/978921901 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b000c180 con 0x7f96b00047c0 2024-01-25T15:04:02.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96c9765640 1 --2- 172.21.15.29:0/978921901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96b00039e0 0x7f96b0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:02.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96c9f66640 1 --2- 172.21.15.29:0/978921901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96b00051d0 0x7f96b000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:02.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96c8f64640 1 --2- 172.21.15.29:0/978921901 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96b00047c0 0x7f96b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:02.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96c9765640 1 -- 172.21.15.29:0/978921901 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96b00047c0 msgr2=0x7f96b0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:02.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96c9765640 1 --2- 172.21.15.29:0/978921901 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96b00047c0 0x7f96b0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:02.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96c9765640 1 -- 172.21.15.29:0/978921901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96b00051d0 msgr2=0x7f96b000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:02.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96c9765640 1 --2- 172.21.15.29:0/978921901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96b00051d0 0x7f96b000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:02.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96c9765640 1 -- 172.21.15.29:0/978921901 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b0003520 con 0x7f96b00039e0 2024-01-25T15:04:02.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.745+0000 7f96c9f66640 1 -- 172.21.15.29:0/978921901 reap_dead start 2024-01-25T15:04:02.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.746+0000 7f96c9765640 1 --2- 172.21.15.29:0/978921901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96b00039e0 0x7f96b0003e00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f96c000c490 tx=0x7f96b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf2efb92ee59778 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:02.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.746+0000 7f96bbfff640 1 -- 172.21.15.29:0/978921901 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c002cd10 con 0x7f96b00039e0 2024-01-25T15:04:02.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.746+0000 7f96bbfff640 1 -- 172.21.15.29:0/978921901 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c002ce70 con 0x7f96b00039e0 2024-01-25T15:04:02.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.746+0000 7f96bbfff640 1 -- 172.21.15.29:0/978921901 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c0034660 con 0x7f96b00039e0 2024-01-25T15:04:02.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.747+0000 7f96cb9c9640 1 -- 172.21.15.29:0/978921901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96b00039e0 msgr2=0x7f96b0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:02.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.747+0000 7f96cb9c9640 1 --2- 172.21.15.29:0/978921901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96b00039e0 0x7f96b0003e00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f96c000c490 tx=0x7f96b00057f0 comp rx=0 tx=0).stop 2024-01-25T15:04:02.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.747+0000 7f96cb9c9640 1 -- 172.21.15.29:0/978921901 shutdown_connections 2024-01-25T15:04:02.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.747+0000 7f96cb9c9640 1 --2- 172.21.15.29:0/978921901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96b00039e0 0x7f96b0003e00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:02.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.747+0000 7f96cb9c9640 1 -- 172.21.15.29:0/978921901 >> 172.21.15.29:0/978921901 conn(0x7f96c40c7f80 msgr2=0x7f96c40c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:02.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.747+0000 7f96cb9c9640 1 -- 172.21.15.29:0/978921901 shutdown_connections 2024-01-25T15:04:02.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.747+0000 7f96cb9c9640 1 -- 172.21.15.29:0/978921901 wait complete. 2024-01-25T15:04:02.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.749+0000 7f96cb9c9640 1 Processor -- start 2024-01-25T15:04:02.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.749+0000 7f96cb9c9640 1 -- start start 2024-01-25T15:04:02.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.749+0000 7f96cb9c9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96b00039e0 0x7f96c40ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:02.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.749+0000 7f96cb9c9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96c4155130 0x7f96c41530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:02.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.749+0000 7f96cb9c9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96c4153600 0x7f96c41ecd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:02.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.749+0000 7f96cb9c9640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c4152c30 con 0x7f96b00039e0 2024-01-25T15:04:02.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.749+0000 7f96cb9c9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40a9390 con 0x7f96c4155130 2024-01-25T15:04:02.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.749+0000 7f96cb9c9640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c4153a80 con 0x7f96c4153600 2024-01-25T15:04:02.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.750+0000 7f96c9765640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96b00039e0 0x7f96c40ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:02.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.750+0000 7f96c9765640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96b00039e0 0x7f96c40ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42294/0 (socket says 172.21.15.29:42294) 2024-01-25T15:04:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.750+0000 7f96c9765640 1 -- 172.21.15.29:0/3454080397 learned_addr learned my addr 172.21.15.29:0/3454080397 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.750+0000 7f96c8f64640 1 --2- 172.21.15.29:0/3454080397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96c4155130 0x7f96c41530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.750+0000 7f96c9f66640 1 --2- 172.21.15.29:0/3454080397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96c4153600 0x7f96c41ecd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.750+0000 7f96c9765640 1 -- 172.21.15.29:0/3454080397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96c4153600 msgr2=0x7f96c41ecd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.750+0000 7f96c9765640 1 --2- 172.21.15.29:0/3454080397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96c4153600 0x7f96c41ecd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.750+0000 7f96c9765640 1 -- 172.21.15.29:0/3454080397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96c4155130 msgr2=0x7f96c41530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.750+0000 7f96c9765640 1 --2- 172.21.15.29:0/3454080397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96c4155130 0x7f96c41530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.750+0000 7f96c9765640 1 -- 172.21.15.29:0/3454080397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c40a95e0 con 0x7f96b00039e0 2024-01-25T15:04:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.750+0000 7f96c9765640 1 --2- 172.21.15.29:0/3454080397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96b00039e0 0x7f96c40ace90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f96c0037040 tx=0x7f96c40c4770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.750+0000 7f96b9ffb640 1 -- 172.21.15.29:0/3454080397 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c0003d80 con 0x7f96b00039e0 2024-01-25T15:04:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.750+0000 7f96b9ffb640 1 -- 172.21.15.29:0/3454080397 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c0007df0 con 0x7f96b00039e0 2024-01-25T15:04:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.750+0000 7f96cb9c9640 1 -- 172.21.15.29:0/3454080397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c40a98c0 con 0x7f96b00039e0 2024-01-25T15:04:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.750+0000 7f96b9ffb640 1 -- 172.21.15.29:0/3454080397 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c00052e0 con 0x7f96b00039e0 2024-01-25T15:04:02.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.750+0000 7f96cb9c9640 1 -- 172.21.15.29:0/3454080397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c40ad3d0 con 0x7f96b00039e0 2024-01-25T15:04:02.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.751+0000 7f96b9ffb640 1 -- 172.21.15.29:0/3454080397 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f96c003b040 con 0x7f96b00039e0 2024-01-25T15:04:02.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.751+0000 7f96b9ffb640 1 -- 172.21.15.29:0/3454080397 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f96c0034440 con 0x7f96b00039e0 2024-01-25T15:04:02.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.751+0000 7f96cb9c9640 1 -- 172.21.15.29:0/3454080397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c40a9b00 con 0x7f96b00039e0 2024-01-25T15:04:02.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.754+0000 7f96b9ffb640 1 -- 172.21.15.29:0/3454080397 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f96c40a9b00 con 0x7f96b00039e0 2024-01-25T15:04:02.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.820+0000 7f96cb9c9640 1 -- 172.21.15.29:0/3454080397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f96c4152720 con 0x7f96b00039e0 2024-01-25T15:04:02.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.822+0000 7f96b9ffb640 1 -- 172.21.15.29:0/3454080397 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f96c4152720 con 0x7f96b00039e0 2024-01-25T15:04:02.822 INFO:teuthology.orchestra.run.smithi029.stderr:adjusted tunables profile to default 2024-01-25T15:04:02.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.823+0000 7f96cb9c9640 1 -- 172.21.15.29:0/3454080397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96b00039e0 msgr2=0x7f96c40ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:02.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.823+0000 7f96cb9c9640 1 --2- 172.21.15.29:0/3454080397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96b00039e0 0x7f96c40ace90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f96c0037040 tx=0x7f96c40c4770 comp rx=0 tx=0).stop 2024-01-25T15:04:02.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.823+0000 7f96cb9c9640 1 -- 172.21.15.29:0/3454080397 shutdown_connections 2024-01-25T15:04:02.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.823+0000 7f96cb9c9640 1 --2- 172.21.15.29:0/3454080397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96c4153600 0x7f96c41ecd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:02.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.823+0000 7f96cb9c9640 1 --2- 172.21.15.29:0/3454080397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96c4155130 0x7f96c41530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:02.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.823+0000 7f96cb9c9640 1 --2- 172.21.15.29:0/3454080397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96b00039e0 0x7f96c40ace90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:02.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.823+0000 7f96cb9c9640 1 -- 172.21.15.29:0/3454080397 >> 172.21.15.29:0/3454080397 conn(0x7f96c40c7f80 msgr2=0x7f96c40c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:02.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.823+0000 7f96cb9c9640 1 -- 172.21.15.29:0/3454080397 shutdown_connections 2024-01-25T15:04:02.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:02.823+0000 7f96cb9c9640 1 -- 172.21.15.29:0/3454080397 wait complete. 2024-01-25T15:04:02.834 INFO:tasks.ceph:check_enable_crimson: False 2024-01-25T15:04:02.834 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-25T15:04:02.834 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:04:02.834 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-25T15:04:02.861 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:04:02.861 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-25T15:04:02.928 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:04:02.928 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-25T15:04:02.995 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:04:02.995 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-25T15:04:03.062 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:04:03.062 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-01-25T15:04:03.089 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:04:03.089 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-01-25T15:04:03.156 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:04:03.156 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-01-25T15:04:03.194 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:03.194+0000 7f42517db040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-25T15:04:03.220 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:04:03.220 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-01-25T15:04:03.238 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:03.238+0000 7ffaf419b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-25T15:04:03.250 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:03.250+0000 7f42517db040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-25T15:04:03.277 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd new 395fb9df-ad7b-4431-9def-b4a5848cb300 0 2024-01-25T15:04:03.293 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:03.293+0000 7ffaf419b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-25T15:04:03.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.418+0000 7fb2c1dce640 1 Processor -- start 2024-01-25T15:04:03.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.418+0000 7fb2c1dce640 1 -- start start 2024-01-25T15:04:03.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.418+0000 7fb2c1dce640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb2bc149190 0x7fb2bc0ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:03.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.418+0000 7fb2c1dce640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2bc070510 0x7fb2bc0c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:03.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.418+0000 7fb2c1dce640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2bc070d40 con 0x7fb2bc0c7890 2024-01-25T15:04:03.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.418+0000 7fb2c1dce640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2bc155c00 con 0x7fb2bc149190 2024-01-25T15:04:03.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.418+0000 7fb2c1dce640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc155ee0 con 0x7fb2bc070510 2024-01-25T15:04:03.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.418+0000 7fb2bb7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb2bc149190 0x7fb2bc0ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:03.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.418+0000 7fb2baffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2bc070510 0x7fb2bc0c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:03.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.419+0000 7fb2bb7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb2bc149190 0x7fb2bc0ad0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46696/0 (socket says 172.21.15.52:46696) 2024-01-25T15:04:03.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.419+0000 7fb2bb7fe640 1 -- 172.21.15.52:0/405817614 learned_addr learned my addr 172.21.15.52:0/405817614 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-01-25T15:04:03.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.419+0000 7fb2bb7fe640 1 -- 172.21.15.52:0/405817614 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2bc070510 msgr2=0x7fb2bc0c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:03.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.419+0000 7fb2bb7fe640 1 --2- 172.21.15.52:0/405817614 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2bc070510 0x7fb2bc0c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.419+0000 7fb2bb7fe640 1 -- 172.21.15.52:0/405817614 >> v1:172.21.15.29:6789/0 conn(0x7fb2bc0c7890 legacy=0x7fb2bc152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:03.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.419+0000 7fb2bb7fe640 1 -- 172.21.15.52:0/405817614 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2bc1561c0 con 0x7fb2bc149190 2024-01-25T15:04:03.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.419+0000 7fb2baffd640 1 --2- 172.21.15.52:0/405817614 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2bc070510 0x7fb2bc0c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:03.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.420+0000 7fb2bb7fe640 1 --2- 172.21.15.52:0/405817614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2bc149190 0x7fb2bc0ad0b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009870 tx=0x7fb2ac02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91d9364c4fadd8 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:03.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.420+0000 7fb2ba7fc640 1 -- 172.21.15.52:0/405817614 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac030840 con 0x7fb2bc149190 2024-01-25T15:04:03.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.420+0000 7fb2ba7fc640 1 -- 172.21.15.52:0/405817614 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ac0309a0 con 0x7fb2bc149190 2024-01-25T15:04:03.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.420+0000 7fb2ba7fc640 1 -- 172.21.15.52:0/405817614 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac030d30 con 0x7fb2bc149190 2024-01-25T15:04:03.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.421+0000 7fb2c1dce640 1 -- 172.21.15.52:0/405817614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2bc149190 msgr2=0x7fb2bc0ad0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:03.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.421+0000 7fb2c1dce640 1 --2- 172.21.15.52:0/405817614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2bc149190 0x7fb2bc0ad0b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009870 tx=0x7fb2ac02b980 comp rx=0 tx=0).stop 2024-01-25T15:04:03.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.421+0000 7fb2c1dce640 1 -- 172.21.15.52:0/405817614 shutdown_connections 2024-01-25T15:04:03.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.421+0000 7fb2c1dce640 1 --2- 172.21.15.52:0/405817614 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2bc070510 0x7fb2bc0c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.421+0000 7fb2c1dce640 1 --2- 172.21.15.52:0/405817614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2bc149190 0x7fb2bc0ad0b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.421+0000 7fb2c1dce640 1 -- 172.21.15.52:0/405817614 >> 172.21.15.52:0/405817614 conn(0x7fb2bc0c7f80 msgr2=0x7fb2bc0c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:03.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.421+0000 7fb2c1dce640 1 -- 172.21.15.52:0/405817614 shutdown_connections 2024-01-25T15:04:03.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.421+0000 7fb2c1dce640 1 -- 172.21.15.52:0/405817614 wait complete. 2024-01-25T15:04:03.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.422+0000 7fb2c1dce640 1 Processor -- start 2024-01-25T15:04:03.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.422+0000 7fb2c1dce640 1 -- start start 2024-01-25T15:04:03.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.423+0000 7fb2c1dce640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2bc070510 0x7fb2bc1ea0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:03.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.423+0000 7fb2c1dce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2bc0c7890 0x7fb2bc145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:03.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.423+0000 7fb2c1dce640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2bc149190 0x7fb2bc1dc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:03.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.423+0000 7fb2c1dce640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc1dbfc0 con 0x7fb2bc149190 2024-01-25T15:04:03.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.423+0000 7fb2c1dce640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc1ee280 con 0x7fb2bc0c7890 2024-01-25T15:04:03.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.423+0000 7fb2c1dce640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc06d770 con 0x7fb2bc070510 2024-01-25T15:04:03.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.423+0000 7fb2baffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2bc0c7890 0x7fb2bc145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:03.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.423+0000 7fb2bb7fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2bc070510 0x7fb2bc1ea0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:03.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.423+0000 7fb2baffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2bc0c7890 0x7fb2bc145730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46698/0 (socket says 172.21.15.52:46698) 2024-01-25T15:04:03.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.423+0000 7fb2baffd640 1 -- 172.21.15.52:0/3151816617 learned_addr learned my addr 172.21.15.52:0/3151816617 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-01-25T15:04:03.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.423+0000 7fb2bbfff640 1 --2- 172.21.15.52:0/3151816617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2bc149190 0x7fb2bc1dc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:03.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.423+0000 7fb2baffd640 1 -- 172.21.15.52:0/3151816617 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2bc070510 msgr2=0x7fb2bc1ea0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:03.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.423+0000 7fb2baffd640 1 --2- 172.21.15.52:0/3151816617 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2bc070510 0x7fb2bc1ea0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.423+0000 7fb2baffd640 1 -- 172.21.15.52:0/3151816617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2bc149190 msgr2=0x7fb2bc1dc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:03.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.423+0000 7fb2baffd640 1 --2- 172.21.15.52:0/3151816617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2bc149190 0x7fb2bc1dc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.423+0000 7fb2baffd640 1 -- 172.21.15.52:0/3151816617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b0009400 con 0x7fb2bc0c7890 2024-01-25T15:04:03.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.423+0000 7fb2bb7fe640 1 --2- 172.21.15.52:0/3151816617 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2bc070510 0x7fb2bc1ea0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:03.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.423+0000 7fb2baffd640 1 --2- 172.21.15.52:0/3151816617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2bc0c7890 0x7fb2bc145730 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000e990 tx=0x7fb2b000ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:03.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.424+0000 7fb2a3fff640 1 -- 172.21.15.52:0/3151816617 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b000c9e0 con 0x7fb2bc0c7890 2024-01-25T15:04:03.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.424+0000 7fb2a3fff640 1 -- 172.21.15.52:0/3151816617 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b000cb40 con 0x7fb2bc0c7890 2024-01-25T15:04:03.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.424+0000 7fb2c1dce640 1 -- 172.21.15.52:0/3151816617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ac0094d0 con 0x7fb2bc0c7890 2024-01-25T15:04:03.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.424+0000 7fb2a3fff640 1 -- 172.21.15.52:0/3151816617 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b000ced0 con 0x7fb2bc0c7890 2024-01-25T15:04:03.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.424+0000 7fb2c1dce640 1 -- 172.21.15.52:0/3151816617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2bc152c50 con 0x7fb2bc0c7890 2024-01-25T15:04:03.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.424+0000 7fb2a3fff640 1 -- 172.21.15.52:0/3151816617 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fb2b0005990 con 0x7fb2bc0c7890 2024-01-25T15:04:03.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.424+0000 7fb2a3fff640 1 -- 172.21.15.52:0/3151816617 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb2b0013840 con 0x7fb2bc0c7890 2024-01-25T15:04:03.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.425+0000 7fb2c1dce640 1 -- 172.21.15.52:0/3151816617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2bc074010 con 0x7fb2bc0c7890 2024-01-25T15:04:03.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.427+0000 7fb2a3fff640 1 -- 172.21.15.52:0/3151816617 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fb2b0021060 con 0x7fb2bc0c7890 2024-01-25T15:04:03.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.500+0000 7fb2c1dce640 1 -- 172.21.15.52:0/3151816617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "395fb9df-ad7b-4431-9def-b4a5848cb300", "id": 0} v 0) v1 -- 0x7fb2bc1dc3c0 con 0x7fb2bc0c7890 2024-01-25T15:04:03.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.503+0000 7fb2a3fff640 1 -- 172.21.15.52:0/3151816617 <== mon.1 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "395fb9df-ad7b-4431-9def-b4a5848cb300", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb2b0017070 con 0x7fb2bc0c7890 2024-01-25T15:04:03.504 INFO:teuthology.orchestra.run.smithi052.stdout:0 2024-01-25T15:04:03.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.504+0000 7fb2c1dce640 1 -- 172.21.15.52:0/3151816617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2bc0c7890 msgr2=0x7fb2bc145730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:03.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.504+0000 7fb2c1dce640 1 --2- 172.21.15.52:0/3151816617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2bc0c7890 0x7fb2bc145730 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000e990 tx=0x7fb2b000ee50 comp rx=0 tx=0).stop 2024-01-25T15:04:03.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.504+0000 7fb2c1dce640 1 -- 172.21.15.52:0/3151816617 shutdown_connections 2024-01-25T15:04:03.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.504+0000 7fb2c1dce640 1 --2- 172.21.15.52:0/3151816617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2bc149190 0x7fb2bc1dc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.504+0000 7fb2c1dce640 1 --2- 172.21.15.52:0/3151816617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2bc0c7890 0x7fb2bc145730 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.504+0000 7fb2c1dce640 1 --2- 172.21.15.52:0/3151816617 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2bc070510 0x7fb2bc1ea0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.504+0000 7fb2c1dce640 1 -- 172.21.15.52:0/3151816617 >> 172.21.15.52:0/3151816617 conn(0x7fb2bc0c7f80 msgr2=0x7fb2bc154710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:03.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.504+0000 7fb2c1dce640 1 -- 172.21.15.52:0/3151816617 shutdown_connections 2024-01-25T15:04:03.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.504+0000 7fb2c1dce640 1 -- 172.21.15.52:0/3151816617 wait complete. 2024-01-25T15:04:03.515 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd new 90952af7-a717-4765-890d-de32fccea0b8 1 2024-01-25T15:04:03.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.615+0000 7f592d65c640 1 Processor -- start 2024-01-25T15:04:03.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.615+0000 7f592d65c640 1 -- start start 2024-01-25T15:04:03.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.616+0000 7f592d65c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59280af6c0 0x7f59280c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:03.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.616+0000 7f592d65c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f59280c5a70 0x7f592806b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:03.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.616+0000 7f592d65c640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59280afaa0 con 0x7f592806d560 2024-01-25T15:04:03.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.616+0000 7f592d65c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592806c480 con 0x7f59280c5a70 2024-01-25T15:04:03.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.616+0000 7f592d65c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5928155290 con 0x7f59280af6c0 2024-01-25T15:04:03.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.616+0000 7f5926ffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59280af6c0 0x7f59280c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:03.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.616+0000 7f591ffff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f592806d560 0x7f592806b220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:58702/0 (socket says 172.21.15.52:58702) 2024-01-25T15:04:03.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.616+0000 7f591ffff640 1 -- 172.21.15.52:0/2262217056 learned_addr learned my addr 172.21.15.52:0/2262217056 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-01-25T15:04:03.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.616+0000 7f59277fe640 1 --2- 172.21.15.52:0/2262217056 >> v2:172.21.15.29:3300/0 conn(0x7f59280c5a70 0x7f592806b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:03.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.616+0000 7f59267fc640 1 -- 172.21.15.52:0/2262217056 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72517399 0 0) 0x7f59280afaa0 con 0x7f592806d560 2024-01-25T15:04:03.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.616+0000 7f59267fc640 1 -- 172.21.15.52:0/2262217056 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5914003520 con 0x7f592806d560 2024-01-25T15:04:03.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.616+0000 7f5926ffd640 1 -- 172.21.15.52:0/2262217056 >> v2:172.21.15.29:3300/0 conn(0x7f59280c5a70 msgr2=0x7f592806b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:03.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.616+0000 7f5926ffd640 1 --2- 172.21.15.52:0/2262217056 >> v2:172.21.15.29:3300/0 conn(0x7f59280c5a70 0x7f592806b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.616+0000 7f5926ffd640 1 -- 172.21.15.52:0/2262217056 >> v1:172.21.15.52:6789/0 conn(0x7f592806d560 legacy=0x7f592806b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:03.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.616+0000 7f5926ffd640 1 -- 172.21.15.52:0/2262217056 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59280c6060 con 0x7f59280af6c0 2024-01-25T15:04:03.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.617+0000 7f5926ffd640 1 --2- 172.21.15.52:0/2262217056 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59280af6c0 0x7f59280c5530 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f59180097a0 tx=0x7f591802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb87aa23014adad9 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:03.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.617+0000 7f59267fc640 1 -- 172.21.15.52:0/2262217056 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918031830 con 0x7f59280af6c0 2024-01-25T15:04:03.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.617+0000 7f59267fc640 1 -- 172.21.15.52:0/2262217056 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5918031990 con 0x7f59280af6c0 2024-01-25T15:04:03.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.617+0000 7f59267fc640 1 -- 172.21.15.52:0/2262217056 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918031d20 con 0x7f59280af6c0 2024-01-25T15:04:03.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.618+0000 7f592d65c640 1 -- 172.21.15.52:0/2262217056 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59280af6c0 msgr2=0x7f59280c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:03.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.618+0000 7f592d65c640 1 --2- 172.21.15.52:0/2262217056 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59280af6c0 0x7f59280c5530 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f59180097a0 tx=0x7f591802b8d0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.618+0000 7f592d65c640 1 -- 172.21.15.52:0/2262217056 shutdown_connections 2024-01-25T15:04:03.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.618+0000 7f592d65c640 1 --2- 172.21.15.52:0/2262217056 >> v2:172.21.15.29:3300/0 conn(0x7f59280c5a70 0x7f592806b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.618+0000 7f592d65c640 1 --2- 172.21.15.52:0/2262217056 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59280af6c0 0x7f59280c5530 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.618+0000 7f592d65c640 1 -- 172.21.15.52:0/2262217056 >> 172.21.15.52:0/2262217056 conn(0x7f59280c6ca0 msgr2=0x7f59280c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:03.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.618+0000 7f592d65c640 1 -- 172.21.15.52:0/2262217056 shutdown_connections 2024-01-25T15:04:03.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.618+0000 7f592d65c640 1 -- 172.21.15.52:0/2262217056 wait complete. 2024-01-25T15:04:03.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.619+0000 7f592d65c640 1 Processor -- start 2024-01-25T15:04:03.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.619+0000 7f592d65c640 1 -- start start 2024-01-25T15:04:03.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.620+0000 7f592d65c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592806d560 0x7f5928157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:03.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.620+0000 7f592d65c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59280af6c0 0x7f5928150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:03.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.620+0000 7f592d65c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59280c5a70 0x7f5928151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:03.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.620+0000 7f592d65c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59280bfd20 con 0x7f59280af6c0 2024-01-25T15:04:03.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.620+0000 7f592d65c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59280bdd50 con 0x7f59280c5a70 2024-01-25T15:04:03.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.620+0000 7f592d65c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59281eb240 con 0x7f592806d560 2024-01-25T15:04:03.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.620+0000 7f5926ffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592806d560 0x7f5928157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:03.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.620+0000 7f59277fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59280c5a70 0x7f5928151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:03.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.620+0000 7f5926ffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592806d560 0x7f5928157e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:34750/0 (socket says 172.21.15.52:34750) 2024-01-25T15:04:03.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.620+0000 7f5926ffd640 1 -- 172.21.15.52:0/348581653 learned_addr learned my addr 172.21.15.52:0/348581653 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-01-25T15:04:03.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.620+0000 7f591ffff640 1 --2- 172.21.15.52:0/348581653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59280af6c0 0x7f5928150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:03.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.620+0000 7f5926ffd640 1 -- 172.21.15.52:0/348581653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59280c5a70 msgr2=0x7f5928151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:03.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.620+0000 7f5926ffd640 1 --2- 172.21.15.52:0/348581653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59280c5a70 0x7f5928151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.620+0000 7f5926ffd640 1 -- 172.21.15.52:0/348581653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59280af6c0 msgr2=0x7f5928150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:03.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.620+0000 7f5926ffd640 1 --2- 172.21.15.52:0/348581653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59280af6c0 0x7f5928150ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.620+0000 7f5926ffd640 1 -- 172.21.15.52:0/348581653 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5918009400 con 0x7f592806d560 2024-01-25T15:04:03.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.620+0000 7f59277fe640 1 --2- 172.21.15.52:0/348581653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59280c5a70 0x7f5928151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:03.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.620+0000 7f5926ffd640 1 --2- 172.21.15.52:0/348581653 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592806d560 0x7f5928157e50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f591802bee0 tx=0x7f59180046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:03.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.620+0000 7f591f7fe640 1 -- 172.21.15.52:0/348581653 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591803a6f0 con 0x7f592806d560 2024-01-25T15:04:03.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.620+0000 7f591f7fe640 1 -- 172.21.15.52:0/348581653 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591803a870 con 0x7f592806d560 2024-01-25T15:04:03.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.620+0000 7f592d65c640 1 -- 172.21.15.52:0/348581653 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59280c4010 con 0x7f592806d560 2024-01-25T15:04:03.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.621+0000 7f591f7fe640 1 -- 172.21.15.52:0/348581653 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591803ac20 con 0x7f592806d560 2024-01-25T15:04:03.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.621+0000 7f592d65c640 1 -- 172.21.15.52:0/348581653 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59280c3a50 con 0x7f592806d560 2024-01-25T15:04:03.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.621+0000 7f591f7fe640 1 -- 172.21.15.52:0/348581653 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f591804d440 con 0x7f592806d560 2024-01-25T15:04:03.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.621+0000 7f591f7fe640 1 -- 172.21.15.52:0/348581653 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f5918043930 con 0x7f592806d560 2024-01-25T15:04:03.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.621+0000 7f592d65c640 1 -- 172.21.15.52:0/348581653 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5928074010 con 0x7f592806d560 2024-01-25T15:04:03.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.624+0000 7f591f7fe640 1 -- 172.21.15.52:0/348581653 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f5918048070 con 0x7f592806d560 2024-01-25T15:04:03.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.697+0000 7f592d65c640 1 -- 172.21.15.52:0/348581653 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd new", "uuid": "90952af7-a717-4765-890d-de32fccea0b8", "id": 1} v 0) v1 -- 0x7f59280c97e0 con 0x7f592806d560 2024-01-25T15:04:03.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.700+0000 7f591f7fe640 1 -- 172.21.15.52:0/348581653 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "90952af7-a717-4765-890d-de32fccea0b8", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5918035020 con 0x7f592806d560 2024-01-25T15:04:03.701 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-01-25T15:04:03.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.701+0000 7f592d65c640 1 -- 172.21.15.52:0/348581653 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592806d560 msgr2=0x7f5928157e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:03.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.701+0000 7f592d65c640 1 --2- 172.21.15.52:0/348581653 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592806d560 0x7f5928157e50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f591802bee0 tx=0x7f59180046c0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.701+0000 7f592d65c640 1 -- 172.21.15.52:0/348581653 shutdown_connections 2024-01-25T15:04:03.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.701+0000 7f592d65c640 1 --2- 172.21.15.52:0/348581653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59280c5a70 0x7f5928151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.701+0000 7f592d65c640 1 --2- 172.21.15.52:0/348581653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59280af6c0 0x7f5928150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.701+0000 7f592d65c640 1 --2- 172.21.15.52:0/348581653 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f592806d560 0x7f5928157e50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.701+0000 7f592d65c640 1 -- 172.21.15.52:0/348581653 >> 172.21.15.52:0/348581653 conn(0x7f59280c6ca0 msgr2=0x7f59280c7080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:03.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.701+0000 7f592d65c640 1 -- 172.21.15.52:0/348581653 shutdown_connections 2024-01-25T15:04:03.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.701+0000 7f592d65c640 1 -- 172.21.15.52:0/348581653 wait complete. 2024-01-25T15:04:03.712 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd new f2bfdf0f-394f-4e66-b968-db6a6c98dcaf 2 2024-01-25T15:04:03.800 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:03.799+0000 7f42517db040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-25T15:04:03.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.813+0000 7fa1d82c9640 1 Processor -- start 2024-01-25T15:04:03.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.813+0000 7fa1d82c9640 1 -- start start 2024-01-25T15:04:03.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.814+0000 7fa1d82c9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa1d00728d0 0x7fa1d0154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:03.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.814+0000 7fa1d82c9640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d006ed10 con 0x7fa1d006f130 2024-01-25T15:04:03.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.814+0000 7fa1d82c9640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d006da90 con 0x7fa1d006e410 2024-01-25T15:04:03.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.814+0000 7fa1d82c9640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d006efb0 con 0x7fa1d00728d0 2024-01-25T15:04:03.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.814+0000 7fa1d6065640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa1d00728d0 0x7fa1d0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:03.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.814+0000 7fa1d6065640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa1d00728d0 0x7fa1d0154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46720/0 (socket says 172.21.15.52:46720) 2024-01-25T15:04:03.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.814+0000 7fa1d6065640 1 -- 172.21.15.52:0/2786424728 learned_addr learned my addr 172.21.15.52:0/2786424728 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-01-25T15:04:03.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.814+0000 7fa1d6065640 1 -- 172.21.15.52:0/2786424728 >> v1:172.21.15.52:6789/0 conn(0x7fa1d006e410 legacy=0x7fa1d006b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:03.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.814+0000 7fa1d6065640 1 -- 172.21.15.52:0/2786424728 >> v1:172.21.15.29:6789/0 conn(0x7fa1d006f130 legacy=0x7fa1d00c1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:03.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.814+0000 7fa1d6065640 1 -- 172.21.15.52:0/2786424728 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d0158990 con 0x7fa1d00728d0 2024-01-25T15:04:03.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.815+0000 7fa1d6065640 1 --2- 172.21.15.52:0/2786424728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1d00728d0 0x7fa1d0154810 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc009870 tx=0x7fa1cc02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84f4700f8402a6e7 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:03.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.815+0000 7fa1d5063640 1 -- 172.21.15.52:0/2786424728 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc031870 con 0x7fa1d00728d0 2024-01-25T15:04:03.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.815+0000 7fa1d5063640 1 -- 172.21.15.52:0/2786424728 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1cc0319d0 con 0x7fa1d00728d0 2024-01-25T15:04:03.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.815+0000 7fa1d5063640 1 -- 172.21.15.52:0/2786424728 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc031d60 con 0x7fa1d00728d0 2024-01-25T15:04:03.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.816+0000 7fa1d82c9640 1 -- 172.21.15.52:0/2786424728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1d00728d0 msgr2=0x7fa1d0154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:03.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.816+0000 7fa1d82c9640 1 --2- 172.21.15.52:0/2786424728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1d00728d0 0x7fa1d0154810 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc009870 tx=0x7fa1cc02b910 comp rx=0 tx=0).stop 2024-01-25T15:04:03.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.816+0000 7fa1d82c9640 1 -- 172.21.15.52:0/2786424728 shutdown_connections 2024-01-25T15:04:03.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.816+0000 7fa1d82c9640 1 --2- 172.21.15.52:0/2786424728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1d00728d0 0x7fa1d0154810 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.816+0000 7fa1d82c9640 1 -- 172.21.15.52:0/2786424728 >> 172.21.15.52:0/2786424728 conn(0x7fa1d00c3160 msgr2=0x7fa1d00c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:03.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.816+0000 7fa1d82c9640 1 -- 172.21.15.52:0/2786424728 shutdown_connections 2024-01-25T15:04:03.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.816+0000 7fa1d82c9640 1 -- 172.21.15.52:0/2786424728 wait complete. 2024-01-25T15:04:03.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.817+0000 7fa1d82c9640 1 Processor -- start 2024-01-25T15:04:03.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.817+0000 7fa1d82c9640 1 -- start start 2024-01-25T15:04:03.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.818+0000 7fa1d82c9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1d006e410 0x7fa1d01eb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:03.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.818+0000 7fa1d82c9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1d006f130 0x7fa1d014d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:03.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.818+0000 7fa1d82c9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1d00728d0 0x7fa1d01475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:03.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.818+0000 7fa1d82c9640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d00a9ab0 con 0x7fa1d006f130 2024-01-25T15:04:03.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.818+0000 7fa1d82c9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d01eb640 con 0x7fa1d00728d0 2024-01-25T15:04:03.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.818+0000 7fa1d82c9640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d00c6310 con 0x7fa1d006e410 2024-01-25T15:04:03.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.818+0000 7fa1d6065640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1d006e410 0x7fa1d01eb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:03.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.818+0000 7fa1d6065640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1d006e410 0x7fa1d01eb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:34752/0 (socket says 172.21.15.52:34752) 2024-01-25T15:04:03.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.818+0000 7fa1d6065640 1 -- 172.21.15.52:0/570892789 learned_addr learned my addr 172.21.15.52:0/570892789 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-01-25T15:04:03.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.818+0000 7fa1d6866640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1d00728d0 0x7fa1d01475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:03.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.818+0000 7fa1d5864640 1 --2- 172.21.15.52:0/570892789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1d006f130 0x7fa1d014d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:03.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.818+0000 7fa1d6866640 1 -- 172.21.15.52:0/570892789 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1d006e410 msgr2=0x7fa1d01eb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:03.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.818+0000 7fa1d6866640 1 --2- 172.21.15.52:0/570892789 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1d006e410 0x7fa1d01eb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.818+0000 7fa1d6866640 1 -- 172.21.15.52:0/570892789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1d006f130 msgr2=0x7fa1d014d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:03.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.818+0000 7fa1d6866640 1 --2- 172.21.15.52:0/570892789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1d006f130 0x7fa1d014d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.818+0000 7fa1d6866640 1 -- 172.21.15.52:0/570892789 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1cc0094d0 con 0x7fa1d00728d0 2024-01-25T15:04:03.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.818+0000 7fa1d6065640 1 --2- 172.21.15.52:0/570892789 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1d006e410 0x7fa1d01eb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:03.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.818+0000 7fa1d6866640 1 --2- 172.21.15.52:0/570892789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1d00728d0 0x7fa1d01475e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800c700 tx=0x7fa1c800cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:03.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.818+0000 7fa1c6ffd640 1 -- 172.21.15.52:0/570892789 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8003b70 con 0x7fa1d00728d0 2024-01-25T15:04:03.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.818+0000 7fa1c6ffd640 1 -- 172.21.15.52:0/570892789 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c8003cd0 con 0x7fa1d00728d0 2024-01-25T15:04:03.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.818+0000 7fa1d82c9640 1 -- 172.21.15.52:0/570892789 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d00a97d0 con 0x7fa1d00728d0 2024-01-25T15:04:03.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.818+0000 7fa1c6ffd640 1 -- 172.21.15.52:0/570892789 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8005310 con 0x7fa1d00728d0 2024-01-25T15:04:03.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.819+0000 7fa1d82c9640 1 -- 172.21.15.52:0/570892789 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d00c6030 con 0x7fa1d00728d0 2024-01-25T15:04:03.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.819+0000 7fa1c6ffd640 1 -- 172.21.15.52:0/570892789 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa1c8005470 con 0x7fa1d00728d0 2024-01-25T15:04:03.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.819+0000 7fa1c6ffd640 1 -- 172.21.15.52:0/570892789 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fa1c8012840 con 0x7fa1d00728d0 2024-01-25T15:04:03.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.819+0000 7fa1d82c9640 1 -- 172.21.15.52:0/570892789 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d00ac870 con 0x7fa1d00728d0 2024-01-25T15:04:03.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.822+0000 7fa1c6ffd640 1 -- 172.21.15.52:0/570892789 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fa1c8003e40 con 0x7fa1d00728d0 2024-01-25T15:04:03.854 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:03.853+0000 7ffaf419b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-25T15:04:03.856 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:03.855+0000 7f42517db040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-25T15:04:03.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.895+0000 7fa1d82c9640 1 -- 172.21.15.52:0/570892789 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f2bfdf0f-394f-4e66-b968-db6a6c98dcaf", "id": 2} v 0) v1 -- 0x7fa1d00c4030 con 0x7fa1d00728d0 2024-01-25T15:04:03.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.897+0000 7fa1c6ffd640 1 -- 172.21.15.52:0/570892789 <== mon.1 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f2bfdf0f-394f-4e66-b968-db6a6c98dcaf", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa1c8012420 con 0x7fa1d00728d0 2024-01-25T15:04:03.898 INFO:teuthology.orchestra.run.smithi052.stdout:2 2024-01-25T15:04:03.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.898+0000 7fa1d82c9640 1 -- 172.21.15.52:0/570892789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1d00728d0 msgr2=0x7fa1d01475e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:03.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.898+0000 7fa1d82c9640 1 --2- 172.21.15.52:0/570892789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1d00728d0 0x7fa1d01475e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800c700 tx=0x7fa1c800cbc0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.898+0000 7fa1d82c9640 1 -- 172.21.15.52:0/570892789 shutdown_connections 2024-01-25T15:04:03.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.898+0000 7fa1d82c9640 1 --2- 172.21.15.52:0/570892789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1d00728d0 0x7fa1d01475e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.898+0000 7fa1d82c9640 1 --2- 172.21.15.52:0/570892789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1d006f130 0x7fa1d014d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.898+0000 7fa1d82c9640 1 --2- 172.21.15.52:0/570892789 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa1d006e410 0x7fa1d01eb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:03.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.898+0000 7fa1d82c9640 1 -- 172.21.15.52:0/570892789 >> 172.21.15.52:0/570892789 conn(0x7fa1d00c3160 msgr2=0x7fa1d00c3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:03.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.898+0000 7fa1d82c9640 1 -- 172.21.15.52:0/570892789 shutdown_connections 2024-01-25T15:04:03.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:03.898+0000 7fa1d82c9640 1 -- 172.21.15.52:0/570892789 wait complete. 2024-01-25T15:04:03.903 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:03.902+0000 7f42517db040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-25T15:04:03.908 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:03.908+0000 7ffaf419b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-25T15:04:03.909 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd new 4df8b3c8-0632-4c9d-89fe-68b81e05470c 3 2024-01-25T15:04:03.955 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:03.955+0000 7ffaf419b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-25T15:04:03.969 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:03.969+0000 7f42517db040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-25T15:04:04.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.009+0000 7ff135cec640 1 Processor -- start 2024-01-25T15:04:04.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.010+0000 7ff135cec640 1 -- start start 2024-01-25T15:04:04.010 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:04.010+0000 7ffaf419b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-25T15:04:04.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.010+0000 7ff135cec640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff13006d3a0 0x7ff130154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:04.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.010+0000 7ff135cec640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1300c30d0 con 0x7ff13006cf10 2024-01-25T15:04:04.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.010+0000 7ff135cec640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff130155310 con 0x7ff130151d30 2024-01-25T15:04:04.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.010+0000 7ff135cec640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13006ef80 con 0x7ff13006d3a0 2024-01-25T15:04:04.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.010+0000 7ff12ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff13006d3a0 0x7ff130154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:04.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.010+0000 7ff12ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff13006d3a0 0x7ff130154dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46748/0 (socket says 172.21.15.52:46748) 2024-01-25T15:04:04.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.010+0000 7ff12ffff640 1 -- 172.21.15.52:0/2516716097 learned_addr learned my addr 172.21.15.52:0/2516716097 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-01-25T15:04:04.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.011+0000 7ff12ffff640 1 -- 172.21.15.52:0/2516716097 >> v1:172.21.15.52:6789/0 conn(0x7ff130151d30 legacy=0x7ff13006a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.011+0000 7ff12ffff640 1 -- 172.21.15.52:0/2516716097 >> v1:172.21.15.29:6789/0 conn(0x7ff13006cf10 legacy=0x7ff1301546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.011+0000 7ff12ffff640 1 -- 172.21.15.52:0/2516716097 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff130152110 con 0x7ff13006d3a0 2024-01-25T15:04:04.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.011+0000 7ff12ffff640 1 --2- 172.21.15.52:0/2516716097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13006d3a0 0x7ff130154dd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff13006d850 tx=0x7ff12802bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc1ed9c6ca6137a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:04.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.011+0000 7ff12e7fc640 1 -- 172.21.15.52:0/2516716097 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12802ca70 con 0x7ff13006d3a0 2024-01-25T15:04:04.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.011+0000 7ff12e7fc640 1 -- 172.21.15.52:0/2516716097 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12802cbd0 con 0x7ff13006d3a0 2024-01-25T15:04:04.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.012+0000 7ff12e7fc640 1 -- 172.21.15.52:0/2516716097 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1280343f0 con 0x7ff13006d3a0 2024-01-25T15:04:04.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.012+0000 7ff135cec640 1 -- 172.21.15.52:0/2516716097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13006d3a0 msgr2=0x7ff130154dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.012+0000 7ff135cec640 1 --2- 172.21.15.52:0/2516716097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13006d3a0 0x7ff130154dd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff13006d850 tx=0x7ff12802bed0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.012+0000 7ff135cec640 1 -- 172.21.15.52:0/2516716097 shutdown_connections 2024-01-25T15:04:04.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.012+0000 7ff135cec640 1 --2- 172.21.15.52:0/2516716097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13006d3a0 0x7ff130154dd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.012+0000 7ff135cec640 1 -- 172.21.15.52:0/2516716097 >> 172.21.15.52:0/2516716097 conn(0x7ff1300c39b0 msgr2=0x7ff1300c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:04.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.012+0000 7ff135cec640 1 -- 172.21.15.52:0/2516716097 shutdown_connections 2024-01-25T15:04:04.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.012+0000 7ff135cec640 1 -- 172.21.15.52:0/2516716097 wait complete. 2024-01-25T15:04:04.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.013+0000 7ff135cec640 1 Processor -- start 2024-01-25T15:04:04.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.013+0000 7ff135cec640 1 -- start start 2024-01-25T15:04:04.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.014+0000 7ff135cec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13006cf10 0x7ff13014ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:04.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.014+0000 7ff135cec640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff13006d3a0 0x7ff1301ea200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:04.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.014+0000 7ff135cec640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff130151d30 0x7ff130154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:04.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.014+0000 7ff135cec640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1301e1670 con 0x7ff13006d3a0 2024-01-25T15:04:04.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.014+0000 7ff135cec640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1301e1b80 con 0x7ff13006cf10 2024-01-25T15:04:04.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.014+0000 7ff135cec640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1301e1250 con 0x7ff130151d30 2024-01-25T15:04:04.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.014+0000 7ff12ffff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff130151d30 0x7ff130154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:04.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.014+0000 7ff12f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13006cf10 0x7ff13014ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:04.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.014+0000 7ff12ffff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff130151d30 0x7ff130154110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:34756/0 (socket says 172.21.15.52:34756) 2024-01-25T15:04:04.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.014+0000 7ff12ffff640 1 -- 172.21.15.52:0/3894417709 learned_addr learned my addr 172.21.15.52:0/3894417709 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-01-25T15:04:04.017 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:04.014+0000 7f42517db040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-25T15:04:04.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.014+0000 7ff12effd640 1 --2- 172.21.15.52:0/3894417709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff13006d3a0 0x7ff1301ea200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:04.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.014+0000 7ff12f7fe640 1 -- 172.21.15.52:0/3894417709 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff130151d30 msgr2=0x7ff130154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.015+0000 7ff12f7fe640 1 --2- 172.21.15.52:0/3894417709 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff130151d30 0x7ff130154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.015+0000 7ff12f7fe640 1 -- 172.21.15.52:0/3894417709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff13006d3a0 msgr2=0x7ff1301ea200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.015+0000 7ff12f7fe640 1 --2- 172.21.15.52:0/3894417709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff13006d3a0 0x7ff1301ea200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.015+0000 7ff12f7fe640 1 -- 172.21.15.52:0/3894417709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff128009b30 con 0x7ff13006cf10 2024-01-25T15:04:04.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.015+0000 7ff12ffff640 1 --2- 172.21.15.52:0/3894417709 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff130151d30 0x7ff130154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:04.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.015+0000 7ff12f7fe640 1 --2- 172.21.15.52:0/3894417709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13006cf10 0x7ff13014ca60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff12000c3c0 tx=0x7ff12000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:04.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.015+0000 7ff117fff640 1 -- 172.21.15.52:0/3894417709 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1200052d0 con 0x7ff13006cf10 2024-01-25T15:04:04.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.015+0000 7ff117fff640 1 -- 172.21.15.52:0/3894417709 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff120005430 con 0x7ff13006cf10 2024-01-25T15:04:04.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.015+0000 7ff135cec640 1 -- 172.21.15.52:0/3894417709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1301ea740 con 0x7ff13006cf10 2024-01-25T15:04:04.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.015+0000 7ff117fff640 1 -- 172.21.15.52:0/3894417709 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff120003830 con 0x7ff13006cf10 2024-01-25T15:04:04.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.015+0000 7ff135cec640 1 -- 172.21.15.52:0/3894417709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1301ed8a0 con 0x7ff13006cf10 2024-01-25T15:04:04.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.015+0000 7ff117fff640 1 -- 172.21.15.52:0/3894417709 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7ff120003990 con 0x7ff13006cf10 2024-01-25T15:04:04.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.015+0000 7ff117fff640 1 -- 172.21.15.52:0/3894417709 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7ff120011ea0 con 0x7ff13006cf10 2024-01-25T15:04:04.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.016+0000 7ff135cec640 1 -- 172.21.15.52:0/3894417709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff130074010 con 0x7ff13006cf10 2024-01-25T15:04:04.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.020+0000 7ff117fff640 1 -- 172.21.15.52:0/3894417709 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7ff120017070 con 0x7ff13006cf10 2024-01-25T15:04:04.054 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:04.054+0000 7ffaf419b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-25T15:04:04.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.094+0000 7ff135cec640 1 -- 172.21.15.52:0/3894417709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4df8b3c8-0632-4c9d-89fe-68b81e05470c", "id": 3} v 0) v1 -- 0x7ff1300aca50 con 0x7ff13006cf10 2024-01-25T15:04:04.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.097+0000 7ff117fff640 1 -- 172.21.15.52:0/3894417709 <== mon.1 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4df8b3c8-0632-4c9d-89fe-68b81e05470c", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff120012420 con 0x7ff13006cf10 2024-01-25T15:04:04.098 INFO:teuthology.orchestra.run.smithi052.stdout:3 2024-01-25T15:04:04.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.098+0000 7ff135cec640 1 -- 172.21.15.52:0/3894417709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13006cf10 msgr2=0x7ff13014ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.098+0000 7ff135cec640 1 --2- 172.21.15.52:0/3894417709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13006cf10 0x7ff13014ca60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff12000c3c0 tx=0x7ff12000c880 comp rx=0 tx=0).stop 2024-01-25T15:04:04.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.098+0000 7ff135cec640 1 -- 172.21.15.52:0/3894417709 shutdown_connections 2024-01-25T15:04:04.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.098+0000 7ff135cec640 1 --2- 172.21.15.52:0/3894417709 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff130151d30 0x7ff130154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.098+0000 7ff135cec640 1 --2- 172.21.15.52:0/3894417709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff13006d3a0 0x7ff1301ea200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.098+0000 7ff135cec640 1 --2- 172.21.15.52:0/3894417709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13006cf10 0x7ff13014ca60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.098+0000 7ff135cec640 1 -- 172.21.15.52:0/3894417709 >> 172.21.15.52:0/3894417709 conn(0x7ff1300c39b0 msgr2=0x7ff13006e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:04.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.098+0000 7ff135cec640 1 -- 172.21.15.52:0/3894417709 shutdown_connections 2024-01-25T15:04:04.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.098+0000 7ff135cec640 1 -- 172.21.15.52:0/3894417709 wait complete. 2024-01-25T15:04:04.109 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd new 6aeed49b-a515-49d8-979e-9bc344d8284d 4 2024-01-25T15:04:04.124 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:04.123+0000 7f42517db040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-25T15:04:04.160 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:04.160+0000 7ffaf419b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-25T15:04:04.198 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:04.197+0000 7f42517db040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-25T15:04:04.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.209+0000 7f7f04e64640 1 Processor -- start 2024-01-25T15:04:04.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.209+0000 7f7f04e64640 1 -- start start 2024-01-25T15:04:04.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.210+0000 7f7f04e64640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f000c2f80 0x7f7f00155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:04.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.210+0000 7f7f04e64640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f00155690 con 0x7f7f0014b2a0 2024-01-25T15:04:04.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.210+0000 7f7f04e64640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f000c24a0 con 0x7f7f0006d600 2024-01-25T15:04:04.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.210+0000 7f7f04e64640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f000c22c0 con 0x7f7f000c2f80 2024-01-25T15:04:04.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.210+0000 7f7ef7fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7f0006d600 0x7f7f00154950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:58722/0 (socket says 172.21.15.52:58722) 2024-01-25T15:04:04.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.210+0000 7f7efed9d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f000c2f80 0x7f7f00155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:04.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.210+0000 7f7ef7fff640 1 -- 172.21.15.52:0/1246599577 learned_addr learned my addr 172.21.15.52:0/1246599577 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-01-25T15:04:04.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.211+0000 7f7efdd9b640 1 -- 172.21.15.52:0/1246599577 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127679706 0 0) 0x7f7f000c24a0 con 0x7f7f0006d600 2024-01-25T15:04:04.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.211+0000 7f7efdd9b640 1 -- 172.21.15.52:0/1246599577 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eec003520 con 0x7f7f0006d600 2024-01-25T15:04:04.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.211+0000 7f7efed9d640 1 -- 172.21.15.52:0/1246599577 >> v1:172.21.15.52:6789/0 conn(0x7f7f0006d600 legacy=0x7f7f00154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.211+0000 7f7efed9d640 1 -- 172.21.15.52:0/1246599577 >> v1:172.21.15.29:6789/0 conn(0x7f7f0014b2a0 legacy=0x7f7f0006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.211+0000 7f7efed9d640 1 -- 172.21.15.52:0/1246599577 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f000c2780 con 0x7f7f000c2f80 2024-01-25T15:04:04.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.211+0000 7f7efed9d640 1 --2- 172.21.15.52:0/1246599577 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f000c2f80 0x7f7f00155060 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009dc0 tx=0x7f7ef802be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e98583dbd315319e server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:04.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.212+0000 7f7efdd9b640 1 -- 172.21.15.52:0/1246599577 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef802cc40 con 0x7f7f000c2f80 2024-01-25T15:04:04.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.212+0000 7f7efdd9b640 1 -- 172.21.15.52:0/1246599577 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef802cda0 con 0x7f7f000c2f80 2024-01-25T15:04:04.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.212+0000 7f7efdd9b640 1 -- 172.21.15.52:0/1246599577 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef8034660 con 0x7f7f000c2f80 2024-01-25T15:04:04.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.212+0000 7f7f04e64640 1 -- 172.21.15.52:0/1246599577 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f000c2f80 msgr2=0x7f7f00155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.212+0000 7f7f04e64640 1 --2- 172.21.15.52:0/1246599577 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f000c2f80 0x7f7f00155060 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009dc0 tx=0x7f7ef802be90 comp rx=0 tx=0).stop 2024-01-25T15:04:04.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.212+0000 7f7f04e64640 1 -- 172.21.15.52:0/1246599577 shutdown_connections 2024-01-25T15:04:04.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.212+0000 7f7f04e64640 1 --2- 172.21.15.52:0/1246599577 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f000c2f80 0x7f7f00155060 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.212+0000 7f7f04e64640 1 -- 172.21.15.52:0/1246599577 >> 172.21.15.52:0/1246599577 conn(0x7f7f000c39b0 msgr2=0x7f7f000c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:04.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.212+0000 7f7f04e64640 1 -- 172.21.15.52:0/1246599577 shutdown_connections 2024-01-25T15:04:04.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.212+0000 7f7f04e64640 1 -- 172.21.15.52:0/1246599577 wait complete. 2024-01-25T15:04:04.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.214+0000 7f7f04e64640 1 Processor -- start 2024-01-25T15:04:04.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.214+0000 7f7f04e64640 1 -- start start 2024-01-25T15:04:04.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.214+0000 7f7f04e64640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f0006d600 0x7f7f001ebb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:04.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.214+0000 7f7f04e64640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f000c2f80 0x7f7f000ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:04.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.214+0000 7f7f04e64640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f0014b2a0 0x7f7f001db6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:04.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.214+0000 7f7f04e64640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f001eb130 con 0x7f7f000c2f80 2024-01-25T15:04:04.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.214+0000 7f7f04e64640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f001eb6f0 con 0x7f7f0006d600 2024-01-25T15:04:04.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.214+0000 7f7f04e64640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f001daec0 con 0x7f7f0014b2a0 2024-01-25T15:04:04.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.214+0000 7f7efed9d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f0014b2a0 0x7f7f001db6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:04.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.214+0000 7f7efe59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f0006d600 0x7f7f001ebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:04.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.214+0000 7f7efed9d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f0014b2a0 0x7f7f001db6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:34768/0 (socket says 172.21.15.52:34768) 2024-01-25T15:04:04.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.214+0000 7f7efed9d640 1 -- 172.21.15.52:0/583410784 learned_addr learned my addr 172.21.15.52:0/583410784 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-01-25T15:04:04.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.214+0000 7f7ef7fff640 1 --2- 172.21.15.52:0/583410784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f000c2f80 0x7f7f000ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:04.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.215+0000 7f7efe59c640 1 -- 172.21.15.52:0/583410784 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f0014b2a0 msgr2=0x7f7f001db6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.215+0000 7f7efe59c640 1 --2- 172.21.15.52:0/583410784 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f0014b2a0 0x7f7f001db6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.215+0000 7f7efe59c640 1 -- 172.21.15.52:0/583410784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f000c2f80 msgr2=0x7f7f000ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.215+0000 7f7efe59c640 1 --2- 172.21.15.52:0/583410784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f000c2f80 0x7f7f000ab7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.215+0000 7f7efe59c640 1 -- 172.21.15.52:0/583410784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef8009a70 con 0x7f7f0006d600 2024-01-25T15:04:04.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.215+0000 7f7efed9d640 1 --2- 172.21.15.52:0/583410784 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f0014b2a0 0x7f7f001db6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:04.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.215+0000 7f7efe59c640 1 --2- 172.21.15.52:0/583410784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f0006d600 0x7f7f001ebb80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7ef000c340 tx=0x7f7ef000c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:04.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.215+0000 7f7ef6ffd640 1 -- 172.21.15.52:0/583410784 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef00052d0 con 0x7f7f0006d600 2024-01-25T15:04:04.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.215+0000 7f7ef6ffd640 1 -- 172.21.15.52:0/583410784 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef0005450 con 0x7f7f0006d600 2024-01-25T15:04:04.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.215+0000 7f7ef6ffd640 1 -- 172.21.15.52:0/583410784 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0007260 con 0x7f7f0006d600 2024-01-25T15:04:04.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.215+0000 7f7f04e64640 1 -- 172.21.15.52:0/583410784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f001db1a0 con 0x7f7f0006d600 2024-01-25T15:04:04.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.215+0000 7f7f04e64640 1 -- 172.21.15.52:0/583410784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f00147860 con 0x7f7f0006d600 2024-01-25T15:04:04.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.215+0000 7f7ef6ffd640 1 -- 172.21.15.52:0/583410784 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f7ef00073c0 con 0x7f7f0006d600 2024-01-25T15:04:04.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.215+0000 7f7ef6ffd640 1 -- 172.21.15.52:0/583410784 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f7ef0003e20 con 0x7f7f0006d600 2024-01-25T15:04:04.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.216+0000 7f7f04e64640 1 -- 172.21.15.52:0/583410784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f00074010 con 0x7f7f0006d600 2024-01-25T15:04:04.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.218+0000 7f7ef6ffd640 1 -- 172.21.15.52:0/583410784 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f7ef0020060 con 0x7f7f0006d600 2024-01-25T15:04:04.233 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:04.232+0000 7ffaf419b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-25T15:04:04.247 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:04.246+0000 7f42517db040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-25T15:04:04.280 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:04.280+0000 7ffaf419b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-25T15:04:04.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.291+0000 7f7f04e64640 1 -- 172.21.15.52:0/583410784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6aeed49b-a515-49d8-979e-9bc344d8284d", "id": 4} v 0) v1 -- 0x7f7f00149d50 con 0x7f7f0006d600 2024-01-25T15:04:04.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.294+0000 7f7ef6ffd640 1 -- 172.21.15.52:0/583410784 <== mon.1 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6aeed49b-a515-49d8-979e-9bc344d8284d", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7ef0003910 con 0x7f7f0006d600 2024-01-25T15:04:04.295 INFO:teuthology.orchestra.run.smithi052.stdout:4 2024-01-25T15:04:04.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.295+0000 7f7f04e64640 1 -- 172.21.15.52:0/583410784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f0006d600 msgr2=0x7f7f001ebb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.295+0000 7f7f04e64640 1 --2- 172.21.15.52:0/583410784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f0006d600 0x7f7f001ebb80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7ef000c340 tx=0x7f7ef000c800 comp rx=0 tx=0).stop 2024-01-25T15:04:04.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.295+0000 7f7f04e64640 1 -- 172.21.15.52:0/583410784 shutdown_connections 2024-01-25T15:04:04.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.295+0000 7f7f04e64640 1 --2- 172.21.15.52:0/583410784 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f0014b2a0 0x7f7f001db6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.295+0000 7f7f04e64640 1 --2- 172.21.15.52:0/583410784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f000c2f80 0x7f7f000ab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.295+0000 7f7f04e64640 1 --2- 172.21.15.52:0/583410784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f0006d600 0x7f7f001ebb80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.295+0000 7f7f04e64640 1 -- 172.21.15.52:0/583410784 >> 172.21.15.52:0/583410784 conn(0x7f7f000c39b0 msgr2=0x7f7f0006f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:04.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.295+0000 7f7f04e64640 1 -- 172.21.15.52:0/583410784 shutdown_connections 2024-01-25T15:04:04.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.295+0000 7f7f04e64640 1 -- 172.21.15.52:0/583410784 wait complete. 2024-01-25T15:04:04.301 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:04.301+0000 7f42517db040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-25T15:04:04.306 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd new 2d0b95e7-c52a-4d07-801b-2f9cffcce796 5 2024-01-25T15:04:04.335 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:04.334+0000 7ffaf419b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-25T15:04:04.351 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:04.350+0000 7f42517db040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-25T15:04:04.383 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:04.383+0000 7ffaf419b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-25T15:04:04.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.447+0000 7f7d335f5640 1 Processor -- start 2024-01-25T15:04:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.447+0000 7f7d335f5640 1 -- start start 2024-01-25T15:04:04.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.448+0000 7f7d335f5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7d2c0a7f40 0x7f7d2c06bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:04.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.448+0000 7f7d335f5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d2c0ab3b0 0x7f7d2c15cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:04.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.448+0000 7f7d335f5640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d2c156470 con 0x7f7d2c06b6d0 2024-01-25T15:04:04.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.448+0000 7f7d335f5640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d2c155b80 con 0x7f7d2c0a7f40 2024-01-25T15:04:04.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.448+0000 7f7d335f5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2c153410 con 0x7f7d2c0ab3b0 2024-01-25T15:04:04.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.448+0000 7f7d31b92640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d2c0ab3b0 0x7f7d2c15cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:04.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.448+0000 7f7d30b90640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7d2c0a7f40 0x7f7d2c06bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:04.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.448+0000 7f7d31b92640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d2c0ab3b0 0x7f7d2c15cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:34774/0 (socket says 172.21.15.52:34774) 2024-01-25T15:04:04.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.448+0000 7f7d30b90640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7d2c0a7f40 0x7f7d2c06bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46778/0 (socket says 172.21.15.52:46778) 2024-01-25T15:04:04.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.448+0000 7f7d31b92640 1 -- 172.21.15.52:0/1947778086 learned_addr learned my addr 172.21.15.52:0/1947778086 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-01-25T15:04:04.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.448+0000 7f7d31b92640 1 -- 172.21.15.52:0/1947778086 >> v2:172.21.15.52:3300/0 conn(0x7f7d2c0a7f40 msgr2=0x7f7d2c06bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:04.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.448+0000 7f7d31b92640 1 --2- 172.21.15.52:0/1947778086 >> v2:172.21.15.52:3300/0 conn(0x7f7d2c0a7f40 0x7f7d2c06bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.448+0000 7f7d31b92640 1 -- 172.21.15.52:0/1947778086 >> v1:172.21.15.29:6789/0 conn(0x7f7d2c06b6d0 legacy=0x7f7d2c0aaca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.448+0000 7f7d23fff640 1 -- 172.21.15.52:0/1947778086 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203234628 0 0) 0x7f7d2c156470 con 0x7f7d2c06b6d0 2024-01-25T15:04:04.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.448+0000 7f7d31b92640 1 -- 172.21.15.52:0/1947778086 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2c155e20 con 0x7f7d2c0ab3b0 2024-01-25T15:04:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.448+0000 7f7d30b90640 1 --2- 172.21.15.52:0/1947778086 >> v2:172.21.15.52:3300/0 conn(0x7f7d2c0a7f40 0x7f7d2c06bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.449+0000 7f7d31b92640 1 --2- 172.21.15.52:0/1947778086 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d2c0ab3b0 0x7f7d2c15cf10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7d24009e50 tx=0x7f7d2402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35246d65808349a6 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.449+0000 7f7d23fff640 1 -- 172.21.15.52:0/1947778086 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2402cb00 con 0x7f7d2c0ab3b0 2024-01-25T15:04:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.449+0000 7f7d23fff640 1 -- 172.21.15.52:0/1947778086 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2402cc60 con 0x7f7d2c0ab3b0 2024-01-25T15:04:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.449+0000 7f7d23fff640 1 -- 172.21.15.52:0/1947778086 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d240343f0 con 0x7f7d2c0ab3b0 2024-01-25T15:04:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.450+0000 7f7d335f5640 1 -- 172.21.15.52:0/1947778086 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d2c0ab3b0 msgr2=0x7f7d2c15cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.450+0000 7f7d335f5640 1 --2- 172.21.15.52:0/1947778086 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d2c0ab3b0 0x7f7d2c15cf10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7d24009e50 tx=0x7f7d2402bf60 comp rx=0 tx=0).stop 2024-01-25T15:04:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.450+0000 7f7d335f5640 1 -- 172.21.15.52:0/1947778086 shutdown_connections 2024-01-25T15:04:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.450+0000 7f7d335f5640 1 --2- 172.21.15.52:0/1947778086 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d2c0ab3b0 0x7f7d2c15cf10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.450+0000 7f7d335f5640 1 --2- 172.21.15.52:0/1947778086 >> v2:172.21.15.52:3300/0 conn(0x7f7d2c0a7f40 0x7f7d2c06bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.450+0000 7f7d335f5640 1 -- 172.21.15.52:0/1947778086 >> 172.21.15.52:0/1947778086 conn(0x7f7d2c0c3160 msgr2=0x7f7d2c0c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.450+0000 7f7d335f5640 1 -- 172.21.15.52:0/1947778086 shutdown_connections 2024-01-25T15:04:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.450+0000 7f7d335f5640 1 -- 172.21.15.52:0/1947778086 wait complete. 2024-01-25T15:04:04.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.451+0000 7f7d335f5640 1 Processor -- start 2024-01-25T15:04:04.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.451+0000 7f7d335f5640 1 -- start start 2024-01-25T15:04:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.452+0000 7f7d335f5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d2c06b6d0 0x7f7d2c154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.452+0000 7f7d335f5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d2c0a7f40 0x7f7d2c14ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.452+0000 7f7d335f5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d2c0ab3b0 0x7f7d2c1e92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.452+0000 7f7d335f5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2c1496b0 con 0x7f7d2c0a7f40 2024-01-25T15:04:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.452+0000 7f7d335f5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2c148830 con 0x7f7d2c0ab3b0 2024-01-25T15:04:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.452+0000 7f7d335f5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2c071700 con 0x7f7d2c06b6d0 2024-01-25T15:04:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.452+0000 7f7d31391640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d2c06b6d0 0x7f7d2c154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.452+0000 7f7d31391640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d2c06b6d0 0x7f7d2c154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:34776/0 (socket says 172.21.15.52:34776) 2024-01-25T15:04:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.452+0000 7f7d31391640 1 -- 172.21.15.52:0/517139622 learned_addr learned my addr 172.21.15.52:0/517139622 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-01-25T15:04:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.452+0000 7f7d31b92640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d2c0ab3b0 0x7f7d2c1e92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.452+0000 7f7d30b90640 1 --2- 172.21.15.52:0/517139622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d2c0a7f40 0x7f7d2c14ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.452+0000 7f7d31391640 1 -- 172.21.15.52:0/517139622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d2c0ab3b0 msgr2=0x7f7d2c1e92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.452+0000 7f7d31391640 1 --2- 172.21.15.52:0/517139622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d2c0ab3b0 0x7f7d2c1e92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.452+0000 7f7d31391640 1 -- 172.21.15.52:0/517139622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d2c0a7f40 msgr2=0x7f7d2c14ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.452+0000 7f7d31391640 1 --2- 172.21.15.52:0/517139622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d2c0a7f40 0x7f7d2c14ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.452+0000 7f7d31391640 1 -- 172.21.15.52:0/517139622 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1c00d8a0 con 0x7f7d2c06b6d0 2024-01-25T15:04:04.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.452+0000 7f7d31b92640 1 --2- 172.21.15.52:0/517139622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d2c0ab3b0 0x7f7d2c1e92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:04.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.452+0000 7f7d31391640 1 --2- 172.21.15.52:0/517139622 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d2c06b6d0 0x7f7d2c154d70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7d2800c4b0 tx=0x7f7d2800c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:04.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.452+0000 7f7d21ffb640 1 -- 172.21.15.52:0/517139622 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28005480 con 0x7f7d2c06b6d0 2024-01-25T15:04:04.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.452+0000 7f7d21ffb640 1 -- 172.21.15.52:0/517139622 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d280035f0 con 0x7f7d2c06b6d0 2024-01-25T15:04:04.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.452+0000 7f7d21ffb640 1 -- 172.21.15.52:0/517139622 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d280039e0 con 0x7f7d2c06b6d0 2024-01-25T15:04:04.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.452+0000 7f7d335f5640 1 -- 172.21.15.52:0/517139622 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d24009b30 con 0x7f7d2c06b6d0 2024-01-25T15:04:04.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.453+0000 7f7d21ffb640 1 -- 172.21.15.52:0/517139622 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f7d28003b40 con 0x7f7d2c06b6d0 2024-01-25T15:04:04.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.453+0000 7f7d335f5640 1 -- 172.21.15.52:0/517139622 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d2c1493d0 con 0x7f7d2c06b6d0 2024-01-25T15:04:04.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.453+0000 7f7d21ffb640 1 -- 172.21.15.52:0/517139622 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f7d28012980 con 0x7f7d2c06b6d0 2024-01-25T15:04:04.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.453+0000 7f7d335f5640 1 -- 172.21.15.52:0/517139622 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d2c074010 con 0x7f7d2c06b6d0 2024-01-25T15:04:04.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.457+0000 7f7d21ffb640 1 -- 172.21.15.52:0/517139622 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f7d28017070 con 0x7f7d2c06b6d0 2024-01-25T15:04:04.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.531+0000 7f7d335f5640 1 -- 172.21.15.52:0/517139622 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2d0b95e7-c52a-4d07-801b-2f9cffcce796", "id": 5} v 0) v1 -- 0x7f7d2c073810 con 0x7f7d2c06b6d0 2024-01-25T15:04:04.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.534+0000 7f7d21ffb640 1 -- 172.21.15.52:0/517139622 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d0b95e7-c52a-4d07-801b-2f9cffcce796", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7d28012b40 con 0x7f7d2c06b6d0 2024-01-25T15:04:04.535 INFO:teuthology.orchestra.run.smithi052.stdout:5 2024-01-25T15:04:04.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.535+0000 7f7d335f5640 1 -- 172.21.15.52:0/517139622 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d2c06b6d0 msgr2=0x7f7d2c154d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.535+0000 7f7d335f5640 1 --2- 172.21.15.52:0/517139622 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d2c06b6d0 0x7f7d2c154d70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7d2800c4b0 tx=0x7f7d2800c970 comp rx=0 tx=0).stop 2024-01-25T15:04:04.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.535+0000 7f7d335f5640 1 -- 172.21.15.52:0/517139622 shutdown_connections 2024-01-25T15:04:04.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.535+0000 7f7d335f5640 1 --2- 172.21.15.52:0/517139622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d2c0ab3b0 0x7f7d2c1e92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.535+0000 7f7d335f5640 1 --2- 172.21.15.52:0/517139622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d2c0a7f40 0x7f7d2c14ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.535+0000 7f7d335f5640 1 --2- 172.21.15.52:0/517139622 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d2c06b6d0 0x7f7d2c154d70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.535+0000 7f7d335f5640 1 -- 172.21.15.52:0/517139622 >> 172.21.15.52:0/517139622 conn(0x7f7d2c0c3160 msgr2=0x7f7d2c0c0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:04.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.535+0000 7f7d335f5640 1 -- 172.21.15.52:0/517139622 shutdown_connections 2024-01-25T15:04:04.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.535+0000 7f7d335f5640 1 -- 172.21.15.52:0/517139622 wait complete. 2024-01-25T15:04:04.545 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd new 9f78c95a-2f4d-48db-a0b6-c9d847834329 6 2024-01-25T15:04:04.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.686+0000 7f0c48d9e640 1 Processor -- start 2024-01-25T15:04:04.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.687+0000 7f0c48d9e640 1 -- start start 2024-01-25T15:04:04.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.687+0000 7f0c48d9e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c4406a6c0 0x7f0c44158590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:04.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.687+0000 7f0c48d9e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0c44151a40 0x7f0c44151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:04.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.687+0000 7f0c48d9e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c440a6500 con 0x7f0c4406f530 2024-01-25T15:04:04.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.687+0000 7f0c48d9e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c441555f0 con 0x7f0c44151a40 2024-01-25T15:04:04.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.687+0000 7f0c48d9e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c44158ad0 con 0x7f0c4406a6c0 2024-01-25T15:04:04.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.687+0000 7f0c42ffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c4406a6c0 0x7f0c44158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:04.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.687+0000 7f0c43fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0c44151a40 0x7f0c44151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:04.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.687+0000 7f0c42ffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c4406a6c0 0x7f0c44158590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:34790/0 (socket says 172.21.15.52:34790) 2024-01-25T15:04:04.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.687+0000 7f0c42ffd640 1 -- 172.21.15.52:0/3271854039 learned_addr learned my addr 172.21.15.52:0/3271854039 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-01-25T15:04:04.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.688+0000 7f0c42ffd640 1 -- 172.21.15.52:0/3271854039 >> v2:172.21.15.52:3300/0 conn(0x7f0c44151a40 msgr2=0x7f0c44151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:04.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.688+0000 7f0c42ffd640 1 --2- 172.21.15.52:0/3271854039 >> v2:172.21.15.52:3300/0 conn(0x7f0c44151a40 0x7f0c44151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.688+0000 7f0c42ffd640 1 -- 172.21.15.52:0/3271854039 >> v1:172.21.15.29:6789/0 conn(0x7f0c4406f530 legacy=0x7f0c44154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.688+0000 7f0c42ffd640 1 -- 172.21.15.52:0/3271854039 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c44154a50 con 0x7f0c4406a6c0 2024-01-25T15:04:04.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.688+0000 7f0c42ffd640 1 --2- 172.21.15.52:0/3271854039 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c4406a6c0 0x7f0c44158590 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009870 tx=0x7f0c3802b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8d0fa993ca87c2c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:04.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.689+0000 7f0c427fc640 1 -- 172.21.15.52:0/3271854039 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c380317c0 con 0x7f0c4406a6c0 2024-01-25T15:04:04.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.689+0000 7f0c427fc640 1 -- 172.21.15.52:0/3271854039 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c38031920 con 0x7f0c4406a6c0 2024-01-25T15:04:04.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.689+0000 7f0c427fc640 1 -- 172.21.15.52:0/3271854039 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c38031cb0 con 0x7f0c4406a6c0 2024-01-25T15:04:04.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.689+0000 7f0c48d9e640 1 -- 172.21.15.52:0/3271854039 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c4406a6c0 msgr2=0x7f0c44158590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.689+0000 7f0c48d9e640 1 --2- 172.21.15.52:0/3271854039 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c4406a6c0 0x7f0c44158590 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009870 tx=0x7f0c3802b860 comp rx=0 tx=0).stop 2024-01-25T15:04:04.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.689+0000 7f0c48d9e640 1 -- 172.21.15.52:0/3271854039 shutdown_connections 2024-01-25T15:04:04.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.689+0000 7f0c48d9e640 1 --2- 172.21.15.52:0/3271854039 >> v2:172.21.15.52:3300/0 conn(0x7f0c44151a40 0x7f0c44151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.689+0000 7f0c48d9e640 1 --2- 172.21.15.52:0/3271854039 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c4406a6c0 0x7f0c44158590 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.689+0000 7f0c48d9e640 1 -- 172.21.15.52:0/3271854039 >> 172.21.15.52:0/3271854039 conn(0x7f0c440a89e0 msgr2=0x7f0c440a8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:04.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.689+0000 7f0c48d9e640 1 -- 172.21.15.52:0/3271854039 shutdown_connections 2024-01-25T15:04:04.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.689+0000 7f0c48d9e640 1 -- 172.21.15.52:0/3271854039 wait complete. 2024-01-25T15:04:04.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.691+0000 7f0c48d9e640 1 Processor -- start 2024-01-25T15:04:04.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.691+0000 7f0c48d9e640 1 -- start start 2024-01-25T15:04:04.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c48d9e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c4406a6c0 0x7f0c4414ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:04.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c48d9e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c4406f530 0x7f0c441ed5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:04.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c48d9e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c44151a40 0x7f0c441edae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:04.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c48d9e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c440ac230 con 0x7f0c4406a6c0 2024-01-25T15:04:04.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c48d9e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c441e9d50 con 0x7f0c44151a40 2024-01-25T15:04:04.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c48d9e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c440abf50 con 0x7f0c4406f530 2024-01-25T15:04:04.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c43fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c44151a40 0x7f0c441edae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:04.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c42ffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c4406f530 0x7f0c441ed5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:04.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c43fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c44151a40 0x7f0c441edae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46792/0 (socket says 172.21.15.52:46792) 2024-01-25T15:04:04.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c43fff640 1 -- 172.21.15.52:0/100716648 learned_addr learned my addr 172.21.15.52:0/100716648 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-01-25T15:04:04.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c437fe640 1 --2- 172.21.15.52:0/100716648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c4406a6c0 0x7f0c4414ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:04.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c43fff640 1 -- 172.21.15.52:0/100716648 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c4406f530 msgr2=0x7f0c441ed5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c43fff640 1 --2- 172.21.15.52:0/100716648 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c4406f530 0x7f0c441ed5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c43fff640 1 -- 172.21.15.52:0/100716648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c4406a6c0 msgr2=0x7f0c4414ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c43fff640 1 --2- 172.21.15.52:0/100716648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c4406a6c0 0x7f0c4414ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c43fff640 1 -- 172.21.15.52:0/100716648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c380094d0 con 0x7f0c44151a40 2024-01-25T15:04:04.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c42ffd640 1 --2- 172.21.15.52:0/100716648 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c4406f530 0x7f0c441ed5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:04.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c43fff640 1 --2- 172.21.15.52:0/100716648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c44151a40 0x7f0c441edae0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00efc0 tx=0x7f0c3c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:04.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c2bfff640 1 -- 172.21.15.52:0/100716648 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c009ba0 con 0x7f0c44151a40 2024-01-25T15:04:04.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c2bfff640 1 -- 172.21.15.52:0/100716648 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3c00f040 con 0x7f0c44151a40 2024-01-25T15:04:04.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c48d9e640 1 -- 172.21.15.52:0/100716648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c44145b60 con 0x7f0c44151a40 2024-01-25T15:04:04.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c2bfff640 1 -- 172.21.15.52:0/100716648 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c0146c0 con 0x7f0c44151a40 2024-01-25T15:04:04.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.692+0000 7f0c48d9e640 1 -- 172.21.15.52:0/100716648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c44146120 con 0x7f0c44151a40 2024-01-25T15:04:04.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.693+0000 7f0c2bfff640 1 -- 172.21.15.52:0/100716648 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f0c3c014bb0 con 0x7f0c44151a40 2024-01-25T15:04:04.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.693+0000 7f0c2bfff640 1 -- 172.21.15.52:0/100716648 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f0c3c0139d0 con 0x7f0c44151a40 2024-01-25T15:04:04.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.693+0000 7f0c48d9e640 1 -- 172.21.15.52:0/100716648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c441459c0 con 0x7f0c44151a40 2024-01-25T15:04:04.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.695+0000 7f0c2bfff640 1 -- 172.21.15.52:0/100716648 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f0c3c03bdb0 con 0x7f0c44151a40 2024-01-25T15:04:04.758 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:04.757+0000 7f42517db040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-25T15:04:04.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.770+0000 7f0c48d9e640 1 -- 172.21.15.52:0/100716648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9f78c95a-2f4d-48db-a0b6-c9d847834329", "id": 6} v 0) v1 -- 0x7f0c4406f040 con 0x7f0c44151a40 2024-01-25T15:04:04.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.773+0000 7f0c2bfff640 1 -- 172.21.15.52:0/100716648 <== mon.1 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9f78c95a-2f4d-48db-a0b6-c9d847834329", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0c3c02a070 con 0x7f0c44151a40 2024-01-25T15:04:04.773 INFO:teuthology.orchestra.run.smithi052.stdout:6 2024-01-25T15:04:04.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.774+0000 7f0c48d9e640 1 -- 172.21.15.52:0/100716648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c44151a40 msgr2=0x7f0c441edae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.774+0000 7f0c48d9e640 1 --2- 172.21.15.52:0/100716648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c44151a40 0x7f0c441edae0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00efc0 tx=0x7f0c3c00c490 comp rx=0 tx=0).stop 2024-01-25T15:04:04.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.774+0000 7f0c48d9e640 1 -- 172.21.15.52:0/100716648 shutdown_connections 2024-01-25T15:04:04.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.774+0000 7f0c48d9e640 1 --2- 172.21.15.52:0/100716648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c44151a40 0x7f0c441edae0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.774+0000 7f0c48d9e640 1 --2- 172.21.15.52:0/100716648 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c4406f530 0x7f0c441ed5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.774+0000 7f0c48d9e640 1 --2- 172.21.15.52:0/100716648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c4406a6c0 0x7f0c4414ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.774+0000 7f0c48d9e640 1 -- 172.21.15.52:0/100716648 >> 172.21.15.52:0/100716648 conn(0x7f0c440a89e0 msgr2=0x7f0c4406ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:04.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.774+0000 7f0c48d9e640 1 -- 172.21.15.52:0/100716648 shutdown_connections 2024-01-25T15:04:04.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.774+0000 7f0c48d9e640 1 -- 172.21.15.52:0/100716648 wait complete. 2024-01-25T15:04:04.780 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:04.780+0000 7ffaf419b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-25T15:04:04.785 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd new 28497b62-b812-4fb0-8fe4-1efba56d7a9a 7 2024-01-25T15:04:04.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.885+0000 7f192dc58640 1 Processor -- start 2024-01-25T15:04:04.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.885+0000 7f192dc58640 1 -- start start 2024-01-25T15:04:04.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.886+0000 7f192dc58640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f19280c6a20 0x7f1928155210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:04.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.886+0000 7f192dc58640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192806bee0 con 0x7f192806c370 2024-01-25T15:04:04.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.886+0000 7f192dc58640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19280c7400 con 0x7f1928151d80 2024-01-25T15:04:04.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.886+0000 7f192dc58640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1928155750 con 0x7f19280c6a20 2024-01-25T15:04:04.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.886+0000 7f1926ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f19280c6a20 0x7f1928155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:04.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.886+0000 7f1926ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f19280c6a20 0x7f1928155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46800/0 (socket says 172.21.15.52:46800) 2024-01-25T15:04:04.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.886+0000 7f1926ffd640 1 -- 172.21.15.52:0/880920520 learned_addr learned my addr 172.21.15.52:0/880920520 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-01-25T15:04:04.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.886+0000 7f1926ffd640 1 -- 172.21.15.52:0/880920520 >> v1:172.21.15.52:6789/0 conn(0x7f1928151d80 legacy=0x7f19280c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.886+0000 7f1926ffd640 1 -- 172.21.15.52:0/880920520 >> v1:172.21.15.29:6789/0 conn(0x7f192806c370 legacy=0x7f19280c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.886+0000 7f1926ffd640 1 -- 172.21.15.52:0/880920520 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192806b8d0 con 0x7f19280c6a20 2024-01-25T15:04:04.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.887+0000 7f1926ffd640 1 --2- 172.21.15.52:0/880920520 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19280c6a20 0x7f1928155210 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f191c009870 tx=0x7f191c02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8aceaaffe174535 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:04.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.887+0000 7f19267fc640 1 -- 172.21.15.52:0/880920520 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c030860 con 0x7f19280c6a20 2024-01-25T15:04:04.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.887+0000 7f19267fc640 1 -- 172.21.15.52:0/880920520 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c0309c0 con 0x7f19280c6a20 2024-01-25T15:04:04.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.887+0000 7f19267fc640 1 -- 172.21.15.52:0/880920520 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c030d50 con 0x7f19280c6a20 2024-01-25T15:04:04.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.888+0000 7f192dc58640 1 -- 172.21.15.52:0/880920520 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19280c6a20 msgr2=0x7f1928155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.888+0000 7f192dc58640 1 --2- 172.21.15.52:0/880920520 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19280c6a20 0x7f1928155210 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f191c009870 tx=0x7f191c02b9a0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.888+0000 7f192dc58640 1 -- 172.21.15.52:0/880920520 shutdown_connections 2024-01-25T15:04:04.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.888+0000 7f192dc58640 1 --2- 172.21.15.52:0/880920520 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19280c6a20 0x7f1928155210 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.888+0000 7f192dc58640 1 -- 172.21.15.52:0/880920520 >> 172.21.15.52:0/880920520 conn(0x7f19280abd80 msgr2=0x7f19280ac190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:04.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.888+0000 7f192dc58640 1 -- 172.21.15.52:0/880920520 shutdown_connections 2024-01-25T15:04:04.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.888+0000 7f192dc58640 1 -- 172.21.15.52:0/880920520 wait complete. 2024-01-25T15:04:04.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.889+0000 7f192dc58640 1 Processor -- start 2024-01-25T15:04:04.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.889+0000 7f192dc58640 1 -- start start 2024-01-25T15:04:04.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.890+0000 7f192dc58640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f192806c370 0x7f1928157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:04.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.890+0000 7f192dc58640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19280c6a20 0x7f19281e7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:04.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.890+0000 7f192dc58640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1928151d80 0x7f19281567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:04.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.890+0000 7f192dc58640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19280c3ca0 con 0x7f192806c370 2024-01-25T15:04:04.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.890+0000 7f192dc58640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19281e9f50 con 0x7f1928151d80 2024-01-25T15:04:04.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.890+0000 7f192dc58640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19281562f0 con 0x7f19280c6a20 2024-01-25T15:04:04.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.890+0000 7f1926ffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19280c6a20 0x7f19281e7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:04.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.890+0000 7f1927fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1928151d80 0x7f19281567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:04.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.890+0000 7f1927fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1928151d80 0x7f19281567f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46802/0 (socket says 172.21.15.52:46802) 2024-01-25T15:04:04.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.890+0000 7f1926ffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19280c6a20 0x7f19281e7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:34816/0 (socket says 172.21.15.52:34816) 2024-01-25T15:04:04.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.890+0000 7f1927fff640 1 -- 172.21.15.52:0/1620399016 learned_addr learned my addr 172.21.15.52:0/1620399016 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-01-25T15:04:04.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.890+0000 7f19277fe640 1 --2- 172.21.15.52:0/1620399016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f192806c370 0x7f1928157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:04.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.890+0000 7f1927fff640 1 -- 172.21.15.52:0/1620399016 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19280c6a20 msgr2=0x7f19281e7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.890+0000 7f1927fff640 1 --2- 172.21.15.52:0/1620399016 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19280c6a20 0x7f19281e7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.890+0000 7f1927fff640 1 -- 172.21.15.52:0/1620399016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f192806c370 msgr2=0x7f1928157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.890+0000 7f1927fff640 1 --2- 172.21.15.52:0/1620399016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f192806c370 0x7f1928157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.890+0000 7f1927fff640 1 -- 172.21.15.52:0/1620399016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191c0094d0 con 0x7f1928151d80 2024-01-25T15:04:04.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.890+0000 7f1927fff640 1 --2- 172.21.15.52:0/1620399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1928151d80 0x7f19281567f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f192000c6b0 tx=0x7f192000cb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:04.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.890+0000 7f190ffff640 1 -- 172.21.15.52:0/1620399016 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920003b70 con 0x7f1928151d80 2024-01-25T15:04:04.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.890+0000 7f190ffff640 1 -- 172.21.15.52:0/1620399016 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1920003cf0 con 0x7f1928151d80 2024-01-25T15:04:04.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.890+0000 7f192dc58640 1 -- 172.21.15.52:0/1620399016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19280c39c0 con 0x7f1928151d80 2024-01-25T15:04:04.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.890+0000 7f190ffff640 1 -- 172.21.15.52:0/1620399016 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920005310 con 0x7f1928151d80 2024-01-25T15:04:04.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.891+0000 7f192dc58640 1 -- 172.21.15.52:0/1620399016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19281ea1d0 con 0x7f1928151d80 2024-01-25T15:04:04.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.891+0000 7f190ffff640 1 -- 172.21.15.52:0/1620399016 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f1920005470 con 0x7f1928151d80 2024-01-25T15:04:04.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.891+0000 7f190ffff640 1 -- 172.21.15.52:0/1620399016 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f1920012a80 con 0x7f1928151d80 2024-01-25T15:04:04.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.891+0000 7f192dc58640 1 -- 172.21.15.52:0/1620399016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1928156510 con 0x7f1928151d80 2024-01-25T15:04:04.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.895+0000 7f190ffff640 1 -- 172.21.15.52:0/1620399016 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f1928156510 con 0x7f1928151d80 2024-01-25T15:04:04.903 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:04.903+0000 7f42517db040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-25T15:04:04.921 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:04.921+0000 7ffaf419b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-25T15:04:04.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.969+0000 7f192dc58640 1 -- 172.21.15.52:0/1620399016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "28497b62-b812-4fb0-8fe4-1efba56d7a9a", "id": 7} v 0) v1 -- 0x7f19280c0a80 con 0x7f1928151d80 2024-01-25T15:04:04.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.972+0000 7f190ffff640 1 -- 172.21.15.52:0/1620399016 <== mon.1 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "28497b62-b812-4fb0-8fe4-1efba56d7a9a", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1920012ce0 con 0x7f1928151d80 2024-01-25T15:04:04.973 INFO:teuthology.orchestra.run.smithi052.stdout:7 2024-01-25T15:04:04.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.973+0000 7f192dc58640 1 -- 172.21.15.52:0/1620399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1928151d80 msgr2=0x7f19281567f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:04.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.973+0000 7f192dc58640 1 --2- 172.21.15.52:0/1620399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1928151d80 0x7f19281567f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f192000c6b0 tx=0x7f192000cb70 comp rx=0 tx=0).stop 2024-01-25T15:04:04.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.973+0000 7f192dc58640 1 -- 172.21.15.52:0/1620399016 shutdown_connections 2024-01-25T15:04:04.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.973+0000 7f192dc58640 1 --2- 172.21.15.52:0/1620399016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1928151d80 0x7f19281567f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.973+0000 7f192dc58640 1 --2- 172.21.15.52:0/1620399016 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19280c6a20 0x7f19281e7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.973+0000 7f192dc58640 1 --2- 172.21.15.52:0/1620399016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f192806c370 0x7f1928157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:04.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.973+0000 7f192dc58640 1 -- 172.21.15.52:0/1620399016 >> 172.21.15.52:0/1620399016 conn(0x7f19280abd80 msgr2=0x7f192814cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:04.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.973+0000 7f192dc58640 1 -- 172.21.15.52:0/1620399016 shutdown_connections 2024-01-25T15:04:04.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-01-25T15:04:04.973+0000 7f192dc58640 1 -- 172.21.15.52:0/1620399016 wait complete. 2024-01-25T15:04:04.984 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-25T15:04:04.984 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-01-25T15:04:04.986 INFO:tasks.ceph.osd.0:Started 2024-01-25T15:04:04.986 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-25T15:04:04.986 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-01-25T15:04:04.989 INFO:tasks.ceph.osd.1:Started 2024-01-25T15:04:04.989 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-25T15:04:04.989 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-01-25T15:04:04.991 INFO:tasks.ceph.osd.2:Started 2024-01-25T15:04:04.991 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-25T15:04:04.991 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-01-25T15:04:04.993 INFO:tasks.ceph.osd.3:Started 2024-01-25T15:04:04.993 INFO:tasks.ceph.osd.4:Restarting daemon 2024-01-25T15:04:04.993 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-01-25T15:04:04.995 INFO:tasks.ceph.osd.4:Started 2024-01-25T15:04:04.995 INFO:tasks.ceph.osd.5:Restarting daemon 2024-01-25T15:04:04.996 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-01-25T15:04:04.997 INFO:tasks.ceph.osd.5:Started 2024-01-25T15:04:04.998 INFO:tasks.ceph.osd.6:Restarting daemon 2024-01-25T15:04:04.998 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-01-25T15:04:04.999 INFO:tasks.ceph.osd.6:Started 2024-01-25T15:04:05.000 INFO:tasks.ceph.osd.7:Restarting daemon 2024-01-25T15:04:05.000 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-01-25T15:04:05.002 INFO:tasks.ceph.osd.7:Started 2024-01-25T15:04:05.002 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:04:05.040 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:05.039+0000 7f42517db040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-25T15:04:05.084 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:05.083+0000 7ffaf419b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-25T15:04:05.104 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:05.103+0000 7f42517db040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-25T15:04:05.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.121+0000 7fc8a99b6640 1 Processor -- start 2024-01-25T15:04:05.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.121+0000 7fc8a99b6640 1 -- start start 2024-01-25T15:04:05.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.122+0000 7fc8a99b6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc8a406cc80 0x7fc8a4155140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:05.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.122+0000 7fc8a99b6640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a40c2750 con 0x7fc8a40c29f0 2024-01-25T15:04:05.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.122+0000 7fc8a99b6640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a40c1f40 con 0x7fc8a40c4620 2024-01-25T15:04:05.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.122+0000 7fc8a99b6640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a40c6120 con 0x7fc8a406cc80 2024-01-25T15:04:05.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.122+0000 7fc8a27fc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc8a40c29f0 0x7fc8a40c82d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44830/0 (socket says 172.21.15.29:44830) 2024-01-25T15:04:05.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.122+0000 7fc8a27fc640 1 -- 172.21.15.29:0/3448924539 learned_addr learned my addr 172.21.15.29:0/3448924539 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:05.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.122+0000 7fc8a2ffd640 1 --2- 172.21.15.29:0/3448924539 >> v2:172.21.15.52:3300/0 conn(0x7fc8a406cc80 0x7fc8a4155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:05.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.122+0000 7fc8a1ffb640 1 -- 172.21.15.29:0/3448924539 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3608067437 0 0) 0x7fc894001110 con 0x7fc8a40c29f0 2024-01-25T15:04:05.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.122+0000 7fc8a1ffb640 1 -- 172.21.15.29:0/3448924539 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc88c003520 con 0x7fc8a40c29f0 2024-01-25T15:04:05.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.122+0000 7fc8a2ffd640 1 -- 172.21.15.29:0/3448924539 >> v1:172.21.15.52:6789/0 conn(0x7fc8a40c4620 legacy=0x7fc8a40c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:05.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.122+0000 7fc8a2ffd640 1 -- 172.21.15.29:0/3448924539 >> v1:172.21.15.29:6789/0 conn(0x7fc8a40c29f0 legacy=0x7fc8a40c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:05.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.122+0000 7fc8a2ffd640 1 -- 172.21.15.29:0/3448924539 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a406d790 con 0x7fc8a406cc80 2024-01-25T15:04:05.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.123+0000 7fc8a2ffd640 1 --2- 172.21.15.29:0/3448924539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8a406cc80 0x7fc8a4155140 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc8980097d0 tx=0x7fc89802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29df625969e9bad server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:05.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.123+0000 7fc8a1ffb640 1 -- 172.21.15.29:0/3448924539 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc898031830 con 0x7fc8a406cc80 2024-01-25T15:04:05.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.123+0000 7fc8a1ffb640 1 -- 172.21.15.29:0/3448924539 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc898031990 con 0x7fc8a406cc80 2024-01-25T15:04:05.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.123+0000 7fc8a1ffb640 1 -- 172.21.15.29:0/3448924539 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc898031d20 con 0x7fc8a406cc80 2024-01-25T15:04:05.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.124+0000 7fc8a99b6640 1 -- 172.21.15.29:0/3448924539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8a406cc80 msgr2=0x7fc8a4155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:05.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.124+0000 7fc8a99b6640 1 --2- 172.21.15.29:0/3448924539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8a406cc80 0x7fc8a4155140 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc8980097d0 tx=0x7fc89802b8d0 comp rx=0 tx=0).stop 2024-01-25T15:04:05.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.124+0000 7fc8a99b6640 1 -- 172.21.15.29:0/3448924539 shutdown_connections 2024-01-25T15:04:05.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.124+0000 7fc8a99b6640 1 --2- 172.21.15.29:0/3448924539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8a406cc80 0x7fc8a4155140 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:05.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.124+0000 7fc8a99b6640 1 -- 172.21.15.29:0/3448924539 >> 172.21.15.29:0/3448924539 conn(0x7fc8a406a8a0 msgr2=0x7fc8a406acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:05.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.124+0000 7fc8a99b6640 1 -- 172.21.15.29:0/3448924539 shutdown_connections 2024-01-25T15:04:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.124+0000 7fc8a99b6640 1 -- 172.21.15.29:0/3448924539 wait complete. 2024-01-25T15:04:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.125+0000 7fc8a99b6640 1 Processor -- start 2024-01-25T15:04:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.125+0000 7fc8a99b6640 1 -- start start 2024-01-25T15:04:05.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.126+0000 7fc8a99b6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a406cc80 0x7fc8a4145f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:05.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.126+0000 7fc8a99b6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8a40c29f0 0x7fc8a41464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.126+0000 7fc8a99b6640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc8a40c4620 0x7fc8a4149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.126+0000 7fc8a99b6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a41469e0 con 0x7fc8a406cc80 2024-01-25T15:04:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.126+0000 7fc8a99b6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a4152310 con 0x7fc8a40c29f0 2024-01-25T15:04:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.126+0000 7fc8a99b6640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a4148110 con 0x7fc8a40c4620 2024-01-25T15:04:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.126+0000 7fc8a2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a406cc80 0x7fc8a4145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.126+0000 7fc8a2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a406cc80 0x7fc8a4145f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42332/0 (socket says 172.21.15.29:42332) 2024-01-25T15:04:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.126+0000 7fc8a2ffd640 1 -- 172.21.15.29:0/2685719234 learned_addr learned my addr 172.21.15.29:0/2685719234 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.126+0000 7fc8a27fc640 1 --2- 172.21.15.29:0/2685719234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8a40c29f0 0x7fc8a41464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.126+0000 7fc8a37fe640 1 --2- 172.21.15.29:0/2685719234 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc8a40c4620 0x7fc8a4149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.127+0000 7fc8a37fe640 1 -- 172.21.15.29:0/2685719234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8a40c29f0 msgr2=0x7fc8a41464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.127+0000 7fc8a37fe640 1 --2- 172.21.15.29:0/2685719234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8a40c29f0 0x7fc8a41464a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.127+0000 7fc8a37fe640 1 -- 172.21.15.29:0/2685719234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a406cc80 msgr2=0x7fc8a4145f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.127+0000 7fc8a37fe640 1 --2- 172.21.15.29:0/2685719234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a406cc80 0x7fc8a4145f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.127+0000 7fc8a37fe640 1 -- 172.21.15.29:0/2685719234 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc898009400 con 0x7fc8a40c4620 2024-01-25T15:04:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.127+0000 7fc8a2ffd640 1 --2- 172.21.15.29:0/2685719234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a406cc80 0x7fc8a4145f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.127+0000 7fc8a27fc640 1 --2- 172.21.15.29:0/2685719234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8a40c29f0 0x7fc8a41464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.127+0000 7fc8a37fe640 1 --2- 172.21.15.29:0/2685719234 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc8a40c4620 0x7fc8a4149bd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc89c00c700 tx=0x7fc89c00cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.127+0000 7fc88bfff640 1 -- 172.21.15.29:0/2685719234 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c003b70 con 0x7fc8a40c4620 2024-01-25T15:04:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.127+0000 7fc88bfff640 1 -- 172.21.15.29:0/2685719234 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89c003cd0 con 0x7fc8a40c4620 2024-01-25T15:04:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.127+0000 7fc8a99b6640 1 -- 172.21.15.29:0/2685719234 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a41483f0 con 0x7fc8a40c4620 2024-01-25T15:04:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.127+0000 7fc88bfff640 1 -- 172.21.15.29:0/2685719234 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c005310 con 0x7fc8a40c4620 2024-01-25T15:04:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.127+0000 7fc8a99b6640 1 -- 172.21.15.29:0/2685719234 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a41489b0 con 0x7fc8a40c4620 2024-01-25T15:04:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.127+0000 7fc88bfff640 1 -- 172.21.15.29:0/2685719234 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc89c005470 con 0x7fc8a40c4620 2024-01-25T15:04:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.127+0000 7fc88bfff640 1 -- 172.21.15.29:0/2685719234 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc89c003e40 con 0x7fc8a40c4620 2024-01-25T15:04:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.128+0000 7fc8a99b6640 1 -- 172.21.15.29:0/2685719234 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a40c6590 con 0x7fc8a40c4620 2024-01-25T15:04:05.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.130+0000 7fc88bfff640 1 -- 172.21.15.29:0/2685719234 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fc8a40c6590 con 0x7fc8a40c4620 2024-01-25T15:04:05.134 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:05.134+0000 7ffaf419b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-25T15:04:05.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.192+0000 7fc8a99b6640 1 -- 172.21.15.29:0/2685719234 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8a4074080 con 0x7fc8a40c4620 2024-01-25T15:04:05.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.193+0000 7fc88bfff640 1 -- 172.21.15.29:0/2685719234 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fc89c005720 con 0x7fc8a40c4620 2024-01-25T15:04:05.194 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:05.194 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":10,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:04.970907+0000","last_up_change":"0.000000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:04:05.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.194+0000 7fc8a99b6640 1 -- 172.21.15.29:0/2685719234 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc8a40c4620 msgr2=0x7fc8a4149bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:05.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.194+0000 7fc8a99b6640 1 --2- 172.21.15.29:0/2685719234 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc8a40c4620 0x7fc8a4149bd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc89c00c700 tx=0x7fc89c00cbc0 comp rx=0 tx=0).stop 2024-01-25T15:04:05.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.194+0000 7fc8a99b6640 1 -- 172.21.15.29:0/2685719234 shutdown_connections 2024-01-25T15:04:05.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.194+0000 7fc8a99b6640 1 --2- 172.21.15.29:0/2685719234 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc8a40c4620 0x7fc8a4149bd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:05.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.194+0000 7fc8a99b6640 1 --2- 172.21.15.29:0/2685719234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8a40c29f0 0x7fc8a41464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:05.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.194+0000 7fc8a99b6640 1 --2- 172.21.15.29:0/2685719234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a406cc80 0x7fc8a4145f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:05.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.194+0000 7fc8a99b6640 1 -- 172.21.15.29:0/2685719234 >> 172.21.15.29:0/2685719234 conn(0x7fc8a406a8a0 msgr2=0x7fc8a40ab160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:05.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.194+0000 7fc8a99b6640 1 -- 172.21.15.29:0/2685719234 shutdown_connections 2024-01-25T15:04:05.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:05.194+0000 7fc8a99b6640 1 -- 172.21.15.29:0/2685719234 wait complete. 2024-01-25T15:04:05.205 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-25T15:04:05.205 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-25T15:04:05.206 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:05.204+0000 7f42517db040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-25T15:04:05.237 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:05.236+0000 7ffaf419b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-25T15:04:05.302 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:05.302+0000 7f42517db040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-25T15:04:05.335 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:05.335+0000 7ffaf419b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-25T15:04:05.448 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:05.447+0000 7f42517db040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-25T15:04:05.481 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:05.480+0000 7ffaf419b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-25T15:04:05.491 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:05.490+0000 7f42517db040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-25T15:04:05.524 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:05.524+0000 7ffaf419b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-25T15:04:05.594 INFO:tasks.ceph.osd.4.smithi052.stderr:2024-01-25T15:04:05.593+0000 7f1f4f8c6640 -1 Falling back to public interface 2024-01-25T15:04:05.597 INFO:tasks.ceph.osd.5.smithi052.stderr:2024-01-25T15:04:05.596+0000 7f42f9213640 -1 Falling back to public interface 2024-01-25T15:04:05.597 INFO:tasks.ceph.osd.7.smithi052.stderr:2024-01-25T15:04:05.596+0000 7fee9b7fa640 -1 Falling back to public interface 2024-01-25T15:04:05.604 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-01-25T15:04:05.603+0000 7f1ef7a24640 -1 Falling back to public interface 2024-01-25T15:04:05.609 INFO:tasks.ceph.osd.6.smithi052.stderr:2024-01-25T15:04:05.609+0000 7fc921004640 -1 Falling back to public interface 2024-01-25T15:04:05.613 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-01-25T15:04:05.612+0000 7f0970ef7640 -1 Falling back to public interface 2024-01-25T15:04:05.617 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-01-25T15:04:05.616+0000 7f6e43268640 -1 Falling back to public interface 2024-01-25T15:04:05.617 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-01-25T15:04:05.616+0000 7efc73621640 -1 Falling back to public interface 2024-01-25T15:04:05.618 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-01-25T15:04:05.618+0000 7f6e42211640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6821/0: (98) Address already in use 2024-01-25T15:04:05.641 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:05.640+0000 7f42517db040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-25T15:04:05.673 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:05.673+0000 7ffaf419b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-25T15:04:06.011 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-25T15:04:06.102 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.101+0000 7f2fe03ea640 1 Processor -- start 2024-01-25T15:04:06.102 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.101+0000 7f2fe03ea640 1 -- start start 2024-01-25T15:04:06.104 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.102+0000 7f2fe03ea640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2fd80c3480 0x7f2fd806cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.104 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.102+0000 7f2fe03ea640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd80c27a0 con 0x7f2fd8151e30 2024-01-25T15:04:06.104 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.102+0000 7f2fe03ea640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd8152210 con 0x7f2fd8154780 2024-01-25T15:04:06.104 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.102+0000 7f2fe03ea640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd80c2470 con 0x7f2fd80c3480 2024-01-25T15:04:06.104 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.102+0000 7f2fde186640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2fd8151e30 0x7f2fd80c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59450/0 (socket says 172.21.15.29:59450) 2024-01-25T15:04:06.104 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.102+0000 7f2fde186640 1 -- 172.21.15.29:0/2019923853 learned_addr learned my addr 172.21.15.29:0/2019923853 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:06.104 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.102+0000 7f2fdd985640 1 --2- 172.21.15.29:0/2019923853 >> v2:172.21.15.52:3300/0 conn(0x7f2fd80c3480 0x7f2fd806cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.104 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.103+0000 7f2fdd184640 1 -- 172.21.15.29:0/2019923853 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349460797 0 0) 0x7f2fd80c27a0 con 0x7f2fd8151e30 2024-01-25T15:04:06.104 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.103+0000 7f2fdd184640 1 -- 172.21.15.29:0/2019923853 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fc4003520 con 0x7f2fd8151e30 2024-01-25T15:04:06.105 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.103+0000 7f2fdd985640 1 -- 172.21.15.29:0/2019923853 >> v1:172.21.15.52:6789/0 conn(0x7f2fd8154780 legacy=0x7f2fd80ac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.105 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.103+0000 7f2fdd985640 1 -- 172.21.15.29:0/2019923853 >> v1:172.21.15.29:6789/0 conn(0x7f2fd8151e30 legacy=0x7f2fd80c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.105 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.103+0000 7f2fdd985640 1 -- 172.21.15.29:0/2019923853 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd806d4e0 con 0x7f2fd80c3480 2024-01-25T15:04:06.109 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.104+0000 7f2fdd985640 1 --2- 172.21.15.29:0/2019923853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd80c3480 0x7f2fd806cf00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80097a0 tx=0x7f2fc802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeae5d5fb832a311 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:06.109 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.104+0000 7f2fdd184640 1 -- 172.21.15.29:0/2019923853 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc8031830 con 0x7f2fd80c3480 2024-01-25T15:04:06.109 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.104+0000 7f2fdd184640 1 -- 172.21.15.29:0/2019923853 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc8031990 con 0x7f2fd80c3480 2024-01-25T15:04:06.109 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.104+0000 7f2fdd184640 1 -- 172.21.15.29:0/2019923853 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc8031d00 con 0x7f2fd80c3480 2024-01-25T15:04:06.109 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.104+0000 7f2fe03ea640 1 -- 172.21.15.29:0/2019923853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd80c3480 msgr2=0x7f2fd806cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.109 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.104+0000 7f2fe03ea640 1 --2- 172.21.15.29:0/2019923853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd80c3480 0x7f2fd806cf00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80097a0 tx=0x7f2fc802b8d0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.109 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.104+0000 7f2fe03ea640 1 -- 172.21.15.29:0/2019923853 shutdown_connections 2024-01-25T15:04:06.109 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.105+0000 7f2fe03ea640 1 --2- 172.21.15.29:0/2019923853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd80c3480 0x7f2fd806cf00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.109 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.105+0000 7f2fe03ea640 1 -- 172.21.15.29:0/2019923853 >> 172.21.15.29:0/2019923853 conn(0x7f2fd80c3a90 msgr2=0x7f2fd80c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:06.109 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.105+0000 7f2fe03ea640 1 -- 172.21.15.29:0/2019923853 shutdown_connections 2024-01-25T15:04:06.109 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.105+0000 7f2fe03ea640 1 -- 172.21.15.29:0/2019923853 wait complete. 2024-01-25T15:04:06.110 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.106+0000 7f2fe03ea640 1 Processor -- start 2024-01-25T15:04:06.110 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.106+0000 7f2fe03ea640 1 -- start start 2024-01-25T15:04:06.110 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.106+0000 7f2fe03ea640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd80c3480 0x7f2fd8153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.110 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.106+0000 7f2fe03ea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd8151e30 0x7f2fd813d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.110 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.106+0000 7f2fe03ea640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2fd8154780 0x7f2fd813dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.110 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.106+0000 7f2fe03ea640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd81561c0 con 0x7f2fd80c3480 2024-01-25T15:04:06.110 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.106+0000 7f2fe03ea640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd813e140 con 0x7f2fd8151e30 2024-01-25T15:04:06.110 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.106+0000 7f2fe03ea640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd8155bb0 con 0x7f2fd8154780 2024-01-25T15:04:06.110 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.106+0000 7f2fde186640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd80c3480 0x7f2fd8153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.110 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.106+0000 7f2fde186640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd80c3480 0x7f2fd8153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47758/0 (socket says 172.21.15.29:47758) 2024-01-25T15:04:06.110 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.106+0000 7f2fde186640 1 -- 172.21.15.29:0/3148770836 learned_addr learned my addr 172.21.15.29:0/3148770836 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:06.110 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.106+0000 7f2fde987640 1 --2- 172.21.15.29:0/3148770836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2fd8154780 0x7f2fd813dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.110 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.106+0000 7f2fdd985640 1 --2- 172.21.15.29:0/3148770836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd8151e30 0x7f2fd813d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.110 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.107+0000 7f2fde186640 1 -- 172.21.15.29:0/3148770836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2fd8154780 msgr2=0x7f2fd813dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.110 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.107+0000 7f2fde186640 1 --2- 172.21.15.29:0/3148770836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2fd8154780 0x7f2fd813dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.111 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.107+0000 7f2fde186640 1 -- 172.21.15.29:0/3148770836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd8151e30 msgr2=0x7f2fd813d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.111 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.107+0000 7f2fde186640 1 --2- 172.21.15.29:0/3148770836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd8151e30 0x7f2fd813d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.111 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.107+0000 7f2fde186640 1 -- 172.21.15.29:0/3148770836 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc8009400 con 0x7f2fd80c3480 2024-01-25T15:04:06.111 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.107+0000 7f2fde186640 1 --2- 172.21.15.29:0/3148770836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd80c3480 0x7f2fd8153260 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400c410 tx=0x7f2fd400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:06.111 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.107+0000 7f2fceffd640 1 -- 172.21.15.29:0/3148770836 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4005ce0 con 0x7f2fd80c3480 2024-01-25T15:04:06.111 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.107+0000 7f2fceffd640 1 -- 172.21.15.29:0/3148770836 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd4005e40 con 0x7f2fd80c3480 2024-01-25T15:04:06.111 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.107+0000 7f2fe03ea640 1 -- 172.21.15.29:0/3148770836 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd81eaad0 con 0x7f2fd80c3480 2024-01-25T15:04:06.111 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.107+0000 7f2fceffd640 1 -- 172.21.15.29:0/3148770836 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd40072f0 con 0x7f2fd80c3480 2024-01-25T15:04:06.111 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.107+0000 7f2fe03ea640 1 -- 172.21.15.29:0/3148770836 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd81eadb0 con 0x7f2fd80c3480 2024-01-25T15:04:06.111 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.107+0000 7f2fceffd640 1 -- 172.21.15.29:0/3148770836 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f2fd4007510 con 0x7f2fd80c3480 2024-01-25T15:04:06.111 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.107+0000 7f2fceffd640 1 -- 172.21.15.29:0/3148770836 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f2fd4012c10 con 0x7f2fd80c3480 2024-01-25T15:04:06.111 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.108+0000 7f2fe03ea640 1 -- 172.21.15.29:0/3148770836 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd80c1480 con 0x7f2fd80c3480 2024-01-25T15:04:06.112 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.110+0000 7f2fceffd640 1 -- 172.21.15.29:0/3148770836 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f2fd4017070 con 0x7f2fd80c3480 2024-01-25T15:04:06.174 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.174+0000 7f2fe03ea640 1 -- 172.21.15.29:0/3148770836 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fd804ea50 con 0x7f2fd80c3480 2024-01-25T15:04:06.175 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.174+0000 7f2fceffd640 1 -- 172.21.15.29:0/3148770836 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f2fd4012540 con 0x7f2fd80c3480 2024-01-25T15:04:06.175 INFO:teuthology.misc.health.smithi029.stdout: 2024-01-25T15:04:06.175 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":10,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:04.970907+0000","last_up_change":"0.000000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:04:06.176 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.175+0000 7f2fe03ea640 1 -- 172.21.15.29:0/3148770836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd80c3480 msgr2=0x7f2fd8153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.176 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.175+0000 7f2fe03ea640 1 --2- 172.21.15.29:0/3148770836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd80c3480 0x7f2fd8153260 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400c410 tx=0x7f2fd400c8d0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.176 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.175+0000 7f2fe03ea640 1 -- 172.21.15.29:0/3148770836 shutdown_connections 2024-01-25T15:04:06.176 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.175+0000 7f2fe03ea640 1 --2- 172.21.15.29:0/3148770836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2fd8154780 0x7f2fd813dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.176 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.175+0000 7f2fe03ea640 1 --2- 172.21.15.29:0/3148770836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd8151e30 0x7f2fd813d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.176 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.175+0000 7f2fe03ea640 1 --2- 172.21.15.29:0/3148770836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd80c3480 0x7f2fd8153260 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.176 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.175+0000 7f2fe03ea640 1 -- 172.21.15.29:0/3148770836 >> 172.21.15.29:0/3148770836 conn(0x7f2fd80c3a90 msgr2=0x7f2fd80c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:06.176 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.175+0000 7f2fe03ea640 1 -- 172.21.15.29:0/3148770836 shutdown_connections 2024-01-25T15:04:06.177 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:06.175+0000 7f2fe03ea640 1 -- 172.21.15.29:0/3148770836 wait complete. 2024-01-25T15:04:06.185 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-25T15:04:06.450 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:06.450+0000 7f42517db040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-25T15:04:06.549 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:06.548+0000 7ffaf419b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-25T15:04:06.734 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:06.734+0000 7f42517db040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-25T15:04:06.788 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:06.787+0000 7f42517db040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-25T15:04:06.834 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:06.834+0000 7ffaf419b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-25T15:04:06.888 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:06.887+0000 7ffaf419b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-25T15:04:06.891 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:06.891+0000 7f42517db040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-25T15:04:06.995 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-01-25T15:04:06.994+0000 7ffaf419b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-25T15:04:07.919 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:07.918+0000 7f41f3351640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-25T15:04:07.919 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-01-25T15:04:07.919+0000 7f41f3351640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-25T15:04:09.083 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-01-25T15:04:09.082+0000 7f0970ef7640 -1 osd.1 0 log_to_monitors true 2024-01-25T15:04:09.090 INFO:tasks.ceph.osd.7.smithi052.stderr:2024-01-25T15:04:09.090+0000 7fee9b7fa640 -1 osd.7 0 log_to_monitors true 2024-01-25T15:04:09.098 INFO:tasks.ceph.osd.4.smithi052.stderr:2024-01-25T15:04:09.098+0000 7f1f4f8c6640 -1 osd.4 0 log_to_monitors true 2024-01-25T15:04:09.099 INFO:tasks.ceph.osd.5.smithi052.stderr:2024-01-25T15:04:09.098+0000 7f42f9213640 -1 osd.5 0 log_to_monitors true 2024-01-25T15:04:09.120 INFO:tasks.ceph.osd.6.smithi052.stderr:2024-01-25T15:04:09.120+0000 7fc921004640 -1 osd.6 0 log_to_monitors true 2024-01-25T15:04:09.121 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-01-25T15:04:09.120+0000 7f1ef7a24640 -1 osd.2 0 log_to_monitors true 2024-01-25T15:04:09.121 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-01-25T15:04:09.120+0000 7f6e43268640 -1 osd.0 0 log_to_monitors true 2024-01-25T15:04:09.134 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-01-25T15:04:09.133+0000 7efc73621640 -1 osd.3 0 log_to_monitors true 2024-01-25T15:04:12.292 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-01-25T15:04:12.291+0000 7efc6ef68640 -1 osd.3 0 waiting for initial osdmap 2024-01-25T15:04:12.303 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-01-25T15:04:12.303+0000 7efc66d8f640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-25T15:04:12.373 INFO:tasks.ceph.osd.7.smithi052.stderr:2024-01-25T15:04:12.372+0000 7fee9778a640 -1 osd.7 0 waiting for initial osdmap 2024-01-25T15:04:12.381 INFO:tasks.ceph.osd.4.smithi052.stderr:2024-01-25T15:04:12.380+0000 7f1f4b856640 -1 osd.4 0 waiting for initial osdmap 2024-01-25T15:04:12.391 INFO:tasks.ceph.osd.7.smithi052.stderr:2024-01-25T15:04:12.391+0000 7fee8f5b1640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-25T15:04:12.397 INFO:tasks.ceph.osd.4.smithi052.stderr:2024-01-25T15:04:12.396+0000 7f1f4367d640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-25T15:04:12.397 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-01-25T15:04:12.396+0000 7f1ef39b4640 -1 osd.2 0 waiting for initial osdmap 2024-01-25T15:04:12.400 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-01-25T15:04:12.399+0000 7f6e3f1f8640 -1 osd.0 0 waiting for initial osdmap 2024-01-25T15:04:12.400 INFO:tasks.ceph.osd.5.smithi052.stderr:2024-01-25T15:04:12.400+0000 7f42f4bb0640 -1 osd.5 0 waiting for initial osdmap 2024-01-25T15:04:12.408 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-01-25T15:04:12.408+0000 7f1eeb7db640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-25T15:04:12.412 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-01-25T15:04:12.412+0000 7f6e3701f640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-25T15:04:12.413 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-01-25T15:04:12.412+0000 7f096ce87640 -1 osd.1 0 waiting for initial osdmap 2024-01-25T15:04:12.416 INFO:tasks.ceph.osd.5.smithi052.stderr:2024-01-25T15:04:12.416+0000 7f42ec9d7640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-25T15:04:12.425 INFO:tasks.ceph.osd.6.smithi052.stderr:2024-01-25T15:04:12.424+0000 7fc91cf94640 -1 osd.6 0 waiting for initial osdmap 2024-01-25T15:04:12.425 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-01-25T15:04:12.425+0000 7f0964cae640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-25T15:04:12.441 INFO:tasks.ceph.osd.6.smithi052.stderr:2024-01-25T15:04:12.441+0000 7fc914dbb640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-25T15:04:12.991 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-25T15:04:13.092 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.091+0000 7f1f1f690640 1 Processor -- start 2024-01-25T15:04:13.092 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.091+0000 7f1f1f690640 1 -- start start 2024-01-25T15:04:13.095 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.092+0000 7f1f1f690640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1f180c8480 0x7f1f181588c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.095 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.092+0000 7f1f1f690640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1f180c4a70 0x7f1f18151af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.095 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.092+0000 7f1f1f690640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f180c5430 con 0x7f1f18152030 2024-01-25T15:04:13.095 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.092+0000 7f1f1f690640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f180c5be0 con 0x7f1f180c4a70 2024-01-25T15:04:13.096 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.092+0000 7f1f1f690640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f181548c0 con 0x7f1f180c8480 2024-01-25T15:04:13.096 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.092+0000 7f1f1cc2b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1f180c4a70 0x7f1f18151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.096 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.092+0000 7f1f1cc2b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1f180c4a70 0x7f1f18151af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47800/0 (socket says 172.21.15.29:47800) 2024-01-25T15:04:13.096 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.092+0000 7f1f1cc2b640 1 -- 172.21.15.29:0/1084470474 learned_addr learned my addr 172.21.15.29:0/1084470474 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:13.096 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.092+0000 7f1f1d42c640 1 --2- 172.21.15.29:0/1084470474 >> v2:172.21.15.52:3300/0 conn(0x7f1f180c8480 0x7f1f181588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.096 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.092+0000 7f1f1cc2b640 1 -- 172.21.15.29:0/1084470474 >> v2:172.21.15.52:3300/0 conn(0x7f1f180c8480 msgr2=0x7f1f181588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:13.096 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.092+0000 7f1f1cc2b640 1 --2- 172.21.15.29:0/1084470474 >> v2:172.21.15.52:3300/0 conn(0x7f1f180c8480 0x7f1f181588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.096 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.092+0000 7f1f1cc2b640 1 -- 172.21.15.29:0/1084470474 >> v1:172.21.15.52:6789/0 conn(0x7f1f18152030 legacy=0x7f1f180c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:13.096 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.092+0000 7f1f1cc2b640 1 -- 172.21.15.29:0/1084470474 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f18154b80 con 0x7f1f180c4a70 2024-01-25T15:04:13.096 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.093+0000 7f1f1cc2b640 1 --2- 172.21.15.29:0/1084470474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f180c4a70 0x7f1f18151af0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1f180669a0 tx=0x7f1f0802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2151587c4209bc4 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:13.096 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.093+0000 7f1f0ffff640 1 -- 172.21.15.29:0/1084470474 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f08031870 con 0x7f1f180c4a70 2024-01-25T15:04:13.096 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.093+0000 7f1f0ffff640 1 -- 172.21.15.29:0/1084470474 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f080319d0 con 0x7f1f180c4a70 2024-01-25T15:04:13.096 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.093+0000 7f1f0ffff640 1 -- 172.21.15.29:0/1084470474 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f08031d60 con 0x7f1f180c4a70 2024-01-25T15:04:13.097 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.094+0000 7f1f1f690640 1 -- 172.21.15.29:0/1084470474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f180c4a70 msgr2=0x7f1f18151af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:13.097 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.094+0000 7f1f1f690640 1 --2- 172.21.15.29:0/1084470474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f180c4a70 0x7f1f18151af0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1f180669a0 tx=0x7f1f0802b910 comp rx=0 tx=0).stop 2024-01-25T15:04:13.097 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.094+0000 7f1f1f690640 1 -- 172.21.15.29:0/1084470474 shutdown_connections 2024-01-25T15:04:13.097 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.094+0000 7f1f1f690640 1 --2- 172.21.15.29:0/1084470474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f180c4a70 0x7f1f18151af0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.097 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.094+0000 7f1f1f690640 1 --2- 172.21.15.29:0/1084470474 >> v2:172.21.15.52:3300/0 conn(0x7f1f180c8480 0x7f1f181588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.097 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.094+0000 7f1f1f690640 1 -- 172.21.15.29:0/1084470474 >> 172.21.15.29:0/1084470474 conn(0x7f1f180abcc0 msgr2=0x7f1f180ac0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:13.097 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.094+0000 7f1f1f690640 1 -- 172.21.15.29:0/1084470474 shutdown_connections 2024-01-25T15:04:13.097 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.094+0000 7f1f1f690640 1 -- 172.21.15.29:0/1084470474 wait complete. 2024-01-25T15:04:13.100 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.095+0000 7f1f1f690640 1 Processor -- start 2024-01-25T15:04:13.100 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.095+0000 7f1f1f690640 1 -- start start 2024-01-25T15:04:13.101 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.096+0000 7f1f1f690640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f180c4a70 0x7f1f181ed810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.101 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.096+0000 7f1f1f690640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1f180c8480 0x7f1f181edd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.101 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.096+0000 7f1f1f690640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f18152030 0x7f1f18156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.101 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.096+0000 7f1f1f690640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f180c12f0 con 0x7f1f18152030 2024-01-25T15:04:13.101 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.096+0000 7f1f1f690640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f180c2af0 con 0x7f1f180c4a70 2024-01-25T15:04:13.101 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.096+0000 7f1f1f690640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f180c39b0 con 0x7f1f180c8480 2024-01-25T15:04:13.101 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.096+0000 7f1f1dc2d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f18152030 0x7f1f18156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.101 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.096+0000 7f1f1dc2d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f18152030 0x7f1f18156d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47808/0 (socket says 172.21.15.29:47808) 2024-01-25T15:04:13.101 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.096+0000 7f1f1dc2d640 1 -- 172.21.15.29:0/4198928514 learned_addr learned my addr 172.21.15.29:0/4198928514 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:13.101 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.096+0000 7f1f1d42c640 1 --2- 172.21.15.29:0/4198928514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f180c4a70 0x7f1f181ed810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.101 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.096+0000 7f1f1cc2b640 1 --2- 172.21.15.29:0/4198928514 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1f180c8480 0x7f1f181edd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.102 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.096+0000 7f1f1dc2d640 1 -- 172.21.15.29:0/4198928514 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1f180c8480 msgr2=0x7f1f181edd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:13.102 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.096+0000 7f1f1dc2d640 1 --2- 172.21.15.29:0/4198928514 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1f180c8480 0x7f1f181edd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.102 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.096+0000 7f1f1dc2d640 1 -- 172.21.15.29:0/4198928514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f180c4a70 msgr2=0x7f1f181ed810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:13.102 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.096+0000 7f1f1dc2d640 1 --2- 172.21.15.29:0/4198928514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f180c4a70 0x7f1f181ed810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.102 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.096+0000 7f1f1dc2d640 1 -- 172.21.15.29:0/4198928514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f080094d0 con 0x7f1f18152030 2024-01-25T15:04:13.102 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.096+0000 7f1f1dc2d640 1 --2- 172.21.15.29:0/4198928514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f18152030 0x7f1f18156d20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1f1000c6e0 tx=0x7f1f1000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:13.102 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.096+0000 7f1f0dffb640 1 -- 172.21.15.29:0/4198928514 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f10003b70 con 0x7f1f18152030 2024-01-25T15:04:13.102 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.096+0000 7f1f0dffb640 1 -- 172.21.15.29:0/4198928514 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f10003cf0 con 0x7f1f18152030 2024-01-25T15:04:13.102 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.096+0000 7f1f0dffb640 1 -- 172.21.15.29:0/4198928514 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f10005310 con 0x7f1f18152030 2024-01-25T15:04:13.102 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.096+0000 7f1f1f690640 1 -- 172.21.15.29:0/4198928514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f181ee370 con 0x7f1f18152030 2024-01-25T15:04:13.102 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.097+0000 7f1f1f690640 1 -- 172.21.15.29:0/4198928514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f180c3f30 con 0x7f1f18152030 2024-01-25T15:04:13.103 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.098+0000 7f1f1f690640 1 -- 172.21.15.29:0/4198928514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f1804ea50 con 0x7f1f18152030 2024-01-25T15:04:13.103 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.098+0000 7f1f0dffb640 1 -- 172.21.15.29:0/4198928514 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 89150+0+0 (secure 0 0 0) 0x7f1f10005470 con 0x7f1f18152030 2024-01-25T15:04:13.103 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.098+0000 7f1f0dffb640 1 --2- 172.21.15.29:0/4198928514 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1efc06ae40 0x7f1efc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.103 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.099+0000 7f1f0dffb640 1 -- 172.21.15.29:0/4198928514 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f1f100883a0 con 0x7f1f18152030 2024-01-25T15:04:13.103 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.099+0000 7f1f1d42c640 1 --2- 172.21.15.29:0/4198928514 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1efc06ae40 0x7f1efc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.103 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.099+0000 7f1f1d42c640 1 --2- 172.21.15.29:0/4198928514 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1efc06ae40 0x7f1efc06d300 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1f14006fd0 tx=0x7f1f14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:13.103 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.103+0000 7f1f0dffb640 1 -- 172.21.15.29:0/4198928514 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f1f10054180 con 0x7f1f18152030 2024-01-25T15:04:13.285 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.284+0000 7f1f1f690640 1 -- 172.21.15.29:0/4198928514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f180c14a0 con 0x7f1f18152030 2024-01-25T15:04:13.285 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.285+0000 7f1f0dffb640 1 -- 172.21.15.29:0/4198928514 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f1f180c14a0 con 0x7f1f18152030 2024-01-25T15:04:13.286 INFO:teuthology.misc.health.smithi029.stdout: 2024-01-25T15:04:13.286 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":12,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:10.918469+0000","last_up_change":"0.000000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:04:13.288 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.287+0000 7f1f1f690640 1 -- 172.21.15.29:0/4198928514 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1efc06ae40 msgr2=0x7f1efc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:13.288 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.287+0000 7f1f1f690640 1 --2- 172.21.15.29:0/4198928514 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1efc06ae40 0x7f1efc06d300 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1f14006fd0 tx=0x7f1f14008040 comp rx=0 tx=0).stop 2024-01-25T15:04:13.288 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.287+0000 7f1f1f690640 1 -- 172.21.15.29:0/4198928514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f18152030 msgr2=0x7f1f18156d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:13.288 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.287+0000 7f1f1f690640 1 --2- 172.21.15.29:0/4198928514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f18152030 0x7f1f18156d20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1f1000c6e0 tx=0x7f1f1000cba0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.288 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.287+0000 7f1f1f690640 1 -- 172.21.15.29:0/4198928514 shutdown_connections 2024-01-25T15:04:13.288 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.287+0000 7f1f1f690640 1 --2- 172.21.15.29:0/4198928514 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1efc06ae40 0x7f1efc06d300 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.288 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.287+0000 7f1f1f690640 1 --2- 172.21.15.29:0/4198928514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f18152030 0x7f1f18156d20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.288 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.287+0000 7f1f1f690640 1 --2- 172.21.15.29:0/4198928514 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1f180c8480 0x7f1f181edd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.288 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.287+0000 7f1f1f690640 1 --2- 172.21.15.29:0/4198928514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f180c4a70 0x7f1f181ed810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.288 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.287+0000 7f1f1f690640 1 -- 172.21.15.29:0/4198928514 >> 172.21.15.29:0/4198928514 conn(0x7f1f180abcc0 msgr2=0x7f1f180c8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:13.288 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.287+0000 7f1f1f690640 1 -- 172.21.15.29:0/4198928514 shutdown_connections 2024-01-25T15:04:13.289 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:13.287+0000 7f1f1f690640 1 -- 172.21.15.29:0/4198928514 wait complete. 2024-01-25T15:04:13.297 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-25T15:04:20.103 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-25T15:04:20.205 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.204+0000 7f64d71b6640 1 Processor -- start 2024-01-25T15:04:20.205 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.204+0000 7f64d71b6640 1 -- start start 2024-01-25T15:04:20.207 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.205+0000 7f64d71b6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f64d00af8d0 0x7f64d006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:20.207 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.205+0000 7f64d71b6640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f64d0155260 0x7f64d00c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:20.207 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.205+0000 7f64d71b6640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d006b540 con 0x7f64d00c4f70 2024-01-25T15:04:20.207 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.205+0000 7f64d71b6640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d006bf80 con 0x7f64d0155260 2024-01-25T15:04:20.207 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.205+0000 7f64d71b6640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d01522b0 con 0x7f64d00af8d0 2024-01-25T15:04:20.208 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.205+0000 7f64cffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f64d0155260 0x7f64d00c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:20.208 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.205+0000 7f64cffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f64d0155260 0x7f64d00c4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44632/0 (socket says 172.21.15.29:44632) 2024-01-25T15:04:20.208 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.205+0000 7f64cffff640 1 -- 172.21.15.29:0/3346394391 learned_addr learned my addr 172.21.15.29:0/3346394391 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:20.208 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.205+0000 7f64d4f52640 1 --2- 172.21.15.29:0/3346394391 >> v2:172.21.15.52:3300/0 conn(0x7f64d00af8d0 0x7f64d006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:20.208 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.206+0000 7f64cffff640 1 -- 172.21.15.29:0/3346394391 >> v2:172.21.15.52:3300/0 conn(0x7f64d00af8d0 msgr2=0x7f64d006af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:20.208 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.206+0000 7f64cffff640 1 --2- 172.21.15.29:0/3346394391 >> v2:172.21.15.52:3300/0 conn(0x7f64d00af8d0 0x7f64d006af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.208 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.206+0000 7f64cffff640 1 -- 172.21.15.29:0/3346394391 >> v1:172.21.15.52:6789/0 conn(0x7f64d00c4f70 legacy=0x7f64d00c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:20.208 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.206+0000 7f64cffff640 1 -- 172.21.15.29:0/3346394391 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d006b820 con 0x7f64d0155260 2024-01-25T15:04:20.208 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.206+0000 7f64cffff640 1 --2- 172.21.15.29:0/3346394391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64d0155260 0x7f64d00c4a30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f64d00c7bd0 tx=0x7f64c402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899ec22f0544874b server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:20.209 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.206+0000 7f64cf7fe640 1 -- 172.21.15.29:0/3346394391 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c4031870 con 0x7f64d0155260 2024-01-25T15:04:20.209 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.207+0000 7f64cf7fe640 1 -- 172.21.15.29:0/3346394391 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c40319d0 con 0x7f64d0155260 2024-01-25T15:04:20.209 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.207+0000 7f64cf7fe640 1 -- 172.21.15.29:0/3346394391 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c4031d60 con 0x7f64d0155260 2024-01-25T15:04:20.211 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.207+0000 7f64d71b6640 1 -- 172.21.15.29:0/3346394391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64d0155260 msgr2=0x7f64d00c4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:20.211 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.207+0000 7f64d71b6640 1 --2- 172.21.15.29:0/3346394391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64d0155260 0x7f64d00c4a30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f64d00c7bd0 tx=0x7f64c402b910 comp rx=0 tx=0).stop 2024-01-25T15:04:20.211 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.207+0000 7f64d71b6640 1 -- 172.21.15.29:0/3346394391 shutdown_connections 2024-01-25T15:04:20.212 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.207+0000 7f64d71b6640 1 --2- 172.21.15.29:0/3346394391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64d0155260 0x7f64d00c4a30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.212 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.207+0000 7f64d71b6640 1 --2- 172.21.15.29:0/3346394391 >> v2:172.21.15.52:3300/0 conn(0x7f64d00af8d0 0x7f64d006af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.212 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.207+0000 7f64d71b6640 1 -- 172.21.15.29:0/3346394391 >> 172.21.15.29:0/3346394391 conn(0x7f64d00ca0b0 msgr2=0x7f64d00ca4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:20.212 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.207+0000 7f64d71b6640 1 -- 172.21.15.29:0/3346394391 shutdown_connections 2024-01-25T15:04:20.212 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.207+0000 7f64d71b6640 1 -- 172.21.15.29:0/3346394391 wait complete. 2024-01-25T15:04:20.212 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.208+0000 7f64d71b6640 1 Processor -- start 2024-01-25T15:04:20.212 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.208+0000 7f64d71b6640 1 -- start start 2024-01-25T15:04:20.212 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.209+0000 7f64d71b6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64d00af8d0 0x7f64d01edc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:20.212 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.209+0000 7f64d71b6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64d00c4f70 0x7f64d00c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:20.212 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.209+0000 7f64d71b6640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f64d0155260 0x7f64d0153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:20.212 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.209+0000 7f64d71b6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00c2ab0 con 0x7f64d00c4f70 2024-01-25T15:04:20.212 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.209+0000 7f64d71b6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d0157160 con 0x7f64d00af8d0 2024-01-25T15:04:20.213 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.209+0000 7f64d71b6640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d01579c0 con 0x7f64d0155260 2024-01-25T15:04:20.213 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.209+0000 7f64cffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64d00c4f70 0x7f64d00c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:20.213 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.209+0000 7f64cffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64d00c4f70 0x7f64d00c3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44634/0 (socket says 172.21.15.29:44634) 2024-01-25T15:04:20.213 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.209+0000 7f64cffff640 1 -- 172.21.15.29:0/3204037784 learned_addr learned my addr 172.21.15.29:0/3204037784 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:20.213 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.209+0000 7f64d4f52640 1 --2- 172.21.15.29:0/3204037784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64d00af8d0 0x7f64d01edc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:20.213 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.209+0000 7f64d5753640 1 --2- 172.21.15.29:0/3204037784 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f64d0155260 0x7f64d0153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:20.213 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.210+0000 7f64cffff640 1 -- 172.21.15.29:0/3204037784 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f64d0155260 msgr2=0x7f64d0153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:20.213 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.210+0000 7f64cffff640 1 --2- 172.21.15.29:0/3204037784 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f64d0155260 0x7f64d0153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.213 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.210+0000 7f64cffff640 1 -- 172.21.15.29:0/3204037784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64d00af8d0 msgr2=0x7f64d01edc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:20.213 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.210+0000 7f64cffff640 1 --2- 172.21.15.29:0/3204037784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64d00af8d0 0x7f64d01edc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.213 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.210+0000 7f64cffff640 1 -- 172.21.15.29:0/3204037784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c40094d0 con 0x7f64d00c4f70 2024-01-25T15:04:20.213 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.210+0000 7f64cffff640 1 --2- 172.21.15.29:0/3204037784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64d00c4f70 0x7f64d00c3c00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f64c402b950 tx=0x7f64c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:20.213 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.210+0000 7f64cd7fa640 1 -- 172.21.15.29:0/3204037784 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c403acb0 con 0x7f64d00c4f70 2024-01-25T15:04:20.213 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.210+0000 7f64cd7fa640 1 -- 172.21.15.29:0/3204037784 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c403ae10 con 0x7f64d00c4f70 2024-01-25T15:04:20.213 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.210+0000 7f64d71b6640 1 -- 172.21.15.29:0/3204037784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d0158540 con 0x7f64d00c4f70 2024-01-25T15:04:20.213 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.210+0000 7f64cd7fa640 1 -- 172.21.15.29:0/3204037784 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c4044630 con 0x7f64d00c4f70 2024-01-25T15:04:20.214 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.210+0000 7f64d71b6640 1 -- 172.21.15.29:0/3204037784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d0157650 con 0x7f64d00c4f70 2024-01-25T15:04:20.214 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.211+0000 7f64d71b6640 1 -- 172.21.15.29:0/3204037784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d006c3e0 con 0x7f64d00c4f70 2024-01-25T15:04:20.214 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.212+0000 7f64cd7fa640 1 -- 172.21.15.29:0/3204037784 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f64c404d450 con 0x7f64d00c4f70 2024-01-25T15:04:20.214 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.212+0000 7f64cd7fa640 1 --2- 172.21.15.29:0/3204037784 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f64bc06af00 0x7f64bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:20.215 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.212+0000 7f64cd7fa640 1 -- 172.21.15.29:0/3204037784 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f64c402d040 con 0x7f64d00c4f70 2024-01-25T15:04:20.215 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.212+0000 7f64d4f52640 1 --2- 172.21.15.29:0/3204037784 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f64bc06af00 0x7f64bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:20.215 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.213+0000 7f64d4f52640 1 --2- 172.21.15.29:0/3204037784 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f64bc06af00 0x7f64bc06d3c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f64c8003aa0 tx=0x7f64c8009830 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:20.217 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.217+0000 7f64cd7fa640 1 -- 172.21.15.29:0/3204037784 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f64c4076a20 con 0x7f64d00c4f70 2024-01-25T15:04:20.400 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.399+0000 7f64d71b6640 1 -- 172.21.15.29:0/3204037784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64d004ea50 con 0x7f64d00c4f70 2024-01-25T15:04:20.400 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.400+0000 7f64cd7fa640 1 -- 172.21.15.29:0/3204037784 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12815 (secure 0 0 0) 0x7f64c407a040 con 0x7f64d00c4f70 2024-01-25T15:04:20.401 INFO:teuthology.misc.health.smithi029.stdout: 2024-01-25T15:04:20.401 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":16,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:16.965572+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:04:20.403 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.402+0000 7f64d71b6640 1 -- 172.21.15.29:0/3204037784 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f64bc06af00 msgr2=0x7f64bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:20.403 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.402+0000 7f64d71b6640 1 --2- 172.21.15.29:0/3204037784 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f64bc06af00 0x7f64bc06d3c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f64c8003aa0 tx=0x7f64c8009830 comp rx=0 tx=0).stop 2024-01-25T15:04:20.403 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.402+0000 7f64d71b6640 1 -- 172.21.15.29:0/3204037784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64d00c4f70 msgr2=0x7f64d00c3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:20.403 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.402+0000 7f64d71b6640 1 --2- 172.21.15.29:0/3204037784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64d00c4f70 0x7f64d00c3c00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f64c402b950 tx=0x7f64c40046c0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.403 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.402+0000 7f64d71b6640 1 -- 172.21.15.29:0/3204037784 shutdown_connections 2024-01-25T15:04:20.403 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.402+0000 7f64d71b6640 1 --2- 172.21.15.29:0/3204037784 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f64d0155260 0x7f64d0153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.403 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.402+0000 7f64d71b6640 1 --2- 172.21.15.29:0/3204037784 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f64bc06af00 0x7f64bc06d3c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.403 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.402+0000 7f64d71b6640 1 --2- 172.21.15.29:0/3204037784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64d00c4f70 0x7f64d00c3c00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.404 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.402+0000 7f64d71b6640 1 --2- 172.21.15.29:0/3204037784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64d00af8d0 0x7f64d01edc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.404 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.402+0000 7f64d71b6640 1 -- 172.21.15.29:0/3204037784 >> 172.21.15.29:0/3204037784 conn(0x7f64d00ca0b0 msgr2=0x7f64d00aa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:20.404 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.402+0000 7f64d71b6640 1 -- 172.21.15.29:0/3204037784 shutdown_connections 2024-01-25T15:04:20.404 INFO:teuthology.misc.health.smithi029.stderr:2024-01-25T15:04:20.402+0000 7f64d71b6640 1 -- 172.21.15.29:0/3204037784 wait complete. 2024-01-25T15:04:20.412 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-25T15:04:20.412 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-25T15:04:20.413 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-25T15:04:20.413 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-25T15:04:20.415 INFO:tasks.ceph.mds.a:Started 2024-01-25T15:04:20.415 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-25T15:04:20.415 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-25T15:04:20.417 INFO:tasks.ceph.mds.c:Started 2024-01-25T15:04:20.417 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-25T15:04:20.417 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-25T15:04:20.420 INFO:tasks.ceph.mds.b:Started 2024-01-25T15:04:20.420 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-25T15:04:20.420 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-25T15:04:20.422 INFO:tasks.ceph.mds.d:Started 2024-01-25T15:04:20.422 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-01-25T15:04:20.425 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:04:20.492 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2024-01-25T15:04:20.493 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2024-01-25T15:04:20.493 INFO:tasks.ceph.mds.a.smithi029.stderr:2024-01-25T15:04:20.492+0000 7fc9e1535640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-01-25T15:04:20.507 INFO:tasks.ceph.mds.b.smithi052.stdout:starting mds.b at 2024-01-25T15:04:20.508 INFO:tasks.ceph.mds.d.smithi052.stdout:starting mds.d at 2024-01-25T15:04:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.529+0000 7f409223d640 1 Processor -- start 2024-01-25T15:04:20.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.530+0000 7f409223d640 1 -- start start 2024-01-25T15:04:20.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.530+0000 7f409223d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f408c14fa70 0x7f408c0c0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:20.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.530+0000 7f409223d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f408c156810 0x7f408c06a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:20.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.530+0000 7f409223d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f408c0c2410 0x7f408c06ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:20.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.530+0000 7f409223d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408c155ae0 con 0x7f408c14fa70 2024-01-25T15:04:20.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.530+0000 7f409223d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408c156380 con 0x7f408c0c2410 2024-01-25T15:04:20.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.530+0000 7f409223d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408c06e3d0 con 0x7f408c156810 2024-01-25T15:04:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.530+0000 7f408b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f408c14fa70 0x7f408c0c0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.530+0000 7f408b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f408c14fa70 0x7f408c0c0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44692/0 (socket says 172.21.15.29:44692) 2024-01-25T15:04:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.530+0000 7f408b7fe640 1 -- 172.21.15.29:0/3537389686 learned_addr learned my addr 172.21.15.29:0/3537389686 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.531+0000 7f408b7fe640 1 -- 172.21.15.29:0/3537389686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f408c156810 msgr2=0x7f408c06a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.531+0000 7f408b7fe640 1 --2- 172.21.15.29:0/3537389686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f408c156810 0x7f408c06a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.531+0000 7f408b7fe640 1 -- 172.21.15.29:0/3537389686 >> v2:172.21.15.52:3300/0 conn(0x7f408c0c2410 msgr2=0x7f408c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.531+0000 7f408bfff640 1 --2- 172.21.15.29:0/3537389686 >> v2:172.21.15.52:3300/0 conn(0x7f408c0c2410 0x7f408c06ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.531+0000 7f408b7fe640 1 --2- 172.21.15.29:0/3537389686 >> v2:172.21.15.52:3300/0 conn(0x7f408c0c2410 0x7f408c06ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.531+0000 7f408b7fe640 1 -- 172.21.15.29:0/3537389686 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c155d30 con 0x7f408c14fa70 2024-01-25T15:04:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.531+0000 7f408b7fe640 1 --2- 172.21.15.29:0/3537389686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f408c14fa70 0x7f408c0c0ff0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f408c06c090 tx=0x7f408002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8233a4b21226b5 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.531+0000 7f408a7fc640 1 -- 172.21.15.29:0/3537389686 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40800317e0 con 0x7f408c14fa70 2024-01-25T15:04:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.532+0000 7f408a7fc640 1 -- 172.21.15.29:0/3537389686 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4080031940 con 0x7f408c14fa70 2024-01-25T15:04:20.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.532+0000 7f408a7fc640 1 -- 172.21.15.29:0/3537389686 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4080031cd0 con 0x7f408c14fa70 2024-01-25T15:04:20.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.532+0000 7f409223d640 1 -- 172.21.15.29:0/3537389686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f408c14fa70 msgr2=0x7f408c0c0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:20.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.532+0000 7f409223d640 1 --2- 172.21.15.29:0/3537389686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f408c14fa70 0x7f408c0c0ff0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f408c06c090 tx=0x7f408002b880 comp rx=0 tx=0).stop 2024-01-25T15:04:20.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.532+0000 7f409223d640 1 -- 172.21.15.29:0/3537389686 shutdown_connections 2024-01-25T15:04:20.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.532+0000 7f409223d640 1 --2- 172.21.15.29:0/3537389686 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f408c156810 0x7f408c06a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.532+0000 7f409223d640 1 --2- 172.21.15.29:0/3537389686 >> v2:172.21.15.52:3300/0 conn(0x7f408c0c2410 0x7f408c06ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.532+0000 7f409223d640 1 --2- 172.21.15.29:0/3537389686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f408c14fa70 0x7f408c0c0ff0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.532+0000 7f409223d640 1 -- 172.21.15.29:0/3537389686 >> 172.21.15.29:0/3537389686 conn(0x7f408c0c65f0 msgr2=0x7f408c0c69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:20.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.532+0000 7f409223d640 1 -- 172.21.15.29:0/3537389686 shutdown_connections 2024-01-25T15:04:20.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.532+0000 7f409223d640 1 -- 172.21.15.29:0/3537389686 wait complete. 2024-01-25T15:04:20.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.533+0000 7f409223d640 1 Processor -- start 2024-01-25T15:04:20.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.534+0000 7f409223d640 1 -- start start 2024-01-25T15:04:20.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.534+0000 7f409223d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f408c0c2410 0x7f408c150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:20.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.534+0000 7f409223d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f408c14fa70 0x7f408c151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:20.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.534+0000 7f409223d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f408c156810 0x7f408c151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:20.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.534+0000 7f409223d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c149f40 con 0x7f408c156810 2024-01-25T15:04:20.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.534+0000 7f409223d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c14a220 con 0x7f408c14fa70 2024-01-25T15:04:20.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.534+0000 7f409223d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408c14a500 con 0x7f408c0c2410 2024-01-25T15:04:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.534+0000 7f408bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f408c156810 0x7f408c151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.534+0000 7f408bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f408c156810 0x7f408c151e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44696/0 (socket says 172.21.15.29:44696) 2024-01-25T15:04:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.534+0000 7f408bfff640 1 -- 172.21.15.29:0/3865644776 learned_addr learned my addr 172.21.15.29:0/3865644776 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.534+0000 7f408b7fe640 1 --2- 172.21.15.29:0/3865644776 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f408c0c2410 0x7f408c150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.534+0000 7f408affd640 1 --2- 172.21.15.29:0/3865644776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f408c14fa70 0x7f408c151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.535+0000 7f408bfff640 1 -- 172.21.15.29:0/3865644776 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f408c0c2410 msgr2=0x7f408c150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.535+0000 7f408bfff640 1 --2- 172.21.15.29:0/3865644776 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f408c0c2410 0x7f408c150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.535+0000 7f408bfff640 1 -- 172.21.15.29:0/3865644776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f408c14fa70 msgr2=0x7f408c151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.535+0000 7f408bfff640 1 --2- 172.21.15.29:0/3865644776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f408c14fa70 0x7f408c151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.535+0000 7f408bfff640 1 -- 172.21.15.29:0/3865644776 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40800094d0 con 0x7f408c156810 2024-01-25T15:04:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.535+0000 7f408bfff640 1 --2- 172.21.15.29:0/3865644776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f408c156810 0x7f408c151e70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f408400cc30 tx=0x7f408400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.535+0000 7f4073fff640 1 -- 172.21.15.29:0/3865644776 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408400cc60 con 0x7f408c156810 2024-01-25T15:04:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.535+0000 7f4073fff640 1 -- 172.21.15.29:0/3865644776 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408400cdc0 con 0x7f408c156810 2024-01-25T15:04:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.535+0000 7f409223d640 1 -- 172.21.15.29:0/3865644776 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f408c14a7e0 con 0x7f408c156810 2024-01-25T15:04:20.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.535+0000 7f4073fff640 1 -- 172.21.15.29:0/3865644776 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084003bb0 con 0x7f408c156810 2024-01-25T15:04:20.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.535+0000 7f409223d640 1 -- 172.21.15.29:0/3865644776 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408c150eb0 con 0x7f408c156810 2024-01-25T15:04:20.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.536+0000 7f409223d640 1 -- 172.21.15.29:0/3865644776 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408c14ad00 con 0x7f408c156810 2024-01-25T15:04:20.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.536+0000 7f4073fff640 1 -- 172.21.15.29:0/3865644776 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f408400f3f0 con 0x7f408c156810 2024-01-25T15:04:20.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.537+0000 7f4073fff640 1 --2- 172.21.15.29:0/3865644776 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f407806aed0 0x7f407806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:20.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.537+0000 7f4073fff640 1 -- 172.21.15.29:0/3865644776 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4084089470 con 0x7f408c156810 2024-01-25T15:04:20.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.537+0000 7f408b7fe640 1 --2- 172.21.15.29:0/3865644776 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f407806aed0 0x7f407806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:20.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.537+0000 7f408b7fe640 1 --2- 172.21.15.29:0/3865644776 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f407806aed0 0x7f407806d390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4080036000 tx=0x7f408003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:20.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.541+0000 7f4073fff640 1 -- 172.21.15.29:0/3865644776 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f408c14ad00 con 0x7f408c156810 2024-01-25T15:04:20.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.724+0000 7f409223d640 1 -- 172.21.15.29:0/3865644776 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f408c14ad00 con 0x7f408c156810 2024-01-25T15:04:20.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.725+0000 7f4073fff640 1 -- 172.21.15.29:0/3865644776 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12815 (secure 0 0 0) 0x7f408c14ad00 con 0x7f408c156810 2024-01-25T15:04:20.726 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:20.726 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":16,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:16.965572+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:04:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.727+0000 7f409223d640 1 -- 172.21.15.29:0/3865644776 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f407806aed0 msgr2=0x7f407806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.727+0000 7f409223d640 1 --2- 172.21.15.29:0/3865644776 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f407806aed0 0x7f407806d390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4080036000 tx=0x7f408003d040 comp rx=0 tx=0).stop 2024-01-25T15:04:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.727+0000 7f409223d640 1 -- 172.21.15.29:0/3865644776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f408c156810 msgr2=0x7f408c151e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.727+0000 7f409223d640 1 --2- 172.21.15.29:0/3865644776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f408c156810 0x7f408c151e70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f408400cc30 tx=0x7f408400a5c0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.727+0000 7f409223d640 1 -- 172.21.15.29:0/3865644776 shutdown_connections 2024-01-25T15:04:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.727+0000 7f409223d640 1 --2- 172.21.15.29:0/3865644776 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f407806aed0 0x7f407806d390 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.727+0000 7f409223d640 1 --2- 172.21.15.29:0/3865644776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f408c156810 0x7f408c151e70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.727+0000 7f409223d640 1 --2- 172.21.15.29:0/3865644776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f408c14fa70 0x7f408c151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.727+0000 7f409223d640 1 --2- 172.21.15.29:0/3865644776 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f408c0c2410 0x7f408c150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.727+0000 7f409223d640 1 -- 172.21.15.29:0/3865644776 >> 172.21.15.29:0/3865644776 conn(0x7f408c0c65f0 msgr2=0x7f408c14ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.727+0000 7f409223d640 1 -- 172.21.15.29:0/3865644776 shutdown_connections 2024-01-25T15:04:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.727+0000 7f409223d640 1 -- 172.21.15.29:0/3865644776 wait complete. 2024-01-25T15:04:20.739 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T15:04:14.955791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-25T15:04:20.739 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:04:20.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.843+0000 7f14ce0db640 1 Processor -- start 2024-01-25T15:04:20.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.843+0000 7f14ce0db640 1 -- start start 2024-01-25T15:04:20.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.843+0000 7f14ce0db640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f14c80c4fe0 0x7f14c806b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:20.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.843+0000 7f14ce0db640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c80afaa0 con 0x7f14c806d560 2024-01-25T15:04:20.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.843+0000 7f14ce0db640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c80c6060 con 0x7f14c80af6c0 2024-01-25T15:04:20.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.843+0000 7f14ce0db640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c806c480 con 0x7f14c80c4fe0 2024-01-25T15:04:20.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.844+0000 7f14c7fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f14c80c4fe0 0x7f14c806b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:20.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.844+0000 7f14c6ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f14c806d560 0x7f14c806b220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50968/0 (socket says 172.21.15.29:50968) 2024-01-25T15:04:20.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.844+0000 7f14c6ffd640 1 -- 172.21.15.29:0/1124513868 learned_addr learned my addr 172.21.15.29:0/1124513868 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:20.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.844+0000 7f14c7fff640 1 -- 172.21.15.29:0/1124513868 >> v1:172.21.15.52:6789/0 conn(0x7f14c80af6c0 legacy=0x7f14c80c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:20.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.844+0000 7f14c7fff640 1 -- 172.21.15.29:0/1124513868 >> v1:172.21.15.29:6789/0 conn(0x7f14c806d560 legacy=0x7f14c806b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:20.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.844+0000 7f14c7fff640 1 -- 172.21.15.29:0/1124513868 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c8155480 con 0x7f14c80c4fe0 2024-01-25T15:04:20.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.844+0000 7f14c67fc640 1 -- 172.21.15.29:0/1124513868 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375626742 0 0) 0x7f14c80afaa0 con 0x7f14c806d560 2024-01-25T15:04:20.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.845+0000 7f14c7fff640 1 --2- 172.21.15.29:0/1124513868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14c80c4fe0 0x7f14c806b930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009d90 tx=0x7f14c002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d39a87e5420c7a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:20.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.845+0000 7f14c67fc640 1 -- 172.21.15.29:0/1124513868 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c002cd00 con 0x7f14c80c4fe0 2024-01-25T15:04:20.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.845+0000 7f14c67fc640 1 -- 172.21.15.29:0/1124513868 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c002ce60 con 0x7f14c80c4fe0 2024-01-25T15:04:20.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.845+0000 7f14c67fc640 1 -- 172.21.15.29:0/1124513868 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c0034660 con 0x7f14c80c4fe0 2024-01-25T15:04:20.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.845+0000 7f14ce0db640 1 -- 172.21.15.29:0/1124513868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14c80c4fe0 msgr2=0x7f14c806b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:20.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.845+0000 7f14ce0db640 1 --2- 172.21.15.29:0/1124513868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14c80c4fe0 0x7f14c806b930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009d90 tx=0x7f14c002bf50 comp rx=0 tx=0).stop 2024-01-25T15:04:20.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.845+0000 7f14ce0db640 1 -- 172.21.15.29:0/1124513868 shutdown_connections 2024-01-25T15:04:20.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.845+0000 7f14ce0db640 1 --2- 172.21.15.29:0/1124513868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14c80c4fe0 0x7f14c806b930 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.845+0000 7f14ce0db640 1 -- 172.21.15.29:0/1124513868 >> 172.21.15.29:0/1124513868 conn(0x7f14c80c6ca0 msgr2=0x7f14c80c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:20.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.845+0000 7f14ce0db640 1 -- 172.21.15.29:0/1124513868 shutdown_connections 2024-01-25T15:04:20.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.845+0000 7f14ce0db640 1 -- 172.21.15.29:0/1124513868 wait complete. 2024-01-25T15:04:20.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.846+0000 7f14ce0db640 1 Processor -- start 2024-01-25T15:04:20.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.847+0000 7f14ce0db640 1 -- start start 2024-01-25T15:04:20.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.847+0000 7f14ce0db640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f14c806d560 0x7f14c80c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:20.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.847+0000 7f14ce0db640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14c80af6c0 0x7f14c81e9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:20.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.847+0000 7f14ce0db640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c80c4fe0 0x7f14c8155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:20.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.847+0000 7f14ce0db640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80c1ed0 con 0x7f14c80af6c0 2024-01-25T15:04:20.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.847+0000 7f14ce0db640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80c21b0 con 0x7f14c80c4fe0 2024-01-25T15:04:20.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.847+0000 7f14ce0db640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80c2490 con 0x7f14c806d560 2024-01-25T15:04:20.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.847+0000 7f14c6ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14c80af6c0 0x7f14c81e9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:20.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.847+0000 7f14c6ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14c80af6c0 0x7f14c81e9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44708/0 (socket says 172.21.15.29:44708) 2024-01-25T15:04:20.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.847+0000 7f14c6ffd640 1 -- 172.21.15.29:0/1594453276 learned_addr learned my addr 172.21.15.29:0/1594453276 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:20.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.848+0000 7f14c7fff640 1 --2- 172.21.15.29:0/1594453276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c80c4fe0 0x7f14c8155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:20.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.848+0000 7f14c77fe640 1 --2- 172.21.15.29:0/1594453276 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f14c806d560 0x7f14c80c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:20.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.848+0000 7f14c6ffd640 1 -- 172.21.15.29:0/1594453276 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f14c806d560 msgr2=0x7f14c80c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:20.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.848+0000 7f14c6ffd640 1 --2- 172.21.15.29:0/1594453276 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f14c806d560 0x7f14c80c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.848+0000 7f14c6ffd640 1 -- 172.21.15.29:0/1594453276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c80c4fe0 msgr2=0x7f14c8155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:20.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.848+0000 7f14c6ffd640 1 --2- 172.21.15.29:0/1594453276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c80c4fe0 0x7f14c8155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:20.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.848+0000 7f14c6ffd640 1 -- 172.21.15.29:0/1594453276 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c0009a70 con 0x7f14c80af6c0 2024-01-25T15:04:20.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.848+0000 7f14c7fff640 1 --2- 172.21.15.29:0/1594453276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c80c4fe0 0x7f14c8155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:20.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.848+0000 7f14c77fe640 1 --2- 172.21.15.29:0/1594453276 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f14c806d560 0x7f14c80c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:20.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.848+0000 7f14c6ffd640 1 --2- 172.21.15.29:0/1594453276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14c80af6c0 0x7f14c81e9ec0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f14bc00c4a0 tx=0x7f14bc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:20.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.848+0000 7f14affff640 1 -- 172.21.15.29:0/1594453276 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc0074e0 con 0x7f14c80af6c0 2024-01-25T15:04:20.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.848+0000 7f14affff640 1 -- 172.21.15.29:0/1594453276 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14bc007640 con 0x7f14c80af6c0 2024-01-25T15:04:20.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.848+0000 7f14ce0db640 1 -- 172.21.15.29:0/1594453276 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c80c2770 con 0x7f14c80af6c0 2024-01-25T15:04:20.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.848+0000 7f14affff640 1 -- 172.21.15.29:0/1594453276 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc004a00 con 0x7f14c80af6c0 2024-01-25T15:04:20.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.848+0000 7f14ce0db640 1 -- 172.21.15.29:0/1594453276 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c8156110 con 0x7f14c80af6c0 2024-01-25T15:04:20.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.849+0000 7f14ce0db640 1 -- 172.21.15.29:0/1594453276 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c8074010 con 0x7f14c80af6c0 2024-01-25T15:04:20.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.849+0000 7f14affff640 1 -- 172.21.15.29:0/1594453276 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f14bc004b60 con 0x7f14c80af6c0 2024-01-25T15:04:20.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.850+0000 7f14affff640 1 --2- 172.21.15.29:0/1594453276 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f14b406aed0 0x7f14b406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:20.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.850+0000 7f14affff640 1 -- 172.21.15.29:0/1594453276 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f14bc088580 con 0x7f14c80af6c0 2024-01-25T15:04:20.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.850+0000 7f14c77fe640 1 --2- 172.21.15.29:0/1594453276 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f14b406aed0 0x7f14b406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:20.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.850+0000 7f14c77fe640 1 --2- 172.21.15.29:0/1594453276 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f14b406aed0 0x7f14b406d390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f14b8000f60 tx=0x7f14b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:20.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:20.854+0000 7f14affff640 1 -- 172.21.15.29:0/1594453276 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f14bc0537b0 con 0x7f14c80af6c0 2024-01-25T15:04:21.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.035+0000 7f14ce0db640 1 -- 172.21.15.29:0/1594453276 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f14c8153a80 con 0x7f14c80af6c0 2024-01-25T15:04:21.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.035+0000 7f14affff640 1 -- 172.21.15.29:0/1594453276 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f14bc0180a0 con 0x7f14c80af6c0 2024-01-25T15:04:21.036 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-25T15:04:21.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.037+0000 7f14ce0db640 1 -- 172.21.15.29:0/1594453276 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f14b406aed0 msgr2=0x7f14b406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:21.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.037+0000 7f14ce0db640 1 --2- 172.21.15.29:0/1594453276 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f14b406aed0 0x7f14b406d390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f14b8000f60 tx=0x7f14b8009040 comp rx=0 tx=0).stop 2024-01-25T15:04:21.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.037+0000 7f14ce0db640 1 -- 172.21.15.29:0/1594453276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14c80af6c0 msgr2=0x7f14c81e9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:21.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.037+0000 7f14ce0db640 1 --2- 172.21.15.29:0/1594453276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14c80af6c0 0x7f14c81e9ec0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f14bc00c4a0 tx=0x7f14bc00c960 comp rx=0 tx=0).stop 2024-01-25T15:04:21.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.037+0000 7f14ce0db640 1 -- 172.21.15.29:0/1594453276 shutdown_connections 2024-01-25T15:04:21.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.037+0000 7f14ce0db640 1 --2- 172.21.15.29:0/1594453276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c80c4fe0 0x7f14c8155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:21.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.037+0000 7f14ce0db640 1 --2- 172.21.15.29:0/1594453276 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f14b406aed0 0x7f14b406d390 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:21.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.037+0000 7f14ce0db640 1 --2- 172.21.15.29:0/1594453276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14c80af6c0 0x7f14c81e9ec0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:21.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.037+0000 7f14ce0db640 1 --2- 172.21.15.29:0/1594453276 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f14c806d560 0x7f14c80c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:21.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.037+0000 7f14ce0db640 1 -- 172.21.15.29:0/1594453276 >> 172.21.15.29:0/1594453276 conn(0x7f14c80c6ca0 msgr2=0x7f14c80c5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:21.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.038+0000 7f14ce0db640 1 -- 172.21.15.29:0/1594453276 shutdown_connections 2024-01-25T15:04:21.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.038+0000 7f14ce0db640 1 -- 172.21.15.29:0/1594453276 wait complete. 2024-01-25T15:04:21.049 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:04:21.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.149+0000 7fdf2a456640 1 Processor -- start 2024-01-25T15:04:21.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.149+0000 7fdf2a456640 1 -- start start 2024-01-25T15:04:21.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.150+0000 7fdf2a456640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdf240c55e0 0x7fdf24155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:21.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.150+0000 7fdf2a456640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdf240c4f00 0x7fdf240c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:21.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.150+0000 7fdf2a456640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf240c66c0 con 0x7fdf241520b0 2024-01-25T15:04:21.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.150+0000 7fdf2a456640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2406cfc0 con 0x7fdf240c55e0 2024-01-25T15:04:21.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.150+0000 7fdf2a456640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf24152490 con 0x7fdf240c4f00 2024-01-25T15:04:21.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.150+0000 7fdf237fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdf240c55e0 0x7fdf24155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:21.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.150+0000 7fdf237fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdf240c55e0 0x7fdf24155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44724/0 (socket says 172.21.15.29:44724) 2024-01-25T15:04:21.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.150+0000 7fdf23fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fdf241520b0 0x7fdf240c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50984/0 (socket says 172.21.15.29:50984) 2024-01-25T15:04:21.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.150+0000 7fdf237fe640 1 -- 172.21.15.29:0/4182433394 learned_addr learned my addr 172.21.15.29:0/4182433394 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:21.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.150+0000 7fdf289f3640 1 --2- 172.21.15.29:0/4182433394 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdf240c4f00 0x7fdf240c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:21.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.150+0000 7fdf237fe640 1 -- 172.21.15.29:0/4182433394 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdf240c4f00 msgr2=0x7fdf240c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:21.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.150+0000 7fdf237fe640 1 --2- 172.21.15.29:0/4182433394 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdf240c4f00 0x7fdf240c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:21.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.150+0000 7fdf237fe640 1 -- 172.21.15.29:0/4182433394 >> v1:172.21.15.29:6789/0 conn(0x7fdf241520b0 legacy=0x7fdf240c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:21.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.150+0000 7fdf237fe640 1 -- 172.21.15.29:0/4182433394 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf240c8830 con 0x7fdf240c55e0 2024-01-25T15:04:21.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.150+0000 7fdf22ffd640 1 -- 172.21.15.29:0/4182433394 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2315508765 0 0) 0x7fdf240c66c0 con 0x7fdf241520b0 2024-01-25T15:04:21.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.151+0000 7fdf237fe640 1 --2- 172.21.15.29:0/4182433394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf240c55e0 0x7fdf24155570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdf14009870 tx=0x7fdf1402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc325f652d635213 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:21.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.151+0000 7fdf22ffd640 1 -- 172.21.15.29:0/4182433394 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14031640 con 0x7fdf240c55e0 2024-01-25T15:04:21.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.151+0000 7fdf22ffd640 1 -- 172.21.15.29:0/4182433394 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf140317a0 con 0x7fdf240c55e0 2024-01-25T15:04:21.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.151+0000 7fdf22ffd640 1 -- 172.21.15.29:0/4182433394 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14031b30 con 0x7fdf240c55e0 2024-01-25T15:04:21.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.151+0000 7fdf2a456640 1 -- 172.21.15.29:0/4182433394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf240c55e0 msgr2=0x7fdf24155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:21.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.151+0000 7fdf2a456640 1 --2- 172.21.15.29:0/4182433394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf240c55e0 0x7fdf24155570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdf14009870 tx=0x7fdf1402b8f0 comp rx=0 tx=0).stop 2024-01-25T15:04:21.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.151+0000 7fdf2a456640 1 -- 172.21.15.29:0/4182433394 shutdown_connections 2024-01-25T15:04:21.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.151+0000 7fdf2a456640 1 --2- 172.21.15.29:0/4182433394 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdf240c4f00 0x7fdf240c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:21.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.151+0000 7fdf2a456640 1 --2- 172.21.15.29:0/4182433394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf240c55e0 0x7fdf24155570 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:21.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.151+0000 7fdf2a456640 1 -- 172.21.15.29:0/4182433394 >> 172.21.15.29:0/4182433394 conn(0x7fdf240ca220 msgr2=0x7fdf240ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:21.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.152+0000 7fdf2a456640 1 -- 172.21.15.29:0/4182433394 shutdown_connections 2024-01-25T15:04:21.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.152+0000 7fdf2a456640 1 -- 172.21.15.29:0/4182433394 wait complete. 2024-01-25T15:04:21.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.153+0000 7fdf2a456640 1 Processor -- start 2024-01-25T15:04:21.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.153+0000 7fdf2a456640 1 -- start start 2024-01-25T15:04:21.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.153+0000 7fdf2a456640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf240c4f00 0x7fdf2414acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:21.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.153+0000 7fdf2a456640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf241520b0 0x7fdf24152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:21.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.153+0000 7fdf2a456640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdf240c1780 0x7fdf241ecfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:21.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.153+0000 7fdf2a456640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf240c0640 con 0x7fdf241520b0 2024-01-25T15:04:21.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.153+0000 7fdf2a456640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf240c12f0 con 0x7fdf240c4f00 2024-01-25T15:04:21.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.153+0000 7fdf2a456640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf240c1d90 con 0x7fdf240c1780 2024-01-25T15:04:21.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.153+0000 7fdf237fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf241520b0 0x7fdf24152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:21.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.154+0000 7fdf237fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf241520b0 0x7fdf24152890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44726/0 (socket says 172.21.15.29:44726) 2024-01-25T15:04:21.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.154+0000 7fdf237fe640 1 -- 172.21.15.29:0/1977784785 learned_addr learned my addr 172.21.15.29:0/1977784785 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:21.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.154+0000 7fdf289f3640 1 --2- 172.21.15.29:0/1977784785 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdf240c1780 0x7fdf241ecfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:21.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.154+0000 7fdf23fff640 1 --2- 172.21.15.29:0/1977784785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf240c4f00 0x7fdf2414acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:21.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.154+0000 7fdf237fe640 1 -- 172.21.15.29:0/1977784785 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdf240c1780 msgr2=0x7fdf241ecfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:21.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.154+0000 7fdf237fe640 1 --2- 172.21.15.29:0/1977784785 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdf240c1780 0x7fdf241ecfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:21.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.154+0000 7fdf237fe640 1 -- 172.21.15.29:0/1977784785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf240c4f00 msgr2=0x7fdf2414acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:21.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.154+0000 7fdf237fe640 1 --2- 172.21.15.29:0/1977784785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf240c4f00 0x7fdf2414acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:21.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.154+0000 7fdf237fe640 1 -- 172.21.15.29:0/1977784785 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf140094d0 con 0x7fdf241520b0 2024-01-25T15:04:21.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.154+0000 7fdf237fe640 1 --2- 172.21.15.29:0/1977784785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf241520b0 0x7fdf24152890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdf14000c00 tx=0x7fdf140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:21.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.154+0000 7fdf20ff9640 1 -- 172.21.15.29:0/1977784785 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1403a930 con 0x7fdf241520b0 2024-01-25T15:04:21.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.154+0000 7fdf20ff9640 1 -- 172.21.15.29:0/1977784785 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1403aa90 con 0x7fdf241520b0 2024-01-25T15:04:21.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.154+0000 7fdf2a456640 1 -- 172.21.15.29:0/1977784785 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf241ea830 con 0x7fdf241520b0 2024-01-25T15:04:21.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.154+0000 7fdf20ff9640 1 -- 172.21.15.29:0/1977784785 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1403ae40 con 0x7fdf241520b0 2024-01-25T15:04:21.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.154+0000 7fdf2a456640 1 -- 172.21.15.29:0/1977784785 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf240c0b30 con 0x7fdf241520b0 2024-01-25T15:04:21.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.155+0000 7fdf2a456640 1 -- 172.21.15.29:0/1977784785 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf240c0cc0 con 0x7fdf241520b0 2024-01-25T15:04:21.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.155+0000 7fdf20ff9640 1 -- 172.21.15.29:0/1977784785 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fdf1402f050 con 0x7fdf241520b0 2024-01-25T15:04:21.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.156+0000 7fdf20ff9640 1 --2- 172.21.15.29:0/1977784785 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdf1006aed0 0x7fdf1006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:21.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.156+0000 7fdf20ff9640 1 -- 172.21.15.29:0/1977784785 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdf140aaf10 con 0x7fdf241520b0 2024-01-25T15:04:21.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.156+0000 7fdf23fff640 1 --2- 172.21.15.29:0/1977784785 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdf1006aed0 0x7fdf1006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:21.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.156+0000 7fdf23fff640 1 --2- 172.21.15.29:0/1977784785 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdf1006aed0 0x7fdf1006d390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdf18007fd0 tx=0x7fdf18007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:21.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.160+0000 7fdf20ff9640 1 -- 172.21.15.29:0/1977784785 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fdf14076270 con 0x7fdf241520b0 2024-01-25T15:04:21.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.376+0000 7fdf2a456640 1 -- 172.21.15.29:0/1977784785 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf24074080 con 0x7fdf241520b0 2024-01-25T15:04:21.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.376+0000 7fdf20ff9640 1 -- 172.21.15.29:0/1977784785 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7fdf14035540 con 0x7fdf241520b0 2024-01-25T15:04:21.377 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:21.377 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1800543981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1800543981},{"type":"v1","addr":"172.21.15.29:6834","nonce":1800543981}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-25T15:04:21.377 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 2 2024-01-25T15:04:21.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.378+0000 7fdf2a456640 1 -- 172.21.15.29:0/1977784785 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdf1006aed0 msgr2=0x7fdf1006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:21.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.378+0000 7fdf2a456640 1 --2- 172.21.15.29:0/1977784785 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdf1006aed0 0x7fdf1006d390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdf18007fd0 tx=0x7fdf18007de0 comp rx=0 tx=0).stop 2024-01-25T15:04:21.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.378+0000 7fdf2a456640 1 -- 172.21.15.29:0/1977784785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf241520b0 msgr2=0x7fdf24152890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:21.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.378+0000 7fdf2a456640 1 --2- 172.21.15.29:0/1977784785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf241520b0 0x7fdf24152890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdf14000c00 tx=0x7fdf140046c0 comp rx=0 tx=0).stop 2024-01-25T15:04:21.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.378+0000 7fdf2a456640 1 -- 172.21.15.29:0/1977784785 shutdown_connections 2024-01-25T15:04:21.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.378+0000 7fdf2a456640 1 --2- 172.21.15.29:0/1977784785 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdf240c1780 0x7fdf241ecfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:21.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.378+0000 7fdf2a456640 1 --2- 172.21.15.29:0/1977784785 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdf1006aed0 0x7fdf1006d390 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:21.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.378+0000 7fdf2a456640 1 --2- 172.21.15.29:0/1977784785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf241520b0 0x7fdf24152890 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:21.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.378+0000 7fdf2a456640 1 --2- 172.21.15.29:0/1977784785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf240c4f00 0x7fdf2414acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:21.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.378+0000 7fdf2a456640 1 -- 172.21.15.29:0/1977784785 >> 172.21.15.29:0/1977784785 conn(0x7fdf240ca220 msgr2=0x7fdf240ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:21.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.378+0000 7fdf2a456640 1 -- 172.21.15.29:0/1977784785 shutdown_connections 2024-01-25T15:04:21.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:21.378+0000 7fdf2a456640 1 -- 172.21.15.29:0/1977784785 wait complete. 2024-01-25T15:04:23.390 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:04:23.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.503+0000 7f91d5350640 1 Processor -- start 2024-01-25T15:04:23.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.503+0000 7f91d5350640 1 -- start start 2024-01-25T15:04:23.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.504+0000 7f91d5350640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f91d0151ed0 0x7f91d0158860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:23.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.504+0000 7f91d5350640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91d00c1a00 0x7f91d00c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:23.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.504+0000 7f91d5350640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d00c7c10 con 0x7f91d00c8370 2024-01-25T15:04:23.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.504+0000 7f91d5350640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d00c6820 con 0x7f91d0151ed0 2024-01-25T15:04:23.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.504+0000 7f91d5350640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d00c7780 con 0x7f91d00c1a00 2024-01-25T15:04:23.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.504+0000 7f91ceffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f91d0151ed0 0x7f91d0158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:23.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.504+0000 7f91ce7fc640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91d00c1a00 0x7f91d00c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:23.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.504+0000 7f91cf7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f91d00c8370 0x7f91d01548e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:58334/0 (socket says 172.21.15.29:58334) 2024-01-25T15:04:23.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.505+0000 7f91cf7fe640 1 -- 172.21.15.29:0/1243479624 learned_addr learned my addr 172.21.15.29:0/1243479624 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:23.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.505+0000 7f91cdffb640 1 -- 172.21.15.29:0/1243479624 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199248392 0 0) 0x7f91c0001490 con 0x7f91d00c8370 2024-01-25T15:04:23.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.505+0000 7f91cdffb640 1 -- 172.21.15.29:0/1243479624 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91bc003520 con 0x7f91d00c8370 2024-01-25T15:04:23.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.505+0000 7f91ce7fc640 1 -- 172.21.15.29:0/1243479624 >> v2:172.21.15.52:3300/0 conn(0x7f91d0151ed0 msgr2=0x7f91d0158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:23.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.505+0000 7f91ce7fc640 1 --2- 172.21.15.29:0/1243479624 >> v2:172.21.15.52:3300/0 conn(0x7f91d0151ed0 0x7f91d0158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:23.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.505+0000 7f91ce7fc640 1 -- 172.21.15.29:0/1243479624 >> v1:172.21.15.52:6789/0 conn(0x7f91d00c8370 legacy=0x7f91d01548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:23.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.505+0000 7f91ce7fc640 1 -- 172.21.15.29:0/1243479624 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d00c7480 con 0x7f91d00c1a00 2024-01-25T15:04:23.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.505+0000 7f91ceffd640 1 --2- 172.21.15.29:0/1243479624 >> v2:172.21.15.52:3300/0 conn(0x7f91d0151ed0 0x7f91d0158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:23.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.506+0000 7f91ce7fc640 1 --2- 172.21.15.29:0/1243479624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91d00c1a00 0x7f91d00c7e30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f91b80097a0 tx=0x7f91b802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52c676967c0ea682 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:23.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.506+0000 7f91cdffb640 1 -- 172.21.15.29:0/1243479624 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b802e070 con 0x7f91d00c1a00 2024-01-25T15:04:23.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.506+0000 7f91cdffb640 1 -- 172.21.15.29:0/1243479624 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b80315a0 con 0x7f91d00c1a00 2024-01-25T15:04:23.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.506+0000 7f91cdffb640 1 -- 172.21.15.29:0/1243479624 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b8031910 con 0x7f91d00c1a00 2024-01-25T15:04:23.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.507+0000 7f91d5350640 1 -- 172.21.15.29:0/1243479624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91d00c1a00 msgr2=0x7f91d00c7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:23.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.507+0000 7f91d5350640 1 --2- 172.21.15.29:0/1243479624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91d00c1a00 0x7f91d00c7e30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f91b80097a0 tx=0x7f91b802b840 comp rx=0 tx=0).stop 2024-01-25T15:04:23.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.507+0000 7f91d5350640 1 -- 172.21.15.29:0/1243479624 shutdown_connections 2024-01-25T15:04:23.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.507+0000 7f91d5350640 1 --2- 172.21.15.29:0/1243479624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91d00c1a00 0x7f91d00c7e30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:23.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.507+0000 7f91d5350640 1 --2- 172.21.15.29:0/1243479624 >> v2:172.21.15.52:3300/0 conn(0x7f91d0151ed0 0x7f91d0158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:23.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.507+0000 7f91d5350640 1 -- 172.21.15.29:0/1243479624 >> 172.21.15.29:0/1243479624 conn(0x7f91d006a6c0 msgr2=0x7f91d006aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:23.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.507+0000 7f91d5350640 1 -- 172.21.15.29:0/1243479624 shutdown_connections 2024-01-25T15:04:23.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.507+0000 7f91d5350640 1 -- 172.21.15.29:0/1243479624 wait complete. 2024-01-25T15:04:23.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.508+0000 7f91d5350640 1 Processor -- start 2024-01-25T15:04:23.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.508+0000 7f91d5350640 1 -- start start 2024-01-25T15:04:23.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.509+0000 7f91d5350640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91d00c1a00 0x7f91d0153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:23.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.509+0000 7f91d5350640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91d00c8370 0x7f91d0153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:23.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.509+0000 7f91d5350640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91d0151ed0 0x7f91d014d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:23.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.509+0000 7f91d5350640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d009a190 con 0x7f91d00c1a00 2024-01-25T15:04:23.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.509+0000 7f91d5350640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d0099bd0 con 0x7f91d0151ed0 2024-01-25T15:04:23.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.509+0000 7f91d5350640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d0099eb0 con 0x7f91d00c8370 2024-01-25T15:04:23.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.509+0000 7f91ceffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91d00c1a00 0x7f91d0153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:23.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.509+0000 7f91ceffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91d00c1a00 0x7f91d0153110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44738/0 (socket says 172.21.15.29:44738) 2024-01-25T15:04:23.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.509+0000 7f91ceffd640 1 -- 172.21.15.29:0/3713279564 learned_addr learned my addr 172.21.15.29:0/3713279564 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:23.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.509+0000 7f91ce7fc640 1 --2- 172.21.15.29:0/3713279564 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91d00c8370 0x7f91d0153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:23.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.509+0000 7f91cf7fe640 1 --2- 172.21.15.29:0/3713279564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91d0151ed0 0x7f91d014d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:23.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.509+0000 7f91ceffd640 1 -- 172.21.15.29:0/3713279564 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91d00c8370 msgr2=0x7f91d0153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:23.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.509+0000 7f91ceffd640 1 --2- 172.21.15.29:0/3713279564 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91d00c8370 0x7f91d0153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:23.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.509+0000 7f91ceffd640 1 -- 172.21.15.29:0/3713279564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91d0151ed0 msgr2=0x7f91d014d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:23.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.509+0000 7f91ceffd640 1 --2- 172.21.15.29:0/3713279564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91d0151ed0 0x7f91d014d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:23.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.509+0000 7f91ceffd640 1 -- 172.21.15.29:0/3713279564 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c8009400 con 0x7f91d00c1a00 2024-01-25T15:04:23.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.509+0000 7f91ceffd640 1 --2- 172.21.15.29:0/3713279564 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91d00c1a00 0x7f91d0153110 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f91c800ebe0 tx=0x7f91c800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:23.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.510+0000 7f91c77fe640 1 -- 172.21.15.29:0/3713279564 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c8009760 con 0x7f91d00c1a00 2024-01-25T15:04:23.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.510+0000 7f91c77fe640 1 -- 172.21.15.29:0/3713279564 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c800cc30 con 0x7f91d00c1a00 2024-01-25T15:04:23.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.510+0000 7f91d5350640 1 -- 172.21.15.29:0/3713279564 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b8009400 con 0x7f91d00c1a00 2024-01-25T15:04:23.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.510+0000 7f91c77fe640 1 -- 172.21.15.29:0/3713279564 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c800eee0 con 0x7f91d00c1a00 2024-01-25T15:04:23.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.510+0000 7f91d5350640 1 -- 172.21.15.29:0/3713279564 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d01546e0 con 0x7f91d00c1a00 2024-01-25T15:04:23.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.511+0000 7f91d5350640 1 -- 172.21.15.29:0/3713279564 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d0074080 con 0x7f91d00c1a00 2024-01-25T15:04:23.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.511+0000 7f91c77fe640 1 -- 172.21.15.29:0/3713279564 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f91c8013470 con 0x7f91d00c1a00 2024-01-25T15:04:23.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.511+0000 7f91c77fe640 1 --2- 172.21.15.29:0/3713279564 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f91b006aed0 0x7f91b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:23.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.512+0000 7f91c77fe640 1 -- 172.21.15.29:0/3713279564 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f91c8089970 con 0x7f91d00c1a00 2024-01-25T15:04:23.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.512+0000 7f91ce7fc640 1 --2- 172.21.15.29:0/3713279564 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f91b006aed0 0x7f91b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:23.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.512+0000 7f91ce7fc640 1 --2- 172.21.15.29:0/3713279564 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f91b006aed0 0x7f91b006d390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f91b8036000 tx=0x7f91b803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:23.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.516+0000 7f91c77fe640 1 -- 172.21.15.29:0/3713279564 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f91c8054bb0 con 0x7f91d00c1a00 2024-01-25T15:04:23.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.733+0000 7f91d5350640 1 -- 172.21.15.29:0/3713279564 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91d00c2070 con 0x7f91d00c1a00 2024-01-25T15:04:23.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.733+0000 7f91c77fe640 1 -- 172.21.15.29:0/3713279564 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3691 (secure 0 0 0) 0x7f91c8017090 con 0x7f91d00c1a00 2024-01-25T15:04:23.734 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:23.735 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6836/2584242962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2584242962},{"type":"v1","addr":"172.21.15.52:6836","nonce":2584242962}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1800543981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1800543981},{"type":"v1","addr":"172.21.15.29:6834","nonce":1800543981}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3686497601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3686497601},{"type":"v1","addr":"172.21.15.29:6835","nonce":3686497601}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/417879912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6835","nonce":417879912},{"type":"v1","addr":"172.21.15.52:6837","nonce":417879912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-01-25T15:04:23.735 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 3 2024-01-25T15:04:23.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.735+0000 7f91d5350640 1 -- 172.21.15.29:0/3713279564 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f91b006aed0 msgr2=0x7f91b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:23.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.735+0000 7f91d5350640 1 --2- 172.21.15.29:0/3713279564 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f91b006aed0 0x7f91b006d390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f91b8036000 tx=0x7f91b803d040 comp rx=0 tx=0).stop 2024-01-25T15:04:23.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.736+0000 7f91d5350640 1 -- 172.21.15.29:0/3713279564 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91d00c1a00 msgr2=0x7f91d0153110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:23.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.736+0000 7f91d5350640 1 --2- 172.21.15.29:0/3713279564 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91d00c1a00 0x7f91d0153110 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f91c800ebe0 tx=0x7f91c800c520 comp rx=0 tx=0).stop 2024-01-25T15:04:23.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.736+0000 7f91d5350640 1 -- 172.21.15.29:0/3713279564 shutdown_connections 2024-01-25T15:04:23.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.736+0000 7f91d5350640 1 --2- 172.21.15.29:0/3713279564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91d0151ed0 0x7f91d014d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:23.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.736+0000 7f91d5350640 1 --2- 172.21.15.29:0/3713279564 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91d00c8370 0x7f91d0153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:23.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.736+0000 7f91d5350640 1 --2- 172.21.15.29:0/3713279564 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f91b006aed0 0x7f91b006d390 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:23.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.736+0000 7f91d5350640 1 --2- 172.21.15.29:0/3713279564 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91d00c1a00 0x7f91d0153110 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:23.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.736+0000 7f91d5350640 1 -- 172.21.15.29:0/3713279564 >> 172.21.15.29:0/3713279564 conn(0x7f91d006a6c0 msgr2=0x7f91d00c2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:23.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.736+0000 7f91d5350640 1 -- 172.21.15.29:0/3713279564 shutdown_connections 2024-01-25T15:04:23.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.736+0000 7f91d5350640 1 -- 172.21.15.29:0/3713279564 wait complete. 2024-01-25T15:04:23.747 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:04:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.847+0000 7f357fa7c640 1 Processor -- start 2024-01-25T15:04:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.847+0000 7f357fa7c640 1 -- start start 2024-01-25T15:04:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.848+0000 7f357fa7c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3578152160 0x7f357806bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.848+0000 7f357fa7c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3578155430 con 0x7f35780c7f10 2024-01-25T15:04:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.848+0000 7f357fa7c640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3578154b40 con 0x7f35780c4990 2024-01-25T15:04:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.848+0000 7f357fa7c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3578152540 con 0x7f3578152160 2024-01-25T15:04:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.848+0000 7f357d818640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3578152160 0x7f357806bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.848+0000 7f357e019640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f35780c7f10 0x7f357815f3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50996/0 (socket says 172.21.15.29:50996) 2024-01-25T15:04:23.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.848+0000 7f357e019640 1 -- 172.21.15.29:0/1227700012 learned_addr learned my addr 172.21.15.29:0/1227700012 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:23.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.848+0000 7f357d818640 1 -- 172.21.15.29:0/1227700012 >> v1:172.21.15.52:6789/0 conn(0x7f35780c4990 legacy=0x7f35780c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:23.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.848+0000 7f357d818640 1 -- 172.21.15.29:0/1227700012 >> v1:172.21.15.29:6789/0 conn(0x7f35780c7f10 legacy=0x7f357815f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:23.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.848+0000 7f357d818640 1 -- 172.21.15.29:0/1227700012 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35780c64b0 con 0x7f3578152160 2024-01-25T15:04:23.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.849+0000 7f357d818640 1 --2- 172.21.15.29:0/1227700012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3578152160 0x7f357806bc00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f35700097a0 tx=0x7f357002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43e76a2f0c669c8 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:23.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.849+0000 7f357c816640 1 -- 172.21.15.29:0/1227700012 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357002e070 con 0x7f3578152160 2024-01-25T15:04:23.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.849+0000 7f357c816640 1 -- 172.21.15.29:0/1227700012 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35700315a0 con 0x7f3578152160 2024-01-25T15:04:23.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.849+0000 7f357c816640 1 -- 172.21.15.29:0/1227700012 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3570031930 con 0x7f3578152160 2024-01-25T15:04:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.850+0000 7f357fa7c640 1 -- 172.21.15.29:0/1227700012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3578152160 msgr2=0x7f357806bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.850+0000 7f357fa7c640 1 --2- 172.21.15.29:0/1227700012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3578152160 0x7f357806bc00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f35700097a0 tx=0x7f357002b840 comp rx=0 tx=0).stop 2024-01-25T15:04:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.850+0000 7f357fa7c640 1 -- 172.21.15.29:0/1227700012 shutdown_connections 2024-01-25T15:04:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.850+0000 7f357fa7c640 1 --2- 172.21.15.29:0/1227700012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3578152160 0x7f357806bc00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.850+0000 7f357fa7c640 1 -- 172.21.15.29:0/1227700012 >> 172.21.15.29:0/1227700012 conn(0x7f35780ca1f0 msgr2=0x7f35780ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.850+0000 7f357fa7c640 1 -- 172.21.15.29:0/1227700012 shutdown_connections 2024-01-25T15:04:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.850+0000 7f357fa7c640 1 -- 172.21.15.29:0/1227700012 wait complete. 2024-01-25T15:04:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.851+0000 7f357fa7c640 1 Processor -- start 2024-01-25T15:04:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.851+0000 7f357fa7c640 1 -- start start 2024-01-25T15:04:23.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f357fa7c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35780c4990 0x7f3578148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:23.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f357fa7c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f35780c7f10 0x7f35780aada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:23.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f357fa7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3578152160 0x7f3578156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:23.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f357fa7c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357814c5a0 con 0x7f35780c4990 2024-01-25T15:04:23.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f357fa7c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35781587a0 con 0x7f3578152160 2024-01-25T15:04:23.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f357fa7c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35781eb220 con 0x7f35780c7f10 2024-01-25T15:04:23.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f357d818640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35780c4990 0x7f3578148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:23.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f357d818640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35780c4990 0x7f3578148500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44762/0 (socket says 172.21.15.29:44762) 2024-01-25T15:04:23.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f357d818640 1 -- 172.21.15.29:0/1176030019 learned_addr learned my addr 172.21.15.29:0/1176030019 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:23.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f357d017640 1 --2- 172.21.15.29:0/1176030019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f35780c7f10 0x7f35780aada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:23.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f357e019640 1 --2- 172.21.15.29:0/1176030019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3578152160 0x7f3578156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:23.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f357d818640 1 -- 172.21.15.29:0/1176030019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f35780c7f10 msgr2=0x7f35780aada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:23.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f357d818640 1 --2- 172.21.15.29:0/1176030019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f35780c7f10 0x7f35780aada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:23.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f357d818640 1 -- 172.21.15.29:0/1176030019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3578152160 msgr2=0x7f3578156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:23.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f357d818640 1 --2- 172.21.15.29:0/1176030019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3578152160 0x7f3578156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:23.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f357d818640 1 -- 172.21.15.29:0/1176030019 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3570009400 con 0x7f35780c4990 2024-01-25T15:04:23.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f357e019640 1 --2- 172.21.15.29:0/1176030019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3578152160 0x7f3578156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:23.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f357d818640 1 --2- 172.21.15.29:0/1176030019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35780c4990 0x7f3578148500 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3570000c00 tx=0x7f35700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:23.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f35767fc640 1 -- 172.21.15.29:0/1176030019 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3570032900 con 0x7f35780c4990 2024-01-25T15:04:23.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f35767fc640 1 -- 172.21.15.29:0/1176030019 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3570032a80 con 0x7f35780c4990 2024-01-25T15:04:23.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f357fa7c640 1 -- 172.21.15.29:0/1176030019 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3578158a40 con 0x7f35780c4990 2024-01-25T15:04:23.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f35767fc640 1 -- 172.21.15.29:0/1176030019 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3570032e30 con 0x7f35780c4990 2024-01-25T15:04:23.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.852+0000 7f357fa7c640 1 -- 172.21.15.29:0/1176030019 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35780ab2e0 con 0x7f35780c4990 2024-01-25T15:04:23.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.853+0000 7f357fa7c640 1 -- 172.21.15.29:0/1176030019 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35780c7be0 con 0x7f35780c4990 2024-01-25T15:04:23.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.854+0000 7f35767fc640 1 -- 172.21.15.29:0/1176030019 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f357003b3f0 con 0x7f35780c4990 2024-01-25T15:04:23.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.854+0000 7f35767fc640 1 --2- 172.21.15.29:0/1176030019 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f356406aed0 0x7f356406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:23.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.854+0000 7f35767fc640 1 -- 172.21.15.29:0/1176030019 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f35700ab2c0 con 0x7f35780c4990 2024-01-25T15:04:23.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.854+0000 7f357d017640 1 --2- 172.21.15.29:0/1176030019 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f356406aed0 0x7f356406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:23.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.855+0000 7f357d017640 1 --2- 172.21.15.29:0/1176030019 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f356406aed0 0x7f356406d390 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f35780abb10 tx=0x7f356c007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:23.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:23.858+0000 7f35767fc640 1 -- 172.21.15.29:0/1176030019 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f3570076570 con 0x7f35780c4990 2024-01-25T15:04:24.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.039+0000 7f357fa7c640 1 -- 172.21.15.29:0/1176030019 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35781558c0 con 0x7f35780c4990 2024-01-25T15:04:24.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.039+0000 7f35767fc640 1 -- 172.21.15.29:0/1176030019 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12815 (secure 0 0 0) 0x7f3570079b90 con 0x7f35780c4990 2024-01-25T15:04:24.040 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:24.040 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":16,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:16.965572+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:04:24.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.041+0000 7f357fa7c640 1 -- 172.21.15.29:0/1176030019 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f356406aed0 msgr2=0x7f356406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:24.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.041+0000 7f357fa7c640 1 --2- 172.21.15.29:0/1176030019 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f356406aed0 0x7f356406d390 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f35780abb10 tx=0x7f356c007e30 comp rx=0 tx=0).stop 2024-01-25T15:04:24.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.041+0000 7f357fa7c640 1 -- 172.21.15.29:0/1176030019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35780c4990 msgr2=0x7f3578148500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:24.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.041+0000 7f357fa7c640 1 --2- 172.21.15.29:0/1176030019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35780c4990 0x7f3578148500 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3570000c00 tx=0x7f35700046c0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.041+0000 7f357fa7c640 1 -- 172.21.15.29:0/1176030019 shutdown_connections 2024-01-25T15:04:24.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.041+0000 7f357fa7c640 1 --2- 172.21.15.29:0/1176030019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3578152160 0x7f3578156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.041+0000 7f357fa7c640 1 --2- 172.21.15.29:0/1176030019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f35780c7f10 0x7f35780aada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.041+0000 7f357fa7c640 1 --2- 172.21.15.29:0/1176030019 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f356406aed0 0x7f356406d390 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.041+0000 7f357fa7c640 1 --2- 172.21.15.29:0/1176030019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35780c4990 0x7f3578148500 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.041+0000 7f357fa7c640 1 -- 172.21.15.29:0/1176030019 >> 172.21.15.29:0/1176030019 conn(0x7f35780ca1f0 msgr2=0x7f357814ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:24.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.041+0000 7f357fa7c640 1 -- 172.21.15.29:0/1176030019 shutdown_connections 2024-01-25T15:04:24.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.041+0000 7f357fa7c640 1 -- 172.21.15.29:0/1176030019 wait complete. 2024-01-25T15:04:24.053 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T15:04:14.955791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-25T15:04:24.053 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:04:24.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.157+0000 7fab4697d640 1 Processor -- start 2024-01-25T15:04:24.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.157+0000 7fab4697d640 1 -- start start 2024-01-25T15:04:24.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.157+0000 7fab4697d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fab4006d560 0x7fab4006b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:24.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.157+0000 7fab4697d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab400c4fe0 0x7fab4006b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:24.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.157+0000 7fab4697d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab400afaa0 con 0x7fab400af6c0 2024-01-25T15:04:24.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.157+0000 7fab4697d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4006c480 con 0x7fab4006d560 2024-01-25T15:04:24.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.157+0000 7fab4697d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab40155290 con 0x7fab400c4fe0 2024-01-25T15:04:24.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.158+0000 7fab44f1a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab400c4fe0 0x7fab4006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:24.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.158+0000 7fab3f7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fab4006d560 0x7fab4006b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:24.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.158+0000 7fab44f1a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab400c4fe0 0x7fab4006b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:45672/0 (socket says 172.21.15.29:45672) 2024-01-25T15:04:24.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.158+0000 7fab44f1a640 1 -- 172.21.15.29:0/3816192797 learned_addr learned my addr 172.21.15.29:0/3816192797 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:24.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.158+0000 7fab3ffff640 1 --1- 172.21.15.29:0/3816192797 >> v1:172.21.15.52:6789/0 conn(0x7fab400af6c0 0x7fab400c5530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:58346/0 (socket says 172.21.15.29:58346) 2024-01-25T15:04:24.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.158+0000 7fab44f1a640 1 -- 172.21.15.29:0/3816192797 >> v2:172.21.15.52:3300/0 conn(0x7fab4006d560 msgr2=0x7fab4006b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:24.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.158+0000 7fab44f1a640 1 --2- 172.21.15.29:0/3816192797 >> v2:172.21.15.52:3300/0 conn(0x7fab4006d560 0x7fab4006b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.158+0000 7fab44f1a640 1 -- 172.21.15.29:0/3816192797 >> v1:172.21.15.52:6789/0 conn(0x7fab400af6c0 legacy=0x7fab400c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:24.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.158+0000 7fab44f1a640 1 -- 172.21.15.29:0/3816192797 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab400c6060 con 0x7fab400c4fe0 2024-01-25T15:04:24.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.158+0000 7fab3f7fe640 1 --2- 172.21.15.29:0/3816192797 >> v2:172.21.15.52:3300/0 conn(0x7fab4006d560 0x7fab4006b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:24.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.159+0000 7fab44f1a640 1 --2- 172.21.15.29:0/3816192797 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab400c4fe0 0x7fab4006b760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fab38009e50 tx=0x7fab3802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af84d0e1b34a86e9 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:24.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.159+0000 7fab3effd640 1 -- 172.21.15.29:0/3816192797 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3802cb00 con 0x7fab400c4fe0 2024-01-25T15:04:24.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.159+0000 7fab3effd640 1 -- 172.21.15.29:0/3816192797 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3802cc60 con 0x7fab400c4fe0 2024-01-25T15:04:24.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.159+0000 7fab3effd640 1 -- 172.21.15.29:0/3816192797 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab380343f0 con 0x7fab400c4fe0 2024-01-25T15:04:24.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.159+0000 7fab4697d640 1 -- 172.21.15.29:0/3816192797 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab400c4fe0 msgr2=0x7fab4006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:24.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.159+0000 7fab4697d640 1 --2- 172.21.15.29:0/3816192797 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab400c4fe0 0x7fab4006b760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fab38009e50 tx=0x7fab3802bf60 comp rx=0 tx=0).stop 2024-01-25T15:04:24.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.159+0000 7fab4697d640 1 -- 172.21.15.29:0/3816192797 shutdown_connections 2024-01-25T15:04:24.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.159+0000 7fab4697d640 1 --2- 172.21.15.29:0/3816192797 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab400c4fe0 0x7fab4006b760 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.159+0000 7fab4697d640 1 --2- 172.21.15.29:0/3816192797 >> v2:172.21.15.52:3300/0 conn(0x7fab4006d560 0x7fab4006b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.159+0000 7fab4697d640 1 -- 172.21.15.29:0/3816192797 >> 172.21.15.29:0/3816192797 conn(0x7fab400c6ca0 msgr2=0x7fab400c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:24.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.160+0000 7fab4697d640 1 -- 172.21.15.29:0/3816192797 shutdown_connections 2024-01-25T15:04:24.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.160+0000 7fab4697d640 1 -- 172.21.15.29:0/3816192797 wait complete. 2024-01-25T15:04:24.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.161+0000 7fab4697d640 1 Processor -- start 2024-01-25T15:04:24.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.161+0000 7fab4697d640 1 -- start start 2024-01-25T15:04:24.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.161+0000 7fab4697d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab4006d560 0x7fab401ed820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:24.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.161+0000 7fab4697d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab400af6c0 0x7fab401edd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:24.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.161+0000 7fab4697d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab400c4fe0 0x7fab400c2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:24.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.161+0000 7fab4697d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab400c3b70 con 0x7fab400af6c0 2024-01-25T15:04:24.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.161+0000 7fab4697d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab400c1dd0 con 0x7fab400c4fe0 2024-01-25T15:04:24.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.161+0000 7fab4697d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab400c1820 con 0x7fab4006d560 2024-01-25T15:04:24.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.162+0000 7fab3f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab400af6c0 0x7fab401edd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:24.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.162+0000 7fab3ffff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab4006d560 0x7fab401ed820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:24.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.162+0000 7fab3f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab400af6c0 0x7fab401edd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44770/0 (socket says 172.21.15.29:44770) 2024-01-25T15:04:24.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.162+0000 7fab3f7fe640 1 -- 172.21.15.29:0/814963201 learned_addr learned my addr 172.21.15.29:0/814963201 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:24.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.162+0000 7fab44f1a640 1 --2- 172.21.15.29:0/814963201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab400c4fe0 0x7fab400c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:24.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.162+0000 7fab3f7fe640 1 -- 172.21.15.29:0/814963201 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab4006d560 msgr2=0x7fab401ed820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:24.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.162+0000 7fab3f7fe640 1 --2- 172.21.15.29:0/814963201 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab4006d560 0x7fab401ed820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.162+0000 7fab3f7fe640 1 -- 172.21.15.29:0/814963201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab400c4fe0 msgr2=0x7fab400c2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:24.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.162+0000 7fab3f7fe640 1 --2- 172.21.15.29:0/814963201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab400c4fe0 0x7fab400c2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.162+0000 7fab3f7fe640 1 -- 172.21.15.29:0/814963201 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab34009400 con 0x7fab400af6c0 2024-01-25T15:04:24.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.162+0000 7fab3f7fe640 1 --2- 172.21.15.29:0/814963201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab400af6c0 0x7fab401edd60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fab3400e990 tx=0x7fab3400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:24.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.162+0000 7fab3cff9640 1 -- 172.21.15.29:0/814963201 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3400c9e0 con 0x7fab400af6c0 2024-01-25T15:04:24.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.162+0000 7fab3cff9640 1 -- 172.21.15.29:0/814963201 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3400cb40 con 0x7fab400af6c0 2024-01-25T15:04:24.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.162+0000 7fab4697d640 1 -- 172.21.15.29:0/814963201 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab38009b30 con 0x7fab400af6c0 2024-01-25T15:04:24.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.162+0000 7fab3cff9640 1 -- 172.21.15.29:0/814963201 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3400ced0 con 0x7fab400af6c0 2024-01-25T15:04:24.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.162+0000 7fab4697d640 1 -- 172.21.15.29:0/814963201 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab40157980 con 0x7fab400af6c0 2024-01-25T15:04:24.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.163+0000 7fab4697d640 1 -- 172.21.15.29:0/814963201 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab401584e0 con 0x7fab400af6c0 2024-01-25T15:04:24.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.164+0000 7fab3cff9640 1 -- 172.21.15.29:0/814963201 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fab34013470 con 0x7fab400af6c0 2024-01-25T15:04:24.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.164+0000 7fab3cff9640 1 --2- 172.21.15.29:0/814963201 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fab2c06af00 0x7fab2c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:24.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.164+0000 7fab3cff9640 1 -- 172.21.15.29:0/814963201 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fab34089430 con 0x7fab400af6c0 2024-01-25T15:04:24.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.164+0000 7fab3ffff640 1 --2- 172.21.15.29:0/814963201 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fab2c06af00 0x7fab2c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:24.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.165+0000 7fab3ffff640 1 --2- 172.21.15.29:0/814963201 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fab2c06af00 0x7fab2c06d3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fab30007fd0 tx=0x7fab30007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:24.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.168+0000 7fab3cff9640 1 -- 172.21.15.29:0/814963201 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fab401584e0 con 0x7fab400af6c0 2024-01-25T15:04:24.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.351+0000 7fab4697d640 1 -- 172.21.15.29:0/814963201 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fab401584e0 con 0x7fab400af6c0 2024-01-25T15:04:24.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.352+0000 7fab3cff9640 1 -- 172.21.15.29:0/814963201 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab401584e0 con 0x7fab400af6c0 2024-01-25T15:04:24.353 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-25T15:04:24.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.354+0000 7fab4697d640 1 -- 172.21.15.29:0/814963201 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fab2c06af00 msgr2=0x7fab2c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:24.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.354+0000 7fab4697d640 1 --2- 172.21.15.29:0/814963201 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fab2c06af00 0x7fab2c06d3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fab30007fd0 tx=0x7fab30007e80 comp rx=0 tx=0).stop 2024-01-25T15:04:24.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.354+0000 7fab4697d640 1 -- 172.21.15.29:0/814963201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab400af6c0 msgr2=0x7fab401edd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:24.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.354+0000 7fab4697d640 1 --2- 172.21.15.29:0/814963201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab400af6c0 0x7fab401edd60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fab3400e990 tx=0x7fab3400ee50 comp rx=0 tx=0).stop 2024-01-25T15:04:24.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.354+0000 7fab4697d640 1 -- 172.21.15.29:0/814963201 shutdown_connections 2024-01-25T15:04:24.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.354+0000 7fab4697d640 1 --2- 172.21.15.29:0/814963201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab400c4fe0 0x7fab400c2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.354+0000 7fab4697d640 1 --2- 172.21.15.29:0/814963201 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fab2c06af00 0x7fab2c06d3c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.354+0000 7fab4697d640 1 --2- 172.21.15.29:0/814963201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab400af6c0 0x7fab401edd60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.354+0000 7fab4697d640 1 --2- 172.21.15.29:0/814963201 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab4006d560 0x7fab401ed820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.354+0000 7fab4697d640 1 -- 172.21.15.29:0/814963201 >> 172.21.15.29:0/814963201 conn(0x7fab400c6ca0 msgr2=0x7fab400ab460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:24.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.354+0000 7fab4697d640 1 -- 172.21.15.29:0/814963201 shutdown_connections 2024-01-25T15:04:24.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.354+0000 7fab4697d640 1 -- 172.21.15.29:0/814963201 wait complete. 2024-01-25T15:04:24.365 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-25T15:04:24.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.466+0000 7f0ca6725640 1 Processor -- start 2024-01-25T15:04:24.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.466+0000 7f0ca6725640 1 -- start start 2024-01-25T15:04:24.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.466+0000 7f0ca6725640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0ca01520b0 0x7f0ca0155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:24.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.466+0000 7f0ca6725640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ca00c55e0 0x7f0ca00c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:24.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.466+0000 7f0ca6725640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ca00c4f00 0x7f0ca00c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:24.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.466+0000 7f0ca6725640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca00c66c0 con 0x7f0ca01520b0 2024-01-25T15:04:24.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.466+0000 7f0ca6725640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca006cfc0 con 0x7f0ca00c55e0 2024-01-25T15:04:24.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.466+0000 7f0ca6725640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca0152490 con 0x7f0ca00c4f00 2024-01-25T15:04:24.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.467+0000 7f0c9ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0ca01520b0 0x7f0ca0155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:24.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.467+0000 7f0c9ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0ca01520b0 0x7f0ca0155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44778/0 (socket says 172.21.15.29:44778) 2024-01-25T15:04:24.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.467+0000 7f0c9ffff640 1 -- 172.21.15.29:0/3071957692 learned_addr learned my addr 172.21.15.29:0/3071957692 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:24.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.467+0000 7f0ca4cc2640 1 --2- 172.21.15.29:0/3071957692 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ca00c4f00 0x7f0ca00c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:24.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.467+0000 7f0c9f7fe640 1 --2- 172.21.15.29:0/3071957692 >> v2:172.21.15.52:3300/0 conn(0x7f0ca00c55e0 0x7f0ca00c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:24.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.467+0000 7f0c9ffff640 1 -- 172.21.15.29:0/3071957692 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ca00c4f00 msgr2=0x7f0ca00c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:24.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.467+0000 7f0c9ffff640 1 --2- 172.21.15.29:0/3071957692 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ca00c4f00 0x7f0ca00c5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.467+0000 7f0c9ffff640 1 -- 172.21.15.29:0/3071957692 >> v2:172.21.15.52:3300/0 conn(0x7f0ca00c55e0 msgr2=0x7f0ca00c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:24.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.467+0000 7f0c9ffff640 1 --2- 172.21.15.29:0/3071957692 >> v2:172.21.15.52:3300/0 conn(0x7f0ca00c55e0 0x7f0ca00c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.467+0000 7f0c9ffff640 1 -- 172.21.15.29:0/3071957692 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca00c6910 con 0x7f0ca01520b0 2024-01-25T15:04:24.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.468+0000 7f0c9ffff640 1 --2- 172.21.15.29:0/3071957692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca01520b0 0x7f0ca0155570 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0ca008b9f0 tx=0x7f0c9002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e851882ce057602 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:24.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.468+0000 7f0c9effd640 1 -- 172.21.15.29:0/3071957692 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c900317e0 con 0x7f0ca01520b0 2024-01-25T15:04:24.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.468+0000 7f0c9effd640 1 -- 172.21.15.29:0/3071957692 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c90031940 con 0x7f0ca01520b0 2024-01-25T15:04:24.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.468+0000 7f0c9effd640 1 -- 172.21.15.29:0/3071957692 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c90031cd0 con 0x7f0ca01520b0 2024-01-25T15:04:24.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.468+0000 7f0ca6725640 1 -- 172.21.15.29:0/3071957692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca01520b0 msgr2=0x7f0ca0155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:24.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.468+0000 7f0ca6725640 1 --2- 172.21.15.29:0/3071957692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca01520b0 0x7f0ca0155570 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0ca008b9f0 tx=0x7f0c9002b880 comp rx=0 tx=0).stop 2024-01-25T15:04:24.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.468+0000 7f0ca6725640 1 -- 172.21.15.29:0/3071957692 shutdown_connections 2024-01-25T15:04:24.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.468+0000 7f0ca6725640 1 --2- 172.21.15.29:0/3071957692 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ca00c4f00 0x7f0ca00c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.468+0000 7f0ca6725640 1 --2- 172.21.15.29:0/3071957692 >> v2:172.21.15.52:3300/0 conn(0x7f0ca00c55e0 0x7f0ca00c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.468+0000 7f0ca6725640 1 --2- 172.21.15.29:0/3071957692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca01520b0 0x7f0ca0155570 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.468+0000 7f0ca6725640 1 -- 172.21.15.29:0/3071957692 >> 172.21.15.29:0/3071957692 conn(0x7f0ca00ca220 msgr2=0x7f0ca00ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:24.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.468+0000 7f0ca6725640 1 -- 172.21.15.29:0/3071957692 shutdown_connections 2024-01-25T15:04:24.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.468+0000 7f0ca6725640 1 -- 172.21.15.29:0/3071957692 wait complete. 2024-01-25T15:04:24.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.469+0000 7f0ca6725640 1 Processor -- start 2024-01-25T15:04:24.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.470+0000 7f0ca6725640 1 -- start start 2024-01-25T15:04:24.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.470+0000 7f0ca6725640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca00c4f00 0x7f0ca01edeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:24.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.470+0000 7f0ca6725640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ca01520b0 0x7f0ca00ab060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:24.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.470+0000 7f0ca6725640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ca00c2350 0x7f0ca01e9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:24.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.470+0000 7f0ca6725640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca00af8b0 con 0x7f0ca00c4f00 2024-01-25T15:04:24.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.470+0000 7f0ca6725640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca01ed3f0 con 0x7f0ca00c2350 2024-01-25T15:04:24.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.470+0000 7f0ca6725640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca00afb00 con 0x7f0ca01520b0 2024-01-25T15:04:24.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.470+0000 7f0c9ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca00c4f00 0x7f0ca01edeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:24.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.470+0000 7f0c9ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca00c4f00 0x7f0ca01edeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44786/0 (socket says 172.21.15.29:44786) 2024-01-25T15:04:24.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.470+0000 7f0c9ffff640 1 -- 172.21.15.29:0/2934224345 learned_addr learned my addr 172.21.15.29:0/2934224345 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:24.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.471+0000 7f0c9f7fe640 1 --2- 172.21.15.29:0/2934224345 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ca01520b0 0x7f0ca00ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:24.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.471+0000 7f0ca4cc2640 1 --2- 172.21.15.29:0/2934224345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ca00c2350 0x7f0ca01e9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:24.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.471+0000 7f0c9ffff640 1 -- 172.21.15.29:0/2934224345 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ca01520b0 msgr2=0x7f0ca00ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:24.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.471+0000 7f0c9ffff640 1 --2- 172.21.15.29:0/2934224345 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ca01520b0 0x7f0ca00ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.471+0000 7f0c9ffff640 1 -- 172.21.15.29:0/2934224345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ca00c2350 msgr2=0x7f0ca01e9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:24.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.471+0000 7f0c9ffff640 1 --2- 172.21.15.29:0/2934224345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ca00c2350 0x7f0ca01e9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.471+0000 7f0c9ffff640 1 -- 172.21.15.29:0/2934224345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c900094d0 con 0x7f0ca00c4f00 2024-01-25T15:04:24.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.471+0000 7f0c9f7fe640 1 --2- 172.21.15.29:0/2934224345 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ca01520b0 0x7f0ca00ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:24.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.471+0000 7f0ca4cc2640 1 --2- 172.21.15.29:0/2934224345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ca00c2350 0x7f0ca01e9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:24.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.471+0000 7f0c9ffff640 1 --2- 172.21.15.29:0/2934224345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca00c4f00 0x7f0ca01edeb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0c9002b8c0 tx=0x7f0c900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:24.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.471+0000 7f0c9cff9640 1 -- 172.21.15.29:0/2934224345 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c90032880 con 0x7f0ca00c4f00 2024-01-25T15:04:24.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.471+0000 7f0c9cff9640 1 -- 172.21.15.29:0/2934224345 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c90032a00 con 0x7f0ca00c4f00 2024-01-25T15:04:24.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.471+0000 7f0ca6725640 1 -- 172.21.15.29:0/2934224345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca01ed6b0 con 0x7f0ca00c4f00 2024-01-25T15:04:24.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.471+0000 7f0c9cff9640 1 -- 172.21.15.29:0/2934224345 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c90032db0 con 0x7f0ca00c4f00 2024-01-25T15:04:24.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.471+0000 7f0ca6725640 1 -- 172.21.15.29:0/2934224345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca00afde0 con 0x7f0ca00c4f00 2024-01-25T15:04:24.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.472+0000 7f0ca6725640 1 -- 172.21.15.29:0/2934224345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca01edbd0 con 0x7f0ca00c4f00 2024-01-25T15:04:24.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.473+0000 7f0c9cff9640 1 -- 172.21.15.29:0/2934224345 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0c9004d3f0 con 0x7f0ca00c4f00 2024-01-25T15:04:24.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.473+0000 7f0c9cff9640 1 --2- 172.21.15.29:0/2934224345 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0c8c06aed0 0x7f0c8c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:24.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.473+0000 7f0c9cff9640 1 -- 172.21.15.29:0/2934224345 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0c900ab020 con 0x7f0ca00c4f00 2024-01-25T15:04:24.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.473+0000 7f0c9f7fe640 1 --2- 172.21.15.29:0/2934224345 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0c8c06aed0 0x7f0c8c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:24.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.474+0000 7f0c9f7fe640 1 --2- 172.21.15.29:0/2934224345 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0c8c06aed0 0x7f0c8c06d390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00abcc0 tx=0x7f0c94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:24.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.477+0000 7f0c9cff9640 1 -- 172.21.15.29:0/2934224345 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f0ca01edbd0 con 0x7f0ca00c4f00 2024-01-25T15:04:24.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.659+0000 7f0ca6725640 1 -- 172.21.15.29:0/2934224345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0ca01edbd0 con 0x7f0ca00c4f00 2024-01-25T15:04:24.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.660+0000 7f0c9cff9640 1 -- 172.21.15.29:0/2934224345 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0ca01edbd0 con 0x7f0ca00c4f00 2024-01-25T15:04:24.660 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:24.661 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2024-01-25T15:04:24.661 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:04:24.661 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2024-01-25T15:04:24.661 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2024-01-25T15:04:24.661 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:04:24.661 INFO:teuthology.orchestra.run.smithi029.stdout:] 2024-01-25T15:04:24.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.661+0000 7f0ca6725640 1 -- 172.21.15.29:0/2934224345 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0c8c06aed0 msgr2=0x7f0c8c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:24.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.661+0000 7f0ca6725640 1 --2- 172.21.15.29:0/2934224345 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0c8c06aed0 0x7f0c8c06d390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00abcc0 tx=0x7f0c94008040 comp rx=0 tx=0).stop 2024-01-25T15:04:24.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.661+0000 7f0ca6725640 1 -- 172.21.15.29:0/2934224345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca00c4f00 msgr2=0x7f0ca01edeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:24.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.661+0000 7f0ca6725640 1 --2- 172.21.15.29:0/2934224345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca00c4f00 0x7f0ca01edeb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0c9002b8c0 tx=0x7f0c900046c0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.661+0000 7f0ca6725640 1 -- 172.21.15.29:0/2934224345 shutdown_connections 2024-01-25T15:04:24.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.661+0000 7f0ca6725640 1 --2- 172.21.15.29:0/2934224345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ca00c2350 0x7f0ca01e9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.661+0000 7f0ca6725640 1 --2- 172.21.15.29:0/2934224345 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ca01520b0 0x7f0ca00ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.661+0000 7f0ca6725640 1 --2- 172.21.15.29:0/2934224345 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0c8c06aed0 0x7f0c8c06d390 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.661+0000 7f0ca6725640 1 --2- 172.21.15.29:0/2934224345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca00c4f00 0x7f0ca01edeb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.661+0000 7f0ca6725640 1 -- 172.21.15.29:0/2934224345 >> 172.21.15.29:0/2934224345 conn(0x7f0ca00ca220 msgr2=0x7f0ca00c6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:24.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.662+0000 7f0ca6725640 1 -- 172.21.15.29:0/2934224345 shutdown_connections 2024-01-25T15:04:24.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.662+0000 7f0ca6725640 1 -- 172.21.15.29:0/2934224345 wait complete. 2024-01-25T15:04:24.673 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-25T15:04:24.673 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-25T15:04:24.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.777+0000 7f96b622f640 1 Processor -- start 2024-01-25T15:04:24.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.777+0000 7f96b622f640 1 -- start start 2024-01-25T15:04:24.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.778+0000 7f96b622f640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96b00ad0b0 0x7f96b00c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:24.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.778+0000 7f96b622f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b00ad510 con 0x7f96b0149190 2024-01-25T15:04:24.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.778+0000 7f96b622f640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b0070d40 con 0x7f96b00c7890 2024-01-25T15:04:24.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.778+0000 7f96b622f640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b0155c00 con 0x7f96b00ad0b0 2024-01-25T15:04:24.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.778+0000 7f96af7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f96b0149190 0x7f96b0070510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51010/0 (socket says 172.21.15.29:51010) 2024-01-25T15:04:24.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.778+0000 7f96af7fe640 1 -- 172.21.15.29:0/2494031443 learned_addr learned my addr 172.21.15.29:0/2494031443 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:24.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.778+0000 7f96aeffd640 1 --2- 172.21.15.29:0/2494031443 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96b00ad0b0 0x7f96b00c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:24.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.778+0000 7f96ae7fc640 1 -- 172.21.15.29:0/2494031443 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524204553 0 0) 0x7f96b00ad510 con 0x7f96b0149190 2024-01-25T15:04:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96ae7fc640 1 -- 172.21.15.29:0/2494031443 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9698003520 con 0x7f96b0149190 2024-01-25T15:04:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96ae7fc640 1 -- 172.21.15.29:0/2494031443 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1666703819 0 0) 0x7f9698003520 con 0x7f96b0149190 2024-01-25T15:04:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96ae7fc640 1 -- 172.21.15.29:0/2494031443 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96b00ad0b0 msgr2=0x7f96b00c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96ae7fc640 1 --2- 172.21.15.29:0/2494031443 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96b00ad0b0 0x7f96b00c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96ae7fc640 1 -- 172.21.15.29:0/2494031443 >> v1:172.21.15.52:6789/0 conn(0x7f96b00c7890 legacy=0x7f96b0152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96ae7fc640 1 -- 172.21.15.29:0/2494031443 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b0155ee0 con 0x7f96b0149190 2024-01-25T15:04:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96ae7fc640 1 -- 172.21.15.29:0/2494031443 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f96a0001670 con 0x7f96b0149190 2024-01-25T15:04:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96ae7fc640 1 -- 172.21.15.29:0/2494031443 >> v1:172.21.15.29:6789/0 conn(0x7f96b0149190 legacy=0x7f96b0070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96ae7fc640 1 --2- 172.21.15.29:0/2494031443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698003a10 0x7f9698003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96ae7fc640 1 --2- 172.21.15.29:0/2494031443 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96b00ad0b0 0x7f96980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96ae7fc640 1 --2- 172.21.15.29:0/2494031443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9698004d00 0x7f9698005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96ae7fc640 1 -- 172.21.15.29:0/2494031443 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b0155c00 con 0x7f9698003a10 2024-01-25T15:04:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96ae7fc640 1 -- 172.21.15.29:0/2494031443 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969800bac0 con 0x7f9698004d00 2024-01-25T15:04:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96ae7fc640 1 -- 172.21.15.29:0/2494031443 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969800bc80 con 0x7f96b00ad0b0 2024-01-25T15:04:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96af7fe640 1 --2- 172.21.15.29:0/2494031443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698003a10 0x7f9698003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:24.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96affff640 1 --2- 172.21.15.29:0/2494031443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9698004d00 0x7f9698005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96aeffd640 1 --2- 172.21.15.29:0/2494031443 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96b00ad0b0 0x7f96980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96af7fe640 1 -- 172.21.15.29:0/2494031443 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96b00ad0b0 msgr2=0x7f96980047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96af7fe640 1 --2- 172.21.15.29:0/2494031443 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96b00ad0b0 0x7f96980047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96af7fe640 1 -- 172.21.15.29:0/2494031443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9698004d00 msgr2=0x7f9698005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96af7fe640 1 --2- 172.21.15.29:0/2494031443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9698004d00 0x7f9698005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96af7fe640 1 -- 172.21.15.29:0/2494031443 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9698003520 con 0x7f9698003a10 2024-01-25T15:04:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.779+0000 7f96aeffd640 1 --2- 172.21.15.29:0/2494031443 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96b00ad0b0 0x7f96980047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.780+0000 7f96af7fe640 1 --2- 172.21.15.29:0/2494031443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698003a10 0x7f9698003e30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f96a000c210 tx=0x7f96980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899ab15f6f7d7ccc server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.780+0000 7f96ae7fc640 1 -- 172.21.15.29:0/2494031443 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0005ad0 con 0x7f9698003a10 2024-01-25T15:04:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.780+0000 7f96ae7fc640 1 -- 172.21.15.29:0/2494031443 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a0005c50 con 0x7f9698003a10 2024-01-25T15:04:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.780+0000 7f96ae7fc640 1 -- 172.21.15.29:0/2494031443 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a002c7c0 con 0x7f9698003a10 2024-01-25T15:04:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.781+0000 7f96b622f640 1 -- 172.21.15.29:0/2494031443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698003a10 msgr2=0x7f9698003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.781+0000 7f96b622f640 1 --2- 172.21.15.29:0/2494031443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698003a10 0x7f9698003e30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f96a000c210 tx=0x7f96980057f0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.781+0000 7f96affff640 1 -- 172.21.15.29:0/2494031443 reap_dead start 2024-01-25T15:04:24.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.781+0000 7f96b622f640 1 -- 172.21.15.29:0/2494031443 shutdown_connections 2024-01-25T15:04:24.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.781+0000 7f96b622f640 1 -- 172.21.15.29:0/2494031443 >> 172.21.15.29:0/2494031443 conn(0x7f96b00c7f80 msgr2=0x7f96b00c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:24.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.781+0000 7f96b622f640 1 -- 172.21.15.29:0/2494031443 shutdown_connections 2024-01-25T15:04:24.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.781+0000 7f96b622f640 1 -- 172.21.15.29:0/2494031443 wait complete. 2024-01-25T15:04:24.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.782+0000 7f96b622f640 1 Processor -- start 2024-01-25T15:04:24.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.782+0000 7f96b622f640 1 -- start start 2024-01-25T15:04:24.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f96b622f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698003a10 0x7f96b01eafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:24.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f96b622f640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96b00c13b0 0x7f96b01ee380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:24.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f96b622f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96b006d240 0x7f96b01eb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f96b622f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b01ee8c0 con 0x7f9698003a10 2024-01-25T15:04:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f96b622f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b0144ae0 con 0x7f96b006d240 2024-01-25T15:04:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f96b622f640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b01ea510 con 0x7f96b00c13b0 2024-01-25T15:04:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f96af7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698003a10 0x7f96b01eafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f96af7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698003a10 0x7f96b01eafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44816/0 (socket says 172.21.15.29:44816) 2024-01-25T15:04:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f96af7fe640 1 -- 172.21.15.29:0/1162535998 learned_addr learned my addr 172.21.15.29:0/1162535998 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f96affff640 1 --2- 172.21.15.29:0/1162535998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96b006d240 0x7f96b01eb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f96aeffd640 1 --2- 172.21.15.29:0/1162535998 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96b00c13b0 0x7f96b01ee380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f96af7fe640 1 -- 172.21.15.29:0/1162535998 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96b00c13b0 msgr2=0x7f96b01ee380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f96af7fe640 1 --2- 172.21.15.29:0/1162535998 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96b00c13b0 0x7f96b01ee380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f96af7fe640 1 -- 172.21.15.29:0/1162535998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96b006d240 msgr2=0x7f96b01eb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f96af7fe640 1 --2- 172.21.15.29:0/1162535998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96b006d240 0x7f96b01eb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f96af7fe640 1 -- 172.21.15.29:0/1162535998 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b00c18b0 con 0x7f9698003a10 2024-01-25T15:04:24.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f96aeffd640 1 --2- 172.21.15.29:0/1162535998 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96b00c13b0 0x7f96b01ee380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f96af7fe640 1 --2- 172.21.15.29:0/1162535998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698003a10 0x7f96b01eafb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f96a0001930 tx=0x7f96a0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f9697fff640 1 -- 172.21.15.29:0/1162535998 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0039070 con 0x7f9698003a10 2024-01-25T15:04:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f9697fff640 1 -- 172.21.15.29:0/1162535998 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a002cbd0 con 0x7f9698003a10 2024-01-25T15:04:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f96b622f640 1 -- 172.21.15.29:0/1162535998 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b01ea7b0 con 0x7f9698003a10 2024-01-25T15:04:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f9697fff640 1 -- 172.21.15.29:0/1162535998 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a003c040 con 0x7f9698003a10 2024-01-25T15:04:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.783+0000 7f96b622f640 1 -- 172.21.15.29:0/1162535998 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b00c1b90 con 0x7f9698003a10 2024-01-25T15:04:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.784+0000 7f96b622f640 1 -- 172.21.15.29:0/1162535998 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b0074010 con 0x7f9698003a10 2024-01-25T15:04:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.785+0000 7f9697fff640 1 -- 172.21.15.29:0/1162535998 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f96a0032070 con 0x7f9698003a10 2024-01-25T15:04:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.785+0000 7f9697fff640 1 --2- 172.21.15.29:0/1162535998 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f969c06af00 0x7f969c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.785+0000 7f9697fff640 1 -- 172.21.15.29:0/1162535998 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f96a00aa5c0 con 0x7f9698003a10 2024-01-25T15:04:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.785+0000 7f96aeffd640 1 --2- 172.21.15.29:0/1162535998 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f969c06af00 0x7f969c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:24.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.786+0000 7f96aeffd640 1 --2- 172.21.15.29:0/1162535998 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f969c06af00 0x7f969c06d3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f96a4006d40 tx=0x7f96a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:24.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.790+0000 7f9697fff640 1 -- 172.21.15.29:0/1162535998 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f96a0075900 con 0x7f9698003a10 2024-01-25T15:04:24.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:24.967+0000 7f96b622f640 1 -- 172.21.15.29:0/1162535998 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f96b00abb70 con 0x7f9698003a10 2024-01-25T15:04:25.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.523+0000 7f9697fff640 1 -- 172.21.15.29:0/1162535998 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f96a0078f20 con 0x7f9698003a10 2024-01-25T15:04:25.524 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' created 2024-01-25T15:04:25.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.526+0000 7f96b622f640 1 -- 172.21.15.29:0/1162535998 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f969c06af00 msgr2=0x7f969c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:25.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.526+0000 7f96b622f640 1 --2- 172.21.15.29:0/1162535998 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f969c06af00 0x7f969c06d3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f96a4006d40 tx=0x7f96a4008040 comp rx=0 tx=0).stop 2024-01-25T15:04:25.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.526+0000 7f96b622f640 1 -- 172.21.15.29:0/1162535998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698003a10 msgr2=0x7f96b01eafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:25.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.526+0000 7f96b622f640 1 --2- 172.21.15.29:0/1162535998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698003a10 0x7f96b01eafb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f96a0001930 tx=0x7f96a0001a00 comp rx=0 tx=0).stop 2024-01-25T15:04:25.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.526+0000 7f96b622f640 1 -- 172.21.15.29:0/1162535998 shutdown_connections 2024-01-25T15:04:25.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.526+0000 7f96b622f640 1 --2- 172.21.15.29:0/1162535998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96b006d240 0x7f96b01eb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:25.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.526+0000 7f96b622f640 1 --2- 172.21.15.29:0/1162535998 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96b00c13b0 0x7f96b01ee380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:25.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.526+0000 7f96b622f640 1 --2- 172.21.15.29:0/1162535998 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f969c06af00 0x7f969c06d3c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:25.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.526+0000 7f96b622f640 1 --2- 172.21.15.29:0/1162535998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9698003a10 0x7f96b01eafb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:25.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.526+0000 7f96b622f640 1 -- 172.21.15.29:0/1162535998 >> 172.21.15.29:0/1162535998 conn(0x7f96b00c7f80 msgr2=0x7f96b00c64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:25.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.527+0000 7f96b622f640 1 -- 172.21.15.29:0/1162535998 shutdown_connections 2024-01-25T15:04:25.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.527+0000 7f96b622f640 1 -- 172.21.15.29:0/1162535998 wait complete. 2024-01-25T15:04:25.545 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-01-25T15:04:25.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.659+0000 7fe469789640 1 Processor -- start 2024-01-25T15:04:25.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.659+0000 7fe469789640 1 -- start start 2024-01-25T15:04:25.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe469789640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe46414eb20 0x7fe46406bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:25.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe469789640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe4640c1920 0x7fe4640c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:25.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe469789640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4641557e0 con 0x7fe4641519c0 2024-01-25T15:04:25.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe469789640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4640a92d0 con 0x7fe4640c1920 2024-01-25T15:04:25.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe469789640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46406e1a0 con 0x7fe46414eb20 2024-01-25T15:04:25.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe4637fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe4641519c0 0x7fe464071340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37074/0 (socket says 172.21.15.29:37074) 2024-01-25T15:04:25.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe4637fe640 1 -- 172.21.15.29:0/1716101208 learned_addr learned my addr 172.21.15.29:0/1716101208 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:25.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe461ffb640 1 -- 172.21.15.29:0/1716101208 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655321611 0 0) 0x7fe4641557e0 con 0x7fe4641519c0 2024-01-25T15:04:25.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe4627fc640 1 --2- 172.21.15.29:0/1716101208 >> v2:172.21.15.52:3300/0 conn(0x7fe4640c1920 0x7fe4640c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:25.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe461ffb640 1 -- 172.21.15.29:0/1716101208 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe450003520 con 0x7fe4641519c0 2024-01-25T15:04:25.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe462ffd640 1 --2- 172.21.15.29:0/1716101208 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe46414eb20 0x7fe46406bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:25.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe461ffb640 1 -- 172.21.15.29:0/1716101208 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 87044331 0 0) 0x7fe450003520 con 0x7fe4641519c0 2024-01-25T15:04:25.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe461ffb640 1 -- 172.21.15.29:0/1716101208 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe46414eb20 msgr2=0x7fe46406bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:25.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe461ffb640 1 --2- 172.21.15.29:0/1716101208 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe46414eb20 0x7fe46406bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:25.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe461ffb640 1 -- 172.21.15.29:0/1716101208 >> v2:172.21.15.52:3300/0 conn(0x7fe4640c1920 msgr2=0x7fe4640c1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:25.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe461ffb640 1 --2- 172.21.15.29:0/1716101208 >> v2:172.21.15.52:3300/0 conn(0x7fe4640c1920 0x7fe4640c1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:25.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe461ffb640 1 -- 172.21.15.29:0/1716101208 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46406e480 con 0x7fe4641519c0 2024-01-25T15:04:25.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe461ffb640 1 -- 172.21.15.29:0/1716101208 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7fe4540019f0 con 0x7fe4641519c0 2024-01-25T15:04:25.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe462ffd640 1 --2- 172.21.15.29:0/1716101208 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe46414eb20 0x7fe46406bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:25.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe461ffb640 1 -- 172.21.15.29:0/1716101208 >> v1:172.21.15.29:6789/0 conn(0x7fe4641519c0 legacy=0x7fe464071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:25.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe461ffb640 1 --2- 172.21.15.29:0/1716101208 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe46414eb20 0x7fe4500039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:25.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe461ffb640 1 --2- 172.21.15.29:0/1716101208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe450003f20 0x7fe4500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:25.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe461ffb640 1 --2- 172.21.15.29:0/1716101208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe450004d00 0x7fe450005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:25.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe461ffb640 1 -- 172.21.15.29:0/1716101208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4640a92d0 con 0x7fe450004d00 2024-01-25T15:04:25.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe461ffb640 1 -- 172.21.15.29:0/1716101208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46406e1a0 con 0x7fe450003f20 2024-01-25T15:04:25.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.660+0000 7fe461ffb640 1 -- 172.21.15.29:0/1716101208 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45000bb40 con 0x7fe46414eb20 2024-01-25T15:04:25.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.661+0000 7fe4637fe640 1 --2- 172.21.15.29:0/1716101208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe450004d00 0x7fe450005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:25.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.661+0000 7fe462ffd640 1 --2- 172.21.15.29:0/1716101208 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe46414eb20 0x7fe4500039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:25.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.661+0000 7fe4627fc640 1 --2- 172.21.15.29:0/1716101208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe450003f20 0x7fe4500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:25.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.661+0000 7fe4637fe640 1 -- 172.21.15.29:0/1716101208 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe46414eb20 msgr2=0x7fe4500039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:25.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.661+0000 7fe4637fe640 1 --2- 172.21.15.29:0/1716101208 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe46414eb20 0x7fe4500039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:25.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.661+0000 7fe4637fe640 1 -- 172.21.15.29:0/1716101208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe450003f20 msgr2=0x7fe4500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:25.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.661+0000 7fe4637fe640 1 --2- 172.21.15.29:0/1716101208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe450003f20 0x7fe4500047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:25.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.661+0000 7fe4637fe640 1 -- 172.21.15.29:0/1716101208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe450003520 con 0x7fe450004d00 2024-01-25T15:04:25.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.662+0000 7fe4637fe640 1 --2- 172.21.15.29:0/1716101208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe450004d00 0x7fe450005180 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe45400a860 tx=0x7fe4500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf9400577d20ea8 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:25.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.662+0000 7fe461ffb640 1 -- 172.21.15.29:0/1716101208 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe454034630 con 0x7fe450004d00 2024-01-25T15:04:25.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.662+0000 7fe461ffb640 1 -- 172.21.15.29:0/1716101208 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45402f070 con 0x7fe450004d00 2024-01-25T15:04:25.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.662+0000 7fe461ffb640 1 -- 172.21.15.29:0/1716101208 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe454034a30 con 0x7fe450004d00 2024-01-25T15:04:25.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.662+0000 7fe469789640 1 -- 172.21.15.29:0/1716101208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe450004d00 msgr2=0x7fe450005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:25.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.662+0000 7fe469789640 1 --2- 172.21.15.29:0/1716101208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe450004d00 0x7fe450005180 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe45400a860 tx=0x7fe4500057f0 comp rx=0 tx=0).stop 2024-01-25T15:04:25.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.662+0000 7fe4637fe640 1 -- 172.21.15.29:0/1716101208 reap_dead start 2024-01-25T15:04:25.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.662+0000 7fe469789640 1 -- 172.21.15.29:0/1716101208 shutdown_connections 2024-01-25T15:04:25.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.662+0000 7fe469789640 1 -- 172.21.15.29:0/1716101208 >> 172.21.15.29:0/1716101208 conn(0x7fe4640c2a10 msgr2=0x7fe4640c2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:25.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.662+0000 7fe469789640 1 -- 172.21.15.29:0/1716101208 shutdown_connections 2024-01-25T15:04:25.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.662+0000 7fe469789640 1 -- 172.21.15.29:0/1716101208 wait complete. 2024-01-25T15:04:25.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.664+0000 7fe469789640 1 Processor -- start 2024-01-25T15:04:25.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.664+0000 7fe469789640 1 -- start start 2024-01-25T15:04:25.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.664+0000 7fe469789640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe450004d00 0x7fe4640aaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:25.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.664+0000 7fe469789640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe4640ab1b0 0x7fe4641e62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:25.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.664+0000 7fe469789640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe464153b10 0x7fe464153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:25.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.664+0000 7fe469789640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4640aa5c0 con 0x7fe464153b10 2024-01-25T15:04:25.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.664+0000 7fe469789640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46406cfe0 con 0x7fe450004d00 2024-01-25T15:04:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.664+0000 7fe469789640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4641e6810 con 0x7fe4640ab1b0 2024-01-25T15:04:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.664+0000 7fe4637fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe464153b10 0x7fe464153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.664+0000 7fe4637fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe464153b10 0x7fe464153fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55588/0 (socket says 172.21.15.29:55588) 2024-01-25T15:04:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.664+0000 7fe4637fe640 1 -- 172.21.15.29:0/3460994647 learned_addr learned my addr 172.21.15.29:0/3460994647 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.665+0000 7fe462ffd640 1 --2- 172.21.15.29:0/3460994647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe450004d00 0x7fe4640aaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.665+0000 7fe4627fc640 1 --2- 172.21.15.29:0/3460994647 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe4640ab1b0 0x7fe4641e62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.665+0000 7fe4637fe640 1 -- 172.21.15.29:0/3460994647 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe4640ab1b0 msgr2=0x7fe4641e62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.665+0000 7fe4637fe640 1 --2- 172.21.15.29:0/3460994647 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe4640ab1b0 0x7fe4641e62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.665+0000 7fe4637fe640 1 -- 172.21.15.29:0/3460994647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe450004d00 msgr2=0x7fe4640aaa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.665+0000 7fe4637fe640 1 --2- 172.21.15.29:0/3460994647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe450004d00 0x7fe4640aaa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.665+0000 7fe4637fe640 1 -- 172.21.15.29:0/3460994647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4640ab920 con 0x7fe464153b10 2024-01-25T15:04:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.665+0000 7fe4637fe640 1 --2- 172.21.15.29:0/3460994647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe464153b10 0x7fe464153fc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe45400a980 tx=0x7fe454001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.665+0000 7fe45b7fe640 1 -- 172.21.15.29:0/3460994647 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe454034840 con 0x7fe464153b10 2024-01-25T15:04:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.665+0000 7fe45b7fe640 1 -- 172.21.15.29:0/3460994647 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4540349a0 con 0x7fe464153b10 2024-01-25T15:04:25.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.665+0000 7fe45b7fe640 1 -- 172.21.15.29:0/3460994647 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe454034d10 con 0x7fe464153b10 2024-01-25T15:04:25.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.665+0000 7fe469789640 1 -- 172.21.15.29:0/3460994647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4640a9fb0 con 0x7fe464153b10 2024-01-25T15:04:25.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.665+0000 7fe469789640 1 -- 172.21.15.29:0/3460994647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4640aa250 con 0x7fe464153b10 2024-01-25T15:04:25.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.666+0000 7fe469789640 1 -- 172.21.15.29:0/3460994647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe464067be0 con 0x7fe464153b10 2024-01-25T15:04:25.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.666+0000 7fe45b7fe640 1 -- 172.21.15.29:0/3460994647 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fe454031030 con 0x7fe464153b10 2024-01-25T15:04:25.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.667+0000 7fe45b7fe640 1 --2- 172.21.15.29:0/3460994647 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe44406aed0 0x7fe44406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:25.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.667+0000 7fe45b7fe640 1 -- 172.21.15.29:0/3460994647 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe4540aaf20 con 0x7fe464153b10 2024-01-25T15:04:25.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.667+0000 7fe462ffd640 1 --2- 172.21.15.29:0/3460994647 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe44406aed0 0x7fe44406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:25.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.668+0000 7fe462ffd640 1 --2- 172.21.15.29:0/3460994647 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe44406aed0 0x7fe44406d390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe45c006fa0 tx=0x7fe45c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:25.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.672+0000 7fe45b7fe640 1 -- 172.21.15.29:0/3460994647 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fe454076070 con 0x7fe464153b10 2024-01-25T15:04:25.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:25.854+0000 7fe469789640 1 -- 172.21.15.29:0/3460994647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fe4640aa770 con 0x7fe464153b10 2024-01-25T15:04:26.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.526+0000 7fe45b7fe640 1 -- 172.21.15.29:0/3460994647 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7fe454001fd0 con 0x7fe464153b10 2024-01-25T15:04:26.527 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' created 2024-01-25T15:04:26.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.531+0000 7fe469789640 1 -- 172.21.15.29:0/3460994647 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe44406aed0 msgr2=0x7fe44406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:26.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.531+0000 7fe469789640 1 --2- 172.21.15.29:0/3460994647 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe44406aed0 0x7fe44406d390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe45c006fa0 tx=0x7fe45c008040 comp rx=0 tx=0).stop 2024-01-25T15:04:26.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.531+0000 7fe469789640 1 -- 172.21.15.29:0/3460994647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe464153b10 msgr2=0x7fe464153fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:26.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.531+0000 7fe469789640 1 --2- 172.21.15.29:0/3460994647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe464153b10 0x7fe464153fc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe45400a980 tx=0x7fe454001d80 comp rx=0 tx=0).stop 2024-01-25T15:04:26.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.534+0000 7fe469789640 1 -- 172.21.15.29:0/3460994647 shutdown_connections 2024-01-25T15:04:26.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.534+0000 7fe469789640 1 --2- 172.21.15.29:0/3460994647 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe44406aed0 0x7fe44406d390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.534+0000 7fe469789640 1 --2- 172.21.15.29:0/3460994647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe464153b10 0x7fe464153fc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.534+0000 7fe469789640 1 --2- 172.21.15.29:0/3460994647 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe4640ab1b0 0x7fe4641e62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.534+0000 7fe469789640 1 --2- 172.21.15.29:0/3460994647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe450004d00 0x7fe4640aaa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.534+0000 7fe469789640 1 -- 172.21.15.29:0/3460994647 >> 172.21.15.29:0/3460994647 conn(0x7fe4640c2a10 msgr2=0x7fe464151da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:26.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.539+0000 7fe469789640 1 -- 172.21.15.29:0/3460994647 shutdown_connections 2024-01-25T15:04:26.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.541+0000 7fe469789640 1 -- 172.21.15.29:0/3460994647 wait complete. 2024-01-25T15:04:26.559 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-25T15:04:26.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.667+0000 7f516b77d640 1 Processor -- start 2024-01-25T15:04:26.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.668+0000 7f516b77d640 1 -- start start 2024-01-25T15:04:26.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.668+0000 7f516b77d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f516406b490 0x7f51640c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.668+0000 7f516b77d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5164158b80 0x7f51640c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.668+0000 7f516b77d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51640c88e0 con 0x7f51640c8450 2024-01-25T15:04:26.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.668+0000 7f516b77d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51640c6770 con 0x7f5164158b80 2024-01-25T15:04:26.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.668+0000 7f516b77d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5164154f10 con 0x7f516406b490 2024-01-25T15:04:26.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.669+0000 7f5168d18640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5164158b80 0x7f51640c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.669+0000 7f5168d18640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5164158b80 0x7f51640c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55592/0 (socket says 172.21.15.29:55592) 2024-01-25T15:04:26.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.669+0000 7f5168d18640 1 -- 172.21.15.29:0/3654462503 learned_addr learned my addr 172.21.15.29:0/3654462503 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:26.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.669+0000 7f5169519640 1 --2- 172.21.15.29:0/3654462503 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f516406b490 0x7f51640c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.669+0000 7f5168d18640 1 -- 172.21.15.29:0/3654462503 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f516406b490 msgr2=0x7f51640c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:26.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.669+0000 7f5168d18640 1 --2- 172.21.15.29:0/3654462503 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f516406b490 0x7f51640c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.669+0000 7f5168d18640 1 -- 172.21.15.29:0/3654462503 >> v1:172.21.15.52:6789/0 conn(0x7f51640c8450 legacy=0x7f5164151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:26.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.669+0000 7f5168d18640 1 -- 172.21.15.29:0/3654462503 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51641551f0 con 0x7f5164158b80 2024-01-25T15:04:26.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.670+0000 7f5168d18640 1 --2- 172.21.15.29:0/3654462503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5164158b80 0x7f51640c7f10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5158009870 tx=0x7f515802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4890756ce8b3dd server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:26.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.670+0000 7f5163fff640 1 -- 172.21.15.29:0/3654462503 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5158031640 con 0x7f5164158b80 2024-01-25T15:04:26.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.670+0000 7f5163fff640 1 -- 172.21.15.29:0/3654462503 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51580317a0 con 0x7f5164158b80 2024-01-25T15:04:26.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.670+0000 7f5163fff640 1 -- 172.21.15.29:0/3654462503 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5158031b30 con 0x7f5164158b80 2024-01-25T15:04:26.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.670+0000 7f516b77d640 1 -- 172.21.15.29:0/3654462503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5164158b80 msgr2=0x7f51640c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:26.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.670+0000 7f516b77d640 1 --2- 172.21.15.29:0/3654462503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5164158b80 0x7f51640c7f10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5158009870 tx=0x7f515802b8f0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.670+0000 7f516b77d640 1 -- 172.21.15.29:0/3654462503 shutdown_connections 2024-01-25T15:04:26.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.670+0000 7f516b77d640 1 --2- 172.21.15.29:0/3654462503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5164158b80 0x7f51640c7f10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.670+0000 7f516b77d640 1 --2- 172.21.15.29:0/3654462503 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f516406b490 0x7f51640c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.670+0000 7f516b77d640 1 -- 172.21.15.29:0/3654462503 >> 172.21.15.29:0/3654462503 conn(0x7f51640ca010 msgr2=0x7f51640ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:26.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.670+0000 7f516b77d640 1 -- 172.21.15.29:0/3654462503 shutdown_connections 2024-01-25T15:04:26.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.670+0000 7f516b77d640 1 -- 172.21.15.29:0/3654462503 wait complete. 2024-01-25T15:04:26.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.671+0000 7f516b77d640 1 Processor -- start 2024-01-25T15:04:26.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.672+0000 7f516b77d640 1 -- start start 2024-01-25T15:04:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.672+0000 7f516b77d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f516406b490 0x7f5164151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.672+0000 7f516b77d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51640c8450 0x7f51640c3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.672+0000 7f516b77d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5164158b80 0x7f51640c3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.672+0000 7f516b77d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516414dde0 con 0x7f5164158b80 2024-01-25T15:04:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.672+0000 7f516b77d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51641ea0b0 con 0x7f51640c8450 2024-01-25T15:04:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.672+0000 7f516b77d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f516414c140 con 0x7f516406b490 2024-01-25T15:04:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.672+0000 7f5169d1a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5164158b80 0x7f51640c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.672+0000 7f5169d1a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5164158b80 0x7f51640c3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55598/0 (socket says 172.21.15.29:55598) 2024-01-25T15:04:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.672+0000 7f5169d1a640 1 -- 172.21.15.29:0/3784224000 learned_addr learned my addr 172.21.15.29:0/3784224000 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.673+0000 7f5168d18640 1 --2- 172.21.15.29:0/3784224000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51640c8450 0x7f51640c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.673+0000 7f5169519640 1 --2- 172.21.15.29:0/3784224000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f516406b490 0x7f5164151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.673+0000 7f5169d1a640 1 -- 172.21.15.29:0/3784224000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f516406b490 msgr2=0x7f5164151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.673+0000 7f5169d1a640 1 --2- 172.21.15.29:0/3784224000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f516406b490 0x7f5164151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.673+0000 7f5169d1a640 1 -- 172.21.15.29:0/3784224000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51640c8450 msgr2=0x7f51640c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.673+0000 7f5169d1a640 1 --2- 172.21.15.29:0/3784224000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51640c8450 0x7f51640c3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.673+0000 7f5169d1a640 1 -- 172.21.15.29:0/3784224000 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51580094d0 con 0x7f5164158b80 2024-01-25T15:04:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.673+0000 7f5168d18640 1 --2- 172.21.15.29:0/3784224000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51640c8450 0x7f51640c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.673+0000 7f5169519640 1 --2- 172.21.15.29:0/3784224000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f516406b490 0x7f5164151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.673+0000 7f5169d1a640 1 --2- 172.21.15.29:0/3784224000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5164158b80 0x7f51640c3970 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f515400c7a0 tx=0x7f515400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.673+0000 7f5161ffb640 1 -- 172.21.15.29:0/3784224000 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5154003b70 con 0x7f5164158b80 2024-01-25T15:04:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.673+0000 7f5161ffb640 1 -- 172.21.15.29:0/3784224000 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5154003cf0 con 0x7f5164158b80 2024-01-25T15:04:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.673+0000 7f516b77d640 1 -- 172.21.15.29:0/3784224000 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5164157ec0 con 0x7f5164158b80 2024-01-25T15:04:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.673+0000 7f5161ffb640 1 -- 172.21.15.29:0/3784224000 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5154003ea0 con 0x7f5164158b80 2024-01-25T15:04:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.673+0000 7f516b77d640 1 -- 172.21.15.29:0/3784224000 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51641ee4c0 con 0x7f5164158b80 2024-01-25T15:04:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.674+0000 7f516b77d640 1 -- 172.21.15.29:0/3784224000 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51641ea220 con 0x7f5164158b80 2024-01-25T15:04:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.675+0000 7f5161ffb640 1 -- 172.21.15.29:0/3784224000 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f515400aa90 con 0x7f5164158b80 2024-01-25T15:04:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.675+0000 7f5161ffb640 1 --2- 172.21.15.29:0/3784224000 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f515006aed0 0x7f515006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.675+0000 7f5161ffb640 1 -- 172.21.15.29:0/3784224000 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f5154089390 con 0x7f5164158b80 2024-01-25T15:04:26.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.675+0000 7f5169519640 1 --2- 172.21.15.29:0/3784224000 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f515006aed0 0x7f515006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.676+0000 7f5169519640 1 --2- 172.21.15.29:0/3784224000 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f515006aed0 0x7f515006d390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f515c006fd0 tx=0x7f515c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:26.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.680+0000 7f5161ffb640 1 -- 172.21.15.29:0/3784224000 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f51641ea220 con 0x7f5164158b80 2024-01-25T15:04:26.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:26.895+0000 7f516b77d640 1 -- 172.21.15.29:0/3784224000 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f51641ea220 con 0x7f5164158b80 2024-01-25T15:04:27.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.545+0000 7f5161ffb640 1 -- 172.21.15.29:0/3784224000 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f51641ea220 con 0x7f5164158b80 2024-01-25T15:04:27.546 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 2 and data pool 3 2024-01-25T15:04:27.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.547+0000 7f516b77d640 1 -- 172.21.15.29:0/3784224000 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f515006aed0 msgr2=0x7f515006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:27.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.547+0000 7f516b77d640 1 --2- 172.21.15.29:0/3784224000 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f515006aed0 0x7f515006d390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f515c006fd0 tx=0x7f515c008040 comp rx=0 tx=0).stop 2024-01-25T15:04:27.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.547+0000 7f516b77d640 1 -- 172.21.15.29:0/3784224000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5164158b80 msgr2=0x7f51640c3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:27.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.547+0000 7f516b77d640 1 --2- 172.21.15.29:0/3784224000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5164158b80 0x7f51640c3970 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f515400c7a0 tx=0x7f515400cc60 comp rx=0 tx=0).stop 2024-01-25T15:04:27.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.547+0000 7f516b77d640 1 -- 172.21.15.29:0/3784224000 shutdown_connections 2024-01-25T15:04:27.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.547+0000 7f516b77d640 1 --2- 172.21.15.29:0/3784224000 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f515006aed0 0x7f515006d390 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:27.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.547+0000 7f516b77d640 1 --2- 172.21.15.29:0/3784224000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5164158b80 0x7f51640c3970 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:27.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.547+0000 7f516b77d640 1 --2- 172.21.15.29:0/3784224000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51640c8450 0x7f51640c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:27.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.547+0000 7f516b77d640 1 --2- 172.21.15.29:0/3784224000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f516406b490 0x7f5164151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:27.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.547+0000 7f516b77d640 1 -- 172.21.15.29:0/3784224000 >> 172.21.15.29:0/3784224000 conn(0x7f51640ca010 msgr2=0x7f51641543f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:27.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.547+0000 7f516b77d640 1 -- 172.21.15.29:0/3784224000 shutdown_connections 2024-01-25T15:04:27.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.548+0000 7f516b77d640 1 -- 172.21.15.29:0/3784224000 wait complete. 2024-01-25T15:04:27.564 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-01-25T15:04:27.565 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-01-25T15:04:27.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.676+0000 7fa34164e640 1 Processor -- start 2024-01-25T15:04:27.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.676+0000 7fa34164e640 1 -- start start 2024-01-25T15:04:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.677+0000 7fa34164e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa33c0af6c0 0x7fa33c0c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.677+0000 7fa34164e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa33c0c5a70 0x7fa33c06b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.677+0000 7fa34164e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33c0afaa0 con 0x7fa33c06d560 2024-01-25T15:04:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.677+0000 7fa34164e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa33c06c480 con 0x7fa33c0af6c0 2024-01-25T15:04:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.677+0000 7fa34164e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa33c155290 con 0x7fa33c0c5a70 2024-01-25T15:04:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.677+0000 7fa33affd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa33c0af6c0 0x7fa33c0c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.677+0000 7fa33affd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa33c0af6c0 0x7fa33c0c5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55608/0 (socket says 172.21.15.29:55608) 2024-01-25T15:04:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.677+0000 7fa33affd640 1 -- 172.21.15.29:0/690576253 learned_addr learned my addr 172.21.15.29:0/690576253 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.677+0000 7fa33b7fe640 1 --2- 172.21.15.29:0/690576253 >> v2:172.21.15.52:3300/0 conn(0x7fa33c0c5a70 0x7fa33c06b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.677+0000 7fa33affd640 1 -- 172.21.15.29:0/690576253 >> v2:172.21.15.52:3300/0 conn(0x7fa33c0c5a70 msgr2=0x7fa33c06b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.677+0000 7fa33affd640 1 --2- 172.21.15.29:0/690576253 >> v2:172.21.15.52:3300/0 conn(0x7fa33c0c5a70 0x7fa33c06b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.677+0000 7fa33affd640 1 -- 172.21.15.29:0/690576253 >> v1:172.21.15.52:6789/0 conn(0x7fa33c06d560 legacy=0x7fa33c06b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:27.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.677+0000 7fa33affd640 1 -- 172.21.15.29:0/690576253 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33c0c6060 con 0x7fa33c0af6c0 2024-01-25T15:04:27.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.678+0000 7fa33affd640 1 --2- 172.21.15.29:0/690576253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa33c0af6c0 0x7fa33c0c5530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa33c0bdc90 tx=0x7fa32c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500e628f0099030d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:27.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.678+0000 7fa33a7fc640 1 -- 172.21.15.29:0/690576253 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c030860 con 0x7fa33c0af6c0 2024-01-25T15:04:27.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.678+0000 7fa33a7fc640 1 -- 172.21.15.29:0/690576253 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c0309c0 con 0x7fa33c0af6c0 2024-01-25T15:04:27.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.678+0000 7fa33a7fc640 1 -- 172.21.15.29:0/690576253 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c030d50 con 0x7fa33c0af6c0 2024-01-25T15:04:27.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.679+0000 7fa34164e640 1 -- 172.21.15.29:0/690576253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa33c0af6c0 msgr2=0x7fa33c0c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:27.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.679+0000 7fa34164e640 1 --2- 172.21.15.29:0/690576253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa33c0af6c0 0x7fa33c0c5530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa33c0bdc90 tx=0x7fa32c02b9a0 comp rx=0 tx=0).stop 2024-01-25T15:04:27.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.679+0000 7fa34164e640 1 -- 172.21.15.29:0/690576253 shutdown_connections 2024-01-25T15:04:27.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.679+0000 7fa34164e640 1 --2- 172.21.15.29:0/690576253 >> v2:172.21.15.52:3300/0 conn(0x7fa33c0c5a70 0x7fa33c06b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:27.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.679+0000 7fa34164e640 1 --2- 172.21.15.29:0/690576253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa33c0af6c0 0x7fa33c0c5530 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:27.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.679+0000 7fa34164e640 1 -- 172.21.15.29:0/690576253 >> 172.21.15.29:0/690576253 conn(0x7fa33c0c6ca0 msgr2=0x7fa33c0c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:27.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.679+0000 7fa34164e640 1 -- 172.21.15.29:0/690576253 shutdown_connections 2024-01-25T15:04:27.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.679+0000 7fa34164e640 1 -- 172.21.15.29:0/690576253 wait complete. 2024-01-25T15:04:27.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.680+0000 7fa34164e640 1 Processor -- start 2024-01-25T15:04:27.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.680+0000 7fa34164e640 1 -- start start 2024-01-25T15:04:27.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa34164e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa33c06d560 0x7fa33c1eb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:27.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa34164e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa33c0af6c0 0x7fa33c1e1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:27.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa34164e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa33c0c5a70 0x7fa33c156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:27.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa34164e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c155bd0 con 0x7fa33c06d560 2024-01-25T15:04:27.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa34164e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c1eb5b0 con 0x7fa33c0af6c0 2024-01-25T15:04:27.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa34164e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c155e70 con 0x7fa33c0c5a70 2024-01-25T15:04:27.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa33affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa33c06d560 0x7fa33c1eb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:27.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa33affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa33c06d560 0x7fa33c1eb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55616/0 (socket says 172.21.15.29:55616) 2024-01-25T15:04:27.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa33affd640 1 -- 172.21.15.29:0/3371182695 learned_addr learned my addr 172.21.15.29:0/3371182695 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:27.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa333fff640 1 --2- 172.21.15.29:0/3371182695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa33c0af6c0 0x7fa33c1e1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:27.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa33b7fe640 1 --2- 172.21.15.29:0/3371182695 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa33c0c5a70 0x7fa33c156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa33affd640 1 -- 172.21.15.29:0/3371182695 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa33c0c5a70 msgr2=0x7fa33c156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa33affd640 1 --2- 172.21.15.29:0/3371182695 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa33c0c5a70 0x7fa33c156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa33affd640 1 -- 172.21.15.29:0/3371182695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa33c0af6c0 msgr2=0x7fa33c1e1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa33affd640 1 --2- 172.21.15.29:0/3371182695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa33c0af6c0 0x7fa33c1e1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa33affd640 1 -- 172.21.15.29:0/3371182695 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c0094d0 con 0x7fa33c06d560 2024-01-25T15:04:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa33b7fe640 1 --2- 172.21.15.29:0/3371182695 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa33c0c5a70 0x7fa33c156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa333fff640 1 --2- 172.21.15.29:0/3371182695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa33c0af6c0 0x7fa33c1e1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa33affd640 1 --2- 172.21.15.29:0/3371182695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa33c06d560 0x7fa33c1eb070 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa32c02b9e0 tx=0x7fa32c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa3337fe640 1 -- 172.21.15.29:0/3371182695 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c039c90 con 0x7fa33c06d560 2024-01-25T15:04:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa3337fe640 1 -- 172.21.15.29:0/3371182695 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c039df0 con 0x7fa33c06d560 2024-01-25T15:04:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa34164e640 1 -- 172.21.15.29:0/3371182695 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33c158280 con 0x7fa33c06d560 2024-01-25T15:04:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.681+0000 7fa3337fe640 1 -- 172.21.15.29:0/3371182695 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c043640 con 0x7fa33c06d560 2024-01-25T15:04:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.682+0000 7fa34164e640 1 -- 172.21.15.29:0/3371182695 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33c158800 con 0x7fa33c06d560 2024-01-25T15:04:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.683+0000 7fa34164e640 1 -- 172.21.15.29:0/3371182695 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33c074010 con 0x7fa33c06d560 2024-01-25T15:04:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.683+0000 7fa3337fe640 1 -- 172.21.15.29:0/3371182695 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fa32c0437a0 con 0x7fa33c06d560 2024-01-25T15:04:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.683+0000 7fa3337fe640 1 --2- 172.21.15.29:0/3371182695 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa31c06af00 0x7fa31c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:27.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.683+0000 7fa3337fe640 1 -- 172.21.15.29:0/3371182695 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa32c03e070 con 0x7fa33c06d560 2024-01-25T15:04:27.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.684+0000 7fa333fff640 1 --2- 172.21.15.29:0/3371182695 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa31c06af00 0x7fa31c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:27.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.684+0000 7fa333fff640 1 --2- 172.21.15.29:0/3371182695 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa31c06af00 0x7fa31c06d3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa33c0aa870 tx=0x7fa324009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:27.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.688+0000 7fa3337fe640 1 -- 172.21.15.29:0/3371182695 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fa32c077600 con 0x7fa33c06d560 2024-01-25T15:04:27.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:27.880+0000 7fa34164e640 1 -- 172.21.15.29:0/3371182695 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fa33c1526d0 con 0x7fa33c06d560 2024-01-25T15:04:28.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.515+0000 7fa3337fe640 1 -- 172.21.15.29:0/3371182695 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7fa32c07ac20 con 0x7fa33c06d560 2024-01-25T15:04:28.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.518+0000 7fa34164e640 1 -- 172.21.15.29:0/3371182695 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa31c06af00 msgr2=0x7fa31c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:28.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.518+0000 7fa34164e640 1 --2- 172.21.15.29:0/3371182695 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa31c06af00 0x7fa31c06d3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa33c0aa870 tx=0x7fa324009040 comp rx=0 tx=0).stop 2024-01-25T15:04:28.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.518+0000 7fa34164e640 1 -- 172.21.15.29:0/3371182695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa33c06d560 msgr2=0x7fa33c1eb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:28.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.518+0000 7fa34164e640 1 --2- 172.21.15.29:0/3371182695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa33c06d560 0x7fa33c1eb070 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa32c02b9e0 tx=0x7fa32c004730 comp rx=0 tx=0).stop 2024-01-25T15:04:28.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.518+0000 7fa34164e640 1 -- 172.21.15.29:0/3371182695 shutdown_connections 2024-01-25T15:04:28.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.518+0000 7fa34164e640 1 --2- 172.21.15.29:0/3371182695 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa33c0c5a70 0x7fa33c156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:28.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.518+0000 7fa34164e640 1 --2- 172.21.15.29:0/3371182695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa33c0af6c0 0x7fa33c1e1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:28.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.518+0000 7fa34164e640 1 --2- 172.21.15.29:0/3371182695 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa31c06af00 0x7fa31c06d3c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:28.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.518+0000 7fa34164e640 1 --2- 172.21.15.29:0/3371182695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa33c06d560 0x7fa33c1eb070 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:28.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.518+0000 7fa34164e640 1 -- 172.21.15.29:0/3371182695 >> 172.21.15.29:0/3371182695 conn(0x7fa33c0c6ca0 msgr2=0x7fa33c1532f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:28.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.518+0000 7fa34164e640 1 -- 172.21.15.29:0/3371182695 shutdown_connections 2024-01-25T15:04:28.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.518+0000 7fa34164e640 1 -- 172.21.15.29:0/3371182695 wait complete. 2024-01-25T15:04:28.533 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-01-25T15:04:28.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.648+0000 7f284229e640 1 Processor -- start 2024-01-25T15:04:28.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.648+0000 7f284229e640 1 -- start start 2024-01-25T15:04:28.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.648+0000 7f284229e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f283c0c4c20 0x7f283c06bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:28.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.648+0000 7f284229e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f283c154e80 0x7f283c155310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:28.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.648+0000 7f284229e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f283c0c5200 con 0x7f283c0c6070 2024-01-25T15:04:28.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.648+0000 7f284229e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f283c1549f0 con 0x7f283c0c4c20 2024-01-25T15:04:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.648+0000 7f284229e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f283c0c5590 con 0x7f283c154e80 2024-01-25T15:04:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.648+0000 7f283b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f283c0c4c20 0x7f283c06bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.649+0000 7f283b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f283c0c4c20 0x7f283c06bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55618/0 (socket says 172.21.15.29:55618) 2024-01-25T15:04:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.649+0000 7f283b7fe640 1 -- 172.21.15.29:0/3224091798 learned_addr learned my addr 172.21.15.29:0/3224091798 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.649+0000 7f284083b640 1 --2- 172.21.15.29:0/3224091798 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f283c154e80 0x7f283c155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.649+0000 7f283b7fe640 1 -- 172.21.15.29:0/3224091798 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f283c154e80 msgr2=0x7f283c155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.649+0000 7f283b7fe640 1 --2- 172.21.15.29:0/3224091798 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f283c154e80 0x7f283c155310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.649+0000 7f283b7fe640 1 -- 172.21.15.29:0/3224091798 >> v1:172.21.15.52:6789/0 conn(0x7f283c0c6070 legacy=0x7f283c151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.649+0000 7f283b7fe640 1 -- 172.21.15.29:0/3224091798 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283c0c5870 con 0x7f283c0c4c20 2024-01-25T15:04:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.650+0000 7f283b7fe640 1 --2- 172.21.15.29:0/3224091798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f283c0c4c20 0x7f283c06bd50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2830009870 tx=0x7f283002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665dca3d959b9f86 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.650+0000 7f283affd640 1 -- 172.21.15.29:0/3224091798 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2830031740 con 0x7f283c0c4c20 2024-01-25T15:04:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.650+0000 7f283affd640 1 -- 172.21.15.29:0/3224091798 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28300318a0 con 0x7f283c0c4c20 2024-01-25T15:04:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.650+0000 7f283affd640 1 -- 172.21.15.29:0/3224091798 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2830031c30 con 0x7f283c0c4c20 2024-01-25T15:04:28.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.650+0000 7f284229e640 1 -- 172.21.15.29:0/3224091798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f283c0c4c20 msgr2=0x7f283c06bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:28.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.650+0000 7f284229e640 1 --2- 172.21.15.29:0/3224091798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f283c0c4c20 0x7f283c06bd50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2830009870 tx=0x7f283002b7e0 comp rx=0 tx=0).stop 2024-01-25T15:04:28.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.650+0000 7f284229e640 1 -- 172.21.15.29:0/3224091798 shutdown_connections 2024-01-25T15:04:28.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.650+0000 7f284229e640 1 --2- 172.21.15.29:0/3224091798 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f283c154e80 0x7f283c155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:28.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.650+0000 7f284229e640 1 --2- 172.21.15.29:0/3224091798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f283c0c4c20 0x7f283c06bd50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:28.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.650+0000 7f284229e640 1 -- 172.21.15.29:0/3224091798 >> 172.21.15.29:0/3224091798 conn(0x7f283c0ca2a0 msgr2=0x7f283c0ca680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:28.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.650+0000 7f284229e640 1 -- 172.21.15.29:0/3224091798 shutdown_connections 2024-01-25T15:04:28.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.650+0000 7f284229e640 1 -- 172.21.15.29:0/3224091798 wait complete. 2024-01-25T15:04:28.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.651+0000 7f284229e640 1 Processor -- start 2024-01-25T15:04:28.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.652+0000 7f284229e640 1 -- start start 2024-01-25T15:04:28.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.652+0000 7f284229e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f283c0c4c20 0x7f283c1edc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:28.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.652+0000 7f284229e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f283c0c6070 0x7f283c153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:28.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.652+0000 7f284229e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f283c154e80 0x7f283c14c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:28.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.652+0000 7f284229e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c0af4b0 con 0x7f283c0c4c20 2024-01-25T15:04:28.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.652+0000 7f284229e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c1ee1b0 con 0x7f283c0c6070 2024-01-25T15:04:28.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.652+0000 7f284229e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f283c0be2d0 con 0x7f283c154e80 2024-01-25T15:04:28.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.652+0000 7f283bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f283c0c4c20 0x7f283c1edc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:28.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.652+0000 7f283bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f283c0c4c20 0x7f283c1edc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55630/0 (socket says 172.21.15.29:55630) 2024-01-25T15:04:28.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.652+0000 7f283bfff640 1 -- 172.21.15.29:0/2749900178 learned_addr learned my addr 172.21.15.29:0/2749900178 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.653+0000 7f284083b640 1 --2- 172.21.15.29:0/2749900178 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f283c154e80 0x7f283c14c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.653+0000 7f283b7fe640 1 --2- 172.21.15.29:0/2749900178 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f283c0c6070 0x7f283c153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.653+0000 7f283bfff640 1 -- 172.21.15.29:0/2749900178 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f283c154e80 msgr2=0x7f283c14c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.653+0000 7f283bfff640 1 --2- 172.21.15.29:0/2749900178 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f283c154e80 0x7f283c14c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.653+0000 7f283bfff640 1 -- 172.21.15.29:0/2749900178 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f283c0c6070 msgr2=0x7f283c153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.653+0000 7f283bfff640 1 --2- 172.21.15.29:0/2749900178 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f283c0c6070 0x7f283c153850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.653+0000 7f283bfff640 1 -- 172.21.15.29:0/2749900178 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28300094d0 con 0x7f283c0c4c20 2024-01-25T15:04:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.653+0000 7f283bfff640 1 --2- 172.21.15.29:0/2749900178 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f283c0c4c20 0x7f283c1edc70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f282c00c430 tx=0x7f282c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.653+0000 7f2838ff9640 1 -- 172.21.15.29:0/2749900178 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c011790 con 0x7f283c0c4c20 2024-01-25T15:04:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.653+0000 7f2838ff9640 1 -- 172.21.15.29:0/2749900178 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282c0118f0 con 0x7f283c0c4c20 2024-01-25T15:04:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.653+0000 7f284229e640 1 -- 172.21.15.29:0/2749900178 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f283c152530 con 0x7f283c0c4c20 2024-01-25T15:04:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.653+0000 7f2838ff9640 1 -- 172.21.15.29:0/2749900178 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c011ce0 con 0x7f283c0c4c20 2024-01-25T15:04:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.653+0000 7f284229e640 1 -- 172.21.15.29:0/2749900178 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f283c1ea370 con 0x7f283c0c4c20 2024-01-25T15:04:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.654+0000 7f284229e640 1 -- 172.21.15.29:0/2749900178 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f283c06d850 con 0x7f283c0c4c20 2024-01-25T15:04:28.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.654+0000 7f2838ff9640 1 -- 172.21.15.29:0/2749900178 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f282c01c460 con 0x7f283c0c4c20 2024-01-25T15:04:28.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.655+0000 7f2838ff9640 1 --2- 172.21.15.29:0/2749900178 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f282806aed0 0x7f282806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:28.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.655+0000 7f2838ff9640 1 -- 172.21.15.29:0/2749900178 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f282c089670 con 0x7f283c0c4c20 2024-01-25T15:04:28.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.655+0000 7f283b7fe640 1 --2- 172.21.15.29:0/2749900178 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f282806aed0 0x7f282806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:28.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.656+0000 7f283b7fe640 1 --2- 172.21.15.29:0/2749900178 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f282806aed0 0x7f282806d390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2830035000 tx=0x7f2830008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:28.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.659+0000 7f2838ff9640 1 -- 172.21.15.29:0/2749900178 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f282c0544f0 con 0x7f283c0c4c20 2024-01-25T15:04:28.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:28.841+0000 7f284229e640 1 -- 172.21.15.29:0/2749900178 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f283c074080 con 0x7f283c0c4c20 2024-01-25T15:04:30.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.557+0000 7f2838ff9640 1 -- 172.21.15.29:0/2749900178 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7f282c057b10 con 0x7f283c0c4c20 2024-01-25T15:04:30.559 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data_ec' created 2024-01-25T15:04:30.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.562+0000 7f284229e640 1 -- 172.21.15.29:0/2749900178 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f282806aed0 msgr2=0x7f282806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:30.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.562+0000 7f284229e640 1 --2- 172.21.15.29:0/2749900178 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f282806aed0 0x7f282806d390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2830035000 tx=0x7f2830008030 comp rx=0 tx=0).stop 2024-01-25T15:04:30.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.562+0000 7f284229e640 1 -- 172.21.15.29:0/2749900178 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f283c0c4c20 msgr2=0x7f283c1edc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:30.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.562+0000 7f284229e640 1 --2- 172.21.15.29:0/2749900178 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f283c0c4c20 0x7f283c1edc70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f282c00c430 tx=0x7f282c00c8f0 comp rx=0 tx=0).stop 2024-01-25T15:04:30.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.562+0000 7f284229e640 1 -- 172.21.15.29:0/2749900178 shutdown_connections 2024-01-25T15:04:30.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.562+0000 7f284229e640 1 --2- 172.21.15.29:0/2749900178 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f283c154e80 0x7f283c14c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:30.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.562+0000 7f284229e640 1 --2- 172.21.15.29:0/2749900178 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f283c0c6070 0x7f283c153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:30.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.562+0000 7f284229e640 1 --2- 172.21.15.29:0/2749900178 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f282806aed0 0x7f282806d390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:30.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.562+0000 7f284229e640 1 --2- 172.21.15.29:0/2749900178 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f283c0c4c20 0x7f283c1edc70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:30.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.562+0000 7f284229e640 1 -- 172.21.15.29:0/2749900178 >> 172.21.15.29:0/2749900178 conn(0x7f283c0ca2a0 msgr2=0x7f283c1526c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:30.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.563+0000 7f284229e640 1 -- 172.21.15.29:0/2749900178 shutdown_connections 2024-01-25T15:04:30.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.563+0000 7f284229e640 1 -- 172.21.15.29:0/2749900178 wait complete. 2024-01-25T15:04:30.583 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-01-25T15:04:30.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.692+0000 7f113daca640 1 Processor -- start 2024-01-25T15:04:30.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.692+0000 7f113daca640 1 -- start start 2024-01-25T15:04:30.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.693+0000 7f113daca640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1138152090 0x7f11380c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:30.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.693+0000 7f113daca640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1138155750 0x7f11380c4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:30.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.693+0000 7f113daca640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11380c9b40 con 0x7f11380c50e0 2024-01-25T15:04:30.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.693+0000 7f113daca640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1138154a80 con 0x7f1138155750 2024-01-25T15:04:30.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.693+0000 7f113daca640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11381552c0 con 0x7f1138152090 2024-01-25T15:04:30.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.693+0000 7f112ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1138155750 0x7f11380c4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:30.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.693+0000 7f1137fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f11380c50e0 0x7f11380c7f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37090/0 (socket says 172.21.15.29:37090) 2024-01-25T15:04:30.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.693+0000 7f1137fff640 1 -- 172.21.15.29:0/527120640 learned_addr learned my addr 172.21.15.29:0/527120640 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:30.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.693+0000 7f11377fe640 1 --2- 172.21.15.29:0/527120640 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1138152090 0x7f11380c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:30.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.693+0000 7f112ffff640 1 -- 172.21.15.29:0/527120640 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1138152090 msgr2=0x7f11380c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:30.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.693+0000 7f112ffff640 1 --2- 172.21.15.29:0/527120640 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1138152090 0x7f11380c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:30.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.693+0000 7f112ffff640 1 -- 172.21.15.29:0/527120640 >> v1:172.21.15.29:6789/0 conn(0x7f11380c50e0 legacy=0x7f11380c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:30.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.693+0000 7f112ffff640 1 -- 172.21.15.29:0/527120640 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11380c6680 con 0x7f1138155750 2024-01-25T15:04:30.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.693+0000 7f1136ffd640 1 -- 172.21.15.29:0/527120640 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150091581 0 0) 0x7f1130001490 con 0x7f11380c50e0 2024-01-25T15:04:30.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.694+0000 7f112ffff640 1 --2- 172.21.15.29:0/527120640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1138155750 0x7f11380c4ba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f11200097a0 tx=0x7f112002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f8b3d39bebf026 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:30.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.694+0000 7f1136ffd640 1 -- 172.21.15.29:0/527120640 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112002e070 con 0x7f1138155750 2024-01-25T15:04:30.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.694+0000 7f1136ffd640 1 -- 172.21.15.29:0/527120640 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11200315a0 con 0x7f1138155750 2024-01-25T15:04:30.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.694+0000 7f1136ffd640 1 -- 172.21.15.29:0/527120640 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1120031930 con 0x7f1138155750 2024-01-25T15:04:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.694+0000 7f113daca640 1 -- 172.21.15.29:0/527120640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1138155750 msgr2=0x7f11380c4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.694+0000 7f113daca640 1 --2- 172.21.15.29:0/527120640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1138155750 0x7f11380c4ba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f11200097a0 tx=0x7f112002b840 comp rx=0 tx=0).stop 2024-01-25T15:04:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.695+0000 7f113daca640 1 -- 172.21.15.29:0/527120640 shutdown_connections 2024-01-25T15:04:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.695+0000 7f113daca640 1 --2- 172.21.15.29:0/527120640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1138155750 0x7f11380c4ba0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.695+0000 7f113daca640 1 --2- 172.21.15.29:0/527120640 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1138152090 0x7f11380c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.695+0000 7f113daca640 1 -- 172.21.15.29:0/527120640 >> 172.21.15.29:0/527120640 conn(0x7f11380ca000 msgr2=0x7f11380ca3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.695+0000 7f113daca640 1 -- 172.21.15.29:0/527120640 shutdown_connections 2024-01-25T15:04:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.695+0000 7f113daca640 1 -- 172.21.15.29:0/527120640 wait complete. 2024-01-25T15:04:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.696+0000 7f113daca640 1 Processor -- start 2024-01-25T15:04:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.696+0000 7f113daca640 1 -- start start 2024-01-25T15:04:30.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.696+0000 7f113daca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11380c50e0 0x7f11381512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:30.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.696+0000 7f113daca640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1138152090 0x7f11381ea9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:30.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.696+0000 7f113daca640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1138155750 0x7f11381eaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:30.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.696+0000 7f113daca640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1138147640 con 0x7f11380c50e0 2024-01-25T15:04:30.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.696+0000 7f113daca640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11380ab750 con 0x7f1138152090 2024-01-25T15:04:30.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.696+0000 7f113daca640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1138149b10 con 0x7f1138155750 2024-01-25T15:04:30.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.696+0000 7f11377fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11380c50e0 0x7f11381512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:30.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.696+0000 7f11377fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11380c50e0 0x7f11381512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55652/0 (socket says 172.21.15.29:55652) 2024-01-25T15:04:30.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.696+0000 7f11377fe640 1 -- 172.21.15.29:0/1050592365 learned_addr learned my addr 172.21.15.29:0/1050592365 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:30.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.697+0000 7f1137fff640 1 --2- 172.21.15.29:0/1050592365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1138155750 0x7f11381eaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:30.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.697+0000 7f112ffff640 1 --2- 172.21.15.29:0/1050592365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1138152090 0x7f11381ea9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:30.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.697+0000 7f11377fe640 1 -- 172.21.15.29:0/1050592365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1138155750 msgr2=0x7f11381eaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:30.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.697+0000 7f11377fe640 1 --2- 172.21.15.29:0/1050592365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1138155750 0x7f11381eaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:30.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.697+0000 7f11377fe640 1 -- 172.21.15.29:0/1050592365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1138152090 msgr2=0x7f11381ea9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:30.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.697+0000 7f11377fe640 1 --2- 172.21.15.29:0/1050592365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1138152090 0x7f11381ea9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:30.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.697+0000 7f11377fe640 1 -- 172.21.15.29:0/1050592365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1120009400 con 0x7f11380c50e0 2024-01-25T15:04:30.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.697+0000 7f112ffff640 1 --2- 172.21.15.29:0/1050592365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1138152090 0x7f11381ea9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:30.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.697+0000 7f11377fe640 1 --2- 172.21.15.29:0/1050592365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11380c50e0 0x7f11381512c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f112800d800 tx=0x7f112800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:30.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.697+0000 7f1134ff9640 1 -- 172.21.15.29:0/1050592365 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112800b6c0 con 0x7f11380c50e0 2024-01-25T15:04:30.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.697+0000 7f1134ff9640 1 -- 172.21.15.29:0/1050592365 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112800b840 con 0x7f11380c50e0 2024-01-25T15:04:30.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.697+0000 7f113daca640 1 -- 172.21.15.29:0/1050592365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1138149df0 con 0x7f11380c50e0 2024-01-25T15:04:30.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.697+0000 7f1134ff9640 1 -- 172.21.15.29:0/1050592365 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112800bbf0 con 0x7f11380c50e0 2024-01-25T15:04:30.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.697+0000 7f113daca640 1 -- 172.21.15.29:0/1050592365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1138151800 con 0x7f11380c50e0 2024-01-25T15:04:30.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.698+0000 7f113daca640 1 -- 172.21.15.29:0/1050592365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113808be00 con 0x7f11380c50e0 2024-01-25T15:04:30.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.699+0000 7f1134ff9640 1 -- 172.21.15.29:0/1050592365 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f112800bd50 con 0x7f11380c50e0 2024-01-25T15:04:30.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.699+0000 7f1134ff9640 1 --2- 172.21.15.29:0/1050592365 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f111806aed0 0x7f111806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:30.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.699+0000 7f1134ff9640 1 -- 172.21.15.29:0/1050592365 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f1128089ec0 con 0x7f11380c50e0 2024-01-25T15:04:30.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.699+0000 7f112ffff640 1 --2- 172.21.15.29:0/1050592365 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f111806aed0 0x7f111806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:30.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.700+0000 7f112ffff640 1 --2- 172.21.15.29:0/1050592365 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f111806aed0 0x7f111806d390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1120036000 tx=0x7f112003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:30.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.704+0000 7f1134ff9640 1 -- 172.21.15.29:0/1050592365 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f1128054b50 con 0x7f11380c50e0 2024-01-25T15:04:30.784 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-25T15:04:30.786 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-25T15:04:30.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:30.881+0000 7f113daca640 1 -- 172.21.15.29:0/1050592365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f11380c6320 con 0x7f11380c50e0 2024-01-25T15:04:31.508 INFO:tasks.ceph.mds.d.smithi052.stderr:2024-01-25T15:04:31.508+0000 7f5125937640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-25T15:04:31.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.561+0000 7f1134ff9640 1 -- 172.21.15.29:0/1050592365 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1128058170 con 0x7f11380c50e0 2024-01-25T15:04:31.563 INFO:teuthology.orchestra.run.smithi029.stderr:set pool 4 allow_ec_overwrites to true 2024-01-25T15:04:31.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.565+0000 7f113daca640 1 -- 172.21.15.29:0/1050592365 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f111806aed0 msgr2=0x7f111806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:31.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.565+0000 7f113daca640 1 --2- 172.21.15.29:0/1050592365 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f111806aed0 0x7f111806d390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1120036000 tx=0x7f112003d040 comp rx=0 tx=0).stop 2024-01-25T15:04:31.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.565+0000 7f113daca640 1 -- 172.21.15.29:0/1050592365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11380c50e0 msgr2=0x7f11381512c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:31.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.565+0000 7f113daca640 1 --2- 172.21.15.29:0/1050592365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11380c50e0 0x7f11381512c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f112800d800 tx=0x7f112800dcc0 comp rx=0 tx=0).stop 2024-01-25T15:04:31.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.567+0000 7f113daca640 1 -- 172.21.15.29:0/1050592365 shutdown_connections 2024-01-25T15:04:31.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.567+0000 7f113daca640 1 --2- 172.21.15.29:0/1050592365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1138155750 0x7f11381eaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:31.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.567+0000 7f113daca640 1 --2- 172.21.15.29:0/1050592365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1138152090 0x7f11381ea9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:31.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.567+0000 7f113daca640 1 --2- 172.21.15.29:0/1050592365 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f111806aed0 0x7f111806d390 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:31.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.567+0000 7f113daca640 1 --2- 172.21.15.29:0/1050592365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11380c50e0 0x7f11381512c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:31.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.567+0000 7f113daca640 1 -- 172.21.15.29:0/1050592365 >> 172.21.15.29:0/1050592365 conn(0x7f11380ca000 msgr2=0x7f11380ca3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:31.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.567+0000 7f113daca640 1 -- 172.21.15.29:0/1050592365 shutdown_connections 2024-01-25T15:04:31.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.569+0000 7f113daca640 1 -- 172.21.15.29:0/1050592365 wait complete. 2024-01-25T15:04:31.595 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-01-25T15:04:31.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.743+0000 7f96c2290640 1 Processor -- start 2024-01-25T15:04:31.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.743+0000 7f96c2290640 1 -- start start 2024-01-25T15:04:31.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.743+0000 7f96c2290640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f96bc0af6c0 0x7f96bc0c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:31.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.743+0000 7f96c2290640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96bc0afaa0 con 0x7f96bc0c5a70 2024-01-25T15:04:31.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.743+0000 7f96c2290640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96bc0c6060 con 0x7f96bc06d560 2024-01-25T15:04:31.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.743+0000 7f96c2290640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96bc06c480 con 0x7f96bc0af6c0 2024-01-25T15:04:31.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.744+0000 7f96bbfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f96bc0af6c0 0x7f96bc0c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:31.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.744+0000 7f96c082d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f96bc0c5a70 0x7f96bc15f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37096/0 (socket says 172.21.15.29:37096) 2024-01-25T15:04:31.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.744+0000 7f96c082d640 1 -- 172.21.15.29:0/2741602109 learned_addr learned my addr 172.21.15.29:0/2741602109 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:31.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.744+0000 7f96baffd640 1 -- 172.21.15.29:0/2741602109 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 284292092 0 0) 0x7f96bc0afaa0 con 0x7f96bc0c5a70 2024-01-25T15:04:31.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.744+0000 7f96baffd640 1 -- 172.21.15.29:0/2741602109 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96a4003520 con 0x7f96bc0c5a70 2024-01-25T15:04:31.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.744+0000 7f96bbfff640 1 -- 172.21.15.29:0/2741602109 >> v1:172.21.15.52:6789/0 conn(0x7f96bc06d560 legacy=0x7f96bc06b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:31.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.744+0000 7f96bbfff640 1 -- 172.21.15.29:0/2741602109 >> v1:172.21.15.29:6789/0 conn(0x7f96bc0c5a70 legacy=0x7f96bc15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:31.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.744+0000 7f96bbfff640 1 -- 172.21.15.29:0/2741602109 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc155480 con 0x7f96bc0af6c0 2024-01-25T15:04:31.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.745+0000 7f96bbfff640 1 --2- 172.21.15.29:0/2741602109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96bc0af6c0 0x7f96bc0c5530 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f96ac0097a0 tx=0x7f96ac02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af3b2aa5ee13edc server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:31.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.745+0000 7f96baffd640 1 -- 172.21.15.29:0/2741602109 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ac030610 con 0x7f96bc0af6c0 2024-01-25T15:04:31.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.745+0000 7f96baffd640 1 -- 172.21.15.29:0/2741602109 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ac030770 con 0x7f96bc0af6c0 2024-01-25T15:04:31.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.745+0000 7f96baffd640 1 -- 172.21.15.29:0/2741602109 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ac030b00 con 0x7f96bc0af6c0 2024-01-25T15:04:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.745+0000 7f96c2290640 1 -- 172.21.15.29:0/2741602109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96bc0af6c0 msgr2=0x7f96bc0c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.745+0000 7f96c2290640 1 --2- 172.21.15.29:0/2741602109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96bc0af6c0 0x7f96bc0c5530 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f96ac0097a0 tx=0x7f96ac02b960 comp rx=0 tx=0).stop 2024-01-25T15:04:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.745+0000 7f96c2290640 1 -- 172.21.15.29:0/2741602109 shutdown_connections 2024-01-25T15:04:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.745+0000 7f96c2290640 1 --2- 172.21.15.29:0/2741602109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96bc0af6c0 0x7f96bc0c5530 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:31.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.745+0000 7f96c2290640 1 -- 172.21.15.29:0/2741602109 >> 172.21.15.29:0/2741602109 conn(0x7f96bc0c6ca0 msgr2=0x7f96bc0c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:31.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.745+0000 7f96c2290640 1 -- 172.21.15.29:0/2741602109 shutdown_connections 2024-01-25T15:04:31.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.745+0000 7f96c2290640 1 -- 172.21.15.29:0/2741602109 wait complete. 2024-01-25T15:04:31.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.746+0000 7f96c2290640 1 Processor -- start 2024-01-25T15:04:31.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.747+0000 7f96c2290640 1 -- start start 2024-01-25T15:04:31.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.747+0000 7f96c2290640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96bc06d560 0x7f96bc0c2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:31.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.747+0000 7f96c2290640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96bc0af6c0 0x7f96bc0c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:31.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.747+0000 7f96c2290640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96bc0c5a70 0x7f96bc1508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:31.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.747+0000 7f96c2290640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc0c31b0 con 0x7f96bc0c5a70 2024-01-25T15:04:31.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.747+0000 7f96c2290640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc151af0 con 0x7f96bc06d560 2024-01-25T15:04:31.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.747+0000 7f96c2290640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc157100 con 0x7f96bc0af6c0 2024-01-25T15:04:31.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.747+0000 7f96c082d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96bc0c5a70 0x7f96bc1508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:31.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.747+0000 7f96c082d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96bc0c5a70 0x7f96bc1508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55682/0 (socket says 172.21.15.29:55682) 2024-01-25T15:04:31.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.747+0000 7f96c082d640 1 -- 172.21.15.29:0/1218584821 learned_addr learned my addr 172.21.15.29:0/1218584821 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:31.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.748+0000 7f96bbfff640 1 --2- 172.21.15.29:0/1218584821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96bc06d560 0x7f96bc0c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:31.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.748+0000 7f96bb7fe640 1 --2- 172.21.15.29:0/1218584821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96bc0af6c0 0x7f96bc0c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:31.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.748+0000 7f96c082d640 1 -- 172.21.15.29:0/1218584821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96bc0af6c0 msgr2=0x7f96bc0c3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:31.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.748+0000 7f96c082d640 1 --2- 172.21.15.29:0/1218584821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96bc0af6c0 0x7f96bc0c3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:31.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.748+0000 7f96c082d640 1 -- 172.21.15.29:0/1218584821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96bc06d560 msgr2=0x7f96bc0c2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:31.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.748+0000 7f96c082d640 1 --2- 172.21.15.29:0/1218584821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96bc06d560 0x7f96bc0c2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:31.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.748+0000 7f96c082d640 1 -- 172.21.15.29:0/1218584821 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ac009400 con 0x7f96bc0c5a70 2024-01-25T15:04:31.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.748+0000 7f96c082d640 1 --2- 172.21.15.29:0/1218584821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96bc0c5a70 0x7f96bc1508e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f96b400ca70 tx=0x7f96b400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:31.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.748+0000 7f96b8ff9640 1 -- 172.21.15.29:0/1218584821 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b400abd0 con 0x7f96bc0c5a70 2024-01-25T15:04:31.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.748+0000 7f96b8ff9640 1 -- 172.21.15.29:0/1218584821 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b400ad30 con 0x7f96bc0c5a70 2024-01-25T15:04:31.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.748+0000 7f96c2290640 1 -- 172.21.15.29:0/1218584821 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96bc1573e0 con 0x7f96bc0c5a70 2024-01-25T15:04:31.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.748+0000 7f96b8ff9640 1 -- 172.21.15.29:0/1218584821 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b4012600 con 0x7f96bc0c5a70 2024-01-25T15:04:31.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.748+0000 7f96c2290640 1 -- 172.21.15.29:0/1218584821 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96bc1582b0 con 0x7f96bc0c5a70 2024-01-25T15:04:31.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.749+0000 7f96c2290640 1 -- 172.21.15.29:0/1218584821 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96bc1584a0 con 0x7f96bc0c5a70 2024-01-25T15:04:31.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.750+0000 7f96b8ff9640 1 -- 172.21.15.29:0/1218584821 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f96b4007070 con 0x7f96bc0c5a70 2024-01-25T15:04:31.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.750+0000 7f96b8ff9640 1 --2- 172.21.15.29:0/1218584821 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f96a806aed0 0x7f96a806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:31.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.750+0000 7f96b8ff9640 1 -- 172.21.15.29:0/1218584821 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f96b40897c0 con 0x7f96bc0c5a70 2024-01-25T15:04:31.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.750+0000 7f96bbfff640 1 --2- 172.21.15.29:0/1218584821 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f96a806aed0 0x7f96a806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:31.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.751+0000 7f96bbfff640 1 --2- 172.21.15.29:0/1218584821 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f96a806aed0 0x7f96a806d390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f96ac036000 tx=0x7f96ac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:31.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.754+0000 7f96b8ff9640 1 -- 172.21.15.29:0/1218584821 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f96b4054470 con 0x7f96bc0c5a70 2024-01-25T15:04:31.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:31.976+0000 7f96c2290640 1 -- 172.21.15.29:0/1218584821 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f96bc074010 con 0x7f96bc0c5a70 2024-01-25T15:04:32.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.563+0000 7f96b8ff9640 1 -- 172.21.15.29:0/1218584821 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f96b4057a90 con 0x7f96bc0c5a70 2024-01-25T15:04:32.565 INFO:teuthology.orchestra.run.smithi029.stderr:added data pool 4 to fsmap 2024-01-25T15:04:32.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.565+0000 7f96c2290640 1 -- 172.21.15.29:0/1218584821 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f96a806aed0 msgr2=0x7f96a806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:32.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.565+0000 7f96c2290640 1 --2- 172.21.15.29:0/1218584821 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f96a806aed0 0x7f96a806d390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f96ac036000 tx=0x7f96ac008030 comp rx=0 tx=0).stop 2024-01-25T15:04:32.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.565+0000 7f96c2290640 1 -- 172.21.15.29:0/1218584821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96bc0c5a70 msgr2=0x7f96bc1508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:32.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.565+0000 7f96c2290640 1 --2- 172.21.15.29:0/1218584821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96bc0c5a70 0x7f96bc1508e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f96b400ca70 tx=0x7f96b400cf30 comp rx=0 tx=0).stop 2024-01-25T15:04:32.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.566+0000 7f96c2290640 1 -- 172.21.15.29:0/1218584821 shutdown_connections 2024-01-25T15:04:32.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.566+0000 7f96c2290640 1 --2- 172.21.15.29:0/1218584821 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f96a806aed0 0x7f96a806d390 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:32.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.566+0000 7f96c2290640 1 --2- 172.21.15.29:0/1218584821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96bc0c5a70 0x7f96bc1508e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:32.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.566+0000 7f96c2290640 1 --2- 172.21.15.29:0/1218584821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f96bc0af6c0 0x7f96bc0c3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:32.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.566+0000 7f96c2290640 1 --2- 172.21.15.29:0/1218584821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96bc06d560 0x7f96bc0c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:32.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.566+0000 7f96c2290640 1 -- 172.21.15.29:0/1218584821 >> 172.21.15.29:0/1218584821 conn(0x7f96bc0c6ca0 msgr2=0x7f96bc0aaf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:32.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.566+0000 7f96c2290640 1 -- 172.21.15.29:0/1218584821 shutdown_connections 2024-01-25T15:04:32.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.566+0000 7f96c2290640 1 -- 172.21.15.29:0/1218584821 wait complete. 2024-01-25T15:04:32.581 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:04:32.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.687+0000 7f4d80e0e640 1 Processor -- start 2024-01-25T15:04:32.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.687+0000 7f4d80e0e640 1 -- start start 2024-01-25T15:04:32.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.687+0000 7f4d80e0e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d7c152160 0x7f4d7c06bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:32.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.687+0000 7f4d80e0e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7c155430 con 0x7f4d7c0c4990 2024-01-25T15:04:32.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.687+0000 7f4d80e0e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7c154b40 con 0x7f4d7c0c7f10 2024-01-25T15:04:32.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.687+0000 7f4d80e0e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c152540 con 0x7f4d7c152160 2024-01-25T15:04:32.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.687+0000 7f4d73fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4d7c0c4990 0x7f4d7c0c4ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37102/0 (socket says 172.21.15.29:37102) 2024-01-25T15:04:32.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.687+0000 7f4d73fff640 1 -- 172.21.15.29:0/1063503567 learned_addr learned my addr 172.21.15.29:0/1063503567 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:32.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.688+0000 7f4d7a59c640 1 --2- 172.21.15.29:0/1063503567 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d7c152160 0x7f4d7c06bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:32.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.688+0000 7f4d79d9b640 1 -- 172.21.15.29:0/1063503567 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137491337 0 0) 0x7f4d7c155430 con 0x7f4d7c0c4990 2024-01-25T15:04:32.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.688+0000 7f4d79d9b640 1 -- 172.21.15.29:0/1063503567 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d68003520 con 0x7f4d7c0c4990 2024-01-25T15:04:32.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.688+0000 7f4d79d9b640 1 -- 172.21.15.29:0/1063503567 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822649562 0 0) 0x7f4d7c154b40 con 0x7f4d7c0c7f10 2024-01-25T15:04:32.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.688+0000 7f4d79d9b640 1 -- 172.21.15.29:0/1063503567 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d7c155430 con 0x7f4d7c0c7f10 2024-01-25T15:04:32.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.688+0000 7f4d7a59c640 1 -- 172.21.15.29:0/1063503567 >> v1:172.21.15.52:6789/0 conn(0x7f4d7c0c7f10 legacy=0x7f4d7c15f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:32.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.688+0000 7f4d7a59c640 1 -- 172.21.15.29:0/1063503567 >> v1:172.21.15.29:6789/0 conn(0x7f4d7c0c4990 legacy=0x7f4d7c0c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:32.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.688+0000 7f4d7a59c640 1 -- 172.21.15.29:0/1063503567 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c0c64b0 con 0x7f4d7c152160 2024-01-25T15:04:32.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.689+0000 7f4d7a59c640 1 --2- 172.21.15.29:0/1063503567 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d7c152160 0x7f4d7c06bc00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0097d0 tx=0x7f4d6c02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fb237a8dc020134 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:32.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.689+0000 7f4d79d9b640 1 -- 172.21.15.29:0/1063503567 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c031800 con 0x7f4d7c152160 2024-01-25T15:04:32.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.689+0000 7f4d79d9b640 1 -- 172.21.15.29:0/1063503567 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6c031960 con 0x7f4d7c152160 2024-01-25T15:04:32.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.689+0000 7f4d79d9b640 1 -- 172.21.15.29:0/1063503567 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c031cf0 con 0x7f4d7c152160 2024-01-25T15:04:32.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.689+0000 7f4d80e0e640 1 -- 172.21.15.29:0/1063503567 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d7c152160 msgr2=0x7f4d7c06bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:32.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.689+0000 7f4d80e0e640 1 --2- 172.21.15.29:0/1063503567 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d7c152160 0x7f4d7c06bc00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0097d0 tx=0x7f4d6c02b8a0 comp rx=0 tx=0).stop 2024-01-25T15:04:32.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.689+0000 7f4d80e0e640 1 -- 172.21.15.29:0/1063503567 shutdown_connections 2024-01-25T15:04:32.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.690+0000 7f4d80e0e640 1 --2- 172.21.15.29:0/1063503567 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d7c152160 0x7f4d7c06bc00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:32.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.690+0000 7f4d80e0e640 1 -- 172.21.15.29:0/1063503567 >> 172.21.15.29:0/1063503567 conn(0x7f4d7c0ca1f0 msgr2=0x7f4d7c0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:32.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.690+0000 7f4d80e0e640 1 -- 172.21.15.29:0/1063503567 shutdown_connections 2024-01-25T15:04:32.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.690+0000 7f4d80e0e640 1 -- 172.21.15.29:0/1063503567 wait complete. 2024-01-25T15:04:32.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d80e0e640 1 Processor -- start 2024-01-25T15:04:32.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d80e0e640 1 -- start start 2024-01-25T15:04:32.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d80e0e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d7c0c4990 0x7f4d7c1eaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:32.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d80e0e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d7c0c7f10 0x7f4d7c1eaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:32.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d80e0e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d7c152160 0x7f4d7c0c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:32.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d80e0e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c1567d0 con 0x7f4d7c0c4990 2024-01-25T15:04:32.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d80e0e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c156f70 con 0x7f4d7c152160 2024-01-25T15:04:32.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d80e0e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0c1860 con 0x7f4d7c0c7f10 2024-01-25T15:04:32.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d7a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d7c0c4990 0x7f4d7c1eaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:32.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d7a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d7c0c4990 0x7f4d7c1eaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55696/0 (socket says 172.21.15.29:55696) 2024-01-25T15:04:32.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d7a59c640 1 -- 172.21.15.29:0/234859240 learned_addr learned my addr 172.21.15.29:0/234859240 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:32.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d73fff640 1 --2- 172.21.15.29:0/234859240 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d7c0c7f10 0x7f4d7c1eaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:32.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d7ad9d640 1 --2- 172.21.15.29:0/234859240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d7c152160 0x7f4d7c0c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:32.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d7a59c640 1 -- 172.21.15.29:0/234859240 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d7c0c7f10 msgr2=0x7f4d7c1eaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:32.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d7a59c640 1 --2- 172.21.15.29:0/234859240 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d7c0c7f10 0x7f4d7c1eaff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:32.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d7a59c640 1 -- 172.21.15.29:0/234859240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d7c152160 msgr2=0x7f4d7c0c1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:32.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d7a59c640 1 --2- 172.21.15.29:0/234859240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d7c152160 0x7f4d7c0c1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:32.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d7a59c640 1 -- 172.21.15.29:0/234859240 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c009400 con 0x7f4d7c0c4990 2024-01-25T15:04:32.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d7a59c640 1 --2- 172.21.15.29:0/234859240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d7c0c4990 0x7f4d7c1eaab0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c000c00 tx=0x7f4d6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:32.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d72ffd640 1 -- 172.21.15.29:0/234859240 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c03ac60 con 0x7f4d7c0c4990 2024-01-25T15:04:32.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d72ffd640 1 -- 172.21.15.29:0/234859240 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6c03adc0 con 0x7f4d7c0c4990 2024-01-25T15:04:32.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d80e0e640 1 -- 172.21.15.29:0/234859240 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7c1569b0 con 0x7f4d7c0c4990 2024-01-25T15:04:32.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d72ffd640 1 -- 172.21.15.29:0/234859240 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c042630 con 0x7f4d7c0c4990 2024-01-25T15:04:32.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.692+0000 7f4d80e0e640 1 -- 172.21.15.29:0/234859240 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7c0c36c0 con 0x7f4d7c0c4990 2024-01-25T15:04:32.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.693+0000 7f4d80e0e640 1 -- 172.21.15.29:0/234859240 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7c1558c0 con 0x7f4d7c0c4990 2024-01-25T15:04:32.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.694+0000 7f4d72ffd640 1 -- 172.21.15.29:0/234859240 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4d6c04b3b0 con 0x7f4d7c0c4990 2024-01-25T15:04:32.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.694+0000 7f4d72ffd640 1 --2- 172.21.15.29:0/234859240 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4d5c06aed0 0x7f4d5c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:32.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.694+0000 7f4d72ffd640 1 -- 172.21.15.29:0/234859240 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4d6c02e070 con 0x7f4d7c0c4990 2024-01-25T15:04:32.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.694+0000 7f4d73fff640 1 --2- 172.21.15.29:0/234859240 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4d5c06aed0 0x7f4d5c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:32.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.695+0000 7f4d73fff640 1 --2- 172.21.15.29:0/234859240 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4d5c06aed0 0x7f4d5c06d390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c150c00 tx=0x7f4d64007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:32.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.699+0000 7f4d72ffd640 1 -- 172.21.15.29:0/234859240 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4d6c076470 con 0x7f4d7c0c4990 2024-01-25T15:04:32.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.914+0000 7f4d80e0e640 1 -- 172.21.15.29:0/234859240 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d7c0737f0 con 0x7f4d7c0c4990 2024-01-25T15:04:32.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.915+0000 7f4d72ffd640 1 -- 172.21.15.29:0/234859240 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4931 (secure 0 0 0) 0x7f4d6c006e10 con 0x7f4d7c0c4990 2024-01-25T15:04:32.917 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:32.917 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6836/2584242962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2584242962},{"type":"v1","addr":"172.21.15.52:6836","nonce":2584242962}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1800543981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1800543981},{"type":"v1","addr":"172.21.15.29:6834","nonce":1800543981}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3686497601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3686497601},{"type":"v1","addr":"172.21.15.29:6835","nonce":3686497601}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:04:26.896909+0000","modified":"2024-01-25T15:04:31.979031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6837/417879912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6835","nonce":417879912},{"type":"v1","addr":"172.21.15.52:6837","nonce":417879912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-01-25T15:04:32.917 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 7 2024-01-25T15:04:32.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.917+0000 7f4d80e0e640 1 -- 172.21.15.29:0/234859240 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4d5c06aed0 msgr2=0x7f4d5c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:32.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.917+0000 7f4d80e0e640 1 --2- 172.21.15.29:0/234859240 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4d5c06aed0 0x7f4d5c06d390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c150c00 tx=0x7f4d64007d50 comp rx=0 tx=0).stop 2024-01-25T15:04:32.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.917+0000 7f4d80e0e640 1 -- 172.21.15.29:0/234859240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d7c0c4990 msgr2=0x7f4d7c1eaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:32.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.917+0000 7f4d80e0e640 1 --2- 172.21.15.29:0/234859240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d7c0c4990 0x7f4d7c1eaab0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c000c00 tx=0x7f4d6c0046c0 comp rx=0 tx=0).stop 2024-01-25T15:04:32.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.917+0000 7f4d80e0e640 1 -- 172.21.15.29:0/234859240 shutdown_connections 2024-01-25T15:04:32.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.917+0000 7f4d80e0e640 1 --2- 172.21.15.29:0/234859240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d7c152160 0x7f4d7c0c1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:32.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.917+0000 7f4d80e0e640 1 --2- 172.21.15.29:0/234859240 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d7c0c7f10 0x7f4d7c1eaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:32.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.917+0000 7f4d80e0e640 1 --2- 172.21.15.29:0/234859240 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4d5c06aed0 0x7f4d5c06d390 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:32.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.917+0000 7f4d80e0e640 1 --2- 172.21.15.29:0/234859240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d7c0c4990 0x7f4d7c1eaab0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:32.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.917+0000 7f4d80e0e640 1 -- 172.21.15.29:0/234859240 >> 172.21.15.29:0/234859240 conn(0x7f4d7c0ca1f0 msgr2=0x7f4d7c0a9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:32.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.917+0000 7f4d80e0e640 1 -- 172.21.15.29:0/234859240 shutdown_connections 2024-01-25T15:04:32.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:32.917+0000 7f4d80e0e640 1 -- 172.21.15.29:0/234859240 wait complete. 2024-01-25T15:04:32.929 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:04:33.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.029+0000 7f0915a56640 1 Processor -- start 2024-01-25T15:04:33.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.029+0000 7f0915a56640 1 -- start start 2024-01-25T15:04:33.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.030+0000 7f0915a56640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f09100ad030 0x7f0910155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:33.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.030+0000 7f0915a56640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0910152140 con 0x7f0910151d60 2024-01-25T15:04:33.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.030+0000 7f0915a56640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09100c9ae0 con 0x7f0910155010 2024-01-25T15:04:33.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.030+0000 7f0915a56640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09100c9520 con 0x7f09100ad030 2024-01-25T15:04:33.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.030+0000 7f090e7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f09100ad030 0x7f0910155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:33.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.030+0000 7f090effd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0910151d60 0x7f0910158690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37104/0 (socket says 172.21.15.29:37104) 2024-01-25T15:04:33.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.030+0000 7f090effd640 1 -- 172.21.15.29:0/888717556 learned_addr learned my addr 172.21.15.29:0/888717556 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:33.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.030+0000 7f090e7fc640 1 -- 172.21.15.29:0/888717556 >> v1:172.21.15.52:6789/0 conn(0x7f0910155010 legacy=0x7f09100ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:33.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.030+0000 7f090e7fc640 1 -- 172.21.15.29:0/888717556 >> v1:172.21.15.29:6789/0 conn(0x7f0910151d60 legacy=0x7f0910158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:33.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.030+0000 7f090e7fc640 1 -- 172.21.15.29:0/888717556 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09100c9800 con 0x7f09100ad030 2024-01-25T15:04:33.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.031+0000 7f090e7fc640 1 --2- 172.21.15.29:0/888717556 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09100ad030 0x7f0910155b80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f09040097a0 tx=0x7f090402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6376b666810728 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:33.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.031+0000 7f090dffb640 1 -- 172.21.15.29:0/888717556 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0904031830 con 0x7f09100ad030 2024-01-25T15:04:33.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.031+0000 7f090dffb640 1 -- 172.21.15.29:0/888717556 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0904031990 con 0x7f09100ad030 2024-01-25T15:04:33.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.031+0000 7f090dffb640 1 -- 172.21.15.29:0/888717556 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0904031d20 con 0x7f09100ad030 2024-01-25T15:04:33.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.032+0000 7f0915a56640 1 -- 172.21.15.29:0/888717556 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09100ad030 msgr2=0x7f0910155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:33.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.032+0000 7f0915a56640 1 --2- 172.21.15.29:0/888717556 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09100ad030 0x7f0910155b80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f09040097a0 tx=0x7f090402b8d0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.032+0000 7f0915a56640 1 -- 172.21.15.29:0/888717556 shutdown_connections 2024-01-25T15:04:33.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.032+0000 7f0915a56640 1 --2- 172.21.15.29:0/888717556 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09100ad030 0x7f0910155b80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.032+0000 7f0915a56640 1 -- 172.21.15.29:0/888717556 >> 172.21.15.29:0/888717556 conn(0x7f0910072420 msgr2=0x7f09100abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:33.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.032+0000 7f0915a56640 1 -- 172.21.15.29:0/888717556 shutdown_connections 2024-01-25T15:04:33.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.032+0000 7f0915a56640 1 -- 172.21.15.29:0/888717556 wait complete. 2024-01-25T15:04:33.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.033+0000 7f0915a56640 1 Processor -- start 2024-01-25T15:04:33.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.033+0000 7f0915a56640 1 -- start start 2024-01-25T15:04:33.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.034+0000 7f0915a56640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09100ad030 0x7f091014bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:33.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.034+0000 7f0915a56640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0910151d60 0x7f09101ed9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:33.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.034+0000 7f0915a56640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0910155010 0x7f09101edf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:33.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.034+0000 7f0915a56640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091014cee0 con 0x7f09100ad030 2024-01-25T15:04:33.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.034+0000 7f0915a56640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091006c850 con 0x7f0910151d60 2024-01-25T15:04:33.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.034+0000 7f0915a56640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09101ea0c0 con 0x7f0910155010 2024-01-25T15:04:33.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.034+0000 7f090effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09100ad030 0x7f091014bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:33.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.034+0000 7f090effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09100ad030 0x7f091014bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55712/0 (socket says 172.21.15.29:55712) 2024-01-25T15:04:33.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.034+0000 7f090effd640 1 -- 172.21.15.29:0/4025780050 learned_addr learned my addr 172.21.15.29:0/4025780050 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:33.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.034+0000 7f090e7fc640 1 --2- 172.21.15.29:0/4025780050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0910151d60 0x7f09101ed9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:33.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.034+0000 7f090f7fe640 1 --2- 172.21.15.29:0/4025780050 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0910155010 0x7f09101edf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:33.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.034+0000 7f090effd640 1 -- 172.21.15.29:0/4025780050 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0910155010 msgr2=0x7f09101edf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:33.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.034+0000 7f090effd640 1 --2- 172.21.15.29:0/4025780050 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0910155010 0x7f09101edf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.034+0000 7f090effd640 1 -- 172.21.15.29:0/4025780050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0910151d60 msgr2=0x7f09101ed9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:33.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.034+0000 7f090effd640 1 --2- 172.21.15.29:0/4025780050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0910151d60 0x7f09101ed9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.034+0000 7f090effd640 1 -- 172.21.15.29:0/4025780050 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0904009400 con 0x7f09100ad030 2024-01-25T15:04:33.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.034+0000 7f090f7fe640 1 --2- 172.21.15.29:0/4025780050 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0910155010 0x7f09101edf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:33.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.034+0000 7f090effd640 1 --2- 172.21.15.29:0/4025780050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09100ad030 0x7f091014bf80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f090000cb10 tx=0x7f090000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:33.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.034+0000 7f08f7fff640 1 -- 172.21.15.29:0/4025780050 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090000ac70 con 0x7f09100ad030 2024-01-25T15:04:33.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.034+0000 7f08f7fff640 1 -- 172.21.15.29:0/4025780050 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090000add0 con 0x7f09100ad030 2024-01-25T15:04:33.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.035+0000 7f08f7fff640 1 -- 172.21.15.29:0/4025780050 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0900012620 con 0x7f09100ad030 2024-01-25T15:04:33.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.035+0000 7f0915a56640 1 -- 172.21.15.29:0/4025780050 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f091006ca80 con 0x7f09100ad030 2024-01-25T15:04:33.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.035+0000 7f0915a56640 1 -- 172.21.15.29:0/4025780050 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091006d040 con 0x7f09100ad030 2024-01-25T15:04:33.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.036+0000 7f0915a56640 1 -- 172.21.15.29:0/4025780050 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09100c9c90 con 0x7f09100ad030 2024-01-25T15:04:33.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.036+0000 7f08f7fff640 1 -- 172.21.15.29:0/4025780050 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0900007070 con 0x7f09100ad030 2024-01-25T15:04:33.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.036+0000 7f08f7fff640 1 --2- 172.21.15.29:0/4025780050 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f08fc06aed0 0x7f08fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:33.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.036+0000 7f08f7fff640 1 -- 172.21.15.29:0/4025780050 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0900089850 con 0x7f09100ad030 2024-01-25T15:04:33.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.036+0000 7f090e7fc640 1 --2- 172.21.15.29:0/4025780050 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f08fc06aed0 0x7f08fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:33.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.037+0000 7f090e7fc640 1 --2- 172.21.15.29:0/4025780050 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f08fc06aed0 0x7f08fc06d390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0904036000 tx=0x7f090403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:33.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.041+0000 7f08f7fff640 1 -- 172.21.15.29:0/4025780050 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f09000544e0 con 0x7f09100ad030 2024-01-25T15:04:33.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.221+0000 7f0915a56640 1 -- 172.21.15.29:0/4025780050 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0910074080 con 0x7f09100ad030 2024-01-25T15:04:33.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.223+0000 7f08f7fff640 1 -- 172.21.15.29:0/4025780050 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18311 (secure 0 0 0) 0x7f0900017090 con 0x7f09100ad030 2024-01-25T15:04:33.225 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:33.225 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:31.978871+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:04:33.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.225+0000 7f0915a56640 1 -- 172.21.15.29:0/4025780050 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f08fc06aed0 msgr2=0x7f08fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:33.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.225+0000 7f0915a56640 1 --2- 172.21.15.29:0/4025780050 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f08fc06aed0 0x7f08fc06d390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0904036000 tx=0x7f090403c040 comp rx=0 tx=0).stop 2024-01-25T15:04:33.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.225+0000 7f0915a56640 1 -- 172.21.15.29:0/4025780050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09100ad030 msgr2=0x7f091014bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:33.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.225+0000 7f0915a56640 1 --2- 172.21.15.29:0/4025780050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09100ad030 0x7f091014bf80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f090000cb10 tx=0x7f090000a060 comp rx=0 tx=0).stop 2024-01-25T15:04:33.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.225+0000 7f0915a56640 1 -- 172.21.15.29:0/4025780050 shutdown_connections 2024-01-25T15:04:33.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.225+0000 7f0915a56640 1 --2- 172.21.15.29:0/4025780050 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0910155010 0x7f09101edf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.225+0000 7f0915a56640 1 --2- 172.21.15.29:0/4025780050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0910151d60 0x7f09101ed9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.225+0000 7f0915a56640 1 --2- 172.21.15.29:0/4025780050 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f08fc06aed0 0x7f08fc06d390 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.225+0000 7f0915a56640 1 --2- 172.21.15.29:0/4025780050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09100ad030 0x7f091014bf80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.225+0000 7f0915a56640 1 -- 172.21.15.29:0/4025780050 >> 172.21.15.29:0/4025780050 conn(0x7f0910072420 msgr2=0x7f0910155930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:33.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.225+0000 7f0915a56640 1 -- 172.21.15.29:0/4025780050 shutdown_connections 2024-01-25T15:04:33.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.225+0000 7f0915a56640 1 -- 172.21.15.29:0/4025780050 wait complete. 2024-01-25T15:04:33.237 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:04:33.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.337+0000 7f6920f05640 1 Processor -- start 2024-01-25T15:04:33.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.337+0000 7f6920f05640 1 -- start start 2024-01-25T15:04:33.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.337+0000 7f6920f05640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f691c1520b0 0x7f691c155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:33.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.337+0000 7f6920f05640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f691c0c66c0 con 0x7f691c0c55e0 2024-01-25T15:04:33.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.337+0000 7f6920f05640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f691c06cfc0 con 0x7f691c0c4f00 2024-01-25T15:04:33.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.337+0000 7f6920f05640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f691c152490 con 0x7f691c1520b0 2024-01-25T15:04:33.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.338+0000 7f6919d9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f691c0c55e0 0x7f691c0c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37110/0 (socket says 172.21.15.29:37110) 2024-01-25T15:04:33.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.338+0000 7f6919d9b640 1 -- 172.21.15.29:0/1071158901 learned_addr learned my addr 172.21.15.29:0/1071158901 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:33.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.338+0000 7f691a59c640 1 --2- 172.21.15.29:0/1071158901 >> v2:172.21.15.52:3300/0 conn(0x7f691c1520b0 0x7f691c155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:33.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.338+0000 7f691959a640 1 -- 172.21.15.29:0/1071158901 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101222260 0 0) 0x7f691c0c66c0 con 0x7f691c0c55e0 2024-01-25T15:04:33.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.338+0000 7f691959a640 1 -- 172.21.15.29:0/1071158901 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6908003520 con 0x7f691c0c55e0 2024-01-25T15:04:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.338+0000 7f691959a640 1 -- 172.21.15.29:0/1071158901 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2115883785 0 0) 0x7f6908003520 con 0x7f691c0c55e0 2024-01-25T15:04:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.338+0000 7f691959a640 1 -- 172.21.15.29:0/1071158901 >> v2:172.21.15.52:3300/0 conn(0x7f691c1520b0 msgr2=0x7f691c155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.338+0000 7f691959a640 1 --2- 172.21.15.29:0/1071158901 >> v2:172.21.15.52:3300/0 conn(0x7f691c1520b0 0x7f691c155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.338+0000 7f691959a640 1 -- 172.21.15.29:0/1071158901 >> v1:172.21.15.52:6789/0 conn(0x7f691c0c4f00 legacy=0x7f691c0c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.338+0000 7f691959a640 1 -- 172.21.15.29:0/1071158901 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691c0c8830 con 0x7f691c0c55e0 2024-01-25T15:04:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.338+0000 7f691959a640 1 -- 172.21.15.29:0/1071158901 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f6904001670 con 0x7f691c0c55e0 2024-01-25T15:04:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.338+0000 7f691959a640 1 -- 172.21.15.29:0/1071158901 >> v1:172.21.15.29:6789/0 conn(0x7f691c0c55e0 legacy=0x7f691c0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.338+0000 7f691959a640 1 --2- 172.21.15.29:0/1071158901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6908003970 0x7f6908003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.338+0000 7f691959a640 1 --2- 172.21.15.29:0/1071158901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69080047c0 0x7f6908004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.338+0000 7f691959a640 1 --2- 172.21.15.29:0/1071158901 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6908005180 0x7f690800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.338+0000 7f691959a640 1 -- 172.21.15.29:0/1071158901 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c152490 con 0x7f69080047c0 2024-01-25T15:04:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.338+0000 7f691959a640 1 -- 172.21.15.29:0/1071158901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690800c120 con 0x7f6908003970 2024-01-25T15:04:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.338+0000 7f691959a640 1 -- 172.21.15.29:0/1071158901 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690800c2e0 con 0x7f6908005180 2024-01-25T15:04:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.338+0000 7f6919d9b640 1 --2- 172.21.15.29:0/1071158901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69080047c0 0x7f6908004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.338+0000 7f691a59c640 1 --2- 172.21.15.29:0/1071158901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6908003970 0x7f6908003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.338+0000 7f691ad9d640 1 --2- 172.21.15.29:0/1071158901 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6908005180 0x7f690800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.339+0000 7f6919d9b640 1 -- 172.21.15.29:0/1071158901 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6908005180 msgr2=0x7f690800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.339+0000 7f6919d9b640 1 --2- 172.21.15.29:0/1071158901 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6908005180 0x7f690800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.339+0000 7f6919d9b640 1 -- 172.21.15.29:0/1071158901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6908003970 msgr2=0x7f6908003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.339+0000 7f6919d9b640 1 --2- 172.21.15.29:0/1071158901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6908003970 0x7f6908003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.339+0000 7f6919d9b640 1 -- 172.21.15.29:0/1071158901 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6908003520 con 0x7f69080047c0 2024-01-25T15:04:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.339+0000 7f691ad9d640 1 -- 172.21.15.29:0/1071158901 reap_dead start 2024-01-25T15:04:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.339+0000 7f6919d9b640 1 --2- 172.21.15.29:0/1071158901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69080047c0 0x7f6908004c40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f690400c190 tx=0x7f69080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95fd3d267180c606 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.340+0000 7f691959a640 1 -- 172.21.15.29:0/1071158901 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6904005ad0 con 0x7f69080047c0 2024-01-25T15:04:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.340+0000 7f691959a640 1 -- 172.21.15.29:0/1071158901 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6904005c30 con 0x7f69080047c0 2024-01-25T15:04:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.340+0000 7f691959a640 1 -- 172.21.15.29:0/1071158901 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690402cab0 con 0x7f69080047c0 2024-01-25T15:04:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.340+0000 7f6920f05640 1 -- 172.21.15.29:0/1071158901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69080047c0 msgr2=0x7f6908004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.340+0000 7f6920f05640 1 --2- 172.21.15.29:0/1071158901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69080047c0 0x7f6908004c40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f690400c190 tx=0x7f69080057f0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.340+0000 7f6920f05640 1 -- 172.21.15.29:0/1071158901 shutdown_connections 2024-01-25T15:04:33.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.340+0000 7f6920f05640 1 --2- 172.21.15.29:0/1071158901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69080047c0 0x7f6908004c40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.340+0000 7f6920f05640 1 -- 172.21.15.29:0/1071158901 >> 172.21.15.29:0/1071158901 conn(0x7f691c0ca220 msgr2=0x7f691c0ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:33.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.340+0000 7f6920f05640 1 -- 172.21.15.29:0/1071158901 shutdown_connections 2024-01-25T15:04:33.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.340+0000 7f6920f05640 1 -- 172.21.15.29:0/1071158901 wait complete. 2024-01-25T15:04:33.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.341+0000 7f6920f05640 1 Processor -- start 2024-01-25T15:04:33.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.341+0000 7f6920f05640 1 -- start start 2024-01-25T15:04:33.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.342+0000 7f6920f05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69080047c0 0x7f691c1478a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:33.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.342+0000 7f6920f05640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f691c0be760 0x7f691c1530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:33.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.342+0000 7f6920f05640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f691c1535e0 0x7f691c0bff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:33.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.342+0000 7f6920f05640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c158ce0 con 0x7f691c1535e0 2024-01-25T15:04:33.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.342+0000 7f6920f05640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c147de0 con 0x7f69080047c0 2024-01-25T15:04:33.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.342+0000 7f6920f05640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691c156be0 con 0x7f691c0be760 2024-01-25T15:04:33.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.342+0000 7f691ad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f691c1535e0 0x7f691c0bff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:33.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.342+0000 7f691ad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f691c1535e0 0x7f691c0bff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55726/0 (socket says 172.21.15.29:55726) 2024-01-25T15:04:33.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.342+0000 7f691ad9d640 1 -- 172.21.15.29:0/4152606728 learned_addr learned my addr 172.21.15.29:0/4152606728 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:33.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.342+0000 7f6919d9b640 1 --2- 172.21.15.29:0/4152606728 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f691c0be760 0x7f691c1530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:33.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.342+0000 7f691a59c640 1 --2- 172.21.15.29:0/4152606728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69080047c0 0x7f691c1478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:33.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.342+0000 7f691ad9d640 1 -- 172.21.15.29:0/4152606728 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f691c0be760 msgr2=0x7f691c1530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:33.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.342+0000 7f691ad9d640 1 --2- 172.21.15.29:0/4152606728 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f691c0be760 0x7f691c1530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.342+0000 7f691ad9d640 1 -- 172.21.15.29:0/4152606728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69080047c0 msgr2=0x7f691c1478a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:33.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.342+0000 7f691ad9d640 1 --2- 172.21.15.29:0/4152606728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69080047c0 0x7f691c1478a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.342+0000 7f691ad9d640 1 -- 172.21.15.29:0/4152606728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691c156ec0 con 0x7f691c1535e0 2024-01-25T15:04:33.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.343+0000 7f691ad9d640 1 --2- 172.21.15.29:0/4152606728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f691c1535e0 0x7f691c0bff40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f691c06aee0 tx=0x7f691400fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:33.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.343+0000 7f6912ffd640 1 -- 172.21.15.29:0/4152606728 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914003b80 con 0x7f691c1535e0 2024-01-25T15:04:33.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.343+0000 7f6912ffd640 1 -- 172.21.15.29:0/4152606728 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6914003d00 con 0x7f691c1535e0 2024-01-25T15:04:33.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.343+0000 7f6920f05640 1 -- 172.21.15.29:0/4152606728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f691c1571a0 con 0x7f691c1535e0 2024-01-25T15:04:33.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.343+0000 7f6912ffd640 1 -- 172.21.15.29:0/4152606728 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914005310 con 0x7f691c1535e0 2024-01-25T15:04:33.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.343+0000 7f6920f05640 1 -- 172.21.15.29:0/4152606728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f691c158a50 con 0x7f691c1535e0 2024-01-25T15:04:33.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.344+0000 7f6920f05640 1 -- 172.21.15.29:0/4152606728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f691c1576c0 con 0x7f691c1535e0 2024-01-25T15:04:33.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.344+0000 7f6912ffd640 1 -- 172.21.15.29:0/4152606728 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6914005470 con 0x7f691c1535e0 2024-01-25T15:04:33.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.345+0000 7f6912ffd640 1 --2- 172.21.15.29:0/4152606728 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f68fc06aed0 0x7f68fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:33.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.345+0000 7f6912ffd640 1 -- 172.21.15.29:0/4152606728 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6914089870 con 0x7f691c1535e0 2024-01-25T15:04:33.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.345+0000 7f691a59c640 1 --2- 172.21.15.29:0/4152606728 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f68fc06aed0 0x7f68fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:33.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.345+0000 7f691a59c640 1 --2- 172.21.15.29:0/4152606728 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f68fc06aed0 0x7f68fc06d390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f691c050350 tx=0x7f690c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:33.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.350+0000 7f6912ffd640 1 -- 172.21.15.29:0/4152606728 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f691c1576c0 con 0x7f691c1535e0 2024-01-25T15:04:33.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.529+0000 7f6920f05640 1 -- 172.21.15.29:0/4152606728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f691c1576c0 con 0x7f691c1535e0 2024-01-25T15:04:33.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.531+0000 7f6912ffd640 1 -- 172.21.15.29:0/4152606728 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18311 (secure 0 0 0) 0x7f691c1576c0 con 0x7f691c1535e0 2024-01-25T15:04:33.531 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:33.532 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:31.978871+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:04:33.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.532+0000 7f6920f05640 1 -- 172.21.15.29:0/4152606728 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f68fc06aed0 msgr2=0x7f68fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:33.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.532+0000 7f6920f05640 1 --2- 172.21.15.29:0/4152606728 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f68fc06aed0 0x7f68fc06d390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f691c050350 tx=0x7f690c008040 comp rx=0 tx=0).stop 2024-01-25T15:04:33.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.532+0000 7f6920f05640 1 -- 172.21.15.29:0/4152606728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f691c1535e0 msgr2=0x7f691c0bff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:33.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.532+0000 7f6920f05640 1 --2- 172.21.15.29:0/4152606728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f691c1535e0 0x7f691c0bff40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f691c06aee0 tx=0x7f691400fd40 comp rx=0 tx=0).stop 2024-01-25T15:04:33.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.533+0000 7f6920f05640 1 -- 172.21.15.29:0/4152606728 shutdown_connections 2024-01-25T15:04:33.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.533+0000 7f6920f05640 1 --2- 172.21.15.29:0/4152606728 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f68fc06aed0 0x7f68fc06d390 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.533+0000 7f6920f05640 1 --2- 172.21.15.29:0/4152606728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f691c1535e0 0x7f691c0bff40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.533+0000 7f6920f05640 1 --2- 172.21.15.29:0/4152606728 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f691c0be760 0x7f691c1530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.533+0000 7f6920f05640 1 --2- 172.21.15.29:0/4152606728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69080047c0 0x7f691c1478a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.533+0000 7f6920f05640 1 -- 172.21.15.29:0/4152606728 >> 172.21.15.29:0/4152606728 conn(0x7f691c0ca220 msgr2=0x7f691c152890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:33.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.533+0000 7f6920f05640 1 -- 172.21.15.29:0/4152606728 shutdown_connections 2024-01-25T15:04:33.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.533+0000 7f6920f05640 1 -- 172.21.15.29:0/4152606728 wait complete. 2024-01-25T15:04:33.559 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:04:33.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.660+0000 7f4efb9ad640 1 Processor -- start 2024-01-25T15:04:33.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.660+0000 7f4efb9ad640 1 -- start start 2024-01-25T15:04:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.661+0000 7f4efb9ad640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4ef4152160 0x7f4ef406bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.661+0000 7f4efb9ad640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4ef40c4990 0x7f4ef40c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.661+0000 7f4efb9ad640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef4155430 con 0x7f4ef40c53e0 2024-01-25T15:04:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.661+0000 7f4efb9ad640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef4154b40 con 0x7f4ef4152160 2024-01-25T15:04:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.661+0000 7f4efb9ad640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef4152540 con 0x7f4ef40c4990 2024-01-25T15:04:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.661+0000 7f4ef9749640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4ef4152160 0x7f4ef406bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.661+0000 7f4ef9749640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4ef4152160 0x7f4ef406bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55736/0 (socket says 172.21.15.29:55736) 2024-01-25T15:04:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.661+0000 7f4ef9f4a640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4ef40c53e0 0x7f4ef40c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37124/0 (socket says 172.21.15.29:37124) 2024-01-25T15:04:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.661+0000 7f4ef9749640 1 -- 172.21.15.29:0/4153854245 learned_addr learned my addr 172.21.15.29:0/4153854245 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.661+0000 7f4ef8f48640 1 --2- 172.21.15.29:0/4153854245 >> v2:172.21.15.52:3300/0 conn(0x7f4ef40c4990 0x7f4ef40c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.661+0000 7f4ef9749640 1 -- 172.21.15.29:0/4153854245 >> v2:172.21.15.52:3300/0 conn(0x7f4ef40c4990 msgr2=0x7f4ef40c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.661+0000 7f4ef9749640 1 --2- 172.21.15.29:0/4153854245 >> v2:172.21.15.52:3300/0 conn(0x7f4ef40c4990 0x7f4ef40c4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.661+0000 7f4ef9749640 1 -- 172.21.15.29:0/4153854245 >> v1:172.21.15.29:6789/0 conn(0x7f4ef40c53e0 legacy=0x7f4ef40c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.661+0000 7f4ef9749640 1 -- 172.21.15.29:0/4153854245 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef40c64b0 con 0x7f4ef4152160 2024-01-25T15:04:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.661+0000 7f4eebfff640 1 -- 172.21.15.29:0/4153854245 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420060160 0 0) 0x7f4ef4155430 con 0x7f4ef40c53e0 2024-01-25T15:04:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.662+0000 7f4ef9749640 1 --2- 172.21.15.29:0/4153854245 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ef4152160 0x7f4ef406bc00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40acaf0 tx=0x7f4ef002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d943c01a78e68682 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.662+0000 7f4eebfff640 1 -- 172.21.15.29:0/4153854245 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0031870 con 0x7f4ef4152160 2024-01-25T15:04:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.662+0000 7f4eebfff640 1 -- 172.21.15.29:0/4153854245 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef00319d0 con 0x7f4ef4152160 2024-01-25T15:04:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.662+0000 7f4eebfff640 1 -- 172.21.15.29:0/4153854245 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0031d60 con 0x7f4ef4152160 2024-01-25T15:04:33.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.662+0000 7f4efb9ad640 1 -- 172.21.15.29:0/4153854245 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ef4152160 msgr2=0x7f4ef406bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:33.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.662+0000 7f4efb9ad640 1 --2- 172.21.15.29:0/4153854245 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ef4152160 0x7f4ef406bc00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40acaf0 tx=0x7f4ef002b910 comp rx=0 tx=0).stop 2024-01-25T15:04:33.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.662+0000 7f4efb9ad640 1 -- 172.21.15.29:0/4153854245 shutdown_connections 2024-01-25T15:04:33.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.662+0000 7f4efb9ad640 1 --2- 172.21.15.29:0/4153854245 >> v2:172.21.15.52:3300/0 conn(0x7f4ef40c4990 0x7f4ef40c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.662+0000 7f4efb9ad640 1 --2- 172.21.15.29:0/4153854245 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ef4152160 0x7f4ef406bc00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.662+0000 7f4efb9ad640 1 -- 172.21.15.29:0/4153854245 >> 172.21.15.29:0/4153854245 conn(0x7f4ef40ca1f0 msgr2=0x7f4ef40ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:33.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.663+0000 7f4efb9ad640 1 -- 172.21.15.29:0/4153854245 shutdown_connections 2024-01-25T15:04:33.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.663+0000 7f4efb9ad640 1 -- 172.21.15.29:0/4153854245 wait complete. 2024-01-25T15:04:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.664+0000 7f4efb9ad640 1 Processor -- start 2024-01-25T15:04:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.664+0000 7f4efb9ad640 1 -- start start 2024-01-25T15:04:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.664+0000 7f4efb9ad640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ef40c4990 0x7f4ef40c18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.664+0000 7f4efb9ad640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ef40c53e0 0x7f4ef40c04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.664+0000 7f4efb9ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ef4152160 0x7f4ef40c0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.664+0000 7f4efb9ad640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef40bf4f0 con 0x7f4ef40c4990 2024-01-25T15:04:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.664+0000 7f4efb9ad640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef40bf700 con 0x7f4ef4152160 2024-01-25T15:04:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.664+0000 7f4efb9ad640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef40bf9e0 con 0x7f4ef40c53e0 2024-01-25T15:04:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.664+0000 7f4ef9749640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ef40c4990 0x7f4ef40c18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.664+0000 7f4ef9749640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ef40c4990 0x7f4ef40c18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55744/0 (socket says 172.21.15.29:55744) 2024-01-25T15:04:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.664+0000 7f4ef9749640 1 -- 172.21.15.29:0/2265050514 learned_addr learned my addr 172.21.15.29:0/2265050514 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.665+0000 7f4ef9f4a640 1 --2- 172.21.15.29:0/2265050514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ef4152160 0x7f4ef40c0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:33.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.665+0000 7f4ef8f48640 1 --2- 172.21.15.29:0/2265050514 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ef40c53e0 0x7f4ef40c04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:33.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.665+0000 7f4ef9749640 1 -- 172.21.15.29:0/2265050514 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ef40c53e0 msgr2=0x7f4ef40c04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:33.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.665+0000 7f4ef9749640 1 --2- 172.21.15.29:0/2265050514 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ef40c53e0 0x7f4ef40c04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.665+0000 7f4ef9749640 1 -- 172.21.15.29:0/2265050514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ef4152160 msgr2=0x7f4ef40c0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:33.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.665+0000 7f4ef9749640 1 --2- 172.21.15.29:0/2265050514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ef4152160 0x7f4ef40c0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.665+0000 7f4ef9749640 1 -- 172.21.15.29:0/2265050514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef00094d0 con 0x7f4ef40c4990 2024-01-25T15:04:33.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.665+0000 7f4ef9f4a640 1 --2- 172.21.15.29:0/2265050514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ef4152160 0x7f4ef40c0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:33.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.665+0000 7f4ef9749640 1 --2- 172.21.15.29:0/2265050514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ef40c4990 0x7f4ef40c18d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4ef002b950 tx=0x7f4ef00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:33.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.665+0000 7f4ee9ffb640 1 -- 172.21.15.29:0/2265050514 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef003abe0 con 0x7f4ef40c4990 2024-01-25T15:04:33.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.665+0000 7f4ee9ffb640 1 -- 172.21.15.29:0/2265050514 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef003ad60 con 0x7f4ef40c4990 2024-01-25T15:04:33.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.665+0000 7f4efb9ad640 1 -- 172.21.15.29:0/2265050514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef40bfcc0 con 0x7f4ef40c4990 2024-01-25T15:04:33.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.665+0000 7f4ee9ffb640 1 -- 172.21.15.29:0/2265050514 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0044630 con 0x7f4ef40c4990 2024-01-25T15:04:33.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.665+0000 7f4efb9ad640 1 -- 172.21.15.29:0/2265050514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef40c1e10 con 0x7f4ef40c4990 2024-01-25T15:04:33.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.666+0000 7f4efb9ad640 1 -- 172.21.15.29:0/2265050514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef40c01e0 con 0x7f4ef40c4990 2024-01-25T15:04:33.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.666+0000 7f4ee9ffb640 1 -- 172.21.15.29:0/2265050514 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4ef004d450 con 0x7f4ef40c4990 2024-01-25T15:04:33.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.667+0000 7f4ee9ffb640 1 --2- 172.21.15.29:0/2265050514 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4ed806af00 0x7f4ed806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:33.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.667+0000 7f4ee9ffb640 1 -- 172.21.15.29:0/2265050514 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4ef002d040 con 0x7f4ef40c4990 2024-01-25T15:04:33.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.667+0000 7f4ef8f48640 1 --2- 172.21.15.29:0/2265050514 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4ed806af00 0x7f4ed806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:33.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.668+0000 7f4ef8f48640 1 --2- 172.21.15.29:0/2265050514 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4ed806af00 0x7f4ed806d3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4ef414f730 tx=0x7f4ee4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:33.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.671+0000 7f4ee9ffb640 1 -- 172.21.15.29:0/2265050514 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4ef40c01e0 con 0x7f4ef40c4990 2024-01-25T15:04:33.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.891+0000 7f4efb9ad640 1 -- 172.21.15.29:0/2265050514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ef40c01e0 con 0x7f4ef40c4990 2024-01-25T15:04:33.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.891+0000 7f4ee9ffb640 1 -- 172.21.15.29:0/2265050514 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4931 (secure 0 0 0) 0x7f4ef40c01e0 con 0x7f4ef40c4990 2024-01-25T15:04:33.892 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:33.893 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6836/2584242962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2584242962},{"type":"v1","addr":"172.21.15.52:6836","nonce":2584242962}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1800543981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1800543981},{"type":"v1","addr":"172.21.15.29:6834","nonce":1800543981}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3686497601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3686497601},{"type":"v1","addr":"172.21.15.29:6835","nonce":3686497601}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:04:26.896909+0000","modified":"2024-01-25T15:04:31.979031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6837/417879912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6835","nonce":417879912},{"type":"v1","addr":"172.21.15.52:6837","nonce":417879912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-01-25T15:04:33.893 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 7 2024-01-25T15:04:33.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.894+0000 7f4efb9ad640 1 -- 172.21.15.29:0/2265050514 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4ed806af00 msgr2=0x7f4ed806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:33.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.894+0000 7f4efb9ad640 1 --2- 172.21.15.29:0/2265050514 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4ed806af00 0x7f4ed806d3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4ef414f730 tx=0x7f4ee4008040 comp rx=0 tx=0).stop 2024-01-25T15:04:33.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.894+0000 7f4efb9ad640 1 -- 172.21.15.29:0/2265050514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ef40c4990 msgr2=0x7f4ef40c18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:33.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.894+0000 7f4efb9ad640 1 --2- 172.21.15.29:0/2265050514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ef40c4990 0x7f4ef40c18d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4ef002b950 tx=0x7f4ef00046c0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.894+0000 7f4efb9ad640 1 -- 172.21.15.29:0/2265050514 shutdown_connections 2024-01-25T15:04:33.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.894+0000 7f4efb9ad640 1 --2- 172.21.15.29:0/2265050514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ef4152160 0x7f4ef40c0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.894+0000 7f4efb9ad640 1 --2- 172.21.15.29:0/2265050514 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ef40c53e0 0x7f4ef40c04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.894+0000 7f4efb9ad640 1 --2- 172.21.15.29:0/2265050514 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4ed806af00 0x7f4ed806d3c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.894+0000 7f4efb9ad640 1 --2- 172.21.15.29:0/2265050514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ef40c4990 0x7f4ef40c18d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:33.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.894+0000 7f4efb9ad640 1 -- 172.21.15.29:0/2265050514 >> 172.21.15.29:0/2265050514 conn(0x7f4ef40ca1f0 msgr2=0x7f4ef4154310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:33.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.894+0000 7f4efb9ad640 1 -- 172.21.15.29:0/2265050514 shutdown_connections 2024-01-25T15:04:33.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:33.894+0000 7f4efb9ad640 1 -- 172.21.15.29:0/2265050514 wait complete. 2024-01-25T15:04:33.905 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:04:34.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.005+0000 7fbda7301640 1 Processor -- start 2024-01-25T15:04:34.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.005+0000 7fbda7301640 1 -- start start 2024-01-25T15:04:34.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.006+0000 7fbda7301640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbda006d500 0x7fbda00a8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.006+0000 7fbda7301640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda00c2460 con 0x7fbda00c2f00 2024-01-25T15:04:34.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.006+0000 7fbda7301640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda0155600 con 0x7fbda014b4c0 2024-01-25T15:04:34.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.006+0000 7fbda7301640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda014b8a0 con 0x7fbda006d500 2024-01-25T15:04:34.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.006+0000 7fbda589e640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbda00c2f00 0x7fbda0154910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37134/0 (socket says 172.21.15.29:37134) 2024-01-25T15:04:34.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.006+0000 7fbda589e640 1 -- 172.21.15.29:0/1308071226 learned_addr learned my addr 172.21.15.29:0/1308071226 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:34.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.006+0000 7fbd9ffff640 1 -- 172.21.15.29:0/1308071226 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681119080 0 0) 0x7fbda00c2460 con 0x7fbda00c2f00 2024-01-25T15:04:34.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.006+0000 7fbda489c640 1 --2- 172.21.15.29:0/1308071226 >> v2:172.21.15.52:3300/0 conn(0x7fbda006d500 0x7fbda00a8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.006+0000 7fbd9ffff640 1 -- 172.21.15.29:0/1308071226 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd88003520 con 0x7fbda00c2f00 2024-01-25T15:04:34.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbd9ffff640 1 -- 172.21.15.29:0/1308071226 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 852974266 0 0) 0x7fbd88003520 con 0x7fbda00c2f00 2024-01-25T15:04:34.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbd9ffff640 1 -- 172.21.15.29:0/1308071226 >> v2:172.21.15.52:3300/0 conn(0x7fbda006d500 msgr2=0x7fbda00a8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:34.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbd9ffff640 1 --2- 172.21.15.29:0/1308071226 >> v2:172.21.15.52:3300/0 conn(0x7fbda006d500 0x7fbda00a8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbd9ffff640 1 -- 172.21.15.29:0/1308071226 >> v1:172.21.15.52:6789/0 conn(0x7fbda014b4c0 legacy=0x7fbda006e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:34.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbd9ffff640 1 -- 172.21.15.29:0/1308071226 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda00c2700 con 0x7fbda00c2f00 2024-01-25T15:04:34.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbd9ffff640 1 -- 172.21.15.29:0/1308071226 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7fbd98001670 con 0x7fbda00c2f00 2024-01-25T15:04:34.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbd9ffff640 1 -- 172.21.15.29:0/1308071226 >> v1:172.21.15.29:6789/0 conn(0x7fbda00c2f00 legacy=0x7fbda0154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:34.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbd9ffff640 1 --2- 172.21.15.29:0/1308071226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd88003970 0x7fbd88003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbd9ffff640 1 --2- 172.21.15.29:0/1308071226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd880047c0 0x7fbd88004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbd9ffff640 1 --2- 172.21.15.29:0/1308071226 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd88005180 0x7fbd8800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbd9ffff640 1 -- 172.21.15.29:0/1308071226 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda014b8a0 con 0x7fbd88003970 2024-01-25T15:04:34.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbd9ffff640 1 -- 172.21.15.29:0/1308071226 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8800c120 con 0x7fbd880047c0 2024-01-25T15:04:34.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbd9ffff640 1 -- 172.21.15.29:0/1308071226 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8800e4f0 con 0x7fbd88005180 2024-01-25T15:04:34.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbda509d640 1 --2- 172.21.15.29:0/1308071226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd88003970 0x7fbd88003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbda489c640 1 --2- 172.21.15.29:0/1308071226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd880047c0 0x7fbd88004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbda589e640 1 --2- 172.21.15.29:0/1308071226 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd88005180 0x7fbd8800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbda509d640 1 -- 172.21.15.29:0/1308071226 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd88005180 msgr2=0x7fbd8800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:34.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbda509d640 1 --2- 172.21.15.29:0/1308071226 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd88005180 0x7fbd8800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbda509d640 1 -- 172.21.15.29:0/1308071226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd880047c0 msgr2=0x7fbd88004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:34.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbda509d640 1 --2- 172.21.15.29:0/1308071226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd880047c0 0x7fbd88004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbda509d640 1 -- 172.21.15.29:0/1308071226 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd88003520 con 0x7fbd88003970 2024-01-25T15:04:34.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbda589e640 1 --2- 172.21.15.29:0/1308071226 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd88005180 0x7fbd8800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:34.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.007+0000 7fbda589e640 1 -- 172.21.15.29:0/1308071226 reap_dead start 2024-01-25T15:04:34.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.008+0000 7fbda509d640 1 --2- 172.21.15.29:0/1308071226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd88003970 0x7fbd88003d90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbd90001e50 tx=0x7fbd880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78db411ba1b3ea4f server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:34.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.008+0000 7fbd9ffff640 1 -- 172.21.15.29:0/1308071226 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90003b70 con 0x7fbd88003970 2024-01-25T15:04:34.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.008+0000 7fbd9ffff640 1 -- 172.21.15.29:0/1308071226 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd90003cd0 con 0x7fbd88003970 2024-01-25T15:04:34.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.008+0000 7fbd9ffff640 1 -- 172.21.15.29:0/1308071226 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90005310 con 0x7fbd88003970 2024-01-25T15:04:34.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.008+0000 7fbda7301640 1 -- 172.21.15.29:0/1308071226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd88003970 msgr2=0x7fbd88003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:34.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.008+0000 7fbda7301640 1 --2- 172.21.15.29:0/1308071226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd88003970 0x7fbd88003d90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbd90001e50 tx=0x7fbd880057f0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.009+0000 7fbda7301640 1 -- 172.21.15.29:0/1308071226 shutdown_connections 2024-01-25T15:04:34.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.009+0000 7fbda7301640 1 --2- 172.21.15.29:0/1308071226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd88003970 0x7fbd88003d90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.009+0000 7fbda7301640 1 -- 172.21.15.29:0/1308071226 >> 172.21.15.29:0/1308071226 conn(0x7fbda00c39b0 msgr2=0x7fbda00c3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:34.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.009+0000 7fbda7301640 1 -- 172.21.15.29:0/1308071226 shutdown_connections 2024-01-25T15:04:34.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.009+0000 7fbda7301640 1 -- 172.21.15.29:0/1308071226 wait complete. 2024-01-25T15:04:34.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.010+0000 7fbda7301640 1 Processor -- start 2024-01-25T15:04:34.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.010+0000 7fbda7301640 1 -- start start 2024-01-25T15:04:34.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.010+0000 7fbda7301640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd88003970 0x7fbda00c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.010+0000 7fbda7301640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbda00bc8e0 0x7fbda01e93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.010+0000 7fbda7301640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbda01e9930 0x7fbda00c0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.010+0000 7fbda7301640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda00ace90 con 0x7fbda01e9930 2024-01-25T15:04:34.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.010+0000 7fbda7301640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda01e8c30 con 0x7fbd88003970 2024-01-25T15:04:34.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.010+0000 7fbda7301640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda00ac3a0 con 0x7fbda00bc8e0 2024-01-25T15:04:34.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.010+0000 7fbda589e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbda01e9930 0x7fbda00c0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.010+0000 7fbda589e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbda01e9930 0x7fbda00c0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55760/0 (socket says 172.21.15.29:55760) 2024-01-25T15:04:34.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.010+0000 7fbda589e640 1 -- 172.21.15.29:0/1951989971 learned_addr learned my addr 172.21.15.29:0/1951989971 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:34.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.011+0000 7fbda509d640 1 --2- 172.21.15.29:0/1951989971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd88003970 0x7fbda00c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.011+0000 7fbda489c640 1 --2- 172.21.15.29:0/1951989971 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbda00bc8e0 0x7fbda01e93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.011+0000 7fbda589e640 1 -- 172.21.15.29:0/1951989971 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbda00bc8e0 msgr2=0x7fbda01e93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:34.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.011+0000 7fbda589e640 1 --2- 172.21.15.29:0/1951989971 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbda00bc8e0 0x7fbda01e93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.011+0000 7fbda589e640 1 -- 172.21.15.29:0/1951989971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd88003970 msgr2=0x7fbda00c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:34.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.011+0000 7fbda589e640 1 --2- 172.21.15.29:0/1951989971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd88003970 0x7fbda00c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.011+0000 7fbda589e640 1 -- 172.21.15.29:0/1951989971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda00ac680 con 0x7fbda01e9930 2024-01-25T15:04:34.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.011+0000 7fbda509d640 1 --2- 172.21.15.29:0/1951989971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd88003970 0x7fbda00c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:34.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.011+0000 7fbda589e640 1 --2- 172.21.15.29:0/1951989971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbda01e9930 0x7fbda00c0430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbda006d070 tx=0x7fbd9800ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:34.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.011+0000 7fbd9dffb640 1 -- 172.21.15.29:0/1951989971 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd98010510 con 0x7fbda01e9930 2024-01-25T15:04:34.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.011+0000 7fbd9dffb640 1 -- 172.21.15.29:0/1951989971 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd98010670 con 0x7fbda01e9930 2024-01-25T15:04:34.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.011+0000 7fbda7301640 1 -- 172.21.15.29:0/1951989971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda01e8ed0 con 0x7fbda01e9930 2024-01-25T15:04:34.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.011+0000 7fbd9dffb640 1 -- 172.21.15.29:0/1951989971 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd980109e0 con 0x7fbda01e9930 2024-01-25T15:04:34.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.011+0000 7fbda7301640 1 -- 172.21.15.29:0/1951989971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda00c1260 con 0x7fbda01e9930 2024-01-25T15:04:34.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.012+0000 7fbda7301640 1 -- 172.21.15.29:0/1951989971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda01e90c0 con 0x7fbda01e9930 2024-01-25T15:04:34.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.013+0000 7fbd9dffb640 1 -- 172.21.15.29:0/1951989971 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fbd98010b40 con 0x7fbda01e9930 2024-01-25T15:04:34.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.013+0000 7fbd9dffb640 1 --2- 172.21.15.29:0/1951989971 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbd8c06aed0 0x7fbd8c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.013+0000 7fbd9dffb640 1 -- 172.21.15.29:0/1951989971 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbd98088ef0 con 0x7fbda01e9930 2024-01-25T15:04:34.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.013+0000 7fbda509d640 1 --2- 172.21.15.29:0/1951989971 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbd8c06aed0 0x7fbd8c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.014+0000 7fbda509d640 1 --2- 172.21.15.29:0/1951989971 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbd8c06aed0 0x7fbd8c06d390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbd90034000 tx=0x7fbd90009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:34.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.017+0000 7fbd9dffb640 1 -- 172.21.15.29:0/1951989971 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fbd98053c10 con 0x7fbda01e9930 2024-01-25T15:04:34.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.199+0000 7fbda7301640 1 -- 172.21.15.29:0/1951989971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbda0074080 con 0x7fbda01e9930 2024-01-25T15:04:34.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.200+0000 7fbd9dffb640 1 -- 172.21.15.29:0/1951989971 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18311 (secure 0 0 0) 0x7fbd98019070 con 0x7fbda01e9930 2024-01-25T15:04:34.201 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:34.201 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:31.978871+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:04:34.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.202+0000 7fbda7301640 1 -- 172.21.15.29:0/1951989971 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbd8c06aed0 msgr2=0x7fbd8c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:34.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.202+0000 7fbda7301640 1 --2- 172.21.15.29:0/1951989971 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbd8c06aed0 0x7fbd8c06d390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbd90034000 tx=0x7fbd90009030 comp rx=0 tx=0).stop 2024-01-25T15:04:34.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.202+0000 7fbda7301640 1 -- 172.21.15.29:0/1951989971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbda01e9930 msgr2=0x7fbda00c0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:34.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.202+0000 7fbda7301640 1 --2- 172.21.15.29:0/1951989971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbda01e9930 0x7fbda00c0430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbda006d070 tx=0x7fbd9800ead0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.202+0000 7fbda7301640 1 -- 172.21.15.29:0/1951989971 shutdown_connections 2024-01-25T15:04:34.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.202+0000 7fbda7301640 1 --2- 172.21.15.29:0/1951989971 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbd8c06aed0 0x7fbd8c06d390 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.202+0000 7fbda7301640 1 --2- 172.21.15.29:0/1951989971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbda01e9930 0x7fbda00c0430 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.202+0000 7fbda7301640 1 --2- 172.21.15.29:0/1951989971 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbda00bc8e0 0x7fbda01e93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.202+0000 7fbda7301640 1 --2- 172.21.15.29:0/1951989971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd88003970 0x7fbda00c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.202+0000 7fbda7301640 1 -- 172.21.15.29:0/1951989971 >> 172.21.15.29:0/1951989971 conn(0x7fbda00c39b0 msgr2=0x7fbda0146250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:34.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.202+0000 7fbda7301640 1 -- 172.21.15.29:0/1951989971 shutdown_connections 2024-01-25T15:04:34.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.202+0000 7fbda7301640 1 -- 172.21.15.29:0/1951989971 wait complete. 2024-01-25T15:04:34.616 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-25T15:04:26.896909+0000', 'modified': '2024-01-25T15:04:31.979031+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.52:6837/417879912', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6835', 'nonce': 417879912}, {'type': 'v1', 'addr': '172.21.15.52:6837', 'nonce': 417879912}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-01-25T15:04:34.617 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-25T15:04:34.617 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-01-25T15:04:34.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.722+0000 7f2579382640 1 Processor -- start 2024-01-25T15:04:34.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.722+0000 7f2579382640 1 -- start start 2024-01-25T15:04:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.723+0000 7f2579382640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f25740af6c0 0x7f25740c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.723+0000 7f2579382640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f257406d560 0x7f257406b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.723+0000 7f2579382640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25740afaa0 con 0x7f25740c5a70 2024-01-25T15:04:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.723+0000 7f2579382640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257406c480 con 0x7f25740af6c0 2024-01-25T15:04:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.723+0000 7f2579382640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2574155290 con 0x7f257406d560 2024-01-25T15:04:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.723+0000 7f2572ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f25740af6c0 0x7f25740c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.723+0000 7f2572ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f25740af6c0 0x7f25740c5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55772/0 (socket says 172.21.15.29:55772) 2024-01-25T15:04:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.723+0000 7f2572ffd640 1 -- 172.21.15.29:0/3255613193 learned_addr learned my addr 172.21.15.29:0/3255613193 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.723+0000 7f2572ffd640 1 -- 172.21.15.29:0/3255613193 >> v2:172.21.15.52:3300/0 conn(0x7f257406d560 msgr2=0x7f257406b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.723+0000 7f2572ffd640 1 --2- 172.21.15.29:0/3255613193 >> v2:172.21.15.52:3300/0 conn(0x7f257406d560 0x7f257406b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.723+0000 7f2572ffd640 1 -- 172.21.15.29:0/3255613193 >> v1:172.21.15.52:6789/0 conn(0x7f25740c5a70 legacy=0x7f257406b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.723+0000 7f2572ffd640 1 -- 172.21.15.29:0/3255613193 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25740c6060 con 0x7f25740af6c0 2024-01-25T15:04:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.724+0000 7f2572ffd640 1 --2- 172.21.15.29:0/3255613193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25740af6c0 0x7f25740c5530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2574158e90 tx=0x7f256c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363e3a7a05ea1034 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:34.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.724+0000 7f2571ffb640 1 -- 172.21.15.29:0/3255613193 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c031870 con 0x7f25740af6c0 2024-01-25T15:04:34.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.724+0000 7f2571ffb640 1 -- 172.21.15.29:0/3255613193 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c0319d0 con 0x7f25740af6c0 2024-01-25T15:04:34.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.724+0000 7f2571ffb640 1 -- 172.21.15.29:0/3255613193 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c031d60 con 0x7f25740af6c0 2024-01-25T15:04:34.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.725+0000 7f2579382640 1 -- 172.21.15.29:0/3255613193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25740af6c0 msgr2=0x7f25740c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:34.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.725+0000 7f2579382640 1 --2- 172.21.15.29:0/3255613193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25740af6c0 0x7f25740c5530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2574158e90 tx=0x7f256c02b910 comp rx=0 tx=0).stop 2024-01-25T15:04:34.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.725+0000 7f2579382640 1 -- 172.21.15.29:0/3255613193 shutdown_connections 2024-01-25T15:04:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.725+0000 7f2579382640 1 --2- 172.21.15.29:0/3255613193 >> v2:172.21.15.52:3300/0 conn(0x7f257406d560 0x7f257406b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.725+0000 7f2579382640 1 --2- 172.21.15.29:0/3255613193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25740af6c0 0x7f25740c5530 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.725+0000 7f2579382640 1 -- 172.21.15.29:0/3255613193 >> 172.21.15.29:0/3255613193 conn(0x7f25740c6ca0 msgr2=0x7f25740c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.725+0000 7f2579382640 1 -- 172.21.15.29:0/3255613193 shutdown_connections 2024-01-25T15:04:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.725+0000 7f2579382640 1 -- 172.21.15.29:0/3255613193 wait complete. 2024-01-25T15:04:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.726+0000 7f2579382640 1 Processor -- start 2024-01-25T15:04:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.726+0000 7f2579382640 1 -- start start 2024-01-25T15:04:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f2579382640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f257406d560 0x7f25741eded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f2579382640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f25740af6c0 0x7f257414e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f2579382640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25740c5a70 0x7f257414e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f2579382640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257414ee80 con 0x7f257406d560 2024-01-25T15:04:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f2579382640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25741eda70 con 0x7f25740c5a70 2024-01-25T15:04:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f2579382640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25740be340 con 0x7f25740af6c0 2024-01-25T15:04:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f2572ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f257406d560 0x7f25741eded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f2572ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f257406d560 0x7f25741eded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55780/0 (socket says 172.21.15.29:55780) 2024-01-25T15:04:34.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f2572ffd640 1 -- 172.21.15.29:0/1276299604 learned_addr learned my addr 172.21.15.29:0/1276299604 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:34.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f25727fc640 1 --2- 172.21.15.29:0/1276299604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f25740af6c0 0x7f257414e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f25737fe640 1 --2- 172.21.15.29:0/1276299604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25740c5a70 0x7f257414e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f2572ffd640 1 -- 172.21.15.29:0/1276299604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f25740af6c0 msgr2=0x7f257414e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:34.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f2572ffd640 1 --2- 172.21.15.29:0/1276299604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f25740af6c0 0x7f257414e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f2572ffd640 1 -- 172.21.15.29:0/1276299604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25740c5a70 msgr2=0x7f257414e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:34.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f2572ffd640 1 --2- 172.21.15.29:0/1276299604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25740c5a70 0x7f257414e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f2572ffd640 1 -- 172.21.15.29:0/1276299604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c0094d0 con 0x7f257406d560 2024-01-25T15:04:34.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f25737fe640 1 --2- 172.21.15.29:0/1276299604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25740c5a70 0x7f257414e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:34.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f2572ffd640 1 --2- 172.21.15.29:0/1276299604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f257406d560 0x7f25741eded0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f256c02b950 tx=0x7f256c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:34.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f255b7fe640 1 -- 172.21.15.29:0/1276299604 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c03ad10 con 0x7f257406d560 2024-01-25T15:04:34.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f255b7fe640 1 -- 172.21.15.29:0/1276299604 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c03ae70 con 0x7f257406d560 2024-01-25T15:04:34.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f255b7fe640 1 -- 172.21.15.29:0/1276299604 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c044610 con 0x7f257406d560 2024-01-25T15:04:34.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f2579382640 1 -- 172.21.15.29:0/1276299604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257414ecd0 con 0x7f257406d560 2024-01-25T15:04:34.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.727+0000 7f2579382640 1 -- 172.21.15.29:0/1276299604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25741ee8c0 con 0x7f257406d560 2024-01-25T15:04:34.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.729+0000 7f255b7fe640 1 -- 172.21.15.29:0/1276299604 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f256c044770 con 0x7f257406d560 2024-01-25T15:04:34.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.729+0000 7f255b7fe640 1 --2- 172.21.15.29:0/1276299604 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f256006aed0 0x7f256006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.729+0000 7f255b7fe640 1 -- 172.21.15.29:0/1276299604 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f256c02d040 con 0x7f257406d560 2024-01-25T15:04:34.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.729+0000 7f25727fc640 1 --2- 172.21.15.29:0/1276299604 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f256006aed0 0x7f256006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.730+0000 7f25727fc640 1 --2- 172.21.15.29:0/1276299604 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f256006aed0 0x7f256006d390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f25740bd820 tx=0x7f2568008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:34.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.730+0000 7f257c027740 1 Processor -- start 2024-01-25T15:04:34.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.730+0000 7f257c027740 1 -- start start 2024-01-25T15:04:34.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.731+0000 7f257c027740 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x562be98f4ef0 0x562be98f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.731+0000 7f257c027740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be98f6200 0x562be9931040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.731+0000 7f257c027740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562be9931580 0x562be992f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.731+0000 7f257c027740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x562be9863030 con 0x562be98f6200 2024-01-25T15:04:34.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.731+0000 7f257c027740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562be9860720 con 0x562be9931580 2024-01-25T15:04:34.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.731+0000 7f257c027740 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x562be985c010 con 0x562be98f4ef0 2024-01-25T15:04:34.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.731+0000 7f25727fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be98f6200 0x562be9931040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.731+0000 7f25727fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be98f6200 0x562be9931040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55782/0 (socket says 172.21.15.29:55782) 2024-01-25T15:04:34.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.731+0000 7f25727fc640 1 -- 172.21.15.29:0/747455461 learned_addr learned my addr 172.21.15.29:0/747455461 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:34.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.731+0000 7f2572ffd640 1 --2- 172.21.15.29:0/747455461 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x562be98f4ef0 0x562be98f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.731+0000 7f25737fe640 1 --2- 172.21.15.29:0/747455461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562be9931580 0x562be992f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.731+0000 7f25727fc640 1 -- 172.21.15.29:0/747455461 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x562be98f4ef0 msgr2=0x562be98f52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:34.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.731+0000 7f25727fc640 1 --2- 172.21.15.29:0/747455461 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x562be98f4ef0 0x562be98f52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.731+0000 7f25727fc640 1 -- 172.21.15.29:0/747455461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562be9931580 msgr2=0x562be992f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:34.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.731+0000 7f25727fc640 1 --2- 172.21.15.29:0/747455461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562be9931580 0x562be992f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.731+0000 7f25727fc640 1 -- 172.21.15.29:0/747455461 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562be981e680 con 0x562be98f6200 2024-01-25T15:04:34.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.732+0000 7f25727fc640 1 --2- 172.21.15.29:0/747455461 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be98f6200 0x562be9931040 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f256800d840 tx=0x7f2568010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9aa95c095fb9a5 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:34.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.732+0000 7f2558ff9640 1 -- 172.21.15.29:0/747455461 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25680149b0 con 0x562be98f6200 2024-01-25T15:04:34.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.732+0000 7f2558ff9640 1 -- 172.21.15.29:0/747455461 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2568014b10 con 0x562be98f6200 2024-01-25T15:04:34.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.732+0000 7f2558ff9640 1 -- 172.21.15.29:0/747455461 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2568014e80 con 0x562be98f6200 2024-01-25T15:04:34.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.732+0000 7f257c027740 1 -- 172.21.15.29:0/747455461 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be98f6200 msgr2=0x562be9931040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:34.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.732+0000 7f257c027740 1 --2- 172.21.15.29:0/747455461 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be98f6200 0x562be9931040 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f256800d840 tx=0x7f2568010000 comp rx=0 tx=0).stop 2024-01-25T15:04:34.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.732+0000 7f257c027740 1 -- 172.21.15.29:0/747455461 shutdown_connections 2024-01-25T15:04:34.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.732+0000 7f257c027740 1 --2- 172.21.15.29:0/747455461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562be9931580 0x562be992f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.732+0000 7f257c027740 1 --2- 172.21.15.29:0/747455461 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be98f6200 0x562be9931040 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.732+0000 7f257c027740 1 --2- 172.21.15.29:0/747455461 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x562be98f4ef0 0x562be98f52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.732+0000 7f257c027740 1 -- 172.21.15.29:0/747455461 >> 172.21.15.29:0/747455461 conn(0x562be98f1840 msgr2=0x562be9916250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:34.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.732+0000 7f257c027740 1 -- 172.21.15.29:0/747455461 shutdown_connections 2024-01-25T15:04:34.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.732+0000 7f257c027740 1 -- 172.21.15.29:0/747455461 wait complete. 2024-01-25T15:04:34.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.733+0000 7f257c027740 1 -- start start 2024-01-25T15:04:34.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.733+0000 7f257c027740 1 Processor -- start 2024-01-25T15:04:34.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.734+0000 7f257c027740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be98f6200 0x562be9935ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.734+0000 7f257c027740 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x562be9931580 0x562be9941250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.734+0000 7f257c027740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562be9910c70 0x562be99110f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.734+0000 7f257c027740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x562be98155f0 con 0x562be98f6200 2024-01-25T15:04:34.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.734+0000 7f257c027740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562be9815290 con 0x562be9910c70 2024-01-25T15:04:34.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.734+0000 7f257c027740 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x562be97da300 con 0x562be9931580 2024-01-25T15:04:34.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.734+0000 7f257c027740 10 client.0 _ll_register_callbacks cb 0x562be9810260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:34.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.734+0000 7f2572ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be98f6200 0x562be9935ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.734+0000 7f2572ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be98f6200 0x562be9935ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55788/0 (socket says 172.21.15.29:55788) 2024-01-25T15:04:34.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.734+0000 7f2572ffd640 1 -- 172.21.15.29:0/4035742130 learned_addr learned my addr 172.21.15.29:0/4035742130 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:34.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.734+0000 7f25727fc640 1 --2- 172.21.15.29:0/4035742130 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x562be9931580 0x562be9941250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.734+0000 7f25737fe640 1 --2- 172.21.15.29:0/4035742130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562be9910c70 0x562be99110f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.734+0000 7f2572ffd640 1 -- 172.21.15.29:0/4035742130 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x562be9931580 msgr2=0x562be9941250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:34.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.734+0000 7f2572ffd640 1 --2- 172.21.15.29:0/4035742130 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x562be9931580 0x562be9941250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.734+0000 7f2572ffd640 1 -- 172.21.15.29:0/4035742130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562be9910c70 msgr2=0x562be99110f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.734+0000 7f2572ffd640 1 --2- 172.21.15.29:0/4035742130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562be9910c70 0x562be99110f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.734+0000 7f2572ffd640 1 -- 172.21.15.29:0/4035742130 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256800e040 con 0x562be98f6200 2024-01-25T15:04:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.734+0000 7f2572ffd640 1 --2- 172.21.15.29:0/4035742130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be98f6200 0x562be9935ee0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f256c07a740 tx=0x7f256c07eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1efad4cf514a2f server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.734+0000 7f2551ffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-01-25T15:04:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.734+0000 7f2551ffb640 1 -- 172.21.15.29:0/4035742130 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c0921c0 con 0x562be98f6200 2024-01-25T15:04:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.734+0000 7f2551ffb640 1 -- 172.21.15.29:0/4035742130 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f256c078ea0 con 0x562be98f6200 2024-01-25T15:04:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.734+0000 7f257c027740 1 -- 172.21.15.29:0/4035742130 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562be9854ea0 con 0x562be98f6200 2024-01-25T15:04:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.735+0000 7f2551ffb640 1 -- 172.21.15.29:0/4035742130 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f256c0828b0 con 0x562be98f6200 2024-01-25T15:04:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.735+0000 7f257c027740 10 client.4428 fetch_fsmap learned FSMap version 7 2024-01-25T15:04:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.735+0000 7f257c027740 1 -- 172.21.15.29:0/4035742130 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x562be985a690 con 0x562be98f6200 2024-01-25T15:04:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.735+0000 7f2551ffb640 1 -- 172.21.15.29:0/4035742130 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562be9854ea0 con 0x562be98f6200 2024-01-25T15:04:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.735+0000 7f2551ffb640 1 -- 172.21.15.29:0/4035742130 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f256c076830 con 0x562be98f6200 2024-01-25T15:04:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.735+0000 7f257c027740 10 client.4428 fetch_fsmap finished waiting for FSMap version 7 2024-01-25T15:04:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.735+0000 7f257c027740 10 client.4428 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-25T15:04:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.735+0000 7f257c027740 20 client.4428 populate_metadata read hostname 'smithi029' 2024-01-25T15:04:34.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.735+0000 7f257c027740 1 --2- 172.21.15.29:0/4035742130 >> [v2:172.21.15.52:6835/417879912,v1:172.21.15.52:6837/417879912] conn(0x562be994e2c0 0x562be99506b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.735+0000 7f257c027740 4 client.4428 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:04:34.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.735+0000 7f257c027740 1 -- 172.21.15.29:0/4035742130 --> [v2:172.21.15.52:6835/417879912,v1:172.21.15.52:6837/417879912] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562be9854bc0 con 0x562be994e2c0 2024-01-25T15:04:34.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.735+0000 7f25727fc640 1 --2- 172.21.15.29:0/4035742130 >> [v2:172.21.15.52:6835/417879912,v1:172.21.15.52:6837/417879912] conn(0x562be994e2c0 0x562be99506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.736+0000 7f25727fc640 1 --2- 172.21.15.29:0/4035742130 >> [v2:172.21.15.52:6835/417879912,v1:172.21.15.52:6837/417879912] conn(0x562be994e2c0 0x562be99506b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=faffbb29eab66bbd server_cookie=aeb24019b6565441 in_seq=0 out_seq=0 2024-01-25T15:04:34.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.736+0000 7f2551ffb640 10 client.4428 ms_handle_connect on v2:172.21.15.52:6835/417879912 2024-01-25T15:04:34.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.736+0000 7f2551ffb640 1 -- 172.21.15.29:0/4035742130 <== mds.0 v2:172.21.15.52:6835/417879912 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562be9854bc0 con 0x562be994e2c0 2024-01-25T15:04:34.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.736+0000 7f2551ffb640 10 client.4428 handle_command_reply: tid=0 2024-01-25T15:04:34.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.736+0000 7f257c027740 1 client.4428 shutdown 2024-01-25T15:04:34.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.736+0000 7f257c027740 1 -- 172.21.15.29:0/4035742130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be98f6200 msgr2=0x562be9935ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:34.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.736+0000 7f257c027740 1 --2- 172.21.15.29:0/4035742130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be98f6200 0x562be9935ee0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f256c07a740 tx=0x7f256c07eb90 comp rx=0 tx=0).stop 2024-01-25T15:04:34.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.736+0000 7f257c027740 1 -- 172.21.15.29:0/4035742130 shutdown_connections 2024-01-25T15:04:34.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.736+0000 7f257c027740 1 --2- 172.21.15.29:0/4035742130 >> [v2:172.21.15.52:6835/417879912,v1:172.21.15.52:6837/417879912] conn(0x562be994e2c0 0x562be99506b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.736+0000 7f257c027740 1 --2- 172.21.15.29:0/4035742130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562be9910c70 0x562be99110f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.736+0000 7f257c027740 1 --2- 172.21.15.29:0/4035742130 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x562be9931580 0x562be9941250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.736+0000 7f2551ffb640 0 client.4428 ms_handle_reset on v2:172.21.15.52:6835/417879912 2024-01-25T15:04:34.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.736+0000 7f257c027740 1 --2- 172.21.15.29:0/4035742130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be98f6200 0x562be9935ee0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.736+0000 7f257c027740 1 -- 172.21.15.29:0/4035742130 >> 172.21.15.29:0/4035742130 conn(0x562be98f4ef0 msgr2=0x562be992fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:34.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.737+0000 7f257c027740 1 -- 172.21.15.29:0/4035742130 shutdown_connections 2024-01-25T15:04:34.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.737+0000 7f257c027740 1 -- 172.21.15.29:0/4035742130 wait complete. 2024-01-25T15:04:34.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.737+0000 7f257c027740 20 client.4428 trim_cache size 0 max 16384 2024-01-25T15:04:34.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.752+0000 7f257c027740 1 Processor -- start 2024-01-25T15:04:34.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.752+0000 7f257c027740 1 -- start start 2024-01-25T15:04:34.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.753+0000 7f257c027740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be98f6200 0x562be99110f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.753+0000 7f257c027740 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x562be9910c70 0x562be9911630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.753+0000 7f257c027740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562be9931580 0x562be99546d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.753+0000 7f257c027740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x562be980f6f0 con 0x562be98f6200 2024-01-25T15:04:34.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.753+0000 7f257c027740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562be97fcc30 con 0x562be9931580 2024-01-25T15:04:34.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.753+0000 7f257c027740 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x562be992dac0 con 0x562be9910c70 2024-01-25T15:04:34.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.753+0000 7f2572ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be98f6200 0x562be99110f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.753+0000 7f2572ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be98f6200 0x562be99110f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55790/0 (socket says 172.21.15.29:55790) 2024-01-25T15:04:34.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.753+0000 7f2572ffd640 1 -- 172.21.15.29:0/789105346 learned_addr learned my addr 172.21.15.29:0/789105346 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:34.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.753+0000 7f25737fe640 1 --2- 172.21.15.29:0/789105346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562be9931580 0x562be99546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.753+0000 7f25727fc640 1 --2- 172.21.15.29:0/789105346 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x562be9910c70 0x562be9911630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.753+0000 7f2572ffd640 1 -- 172.21.15.29:0/789105346 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x562be9910c70 msgr2=0x562be9911630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:34.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.753+0000 7f2572ffd640 1 --2- 172.21.15.29:0/789105346 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x562be9910c70 0x562be9911630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.753+0000 7f2572ffd640 1 -- 172.21.15.29:0/789105346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562be9931580 msgr2=0x562be99546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:34.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.753+0000 7f2572ffd640 1 --2- 172.21.15.29:0/789105346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562be9931580 0x562be99546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.753+0000 7f2572ffd640 1 -- 172.21.15.29:0/789105346 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562be97f7390 con 0x562be98f6200 2024-01-25T15:04:34.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.753+0000 7f2572ffd640 1 --2- 172.21.15.29:0/789105346 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be98f6200 0x562be99110f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f256c07a6f0 tx=0x7f256c04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f2731cb2fe7d2b server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:34.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.753+0000 7f2553fff640 1 -- 172.21.15.29:0/789105346 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c0921c0 con 0x562be98f6200 2024-01-25T15:04:34.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.753+0000 7f2553fff640 1 -- 172.21.15.29:0/789105346 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c076d80 con 0x562be98f6200 2024-01-25T15:04:34.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.753+0000 7f2553fff640 1 -- 172.21.15.29:0/789105346 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c078ea0 con 0x562be98f6200 2024-01-25T15:04:34.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.754+0000 7f257c027740 1 -- 172.21.15.29:0/789105346 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be98f6200 msgr2=0x562be99110f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:34.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.754+0000 7f257c027740 1 --2- 172.21.15.29:0/789105346 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be98f6200 0x562be99110f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f256c07a6f0 tx=0x7f256c04e000 comp rx=0 tx=0).stop 2024-01-25T15:04:34.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.754+0000 7f257c027740 1 -- 172.21.15.29:0/789105346 shutdown_connections 2024-01-25T15:04:34.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.754+0000 7f257c027740 1 --2- 172.21.15.29:0/789105346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562be9931580 0x562be99546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.754+0000 7f257c027740 1 --2- 172.21.15.29:0/789105346 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x562be9910c70 0x562be9911630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.754+0000 7f257c027740 1 --2- 172.21.15.29:0/789105346 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be98f6200 0x562be99110f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.754+0000 7f257c027740 1 -- 172.21.15.29:0/789105346 >> 172.21.15.29:0/789105346 conn(0x562be98f4ef0 msgr2=0x562be993e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:34.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.754+0000 7f257c027740 1 -- 172.21.15.29:0/789105346 shutdown_connections 2024-01-25T15:04:34.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.754+0000 7f257c027740 1 -- 172.21.15.29:0/789105346 wait complete. 2024-01-25T15:04:34.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.755+0000 7f257c027740 1 -- start start 2024-01-25T15:04:34.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.755+0000 7f257c027740 1 Processor -- start 2024-01-25T15:04:34.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.755+0000 7f257c027740 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x562be98f6200 0x562be9999960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.755+0000 7f257c027740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be9910c70 0x562be994b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.755+0000 7f257c027740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562be9931580 0x562be9913100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.755+0000 7f257c027740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x562be999fd70 con 0x562be9910c70 2024-01-25T15:04:34.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.755+0000 7f257c027740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x562be992e030 con 0x562be9931580 2024-01-25T15:04:34.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.755+0000 7f257c027740 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x562be9912a20 con 0x562be98f6200 2024-01-25T15:04:34.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.755+0000 7f257c027740 10 client.0 _ll_register_callbacks cb 0x7f2568009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:34.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.755+0000 7f25727fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be9910c70 0x562be994b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.755+0000 7f25727fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be9910c70 0x562be994b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55804/0 (socket says 172.21.15.29:55804) 2024-01-25T15:04:34.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.755+0000 7f25727fc640 1 -- 172.21.15.29:0/2769437544 learned_addr learned my addr 172.21.15.29:0/2769437544 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:34.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.756+0000 7f2572ffd640 1 --2- 172.21.15.29:0/2769437544 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x562be98f6200 0x562be9999960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.756+0000 7f25737fe640 1 --2- 172.21.15.29:0/2769437544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562be9931580 0x562be9913100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.756+0000 7f25727fc640 1 -- 172.21.15.29:0/2769437544 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x562be98f6200 msgr2=0x562be9999960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:34.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.756+0000 7f25727fc640 1 --2- 172.21.15.29:0/2769437544 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x562be98f6200 0x562be9999960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.756+0000 7f25727fc640 1 -- 172.21.15.29:0/2769437544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562be9931580 msgr2=0x562be9913100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:34.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.756+0000 7f25727fc640 1 --2- 172.21.15.29:0/2769437544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562be9931580 0x562be9913100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.756+0000 7f25727fc640 1 -- 172.21.15.29:0/2769437544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256800e040 con 0x562be9910c70 2024-01-25T15:04:34.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.756+0000 7f25727fc640 1 --2- 172.21.15.29:0/2769437544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be9910c70 0x562be994b4f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f256800e010 tx=0x7f25680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d832d77c82fa6dbe server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:34.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.756+0000 7f2551ffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-01-25T15:04:34.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.756+0000 7f2551ffb640 1 -- 172.21.15.29:0/2769437544 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256802eea0 con 0x562be9910c70 2024-01-25T15:04:34.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.756+0000 7f2551ffb640 1 -- 172.21.15.29:0/2769437544 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2568020250 con 0x562be9910c70 2024-01-25T15:04:34.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.756+0000 7f257c027740 1 -- 172.21.15.29:0/2769437544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2568014b10 con 0x562be9910c70 2024-01-25T15:04:34.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.756+0000 7f2551ffb640 1 -- 172.21.15.29:0/2769437544 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25680149b0 con 0x562be9910c70 2024-01-25T15:04:34.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.756+0000 7f257c027740 10 client.4434 fetch_fsmap learned FSMap version 7 2024-01-25T15:04:34.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.756+0000 7f257c027740 1 -- 172.21.15.29:0/2769437544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x562be981cee0 con 0x562be9910c70 2024-01-25T15:04:34.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.756+0000 7f2551ffb640 1 -- 172.21.15.29:0/2769437544 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2568014b10 con 0x562be9910c70 2024-01-25T15:04:34.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.757+0000 7f2551ffb640 1 -- 172.21.15.29:0/2769437544 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f25680059c0 con 0x562be9910c70 2024-01-25T15:04:34.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.757+0000 7f257c027740 10 client.4434 fetch_fsmap finished waiting for FSMap version 7 2024-01-25T15:04:34.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.757+0000 7f257c027740 10 client.4434 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-25T15:04:34.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.757+0000 7f257c027740 20 client.4434 populate_metadata read hostname 'smithi029' 2024-01-25T15:04:34.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.757+0000 7f257c027740 1 --2- 172.21.15.29:0/2769437544 >> [v2:172.21.15.52:6835/417879912,v1:172.21.15.52:6837/417879912] conn(0x562be9913640 0x562be99411d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.757+0000 7f257c027740 4 client.4434 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-25T15:04:34.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.757+0000 7f257c027740 1 -- 172.21.15.29:0/2769437544 --> [v2:172.21.15.52:6835/417879912,v1:172.21.15.52:6837/417879912] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562be955b6c0 con 0x562be9913640 2024-01-25T15:04:34.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.757+0000 7f2572ffd640 1 --2- 172.21.15.29:0/2769437544 >> [v2:172.21.15.52:6835/417879912,v1:172.21.15.52:6837/417879912] conn(0x562be9913640 0x562be99411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f2551ffb640 10 client.4434 ms_handle_connect on v2:172.21.15.52:6835/417879912 2024-01-25T15:04:34.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f2572ffd640 1 --2- 172.21.15.29:0/2769437544 >> [v2:172.21.15.52:6835/417879912,v1:172.21.15.52:6837/417879912] conn(0x562be9913640 0x562be99411d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ead9ece2673a2402 server_cookie=814309d3ab6a61c5 in_seq=0 out_seq=0 2024-01-25T15:04:34.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f2551ffb640 1 -- 172.21.15.29:0/2769437544 <== mds.0 v2:172.21.15.52:6835/417879912 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x562be955b6c0 con 0x562be9913640 2024-01-25T15:04:34.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f2551ffb640 10 client.4434 handle_command_reply: tid=0 2024-01-25T15:04:34.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f257c027740 1 client.4434 shutdown 2024-01-25T15:04:34.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f257c027740 1 -- 172.21.15.29:0/2769437544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be9910c70 msgr2=0x562be994b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:34.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f257c027740 1 --2- 172.21.15.29:0/2769437544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be9910c70 0x562be994b4f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f256800e010 tx=0x7f25680046c0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f257c027740 1 -- 172.21.15.29:0/2769437544 shutdown_connections 2024-01-25T15:04:34.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f257c027740 1 --2- 172.21.15.29:0/2769437544 >> [v2:172.21.15.52:6835/417879912,v1:172.21.15.52:6837/417879912] conn(0x562be9913640 0x562be99411d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f257c027740 1 --2- 172.21.15.29:0/2769437544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562be9931580 0x562be9913100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f257c027740 1 --2- 172.21.15.29:0/2769437544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562be9910c70 0x562be994b4f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f2551ffb640 0 client.4434 ms_handle_reset on v2:172.21.15.52:6835/417879912 2024-01-25T15:04:34.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f257c027740 1 --2- 172.21.15.29:0/2769437544 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x562be98f6200 0x562be9999960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f257c027740 1 -- 172.21.15.29:0/2769437544 >> 172.21.15.29:0/2769437544 conn(0x562be98f4ef0 msgr2=0x562be9935aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:34.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f257c027740 1 -- 172.21.15.29:0/2769437544 shutdown_connections 2024-01-25T15:04:34.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f257c027740 1 -- 172.21.15.29:0/2769437544 wait complete. 2024-01-25T15:04:34.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f257c027740 20 client.4434 trim_cache size 0 max 16384 2024-01-25T15:04:34.765 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-25T15:04:34.765 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "3f65c5fb-9e8c-471f-b2c4-a9841e901c7a", 2024-01-25T15:04:34.766 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2024-01-25T15:04:34.766 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4285, 2024-01-25T15:04:34.766 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-01-25T15:04:34.766 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-01-25T15:04:34.766 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-01-25T15:04:34.766 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 7.2124779999999999, 2024-01-25T15:04:34.766 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 7, 2024-01-25T15:04:34.766 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 24, 2024-01-25T15:04:34.766 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 24, 2024-01-25T15:04:34.766 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 14.249059308 2024-01-25T15:04:34.766 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-25T15:04:34.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f2579382640 1 -- 172.21.15.29:0/1276299604 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f256006aed0 msgr2=0x7f256006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:34.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f2579382640 1 --2- 172.21.15.29:0/1276299604 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f256006aed0 0x7f256006d390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f25740bd820 tx=0x7f2568008040 comp rx=0 tx=0).stop 2024-01-25T15:04:34.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f2579382640 1 -- 172.21.15.29:0/1276299604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f257406d560 msgr2=0x7f25741eded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:34.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f2579382640 1 --2- 172.21.15.29:0/1276299604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f257406d560 0x7f25741eded0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f256c02b950 tx=0x7f256c0046c0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f2579382640 1 -- 172.21.15.29:0/1276299604 shutdown_connections 2024-01-25T15:04:34.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f2579382640 1 --2- 172.21.15.29:0/1276299604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25740c5a70 0x7f257414e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f2579382640 1 --2- 172.21.15.29:0/1276299604 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f25740af6c0 0x7f257414e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f2579382640 1 --2- 172.21.15.29:0/1276299604 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f256006aed0 0x7f256006d390 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f2579382640 1 --2- 172.21.15.29:0/1276299604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f257406d560 0x7f25741eded0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.758+0000 7f2579382640 1 -- 172.21.15.29:0/1276299604 >> 172.21.15.29:0/1276299604 conn(0x7f25740c6ca0 msgr2=0x7f25740abcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:34.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.759+0000 7f2579382640 1 -- 172.21.15.29:0/1276299604 shutdown_connections 2024-01-25T15:04:34.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.759+0000 7f2579382640 1 -- 172.21.15.29:0/1276299604 wait complete. 2024-01-25T15:04:34.769 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-25T15:04:34.770 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-01-25T15:04:34.770 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-25T15:04:34.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.870+0000 7f8a527c9640 1 Processor -- start 2024-01-25T15:04:34.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.870+0000 7f8a527c9640 1 -- start start 2024-01-25T15:04:34.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.871+0000 7f8a527c9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8a4c1520b0 0x7f8a4c155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.871+0000 7f8a527c9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a4c0c4f00 0x7f8a4c0c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.871+0000 7f8a527c9640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4c0c66c0 con 0x7f8a4c0c55e0 2024-01-25T15:04:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.871+0000 7f8a527c9640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4c06cfc0 con 0x7f8a4c1520b0 2024-01-25T15:04:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.871+0000 7f8a527c9640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c152490 con 0x7f8a4c0c4f00 2024-01-25T15:04:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.871+0000 7f8a4bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8a4c1520b0 0x7f8a4c155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.871+0000 7f8a4bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8a4c1520b0 0x7f8a4c155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55818/0 (socket says 172.21.15.29:55818) 2024-01-25T15:04:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.871+0000 7f8a4bfff640 1 -- 172.21.15.29:0/732207519 learned_addr learned my addr 172.21.15.29:0/732207519 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.871+0000 7f8a50d66640 1 --2- 172.21.15.29:0/732207519 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a4c0c4f00 0x7f8a4c0c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.871+0000 7f8a4bfff640 1 -- 172.21.15.29:0/732207519 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a4c0c4f00 msgr2=0x7f8a4c0c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.871+0000 7f8a4bfff640 1 --2- 172.21.15.29:0/732207519 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a4c0c4f00 0x7f8a4c0c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.871+0000 7f8a4bfff640 1 -- 172.21.15.29:0/732207519 >> v1:172.21.15.52:6789/0 conn(0x7f8a4c0c55e0 legacy=0x7f8a4c0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.871+0000 7f8a4bfff640 1 -- 172.21.15.29:0/732207519 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c0c8830 con 0x7f8a4c1520b0 2024-01-25T15:04:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.872+0000 7f8a4bfff640 1 --2- 172.21.15.29:0/732207519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a4c1520b0 0x7f8a4c155570 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009870 tx=0x7f8a4002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10ac332ef02eca8 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:34.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.872+0000 7f8a4affd640 1 -- 172.21.15.29:0/732207519 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a400317c0 con 0x7f8a4c1520b0 2024-01-25T15:04:34.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.872+0000 7f8a4affd640 1 -- 172.21.15.29:0/732207519 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a40031920 con 0x7f8a4c1520b0 2024-01-25T15:04:34.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.872+0000 7f8a4affd640 1 -- 172.21.15.29:0/732207519 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40031cb0 con 0x7f8a4c1520b0 2024-01-25T15:04:34.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.873+0000 7f8a527c9640 1 -- 172.21.15.29:0/732207519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a4c1520b0 msgr2=0x7f8a4c155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:34.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.873+0000 7f8a527c9640 1 --2- 172.21.15.29:0/732207519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a4c1520b0 0x7f8a4c155570 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009870 tx=0x7f8a4002b860 comp rx=0 tx=0).stop 2024-01-25T15:04:34.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.873+0000 7f8a527c9640 1 -- 172.21.15.29:0/732207519 shutdown_connections 2024-01-25T15:04:34.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.873+0000 7f8a527c9640 1 --2- 172.21.15.29:0/732207519 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a4c0c4f00 0x7f8a4c0c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.873+0000 7f8a527c9640 1 --2- 172.21.15.29:0/732207519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a4c1520b0 0x7f8a4c155570 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.873+0000 7f8a527c9640 1 -- 172.21.15.29:0/732207519 >> 172.21.15.29:0/732207519 conn(0x7f8a4c0ca220 msgr2=0x7f8a4c0ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:34.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.873+0000 7f8a527c9640 1 -- 172.21.15.29:0/732207519 shutdown_connections 2024-01-25T15:04:34.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.873+0000 7f8a527c9640 1 -- 172.21.15.29:0/732207519 wait complete. 2024-01-25T15:04:34.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.874+0000 7f8a527c9640 1 Processor -- start 2024-01-25T15:04:34.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.874+0000 7f8a527c9640 1 -- start start 2024-01-25T15:04:34.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.875+0000 7f8a527c9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a4c0c4f00 0x7f8a4c1ee3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.875+0000 7f8a527c9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a4c1520b0 0x7f8a4c150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.875+0000 7f8a527c9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a4c158180 0x7f8a4c155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.875+0000 7f8a527c9640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c1edf90 con 0x7f8a4c158180 2024-01-25T15:04:34.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.875+0000 7f8a527c9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c0bdb00 con 0x7f8a4c1520b0 2024-01-25T15:04:34.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.875+0000 7f8a527c9640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c0bd820 con 0x7f8a4c0c4f00 2024-01-25T15:04:34.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.875+0000 7f8a50d66640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a4c158180 0x7f8a4c155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.875+0000 7f8a50d66640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a4c158180 0x7f8a4c155d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55826/0 (socket says 172.21.15.29:55826) 2024-01-25T15:04:34.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.875+0000 7f8a50d66640 1 -- 172.21.15.29:0/2186962266 learned_addr learned my addr 172.21.15.29:0/2186962266 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:34.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.875+0000 7f8a4bfff640 1 --2- 172.21.15.29:0/2186962266 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a4c0c4f00 0x7f8a4c1ee3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.875+0000 7f8a4b7fe640 1 --2- 172.21.15.29:0/2186962266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a4c1520b0 0x7f8a4c150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.875+0000 7f8a50d66640 1 -- 172.21.15.29:0/2186962266 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a4c0c4f00 msgr2=0x7f8a4c1ee3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:34.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.875+0000 7f8a50d66640 1 --2- 172.21.15.29:0/2186962266 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a4c0c4f00 0x7f8a4c1ee3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.875+0000 7f8a50d66640 1 -- 172.21.15.29:0/2186962266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a4c1520b0 msgr2=0x7f8a4c150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:34.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.875+0000 7f8a50d66640 1 --2- 172.21.15.29:0/2186962266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a4c1520b0 0x7f8a4c150b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:34.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.875+0000 7f8a50d66640 1 -- 172.21.15.29:0/2186962266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a400094d0 con 0x7f8a4c158180 2024-01-25T15:04:34.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.875+0000 7f8a50d66640 1 --2- 172.21.15.29:0/2186962266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a4c158180 0x7f8a4c155d90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8a44007e40 tx=0x7f8a4400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:34.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.875+0000 7f8a48ff9640 1 -- 172.21.15.29:0/2186962266 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a44014620 con 0x7f8a4c158180 2024-01-25T15:04:34.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.875+0000 7f8a48ff9640 1 -- 172.21.15.29:0/2186962266 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4400ee90 con 0x7f8a4c158180 2024-01-25T15:04:34.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.875+0000 7f8a527c9640 1 -- 172.21.15.29:0/2186962266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4c1ed8d0 con 0x7f8a4c158180 2024-01-25T15:04:34.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.875+0000 7f8a48ff9640 1 -- 172.21.15.29:0/2186962266 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a440149e0 con 0x7f8a4c158180 2024-01-25T15:04:34.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.875+0000 7f8a527c9640 1 -- 172.21.15.29:0/2186962266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4c1510b0 con 0x7f8a4c158180 2024-01-25T15:04:34.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.877+0000 7f8a527c9640 1 -- 172.21.15.29:0/2186962266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a4c158ea0 con 0x7f8a4c158180 2024-01-25T15:04:34.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.877+0000 7f8a48ff9640 1 -- 172.21.15.29:0/2186962266 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8a44014b40 con 0x7f8a4c158180 2024-01-25T15:04:34.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.877+0000 7f8a48ff9640 1 --2- 172.21.15.29:0/2186962266 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8a3806aed0 0x7f8a3806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:34.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.877+0000 7f8a48ff9640 1 -- 172.21.15.29:0/2186962266 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8a4408a270 con 0x7f8a4c158180 2024-01-25T15:04:34.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.877+0000 7f8a4bfff640 1 --2- 172.21.15.29:0/2186962266 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8a3806aed0 0x7f8a3806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:34.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.878+0000 7f8a4bfff640 1 --2- 172.21.15.29:0/2186962266 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8a3806aed0 0x7f8a3806d390 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8a40036000 tx=0x7f8a4003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:34.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:34.882+0000 7f8a48ff9640 1 -- 172.21.15.29:0/2186962266 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8a44054ee0 con 0x7f8a4c158180 2024-01-25T15:04:35.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:35.098+0000 7f8a527c9640 1 -- 172.21.15.29:0/2186962266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8a4c1ee0d0 con 0x7f8a4c158180 2024-01-25T15:04:35.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:35.099+0000 7f8a48ff9640 1 -- 172.21.15.29:0/2186962266 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8a4c1ee0d0 con 0x7f8a4c158180 2024-01-25T15:04:35.099 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-25T15:04:35.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:35.101+0000 7f8a527c9640 1 -- 172.21.15.29:0/2186962266 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8a3806aed0 msgr2=0x7f8a3806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:35.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:35.101+0000 7f8a527c9640 1 --2- 172.21.15.29:0/2186962266 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8a3806aed0 0x7f8a3806d390 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8a40036000 tx=0x7f8a4003d040 comp rx=0 tx=0).stop 2024-01-25T15:04:35.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:35.101+0000 7f8a527c9640 1 -- 172.21.15.29:0/2186962266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a4c158180 msgr2=0x7f8a4c155d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:35.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:35.101+0000 7f8a527c9640 1 --2- 172.21.15.29:0/2186962266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a4c158180 0x7f8a4c155d90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8a44007e40 tx=0x7f8a4400e4b0 comp rx=0 tx=0).stop 2024-01-25T15:04:35.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:35.101+0000 7f8a527c9640 1 -- 172.21.15.29:0/2186962266 shutdown_connections 2024-01-25T15:04:35.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:35.101+0000 7f8a527c9640 1 --2- 172.21.15.29:0/2186962266 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8a3806aed0 0x7f8a3806d390 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:35.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:35.101+0000 7f8a527c9640 1 --2- 172.21.15.29:0/2186962266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a4c158180 0x7f8a4c155d90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:35.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:35.101+0000 7f8a527c9640 1 --2- 172.21.15.29:0/2186962266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a4c1520b0 0x7f8a4c150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:35.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:35.101+0000 7f8a527c9640 1 --2- 172.21.15.29:0/2186962266 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a4c0c4f00 0x7f8a4c1ee3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:35.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:35.101+0000 7f8a527c9640 1 -- 172.21.15.29:0/2186962266 >> 172.21.15.29:0/2186962266 conn(0x7f8a4c0ca220 msgr2=0x7f8a4c0c5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:35.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:35.101+0000 7f8a527c9640 1 -- 172.21.15.29:0/2186962266 shutdown_connections 2024-01-25T15:04:35.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:35.101+0000 7f8a527c9640 1 -- 172.21.15.29:0/2186962266 wait complete. 2024-01-25T15:04:35.112 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-25T15:04:35.112 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-25T15:04:35.112 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-01-25T15:04:35.112 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-01-25T15:04:35.112 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-01-25T15:04:35.112 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-25T15:04:35.112 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-25T15:04:35.112 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-25T15:04:35.113 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-01-25T15:04:35.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:35.113 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-01-25T15:04:35.127 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-25T15:04:35.127 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-25T15:04:35.127 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-01-25T15:04:35.128 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:04:35.128 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-01-25T15:04:35.128 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:04:35.128 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:04:35.128 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-01-25T15:04:35.128 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2024-01-25T15:04:35.128 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:04:35.128 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-01-25T15:04:35.128 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2024-01-25T15:04:35.128 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-25T15:04:35.128 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-01-25T15:04:35.128 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2024-01-25T15:04:35.128 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-01-25T15:04:35.128 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42712sec preferred_lft 42712sec 2024-01-25T15:04:35.128 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link noprefixroute 2024-01-25T15:04:35.129 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:04:35.129 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:04:35.129 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-01-25T15:04:35.129 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2024-01-25T15:04:35.129 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-25T15:04:35.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:35.130 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-25T15:04:35.130 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-25T15:04:35.130 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add name ceph-brx type bridge 2024-01-25T15:04:35.130 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr flush dev ceph-brx 2024-01-25T15:04:35.130 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set ceph-brx up 2024-01-25T15:04:35.130 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-25T15:04:35.130 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-25T15:04:35.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:35.289 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-25T15:04:35.317 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-01-25T15:04:35.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:35.319 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-01-25T15:04:35.388 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-01-25T15:04:35.388 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-25T15:04:35.388 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-01-25T15:04:35.388 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-01-25T15:04:35.388 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-25T15:04:35.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:35.389 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-25T15:04:35.389 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-25T15:04:35.389 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-25T15:04:35.389 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-25T15:04:35.389 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-25T15:04:35.389 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-25T15:04:35.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:35.666 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-01-25T15:04:35.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:35.682 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2024-01-25T15:04:35.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:35.737 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-25T15:04:35.737 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-25T15:04:35.737 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-25T15:04:35.737 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-01-25T15:04:35.737 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-25T15:04:35.821 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-01-25T15:04:35.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:35.821 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-25T15:04:35.821 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-25T15:04:35.822 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-01-25T15:04:35.822 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-25T15:04:35.822 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-01-25T15:04:35.822 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-01-25T15:04:35.822 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-01-25T15:04:35.822 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-25T15:04:35.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:35.957 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-25T15:04:35.957 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-25T15:04:35.957 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2024-01-25T15:04:35.957 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.0 master ceph-brx 2024-01-25T15:04:35.957 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-25T15:04:35.999 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-01-25T15:04:35.999 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-25T15:04:36.000 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-01-25T15:04:36.053 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-01-25T15:04:36.054 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-25T15:04:36.054 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-01-25T15:04:36.109 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-25T15:04:36.178 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-01-25T15:04:36.234 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-01-25T15:04:36.234 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-01-25T15:04:36.234 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-01-25T15:04:36.234 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-01-25T15:04:36.234 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-01-25T15:04:36.234 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-01-25T15:04:36.234 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-01-25T15:04:36.234 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-01-25T15:04:36.234 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-01-25T15:04:36.234 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-01-25T15:04:36.234 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-01-25T15:04:36.234 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2024-01-25T15:04:36.235 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-01-25T15:04:36.235 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-01-25T15:04:36.235 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-01-25T15:04:36.235 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-01-25T15:04:36.235 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-01-25T15:04:36.235 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-25T15:04:36.235 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-01-25T15:04:36.235 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysctl.service 2024-01-25T15:04:36.235 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-01-25T15:04:36.235 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-25T15:04:36.235 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2024-01-25T15:04:36.235 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-01-25T15:04:36.235 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-01-25T15:04:36.235 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-01-25T15:04:36.235 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-01-25T15:04:36.236 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-01-25T15:04:36.236 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-01-25T15:04:36.236 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-01-25T15:04:36.236 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-25T15:04:36.236 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-25T15:04:36.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:36.236 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-25T15:04:36.288 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-25T15:04:36.289 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-01-25T15:04:36.330 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-01-25T15:04:36.357 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-01-25T15:04:36.413 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-01-25T15:04:36.413 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-01-25T15:04:36.413 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-01-25T15:04:36.413 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-01-25T15:04:36.413 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-01-25T15:04:36.414 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-01-25T15:04:36.414 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-01-25T15:04:36.414 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-01-25T15:04:36.414 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-01-25T15:04:36.414 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-01-25T15:04:36.414 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-01-25T15:04:36.414 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2024-01-25T15:04:36.414 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-01-25T15:04:36.414 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-01-25T15:04:36.414 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-01-25T15:04:36.414 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-01-25T15:04:36.414 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-01-25T15:04:36.414 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-25T15:04:36.415 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-01-25T15:04:36.415 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysctl.service 2024-01-25T15:04:36.415 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-01-25T15:04:36.415 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-25T15:04:36.415 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2024-01-25T15:04:36.415 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-01-25T15:04:36.415 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-01-25T15:04:36.415 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-01-25T15:04:36.415 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-01-25T15:04:36.415 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-01-25T15:04:36.415 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-01-25T15:04:36.415 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-01-25T15:04:36.415 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-25T15:04:36.415 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-25T15:04:36.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:36.416 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-01-25T15:04:36.423 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:2024-01-25T15:04:36.422+0000 7f1e808d8480 -1 init, newargv = 0x55d01661cf00 newargc=15 2024-01-25T15:04:36.423 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:ceph-fuse[43268]: starting ceph client 2024-01-25T15:04:36.429 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:ceph-fuse[43268]: starting fuse 2024-01-25T15:04:36.437 INFO:teuthology.orchestra.run.smithi029.stdout:42 2024-01-25T15:04:36.437 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-01-25T15:04:36.437 DEBUG:teuthology.orchestra.run.smithi029:> sudo stdin-killer -- python3 -c ' 2024-01-25T15:04:36.437 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2024-01-25T15:04:36.437 DEBUG:teuthology.orchestra.run.smithi029:> import re 2024-01-25T15:04:36.437 DEBUG:teuthology.orchestra.run.smithi029:> import os 2024-01-25T15:04:36.438 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2024-01-25T15:04:36.438 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-25T15:04:36.438 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2024-01-25T15:04:36.438 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-01-25T15:04:36.438 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2024-01-25T15:04:36.438 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-01-25T15:04:36.438 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-25T15:04:36.438 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2024-01-25T15:04:36.438 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2024-01-25T15:04:36.438 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2024-01-25T15:04:36.438 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2024-01-25T15:04:36.438 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-25T15:04:36.438 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2024-01-25T15:04:36.438 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-25T15:04:36.438 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-25T15:04:36.438 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-25T15:04:36.439 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2024-01-25T15:04:36.439 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2024-01-25T15:04:36.439 DEBUG:teuthology.orchestra.run.smithi029:> return f 2024-01-25T15:04:36.439 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-25T15:04:36.439 DEBUG:teuthology.orchestra.run.smithi029:> 2024-01-25T15:04:36.439 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.admin")) 2024-01-25T15:04:36.439 DEBUG:teuthology.orchestra.run.smithi029:> ' 2024-01-25T15:04:36.558 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.admin.43268.asok 2024-01-25T15:04:36.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-25T15:04:36.569 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43268.asok 2024-01-25T15:04:36.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:36.570 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43268.asok status 2024-01-25T15:04:36.715 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-25T15:04:36.715 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2024-01-25T15:04:36.715 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "661946e7044723130c03627323f6a879a9848cb5", 2024-01-25T15:04:36.715 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 19.0.0-885-g661946e7 (661946e7044723130c03627323f6a879a9848cb5) squid (dev)", 2024-01-25T15:04:36.715 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "admin", 2024-01-25T15:04:36.715 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2024-01-25T15:04:36.715 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-01-25T15:04:36.716 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "43268", 2024-01-25T15:04:36.716 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2024-01-25T15:04:36.716 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:04:36.716 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2024-01-25T15:04:36.716 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2024-01-25T15:04:36.716 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4449, 2024-01-25T15:04:36.716 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2024-01-25T15:04:36.716 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2024-01-25T15:04:36.716 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2024-01-25T15:04:36.716 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 4449 2024-01-25T15:04:36.716 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:04:36.716 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-01-25T15:04:36.716 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-01-25T15:04:36.716 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-01-25T15:04:36.717 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 1416874408 2024-01-25T15:04:36.717 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:04:36.717 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:04:36.717 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-01-25T15:04:36.717 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-01-25T15:04:36.717 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-01-25T15:04:36.717 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 1416874408 2024-01-25T15:04:36.717 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:04:36.717 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.4449 192.168.0.1:0/1416874408", 2024-01-25T15:04:36.717 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/1416874408", 2024-01-25T15:04:36.717 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2024-01-25T15:04:36.717 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 7, 2024-01-25T15:04:36.717 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 24, 2024-01-25T15:04:36.717 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2024-01-25T15:04:36.717 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2024-01-25T15:04:36.718 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2024-01-25T15:04:36.718 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-25T15:04:36.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:36.727 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2024-01-25T15:04:36.727 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-01-25T15:04:36.741 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2024-01-25T15:04:36.742 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-01-25T15:04:36.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:36.742 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-01-25T15:04:36.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:36.810 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-01-25T15:04:36.883 INFO:teuthology.orchestra.run.smithi029.stdout:# file: . 2024-01-25T15:04:36.884 INFO:teuthology.orchestra.run.smithi029.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-01-25T15:04:36.884 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:36.884 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:04:36.884 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:04:36.939 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:04:37.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.079+0000 7f4098c1e640 1 Processor -- start 2024-01-25T15:04:37.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.079+0000 7f4098c1e640 1 -- start start 2024-01-25T15:04:37.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.079+0000 7f4098c1e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4094152160 0x7f409406bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.079+0000 7f4098c1e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4094155430 con 0x7f40940c4990 2024-01-25T15:04:37.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.079+0000 7f4098c1e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4094154b40 con 0x7f40940c7f10 2024-01-25T15:04:37.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.079+0000 7f4098c1e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4094152540 con 0x7f4094152160 2024-01-25T15:04:37.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.080+0000 7f4089d9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f40940c4990 0x7f40940c4ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54508/0 (socket says 172.21.15.29:54508) 2024-01-25T15:04:37.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.080+0000 7f4089d9b640 1 -- 172.21.15.29:0/2413217631 learned_addr learned my addr 172.21.15.29:0/2413217631 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:37.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.080+0000 7f4091d9b640 1 -- 172.21.15.29:0/2413217631 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731594075 0 0) 0x7f4094155430 con 0x7f40940c4990 2024-01-25T15:04:37.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.080+0000 7f409259c640 1 --2- 172.21.15.29:0/2413217631 >> v2:172.21.15.52:3300/0 conn(0x7f4094152160 0x7f409406bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.080+0000 7f4091d9b640 1 -- 172.21.15.29:0/2413217631 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4080003520 con 0x7f40940c4990 2024-01-25T15:04:37.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.080+0000 7f4091d9b640 1 -- 172.21.15.29:0/2413217631 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 47633876 0 0) 0x7f4080003520 con 0x7f40940c4990 2024-01-25T15:04:37.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.080+0000 7f4091d9b640 1 -- 172.21.15.29:0/2413217631 >> v2:172.21.15.52:3300/0 conn(0x7f4094152160 msgr2=0x7f409406bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:37.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.080+0000 7f4091d9b640 1 --2- 172.21.15.29:0/2413217631 >> v2:172.21.15.52:3300/0 conn(0x7f4094152160 0x7f409406bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.080+0000 7f4091d9b640 1 -- 172.21.15.29:0/2413217631 >> v1:172.21.15.52:6789/0 conn(0x7f40940c7f10 legacy=0x7f409415f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:37.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.080+0000 7f4091d9b640 1 -- 172.21.15.29:0/2413217631 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40940c64b0 con 0x7f40940c4990 2024-01-25T15:04:37.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.080+0000 7f4091d9b640 1 -- 172.21.15.29:0/2413217631 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f407c001670 con 0x7f40940c4990 2024-01-25T15:04:37.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.080+0000 7f4091d9b640 1 -- 172.21.15.29:0/2413217631 >> v1:172.21.15.29:6789/0 conn(0x7f40940c4990 legacy=0x7f40940c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:37.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.080+0000 7f4091d9b640 1 --2- 172.21.15.29:0/2413217631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40800039c0 0x7f4080003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.080+0000 7f4091d9b640 1 --2- 172.21.15.29:0/2413217631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40800047c0 0x7f4080004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.080+0000 7f4091d9b640 1 --2- 172.21.15.29:0/2413217631 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40800051d0 0x7f408000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.080+0000 7f4091d9b640 1 -- 172.21.15.29:0/2413217631 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4094152540 con 0x7f40800039c0 2024-01-25T15:04:37.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.080+0000 7f4091d9b640 1 -- 172.21.15.29:0/2413217631 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408000c120 con 0x7f40800047c0 2024-01-25T15:04:37.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.080+0000 7f4091d9b640 1 -- 172.21.15.29:0/2413217631 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408000c2e0 con 0x7f40800051d0 2024-01-25T15:04:37.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.080+0000 7f409259c640 1 --2- 172.21.15.29:0/2413217631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40800039c0 0x7f4080003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.080+0000 7f4089d9b640 1 --2- 172.21.15.29:0/2413217631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40800047c0 0x7f4080004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.080+0000 7f4092d9d640 1 --2- 172.21.15.29:0/2413217631 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40800051d0 0x7f408000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.081+0000 7f409259c640 1 -- 172.21.15.29:0/2413217631 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40800051d0 msgr2=0x7f408000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:37.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.081+0000 7f409259c640 1 --2- 172.21.15.29:0/2413217631 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40800051d0 0x7f408000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.081+0000 7f409259c640 1 -- 172.21.15.29:0/2413217631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40800047c0 msgr2=0x7f4080004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:37.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.081+0000 7f409259c640 1 --2- 172.21.15.29:0/2413217631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40800047c0 0x7f4080004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.081+0000 7f409259c640 1 -- 172.21.15.29:0/2413217631 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4080003520 con 0x7f40800039c0 2024-01-25T15:04:37.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.081+0000 7f4092d9d640 1 --2- 172.21.15.29:0/2413217631 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40800051d0 0x7f408000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:37.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.081+0000 7f4092d9d640 1 -- 172.21.15.29:0/2413217631 reap_dead start 2024-01-25T15:04:37.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.081+0000 7f409259c640 1 --2- 172.21.15.29:0/2413217631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40800039c0 0x7f4080003de0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4084009a90 tx=0x7f40800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc3e11a76d05367 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:37.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.081+0000 7f4091d9b640 1 -- 172.21.15.29:0/2413217631 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408402c680 con 0x7f40800039c0 2024-01-25T15:04:37.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.081+0000 7f4091d9b640 1 -- 172.21.15.29:0/2413217631 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408402c7e0 con 0x7f40800039c0 2024-01-25T15:04:37.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.081+0000 7f4091d9b640 1 -- 172.21.15.29:0/2413217631 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408402cb70 con 0x7f40800039c0 2024-01-25T15:04:37.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.082+0000 7f4098c1e640 1 -- 172.21.15.29:0/2413217631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40800039c0 msgr2=0x7f4080003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:37.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.082+0000 7f4098c1e640 1 --2- 172.21.15.29:0/2413217631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40800039c0 0x7f4080003de0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4084009a90 tx=0x7f40800057f0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.082+0000 7f4098c1e640 1 -- 172.21.15.29:0/2413217631 shutdown_connections 2024-01-25T15:04:37.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.082+0000 7f4098c1e640 1 --2- 172.21.15.29:0/2413217631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40800039c0 0x7f4080003de0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.082+0000 7f4098c1e640 1 -- 172.21.15.29:0/2413217631 >> 172.21.15.29:0/2413217631 conn(0x7f40940ca1f0 msgr2=0x7f40940ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:37.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.082+0000 7f4098c1e640 1 -- 172.21.15.29:0/2413217631 shutdown_connections 2024-01-25T15:04:37.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.082+0000 7f4098c1e640 1 -- 172.21.15.29:0/2413217631 wait complete. 2024-01-25T15:04:37.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.083+0000 7f4098c1e640 1 Processor -- start 2024-01-25T15:04:37.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.083+0000 7f4098c1e640 1 -- start start 2024-01-25T15:04:37.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.084+0000 7f4098c1e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40800039c0 0x7f4094149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.084+0000 7f4098c1e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40941eaf30 0x7f40941ee250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.084+0000 7f4098c1e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4094157620 0x7f40941538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.084+0000 7f4098c1e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4094158400 con 0x7f40800039c0 2024-01-25T15:04:37.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.084+0000 7f4098c1e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40941ee790 con 0x7f4094157620 2024-01-25T15:04:37.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.084+0000 7f4098c1e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409414a240 con 0x7f40941eaf30 2024-01-25T15:04:37.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.084+0000 7f409259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40800039c0 0x7f4094149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.084+0000 7f409259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40800039c0 0x7f4094149910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35942/0 (socket says 172.21.15.29:35942) 2024-01-25T15:04:37.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.084+0000 7f409259c640 1 -- 172.21.15.29:0/2190466177 learned_addr learned my addr 172.21.15.29:0/2190466177 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:37.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.084+0000 7f4092d9d640 1 --2- 172.21.15.29:0/2190466177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4094157620 0x7f40941538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.084+0000 7f4089d9b640 1 --2- 172.21.15.29:0/2190466177 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40941eaf30 0x7f40941ee250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.084+0000 7f409259c640 1 -- 172.21.15.29:0/2190466177 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40941eaf30 msgr2=0x7f40941ee250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:37.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.084+0000 7f409259c640 1 --2- 172.21.15.29:0/2190466177 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40941eaf30 0x7f40941ee250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.085+0000 7f409259c640 1 -- 172.21.15.29:0/2190466177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4094157620 msgr2=0x7f40941538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:37.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.085+0000 7f409259c640 1 --2- 172.21.15.29:0/2190466177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4094157620 0x7f40941538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.085+0000 7f409259c640 1 -- 172.21.15.29:0/2190466177 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4094149f60 con 0x7f40800039c0 2024-01-25T15:04:37.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.085+0000 7f409259c640 1 --2- 172.21.15.29:0/2190466177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40800039c0 0x7f4094149910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4084009bb0 tx=0x7f4084004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:37.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.085+0000 7f408b7fe640 1 -- 172.21.15.29:0/2190466177 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084003810 con 0x7f40800039c0 2024-01-25T15:04:37.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.085+0000 7f408b7fe640 1 -- 172.21.15.29:0/2190466177 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4084003970 con 0x7f40800039c0 2024-01-25T15:04:37.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.085+0000 7f4098c1e640 1 -- 172.21.15.29:0/2190466177 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40941ea450 con 0x7f40800039c0 2024-01-25T15:04:37.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.085+0000 7f408b7fe640 1 -- 172.21.15.29:0/2190466177 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084003d20 con 0x7f40800039c0 2024-01-25T15:04:37.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.085+0000 7f4098c1e640 1 -- 172.21.15.29:0/2190466177 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40941eaa10 con 0x7f40800039c0 2024-01-25T15:04:37.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.086+0000 7f4098c1e640 1 -- 172.21.15.29:0/2190466177 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40941eaba0 con 0x7f40800039c0 2024-01-25T15:04:37.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.086+0000 7f408b7fe640 1 -- 172.21.15.29:0/2190466177 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4084034440 con 0x7f40800039c0 2024-01-25T15:04:37.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.087+0000 7f408b7fe640 1 --2- 172.21.15.29:0/2190466177 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f407406af00 0x7f407406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.087+0000 7f408b7fe640 1 -- 172.21.15.29:0/2190466177 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f40840ab600 con 0x7f40800039c0 2024-01-25T15:04:37.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.087+0000 7f4089d9b640 1 --2- 172.21.15.29:0/2190466177 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f407406af00 0x7f407406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.087+0000 7f4089d9b640 1 --2- 172.21.15.29:0/2190466177 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f407406af00 0x7f407406d3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f409414fc00 tx=0x7f407c000f80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:37.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.091+0000 7f408b7fe640 1 -- 172.21.15.29:0/2190466177 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4084076320 con 0x7f40800039c0 2024-01-25T15:04:37.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.270+0000 7f4098c1e640 1 -- 172.21.15.29:0/2190466177 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40940a97d0 con 0x7f40800039c0 2024-01-25T15:04:37.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.272+0000 7f408b7fe640 1 -- 172.21.15.29:0/2190466177 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18311 (secure 0 0 0) 0x7f40840044e0 con 0x7f40800039c0 2024-01-25T15:04:37.273 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:37.273 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:31.978871+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:04:37.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.273+0000 7f4098c1e640 1 -- 172.21.15.29:0/2190466177 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f407406af00 msgr2=0x7f407406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.273+0000 7f4098c1e640 1 --2- 172.21.15.29:0/2190466177 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f407406af00 0x7f407406d3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f409414fc00 tx=0x7f407c000f80 comp rx=0 tx=0).stop 2024-01-25T15:04:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.273+0000 7f4098c1e640 1 -- 172.21.15.29:0/2190466177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40800039c0 msgr2=0x7f4094149910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.273+0000 7f4098c1e640 1 --2- 172.21.15.29:0/2190466177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40800039c0 0x7f4094149910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4084009bb0 tx=0x7f4084004730 comp rx=0 tx=0).stop 2024-01-25T15:04:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.274+0000 7f4098c1e640 1 -- 172.21.15.29:0/2190466177 shutdown_connections 2024-01-25T15:04:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.274+0000 7f4098c1e640 1 --2- 172.21.15.29:0/2190466177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4094157620 0x7f40941538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.274+0000 7f4098c1e640 1 --2- 172.21.15.29:0/2190466177 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40941eaf30 0x7f40941ee250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.274+0000 7f4098c1e640 1 --2- 172.21.15.29:0/2190466177 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f407406af00 0x7f407406d3c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.274+0000 7f4098c1e640 1 --2- 172.21.15.29:0/2190466177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40800039c0 0x7f4094149910 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.274+0000 7f4098c1e640 1 -- 172.21.15.29:0/2190466177 >> 172.21.15.29:0/2190466177 conn(0x7f40940ca1f0 msgr2=0x7f4094151490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.274+0000 7f4098c1e640 1 -- 172.21.15.29:0/2190466177 shutdown_connections 2024-01-25T15:04:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.274+0000 7f4098c1e640 1 -- 172.21.15.29:0/2190466177 wait complete. 2024-01-25T15:04:37.285 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T15:04:14.955791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T15:04:24.986626+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T15:04:25.873673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-25T15:04:29.578261+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-25T15:04:37.285 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:04:37.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.389+0000 7f79e60a6640 1 Processor -- start 2024-01-25T15:04:37.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.389+0000 7f79e60a6640 1 -- start start 2024-01-25T15:04:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.389+0000 7f79e60a6640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e006d560 0x7f79e006b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.389+0000 7f79e60a6640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e00afaa0 con 0x7f79e00c4fe0 2024-01-25T15:04:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.389+0000 7f79e60a6640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e00c6060 con 0x7f79e00af6c0 2024-01-25T15:04:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.389+0000 7f79e60a6640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e006c480 con 0x7f79e006d560 2024-01-25T15:04:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.390+0000 7f79dffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f79e00c4fe0 0x7f79e006b760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54510/0 (socket says 172.21.15.29:54510) 2024-01-25T15:04:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.390+0000 7f79dffff640 1 -- 172.21.15.29:0/3968999996 learned_addr learned my addr 172.21.15.29:0/3968999996 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.390+0000 7f79deffd640 1 --2- 172.21.15.29:0/3968999996 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e006d560 0x7f79e006b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.390+0000 7f79de7fc640 1 -- 172.21.15.29:0/3968999996 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 620701176 0 0) 0x7f79e00afaa0 con 0x7f79e00c4fe0 2024-01-25T15:04:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.390+0000 7f79de7fc640 1 -- 172.21.15.29:0/3968999996 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79c8003520 con 0x7f79e00c4fe0 2024-01-25T15:04:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.390+0000 7f79de7fc640 1 -- 172.21.15.29:0/3968999996 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2548219842 0 0) 0x7f79c8003520 con 0x7f79e00c4fe0 2024-01-25T15:04:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.390+0000 7f79de7fc640 1 -- 172.21.15.29:0/3968999996 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e006d560 msgr2=0x7f79e006b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.390+0000 7f79de7fc640 1 --2- 172.21.15.29:0/3968999996 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e006d560 0x7f79e006b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.390+0000 7f79de7fc640 1 -- 172.21.15.29:0/3968999996 >> v1:172.21.15.52:6789/0 conn(0x7f79e00af6c0 legacy=0x7f79e00c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.390+0000 7f79de7fc640 1 -- 172.21.15.29:0/3968999996 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e0155480 con 0x7f79e00c4fe0 2024-01-25T15:04:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.390+0000 7f79de7fc640 1 -- 172.21.15.29:0/3968999996 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f79d80019f0 con 0x7f79e00c4fe0 2024-01-25T15:04:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.390+0000 7f79de7fc640 1 -- 172.21.15.29:0/3968999996 >> v1:172.21.15.29:6789/0 conn(0x7f79e00c4fe0 legacy=0x7f79e006b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.390+0000 7f79de7fc640 1 --2- 172.21.15.29:0/3968999996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c8003a10 0x7f79c8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.390+0000 7f79de7fc640 1 --2- 172.21.15.29:0/3968999996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c80047c0 0x7f79c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.390+0000 7f79de7fc640 1 --2- 172.21.15.29:0/3968999996 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e006d560 0x7f79c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.390+0000 7f79de7fc640 1 -- 172.21.15.29:0/3968999996 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e006c480 con 0x7f79c8003a10 2024-01-25T15:04:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.390+0000 7f79de7fc640 1 -- 172.21.15.29:0/3968999996 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c800ba30 con 0x7f79c80047c0 2024-01-25T15:04:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.390+0000 7f79de7fc640 1 -- 172.21.15.29:0/3968999996 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c800bbc0 con 0x7f79e006d560 2024-01-25T15:04:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.390+0000 7f79df7fe640 1 --2- 172.21.15.29:0/3968999996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c8003a10 0x7f79c8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.390+0000 7f79deffd640 1 --2- 172.21.15.29:0/3968999996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c80047c0 0x7f79c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.390+0000 7f79dffff640 1 --2- 172.21.15.29:0/3968999996 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e006d560 0x7f79c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.391+0000 7f79df7fe640 1 -- 172.21.15.29:0/3968999996 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e006d560 msgr2=0x7f79c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.391+0000 7f79df7fe640 1 --2- 172.21.15.29:0/3968999996 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e006d560 0x7f79c8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.391+0000 7f79df7fe640 1 -- 172.21.15.29:0/3968999996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c80047c0 msgr2=0x7f79c8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.391+0000 7f79df7fe640 1 --2- 172.21.15.29:0/3968999996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c80047c0 0x7f79c8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.391+0000 7f79df7fe640 1 -- 172.21.15.29:0/3968999996 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c8003520 con 0x7f79c8003a10 2024-01-25T15:04:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.391+0000 7f79df7fe640 1 --2- 172.21.15.29:0/3968999996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c8003a10 0x7f79c8003df0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f79d0001860 tx=0x7f79c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db5fb87ee517c339 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.391+0000 7f79de7fc640 1 -- 172.21.15.29:0/3968999996 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d002f050 con 0x7f79c8003a10 2024-01-25T15:04:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.391+0000 7f79de7fc640 1 -- 172.21.15.29:0/3968999996 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d0033610 con 0x7f79c8003a10 2024-01-25T15:04:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.391+0000 7f79de7fc640 1 -- 172.21.15.29:0/3968999996 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d00339c0 con 0x7f79c8003a10 2024-01-25T15:04:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.392+0000 7f79e60a6640 1 -- 172.21.15.29:0/3968999996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c8003a10 msgr2=0x7f79c8003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.392+0000 7f79e60a6640 1 --2- 172.21.15.29:0/3968999996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c8003a10 0x7f79c8003df0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f79d0001860 tx=0x7f79c80057f0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.392+0000 7f79dffff640 1 -- 172.21.15.29:0/3968999996 reap_dead start 2024-01-25T15:04:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.392+0000 7f79e60a6640 1 -- 172.21.15.29:0/3968999996 shutdown_connections 2024-01-25T15:04:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.392+0000 7f79e60a6640 1 -- 172.21.15.29:0/3968999996 >> 172.21.15.29:0/3968999996 conn(0x7f79e00c6ca0 msgr2=0x7f79e00c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.392+0000 7f79e60a6640 1 -- 172.21.15.29:0/3968999996 shutdown_connections 2024-01-25T15:04:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.392+0000 7f79e60a6640 1 -- 172.21.15.29:0/3968999996 wait complete. 2024-01-25T15:04:37.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.393+0000 7f79e60a6640 1 Processor -- start 2024-01-25T15:04:37.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.393+0000 7f79e60a6640 1 -- start start 2024-01-25T15:04:37.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.394+0000 7f79e60a6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c8003a10 0x7f79e00c0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.394+0000 7f79e60a6640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e0158590 0x7f79e00c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.394+0000 7f79e60a6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79e014ebf0 0x7f79e014f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.394+0000 7f79e60a6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e00c3da0 con 0x7f79e014ebf0 2024-01-25T15:04:37.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.394+0000 7f79e60a6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e00c1260 con 0x7f79c8003a10 2024-01-25T15:04:37.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.394+0000 7f79e60a6640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e014f5b0 con 0x7f79e0158590 2024-01-25T15:04:37.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.394+0000 7f79dffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79e014ebf0 0x7f79e014f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.394+0000 7f79dffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79e014ebf0 0x7f79e014f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35952/0 (socket says 172.21.15.29:35952) 2024-01-25T15:04:37.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.394+0000 7f79dffff640 1 -- 172.21.15.29:0/1201579338 learned_addr learned my addr 172.21.15.29:0/1201579338 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:37.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.394+0000 7f79df7fe640 1 --2- 172.21.15.29:0/1201579338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c8003a10 0x7f79e00c0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.394+0000 7f79deffd640 1 --2- 172.21.15.29:0/1201579338 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e0158590 0x7f79e00c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.394+0000 7f79dffff640 1 -- 172.21.15.29:0/1201579338 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e0158590 msgr2=0x7f79e00c0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:37.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.394+0000 7f79dffff640 1 --2- 172.21.15.29:0/1201579338 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e0158590 0x7f79e00c0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.394+0000 7f79dffff640 1 -- 172.21.15.29:0/1201579338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c8003a10 msgr2=0x7f79e00c0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:37.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.394+0000 7f79dffff640 1 --2- 172.21.15.29:0/1201579338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c8003a10 0x7f79e00c0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.394+0000 7f79dffff640 1 -- 172.21.15.29:0/1201579338 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e00c1490 con 0x7f79e014ebf0 2024-01-25T15:04:37.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.394+0000 7f79df7fe640 1 --2- 172.21.15.29:0/1201579338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c8003a10 0x7f79e00c0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:37.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.394+0000 7f79deffd640 1 --2- 172.21.15.29:0/1201579338 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e0158590 0x7f79e00c0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:37.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.395+0000 7f79dffff640 1 --2- 172.21.15.29:0/1201579338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79e014ebf0 0x7f79e014f070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f79d8001b20 tx=0x7f79d8007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:37.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.395+0000 7f79c7fff640 1 -- 172.21.15.29:0/1201579338 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d800eb30 con 0x7f79e014ebf0 2024-01-25T15:04:37.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.395+0000 7f79c7fff640 1 -- 172.21.15.29:0/1201579338 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d800ec90 con 0x7f79e014ebf0 2024-01-25T15:04:37.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.395+0000 7f79e60a6640 1 -- 172.21.15.29:0/1201579338 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e01565e0 con 0x7f79e014ebf0 2024-01-25T15:04:37.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.395+0000 7f79c7fff640 1 -- 172.21.15.29:0/1201579338 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d8014430 con 0x7f79e014ebf0 2024-01-25T15:04:37.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.395+0000 7f79e60a6640 1 -- 172.21.15.29:0/1201579338 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e0156ba0 con 0x7f79e014ebf0 2024-01-25T15:04:37.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.396+0000 7f79e60a6640 1 -- 172.21.15.29:0/1201579338 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e0074010 con 0x7f79e014ebf0 2024-01-25T15:04:37.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.396+0000 7f79c7fff640 1 -- 172.21.15.29:0/1201579338 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f79d8014590 con 0x7f79e014ebf0 2024-01-25T15:04:37.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.397+0000 7f79c7fff640 1 --2- 172.21.15.29:0/1201579338 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f79cc06aed0 0x7f79cc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.397+0000 7f79c7fff640 1 -- 172.21.15.29:0/1201579338 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f79d8089490 con 0x7f79e014ebf0 2024-01-25T15:04:37.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.397+0000 7f79df7fe640 1 --2- 172.21.15.29:0/1201579338 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f79cc06aed0 0x7f79cc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.397+0000 7f79df7fe640 1 --2- 172.21.15.29:0/1201579338 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f79cc06aed0 0x7f79cc06d390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f79d0036000 tx=0x7f79d0031000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:37.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.401+0000 7f79c7fff640 1 -- 172.21.15.29:0/1201579338 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f79d8054100 con 0x7f79e014ebf0 2024-01-25T15:04:37.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.580+0000 7f79e60a6640 1 -- 172.21.15.29:0/1201579338 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79e00c55d0 con 0x7f79e014ebf0 2024-01-25T15:04:37.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.581+0000 7f79c7fff640 1 -- 172.21.15.29:0/1201579338 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f79d8057720 con 0x7f79e014ebf0 2024-01-25T15:04:37.582 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-25T15:04:37.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.583+0000 7f79e60a6640 1 -- 172.21.15.29:0/1201579338 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f79cc06aed0 msgr2=0x7f79cc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:37.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.583+0000 7f79e60a6640 1 --2- 172.21.15.29:0/1201579338 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f79cc06aed0 0x7f79cc06d390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f79d0036000 tx=0x7f79d0031000 comp rx=0 tx=0).stop 2024-01-25T15:04:37.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.583+0000 7f79e60a6640 1 -- 172.21.15.29:0/1201579338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79e014ebf0 msgr2=0x7f79e014f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:37.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.583+0000 7f79e60a6640 1 --2- 172.21.15.29:0/1201579338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79e014ebf0 0x7f79e014f070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f79d8001b20 tx=0x7f79d8007bc0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.583+0000 7f79e60a6640 1 -- 172.21.15.29:0/1201579338 shutdown_connections 2024-01-25T15:04:37.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.583+0000 7f79e60a6640 1 --2- 172.21.15.29:0/1201579338 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f79cc06aed0 0x7f79cc06d390 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.583+0000 7f79e60a6640 1 --2- 172.21.15.29:0/1201579338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79e014ebf0 0x7f79e014f070 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.583+0000 7f79e60a6640 1 --2- 172.21.15.29:0/1201579338 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79e0158590 0x7f79e00c0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.583+0000 7f79e60a6640 1 --2- 172.21.15.29:0/1201579338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c8003a10 0x7f79e00c0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.583+0000 7f79e60a6640 1 -- 172.21.15.29:0/1201579338 >> 172.21.15.29:0/1201579338 conn(0x7f79e00c6ca0 msgr2=0x7f79e006b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:37.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.583+0000 7f79e60a6640 1 -- 172.21.15.29:0/1201579338 shutdown_connections 2024-01-25T15:04:37.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.583+0000 7f79e60a6640 1 -- 172.21.15.29:0/1201579338 wait complete. 2024-01-25T15:04:37.594 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:04:37.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.697+0000 7f084cbbe640 1 Processor -- start 2024-01-25T15:04:37.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.697+0000 7f084cbbe640 1 -- start start 2024-01-25T15:04:37.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.698+0000 7f084cbbe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f08480af6c0 0x7f08480c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.698+0000 7f084cbbe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08480c5a70 0x7f084806b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.698+0000 7f084cbbe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08480afaa0 con 0x7f084806d560 2024-01-25T15:04:37.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.698+0000 7f084cbbe640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f084806c480 con 0x7f08480af6c0 2024-01-25T15:04:37.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.698+0000 7f084cbbe640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0848155290 con 0x7f08480c5a70 2024-01-25T15:04:37.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.698+0000 7f0845d9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f084806d560 0x7f084806b220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54522/0 (socket says 172.21.15.29:54522) 2024-01-25T15:04:37.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.698+0000 7f0845d9b640 1 -- 172.21.15.29:0/802193914 learned_addr learned my addr 172.21.15.29:0/802193914 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:37.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.698+0000 7f084659c640 1 --2- 172.21.15.29:0/802193914 >> v2:172.21.15.52:3300/0 conn(0x7f08480af6c0 0x7f08480c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.698+0000 7f0846d9d640 1 --2- 172.21.15.29:0/802193914 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08480c5a70 0x7f084806b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.698+0000 7f084559a640 1 -- 172.21.15.29:0/802193914 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251682044 0 0) 0x7f08480afaa0 con 0x7f084806d560 2024-01-25T15:04:37.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.698+0000 7f084559a640 1 -- 172.21.15.29:0/802193914 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0834003520 con 0x7f084806d560 2024-01-25T15:04:37.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f084559a640 1 -- 172.21.15.29:0/802193914 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 74115461 0 0) 0x7f0834003520 con 0x7f084806d560 2024-01-25T15:04:37.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f084559a640 1 -- 172.21.15.29:0/802193914 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08480c5a70 msgr2=0x7f084806b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:37.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f084559a640 1 --2- 172.21.15.29:0/802193914 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08480c5a70 0x7f084806b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f084559a640 1 -- 172.21.15.29:0/802193914 >> v2:172.21.15.52:3300/0 conn(0x7f08480af6c0 msgr2=0x7f08480c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:37.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f084559a640 1 --2- 172.21.15.29:0/802193914 >> v2:172.21.15.52:3300/0 conn(0x7f08480af6c0 0x7f08480c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f084559a640 1 -- 172.21.15.29:0/802193914 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08480c6060 con 0x7f084806d560 2024-01-25T15:04:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f084559a640 1 -- 172.21.15.29:0/802193914 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f0830001670 con 0x7f084806d560 2024-01-25T15:04:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f084659c640 1 --2- 172.21.15.29:0/802193914 >> v2:172.21.15.52:3300/0 conn(0x7f08480af6c0 0x7f08480c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f084559a640 1 -- 172.21.15.29:0/802193914 >> v1:172.21.15.29:6789/0 conn(0x7f084806d560 legacy=0x7f084806b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f084559a640 1 --2- 172.21.15.29:0/802193914 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08480c5a70 0x7f08340039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f084559a640 1 --2- 172.21.15.29:0/802193914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0834003f60 0x7f08340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f084559a640 1 --2- 172.21.15.29:0/802193914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0834004d00 0x7f0834005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f084559a640 1 -- 172.21.15.29:0/802193914 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084806c480 con 0x7f0834003f60 2024-01-25T15:04:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f084559a640 1 -- 172.21.15.29:0/802193914 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083400b980 con 0x7f0834004d00 2024-01-25T15:04:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f084559a640 1 -- 172.21.15.29:0/802193914 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083400baf0 con 0x7f08480c5a70 2024-01-25T15:04:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f0845d9b640 1 --2- 172.21.15.29:0/802193914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0834003f60 0x7f08340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f084659c640 1 --2- 172.21.15.29:0/802193914 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08480c5a70 0x7f08340039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f0846d9d640 1 --2- 172.21.15.29:0/802193914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0834004d00 0x7f0834005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f0845d9b640 1 -- 172.21.15.29:0/802193914 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08480c5a70 msgr2=0x7f08340039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f0845d9b640 1 --2- 172.21.15.29:0/802193914 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08480c5a70 0x7f08340039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f0845d9b640 1 -- 172.21.15.29:0/802193914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0834004d00 msgr2=0x7f0834005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:37.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f0845d9b640 1 --2- 172.21.15.29:0/802193914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0834004d00 0x7f0834005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.699+0000 7f0845d9b640 1 -- 172.21.15.29:0/802193914 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0834003520 con 0x7f0834003f60 2024-01-25T15:04:37.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.700+0000 7f0845d9b640 1 --2- 172.21.15.29:0/802193914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0834003f60 0x7f08340047c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f083000c210 tx=0x7f08340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e551c10d1f730ae server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:37.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.700+0000 7f084559a640 1 -- 172.21.15.29:0/802193914 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0830005ad0 con 0x7f0834003f60 2024-01-25T15:04:37.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.700+0000 7f084559a640 1 -- 172.21.15.29:0/802193914 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0830005c30 con 0x7f0834003f60 2024-01-25T15:04:37.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.700+0000 7f084559a640 1 -- 172.21.15.29:0/802193914 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083002c8d0 con 0x7f0834003f60 2024-01-25T15:04:37.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.700+0000 7f084cbbe640 1 -- 172.21.15.29:0/802193914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0834003f60 msgr2=0x7f08340047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:37.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.700+0000 7f084cbbe640 1 --2- 172.21.15.29:0/802193914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0834003f60 0x7f08340047c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f083000c210 tx=0x7f08340057f0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.700+0000 7f0846d9d640 1 -- 172.21.15.29:0/802193914 reap_dead start 2024-01-25T15:04:37.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.701+0000 7f084cbbe640 1 -- 172.21.15.29:0/802193914 shutdown_connections 2024-01-25T15:04:37.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.701+0000 7f084cbbe640 1 -- 172.21.15.29:0/802193914 >> 172.21.15.29:0/802193914 conn(0x7f08480c6ca0 msgr2=0x7f08480c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:37.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.701+0000 7f084cbbe640 1 -- 172.21.15.29:0/802193914 shutdown_connections 2024-01-25T15:04:37.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.701+0000 7f084cbbe640 1 -- 172.21.15.29:0/802193914 wait complete. 2024-01-25T15:04:37.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.702+0000 7f084cbbe640 1 Processor -- start 2024-01-25T15:04:37.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.702+0000 7f084cbbe640 1 -- start start 2024-01-25T15:04:37.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.703+0000 7f084cbbe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0834003f60 0x7f0848156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.703+0000 7f084cbbe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08481e9de0 0x7f08480c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.703+0000 7f084cbbe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08480c2300 0x7f08480c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.703+0000 7f084cbbe640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08480bde00 con 0x7f08481e9de0 2024-01-25T15:04:37.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.703+0000 7f084cbbe640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084814f3f0 con 0x7f08480c2300 2024-01-25T15:04:37.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.703+0000 7f084cbbe640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08480c1260 con 0x7f0834003f60 2024-01-25T15:04:37.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.703+0000 7f0845d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08481e9de0 0x7f08480c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.703+0000 7f0845d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08481e9de0 0x7f08480c0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35966/0 (socket says 172.21.15.29:35966) 2024-01-25T15:04:37.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.703+0000 7f0845d9b640 1 -- 172.21.15.29:0/2303902418 learned_addr learned my addr 172.21.15.29:0/2303902418 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:37.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.703+0000 7f084659c640 1 --2- 172.21.15.29:0/2303902418 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0834003f60 0x7f0848156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.703+0000 7f0846d9d640 1 --2- 172.21.15.29:0/2303902418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08480c2300 0x7f08480c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.703+0000 7f0845d9b640 1 -- 172.21.15.29:0/2303902418 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0834003f60 msgr2=0x7f0848156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:37.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.703+0000 7f0845d9b640 1 --2- 172.21.15.29:0/2303902418 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0834003f60 0x7f0848156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.703+0000 7f0845d9b640 1 -- 172.21.15.29:0/2303902418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08480c2300 msgr2=0x7f08480c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:37.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.703+0000 7f0845d9b640 1 --2- 172.21.15.29:0/2303902418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08480c2300 0x7f08480c3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.703+0000 7f0845d9b640 1 -- 172.21.15.29:0/2303902418 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08480c1540 con 0x7f08481e9de0 2024-01-25T15:04:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.703+0000 7f0845d9b640 1 --2- 172.21.15.29:0/2303902418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08481e9de0 0x7f08480c0ac0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0830000f60 tx=0x7f08480c61f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.703+0000 7f083effd640 1 -- 172.21.15.29:0/2303902418 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0830039070 con 0x7f08481e9de0 2024-01-25T15:04:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.703+0000 7f083effd640 1 -- 172.21.15.29:0/2303902418 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083002cd00 con 0x7f08481e9de0 2024-01-25T15:04:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.703+0000 7f084cbbe640 1 -- 172.21.15.29:0/2303902418 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08480c1820 con 0x7f08481e9de0 2024-01-25T15:04:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.703+0000 7f083effd640 1 -- 172.21.15.29:0/2303902418 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08300072b0 con 0x7f08481e9de0 2024-01-25T15:04:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.703+0000 7f084cbbe640 1 -- 172.21.15.29:0/2303902418 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08480c1de0 con 0x7f08481e9de0 2024-01-25T15:04:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.704+0000 7f084cbbe640 1 -- 172.21.15.29:0/2303902418 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0848074010 con 0x7f08481e9de0 2024-01-25T15:04:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.705+0000 7f083effd640 1 -- 172.21.15.29:0/2303902418 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0830032070 con 0x7f08481e9de0 2024-01-25T15:04:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.705+0000 7f083effd640 1 --2- 172.21.15.29:0/2303902418 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f082806af00 0x7f082806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.705+0000 7f083effd640 1 -- 172.21.15.29:0/2303902418 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f083003c040 con 0x7f08481e9de0 2024-01-25T15:04:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.705+0000 7f084659c640 1 --2- 172.21.15.29:0/2303902418 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f082806af00 0x7f082806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.706+0000 7f084659c640 1 --2- 172.21.15.29:0/2303902418 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f082806af00 0x7f082806d3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f08480c3260 tx=0x7f0840008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:37.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.709+0000 7f083effd640 1 -- 172.21.15.29:0/2303902418 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f08300756f0 con 0x7f08481e9de0 2024-01-25T15:04:37.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.892+0000 7f084cbbe640 1 -- 172.21.15.29:0/2303902418 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f08480c4550 con 0x7f08481e9de0 2024-01-25T15:04:37.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.892+0000 7f083effd640 1 -- 172.21.15.29:0/2303902418 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f08300aa070 con 0x7f08481e9de0 2024-01-25T15:04:37.893 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:04:37.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.894+0000 7f084cbbe640 1 -- 172.21.15.29:0/2303902418 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f082806af00 msgr2=0x7f082806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:37.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.894+0000 7f084cbbe640 1 --2- 172.21.15.29:0/2303902418 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f082806af00 0x7f082806d3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f08480c3260 tx=0x7f0840008040 comp rx=0 tx=0).stop 2024-01-25T15:04:37.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.894+0000 7f084cbbe640 1 -- 172.21.15.29:0/2303902418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08481e9de0 msgr2=0x7f08480c0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:37.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.894+0000 7f084cbbe640 1 --2- 172.21.15.29:0/2303902418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08481e9de0 0x7f08480c0ac0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0830000f60 tx=0x7f08480c61f0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.894+0000 7f084cbbe640 1 -- 172.21.15.29:0/2303902418 shutdown_connections 2024-01-25T15:04:37.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.894+0000 7f084cbbe640 1 --2- 172.21.15.29:0/2303902418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08480c2300 0x7f08480c3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.894+0000 7f084cbbe640 1 --2- 172.21.15.29:0/2303902418 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f082806af00 0x7f082806d3c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.894+0000 7f084cbbe640 1 --2- 172.21.15.29:0/2303902418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08481e9de0 0x7f08480c0ac0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.894+0000 7f084cbbe640 1 --2- 172.21.15.29:0/2303902418 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0834003f60 0x7f0848156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:37.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.894+0000 7f084cbbe640 1 -- 172.21.15.29:0/2303902418 >> 172.21.15.29:0/2303902418 conn(0x7f08480c6ca0 msgr2=0x7f084806ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:37.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.894+0000 7f084cbbe640 1 -- 172.21.15.29:0/2303902418 shutdown_connections 2024-01-25T15:04:37.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:37.894+0000 7f084cbbe640 1 -- 172.21.15.29:0/2303902418 wait complete. 2024-01-25T15:04:37.905 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:04:38.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.009+0000 7f27bf533640 1 Processor -- start 2024-01-25T15:04:38.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.009+0000 7f27bf533640 1 -- start start 2024-01-25T15:04:38.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.010+0000 7f27bf533640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f27b80af6c0 0x7f27b80c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:38.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.010+0000 7f27bf533640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f27b80c5a70 0x7f27b806b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:38.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.010+0000 7f27bf533640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b80afaa0 con 0x7f27b806d560 2024-01-25T15:04:38.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.010+0000 7f27bf533640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b806c480 con 0x7f27b80c5a70 2024-01-25T15:04:38.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.010+0000 7f27bf533640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b8155290 con 0x7f27b80af6c0 2024-01-25T15:04:38.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.010+0000 7f27bdad0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f27b80c5a70 0x7f27b806b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:38.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.010+0000 7f27bcace640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f27b806d560 0x7f27b806b220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54538/0 (socket says 172.21.15.29:54538) 2024-01-25T15:04:38.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.010+0000 7f27bcace640 1 -- 172.21.15.29:0/1980899195 learned_addr learned my addr 172.21.15.29:0/1980899195 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:38.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.010+0000 7f27bd2cf640 1 --2- 172.21.15.29:0/1980899195 >> v2:172.21.15.52:3300/0 conn(0x7f27b80af6c0 0x7f27b80c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:38.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.010+0000 7f27bdad0640 1 -- 172.21.15.29:0/1980899195 >> v2:172.21.15.52:3300/0 conn(0x7f27b80af6c0 msgr2=0x7f27b80c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:38.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.010+0000 7f27bdad0640 1 --2- 172.21.15.29:0/1980899195 >> v2:172.21.15.52:3300/0 conn(0x7f27b80af6c0 0x7f27b80c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.010+0000 7f27bdad0640 1 -- 172.21.15.29:0/1980899195 >> v1:172.21.15.29:6789/0 conn(0x7f27b806d560 legacy=0x7f27b806b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:38.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.010+0000 7f27b7fff640 1 -- 172.21.15.29:0/1980899195 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089976899 0 0) 0x7f27b80afaa0 con 0x7f27b806d560 2024-01-25T15:04:38.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.010+0000 7f27bdad0640 1 -- 172.21.15.29:0/1980899195 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b80c6060 con 0x7f27b80c5a70 2024-01-25T15:04:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.011+0000 7f27bdad0640 1 --2- 172.21.15.29:0/1980899195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27b80c5a70 0x7f27b806b930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f27b808b4b0 tx=0x7f27a802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2080f4cde28c908a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.011+0000 7f27b7fff640 1 -- 172.21.15.29:0/1980899195 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a8031830 con 0x7f27b80c5a70 2024-01-25T15:04:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.011+0000 7f27b7fff640 1 -- 172.21.15.29:0/1980899195 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a8031990 con 0x7f27b80c5a70 2024-01-25T15:04:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.011+0000 7f27b7fff640 1 -- 172.21.15.29:0/1980899195 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a8031d20 con 0x7f27b80c5a70 2024-01-25T15:04:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.012+0000 7f27bf533640 1 -- 172.21.15.29:0/1980899195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27b80c5a70 msgr2=0x7f27b806b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.012+0000 7f27bf533640 1 --2- 172.21.15.29:0/1980899195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27b80c5a70 0x7f27b806b930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f27b808b4b0 tx=0x7f27a802b8d0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.012+0000 7f27bf533640 1 -- 172.21.15.29:0/1980899195 shutdown_connections 2024-01-25T15:04:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.012+0000 7f27bf533640 1 --2- 172.21.15.29:0/1980899195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27b80c5a70 0x7f27b806b930 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.012+0000 7f27bf533640 1 --2- 172.21.15.29:0/1980899195 >> v2:172.21.15.52:3300/0 conn(0x7f27b80af6c0 0x7f27b80c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.012+0000 7f27bf533640 1 -- 172.21.15.29:0/1980899195 >> 172.21.15.29:0/1980899195 conn(0x7f27b80c6ca0 msgr2=0x7f27b80c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.012+0000 7f27bf533640 1 -- 172.21.15.29:0/1980899195 shutdown_connections 2024-01-25T15:04:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.012+0000 7f27bf533640 1 -- 172.21.15.29:0/1980899195 wait complete. 2024-01-25T15:04:38.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.013+0000 7f27bf533640 1 Processor -- start 2024-01-25T15:04:38.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.013+0000 7f27bf533640 1 -- start start 2024-01-25T15:04:38.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.014+0000 7f27bf533640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27b806d560 0x7f27b81ed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:38.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.014+0000 7f27bf533640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27b80af6c0 0x7f27b814e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:38.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.014+0000 7f27bf533640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27b80c5a70 0x7f27b814e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:38.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.014+0000 7f27bf533640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b80c0c00 con 0x7f27b80af6c0 2024-01-25T15:04:38.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.014+0000 7f27bf533640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b81edb00 con 0x7f27b806d560 2024-01-25T15:04:38.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.014+0000 7f27bf533640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b81edda0 con 0x7f27b80c5a70 2024-01-25T15:04:38.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.014+0000 7f27bcace640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27b80af6c0 0x7f27b814e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:38.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.014+0000 7f27bcace640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27b80af6c0 0x7f27b814e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35982/0 (socket says 172.21.15.29:35982) 2024-01-25T15:04:38.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.014+0000 7f27bcace640 1 -- 172.21.15.29:0/2592100781 learned_addr learned my addr 172.21.15.29:0/2592100781 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.014+0000 7f27bd2cf640 1 --2- 172.21.15.29:0/2592100781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27b806d560 0x7f27b81ed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.014+0000 7f27bdad0640 1 --2- 172.21.15.29:0/2592100781 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27b80c5a70 0x7f27b814e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.014+0000 7f27bcace640 1 -- 172.21.15.29:0/2592100781 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27b80c5a70 msgr2=0x7f27b814e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.014+0000 7f27bcace640 1 --2- 172.21.15.29:0/2592100781 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27b80c5a70 0x7f27b814e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.014+0000 7f27bcace640 1 -- 172.21.15.29:0/2592100781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27b806d560 msgr2=0x7f27b81ed2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.014+0000 7f27bcace640 1 --2- 172.21.15.29:0/2592100781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27b806d560 0x7f27b81ed2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.014+0000 7f27bcace640 1 -- 172.21.15.29:0/2592100781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a8009400 con 0x7f27b80af6c0 2024-01-25T15:04:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.014+0000 7f27bdad0640 1 --2- 172.21.15.29:0/2592100781 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27b80c5a70 0x7f27b814e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.014+0000 7f27bcace640 1 --2- 172.21.15.29:0/2592100781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27b80af6c0 0x7f27b814e020 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c4d0 tx=0x7f27ac00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.014+0000 7f27b5ffb640 1 -- 172.21.15.29:0/2592100781 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac0074e0 con 0x7f27b80af6c0 2024-01-25T15:04:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.014+0000 7f27b5ffb640 1 -- 172.21.15.29:0/2592100781 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac007660 con 0x7f27b80af6c0 2024-01-25T15:04:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.014+0000 7f27bf533640 1 -- 172.21.15.29:0/2592100781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b8157f20 con 0x7f27b80af6c0 2024-01-25T15:04:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.014+0000 7f27b5ffb640 1 -- 172.21.15.29:0/2592100781 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac004a20 con 0x7f27b80af6c0 2024-01-25T15:04:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.015+0000 7f27bf533640 1 -- 172.21.15.29:0/2592100781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b81ed800 con 0x7f27b80af6c0 2024-01-25T15:04:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.016+0000 7f27bf533640 1 -- 172.21.15.29:0/2592100781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b81edfc0 con 0x7f27b80af6c0 2024-01-25T15:04:38.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.016+0000 7f27b5ffb640 1 -- 172.21.15.29:0/2592100781 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f27ac004b80 con 0x7f27b80af6c0 2024-01-25T15:04:38.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.016+0000 7f27b5ffb640 1 --2- 172.21.15.29:0/2592100781 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f27a406af00 0x7f27a406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:38.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.016+0000 7f27b5ffb640 1 -- 172.21.15.29:0/2592100781 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f27ac088d80 con 0x7f27b80af6c0 2024-01-25T15:04:38.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.017+0000 7f27bd2cf640 1 --2- 172.21.15.29:0/2592100781 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f27a406af00 0x7f27a406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:38.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.017+0000 7f27bd2cf640 1 --2- 172.21.15.29:0/2592100781 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f27a406af00 0x7f27a406d3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f27b00113e0 tx=0x7f27b000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:38.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.021+0000 7f27b5ffb640 1 -- 172.21.15.29:0/2592100781 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f27ac053a10 con 0x7f27b80af6c0 2024-01-25T15:04:38.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.199+0000 7f27bf533640 1 -- 172.21.15.29:0/2592100781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f27b8074010 con 0x7f27b80af6c0 2024-01-25T15:04:38.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.200+0000 7f27b5ffb640 1 -- 172.21.15.29:0/2592100781 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f27ac018020 con 0x7f27b80af6c0 2024-01-25T15:04:38.200 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-25T15:04:38.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.202+0000 7f27bf533640 1 -- 172.21.15.29:0/2592100781 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f27a406af00 msgr2=0x7f27a406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:38.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.202+0000 7f27bf533640 1 --2- 172.21.15.29:0/2592100781 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f27a406af00 0x7f27a406d3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f27b00113e0 tx=0x7f27b000b040 comp rx=0 tx=0).stop 2024-01-25T15:04:38.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.202+0000 7f27bf533640 1 -- 172.21.15.29:0/2592100781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27b80af6c0 msgr2=0x7f27b814e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:38.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.202+0000 7f27bf533640 1 --2- 172.21.15.29:0/2592100781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27b80af6c0 0x7f27b814e020 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c4d0 tx=0x7f27ac00c990 comp rx=0 tx=0).stop 2024-01-25T15:04:38.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.202+0000 7f27bf533640 1 -- 172.21.15.29:0/2592100781 shutdown_connections 2024-01-25T15:04:38.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.202+0000 7f27bf533640 1 --2- 172.21.15.29:0/2592100781 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27b80c5a70 0x7f27b814e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.202+0000 7f27bf533640 1 --2- 172.21.15.29:0/2592100781 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f27a406af00 0x7f27a406d3c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.202+0000 7f27bf533640 1 --2- 172.21.15.29:0/2592100781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27b80af6c0 0x7f27b814e020 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.202+0000 7f27bf533640 1 --2- 172.21.15.29:0/2592100781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27b806d560 0x7f27b81ed2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.202+0000 7f27bf533640 1 -- 172.21.15.29:0/2592100781 >> 172.21.15.29:0/2592100781 conn(0x7f27b80c6ca0 msgr2=0x7f27b80c7080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:38.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.202+0000 7f27bf533640 1 -- 172.21.15.29:0/2592100781 shutdown_connections 2024-01-25T15:04:38.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.202+0000 7f27bf533640 1 -- 172.21.15.29:0/2592100781 wait complete. 2024-01-25T15:04:38.213 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-25T15:04:38.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.316+0000 7fad381c9640 1 Processor -- start 2024-01-25T15:04:38.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.316+0000 7fad381c9640 1 -- start start 2024-01-25T15:04:38.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.317+0000 7fad381c9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fad300c8620 0x7fad300c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:38.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.317+0000 7fad381c9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad30158b80 0x7fad30151c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:38.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.317+0000 7fad381c9640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad30159030 con 0x7fad3006b490 2024-01-25T15:04:38.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.317+0000 7fad381c9640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad300c6770 con 0x7fad300c8620 2024-01-25T15:04:38.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.317+0000 7fad381c9640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad30154f10 con 0x7fad30158b80 2024-01-25T15:04:38.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.317+0000 7fad35f65640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fad3006b490 0x7fad300c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54546/0 (socket says 172.21.15.29:54546) 2024-01-25T15:04:38.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.317+0000 7fad35f65640 1 -- 172.21.15.29:0/1193575313 learned_addr learned my addr 172.21.15.29:0/1193575313 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:38.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.317+0000 7fad35764640 1 --2- 172.21.15.29:0/1193575313 >> v2:172.21.15.52:3300/0 conn(0x7fad300c8620 0x7fad300c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:38.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.317+0000 7fad36766640 1 --2- 172.21.15.29:0/1193575313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad30158b80 0x7fad30151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:38.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.317+0000 7fad34f63640 1 -- 172.21.15.29:0/1193575313 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19420867 0 0) 0x7fad30159030 con 0x7fad3006b490 2024-01-25T15:04:38.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.317+0000 7fad34f63640 1 -- 172.21.15.29:0/1193575313 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad1c003520 con 0x7fad3006b490 2024-01-25T15:04:38.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.317+0000 7fad36766640 1 -- 172.21.15.29:0/1193575313 >> v2:172.21.15.52:3300/0 conn(0x7fad300c8620 msgr2=0x7fad300c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:38.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.317+0000 7fad36766640 1 --2- 172.21.15.29:0/1193575313 >> v2:172.21.15.52:3300/0 conn(0x7fad300c8620 0x7fad300c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.317+0000 7fad36766640 1 -- 172.21.15.29:0/1193575313 >> v1:172.21.15.29:6789/0 conn(0x7fad3006b490 legacy=0x7fad300c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:38.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.317+0000 7fad36766640 1 -- 172.21.15.29:0/1193575313 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad301551f0 con 0x7fad30158b80 2024-01-25T15:04:38.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.317+0000 7fad35764640 1 --2- 172.21.15.29:0/1193575313 >> v2:172.21.15.52:3300/0 conn(0x7fad300c8620 0x7fad300c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:38.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.318+0000 7fad36766640 1 --2- 172.21.15.29:0/1193575313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad30158b80 0x7fad30151c30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fad28009d90 tx=0x7fad2802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6045b2e9feb4defd server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:38.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.318+0000 7fad34f63640 1 -- 172.21.15.29:0/1193575313 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2802cbc0 con 0x7fad30158b80 2024-01-25T15:04:38.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.318+0000 7fad34f63640 1 -- 172.21.15.29:0/1193575313 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2802cd20 con 0x7fad30158b80 2024-01-25T15:04:38.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.318+0000 7fad34f63640 1 -- 172.21.15.29:0/1193575313 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad28034640 con 0x7fad30158b80 2024-01-25T15:04:38.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.319+0000 7fad381c9640 1 -- 172.21.15.29:0/1193575313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad30158b80 msgr2=0x7fad30151c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:38.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.319+0000 7fad381c9640 1 --2- 172.21.15.29:0/1193575313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad30158b80 0x7fad30151c30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fad28009d90 tx=0x7fad2802be10 comp rx=0 tx=0).stop 2024-01-25T15:04:38.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.319+0000 7fad381c9640 1 -- 172.21.15.29:0/1193575313 shutdown_connections 2024-01-25T15:04:38.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.319+0000 7fad381c9640 1 --2- 172.21.15.29:0/1193575313 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad30158b80 0x7fad30151c30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.319+0000 7fad381c9640 1 --2- 172.21.15.29:0/1193575313 >> v2:172.21.15.52:3300/0 conn(0x7fad300c8620 0x7fad300c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.319+0000 7fad381c9640 1 -- 172.21.15.29:0/1193575313 >> 172.21.15.29:0/1193575313 conn(0x7fad300ca010 msgr2=0x7fad300ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:38.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.319+0000 7fad381c9640 1 -- 172.21.15.29:0/1193575313 shutdown_connections 2024-01-25T15:04:38.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.319+0000 7fad381c9640 1 -- 172.21.15.29:0/1193575313 wait complete. 2024-01-25T15:04:38.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.320+0000 7fad381c9640 1 Processor -- start 2024-01-25T15:04:38.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.320+0000 7fad381c9640 1 -- start start 2024-01-25T15:04:38.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.320+0000 7fad381c9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad3006b490 0x7fad30148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:38.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.320+0000 7fad381c9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad300c8620 0x7fad301ed730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:38.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.321+0000 7fad381c9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad30158b80 0x7fad301501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:38.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.321+0000 7fad381c9640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad30157590 con 0x7fad3006b490 2024-01-25T15:04:38.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.321+0000 7fad381c9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad301ee1f0 con 0x7fad30158b80 2024-01-25T15:04:38.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.321+0000 7fad381c9640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3014f760 con 0x7fad300c8620 2024-01-25T15:04:38.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.321+0000 7fad35f65640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad3006b490 0x7fad30148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:38.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.321+0000 7fad35f65640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad3006b490 0x7fad30148ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35996/0 (socket says 172.21.15.29:35996) 2024-01-25T15:04:38.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.321+0000 7fad35f65640 1 -- 172.21.15.29:0/3632756074 learned_addr learned my addr 172.21.15.29:0/3632756074 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:38.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.321+0000 7fad35764640 1 --2- 172.21.15.29:0/3632756074 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad300c8620 0x7fad301ed730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:38.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.321+0000 7fad36766640 1 --2- 172.21.15.29:0/3632756074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad30158b80 0x7fad301501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.321+0000 7fad35f65640 1 -- 172.21.15.29:0/3632756074 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad300c8620 msgr2=0x7fad301ed730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.321+0000 7fad35f65640 1 --2- 172.21.15.29:0/3632756074 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad300c8620 0x7fad301ed730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.321+0000 7fad35f65640 1 -- 172.21.15.29:0/3632756074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad30158b80 msgr2=0x7fad301501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.321+0000 7fad35f65640 1 --2- 172.21.15.29:0/3632756074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad30158b80 0x7fad301501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.321+0000 7fad35f65640 1 -- 172.21.15.29:0/3632756074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad20009400 con 0x7fad3006b490 2024-01-25T15:04:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.321+0000 7fad35f65640 1 --2- 172.21.15.29:0/3632756074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad3006b490 0x7fad30148ac0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fad2c00c430 tx=0x7fad2c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.321+0000 7fad267fc640 1 -- 172.21.15.29:0/3632756074 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2c005ce0 con 0x7fad3006b490 2024-01-25T15:04:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.321+0000 7fad267fc640 1 -- 172.21.15.29:0/3632756074 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2c005e40 con 0x7fad3006b490 2024-01-25T15:04:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.321+0000 7fad381c9640 1 -- 172.21.15.29:0/3632756074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad28009a70 con 0x7fad3006b490 2024-01-25T15:04:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.321+0000 7fad267fc640 1 -- 172.21.15.29:0/3632756074 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2c0072f0 con 0x7fad3006b490 2024-01-25T15:04:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.321+0000 7fad381c9640 1 -- 172.21.15.29:0/3632756074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad30155b70 con 0x7fad3006b490 2024-01-25T15:04:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.322+0000 7fad381c9640 1 -- 172.21.15.29:0/3632756074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad30157760 con 0x7fad3006b490 2024-01-25T15:04:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.323+0000 7fad267fc640 1 -- 172.21.15.29:0/3632756074 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fad2c007450 con 0x7fad3006b490 2024-01-25T15:04:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.323+0000 7fad267fc640 1 --2- 172.21.15.29:0/3632756074 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fad1406aed0 0x7fad1406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.323+0000 7fad267fc640 1 -- 172.21.15.29:0/3632756074 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fad2c088f20 con 0x7fad3006b490 2024-01-25T15:04:38.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.323+0000 7fad35764640 1 --2- 172.21.15.29:0/3632756074 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fad1406aed0 0x7fad1406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:38.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.324+0000 7fad35764640 1 --2- 172.21.15.29:0/3632756074 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fad1406aed0 0x7fad1406d390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fad30151560 tx=0x7fad20009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:38.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.328+0000 7fad267fc640 1 -- 172.21.15.29:0/3632756074 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fad2c053bb0 con 0x7fad3006b490 2024-01-25T15:04:38.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.507+0000 7fad381c9640 1 -- 172.21.15.29:0/3632756074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fad300a97d0 con 0x7fad3006b490 2024-01-25T15:04:38.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.508+0000 7fad267fc640 1 -- 172.21.15.29:0/3632756074 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fad2c017020 con 0x7fad3006b490 2024-01-25T15:04:38.509 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:04:38.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.510+0000 7fad381c9640 1 -- 172.21.15.29:0/3632756074 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fad1406aed0 msgr2=0x7fad1406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:38.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.510+0000 7fad381c9640 1 --2- 172.21.15.29:0/3632756074 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fad1406aed0 0x7fad1406d390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fad30151560 tx=0x7fad20009190 comp rx=0 tx=0).stop 2024-01-25T15:04:38.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.510+0000 7fad381c9640 1 -- 172.21.15.29:0/3632756074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad3006b490 msgr2=0x7fad30148ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:38.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.510+0000 7fad381c9640 1 --2- 172.21.15.29:0/3632756074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad3006b490 0x7fad30148ac0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fad2c00c430 tx=0x7fad2c00c8f0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.510+0000 7fad381c9640 1 -- 172.21.15.29:0/3632756074 shutdown_connections 2024-01-25T15:04:38.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.510+0000 7fad381c9640 1 --2- 172.21.15.29:0/3632756074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad30158b80 0x7fad301501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.510+0000 7fad381c9640 1 --2- 172.21.15.29:0/3632756074 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad300c8620 0x7fad301ed730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.510+0000 7fad381c9640 1 --2- 172.21.15.29:0/3632756074 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fad1406aed0 0x7fad1406d390 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.510+0000 7fad381c9640 1 --2- 172.21.15.29:0/3632756074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad3006b490 0x7fad30148ac0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.510+0000 7fad381c9640 1 -- 172.21.15.29:0/3632756074 >> 172.21.15.29:0/3632756074 conn(0x7fad300ca010 msgr2=0x7fad3014b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:38.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.510+0000 7fad381c9640 1 -- 172.21.15.29:0/3632756074 shutdown_connections 2024-01-25T15:04:38.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.510+0000 7fad381c9640 1 -- 172.21.15.29:0/3632756074 wait complete. 2024-01-25T15:04:38.521 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-25T15:04:38.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.623+0000 7f0fa77f0640 1 Processor -- start 2024-01-25T15:04:38.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.623+0000 7f0fa77f0640 1 -- start start 2024-01-25T15:04:38.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.624+0000 7f0fa77f0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0fa00c8620 0x7f0fa00c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:38.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.624+0000 7f0fa77f0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fa0158b80 0x7f0fa0151c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:38.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.624+0000 7f0fa77f0640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa0159030 con 0x7f0fa006b490 2024-01-25T15:04:38.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.624+0000 7f0fa77f0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa00c6770 con 0x7f0fa00c8620 2024-01-25T15:04:38.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.624+0000 7f0fa77f0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa0154f10 con 0x7f0fa0158b80 2024-01-25T15:04:38.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.624+0000 7f0fa4d8b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0fa00c8620 0x7f0fa00c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:38.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.624+0000 7f0fa4d8b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0fa00c8620 0x7f0fa00c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36004/0 (socket says 172.21.15.29:36004) 2024-01-25T15:04:38.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.624+0000 7f0fa4d8b640 1 -- 172.21.15.29:0/606109299 learned_addr learned my addr 172.21.15.29:0/606109299 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:38.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.624+0000 7f0fa5d8d640 1 --2- 172.21.15.29:0/606109299 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fa0158b80 0x7f0fa0151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:38.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.624+0000 7f0fa4d8b640 1 -- 172.21.15.29:0/606109299 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fa0158b80 msgr2=0x7f0fa0151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:38.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.624+0000 7f0fa4d8b640 1 --2- 172.21.15.29:0/606109299 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fa0158b80 0x7f0fa0151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.624+0000 7f0fa4d8b640 1 -- 172.21.15.29:0/606109299 >> v1:172.21.15.52:6789/0 conn(0x7f0fa006b490 legacy=0x7f0fa00c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:38.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.624+0000 7f0fa4d8b640 1 -- 172.21.15.29:0/606109299 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa01551f0 con 0x7f0fa00c8620 2024-01-25T15:04:38.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.624+0000 7f0fa5d8d640 1 --2- 172.21.15.29:0/606109299 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fa0158b80 0x7f0fa0151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:38.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.625+0000 7f0fa4d8b640 1 --2- 172.21.15.29:0/606109299 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fa00c8620 0x7f0fa00c6120 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009870 tx=0x7f0f9002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e118db2cc98903 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:38.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.625+0000 7f0f97fff640 1 -- 172.21.15.29:0/606109299 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f90031640 con 0x7f0fa00c8620 2024-01-25T15:04:38.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.625+0000 7f0f97fff640 1 -- 172.21.15.29:0/606109299 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f900317a0 con 0x7f0fa00c8620 2024-01-25T15:04:38.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.625+0000 7f0f97fff640 1 -- 172.21.15.29:0/606109299 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f90031b30 con 0x7f0fa00c8620 2024-01-25T15:04:38.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.625+0000 7f0fa77f0640 1 -- 172.21.15.29:0/606109299 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fa00c8620 msgr2=0x7f0fa00c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:38.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.625+0000 7f0fa77f0640 1 --2- 172.21.15.29:0/606109299 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fa00c8620 0x7f0fa00c6120 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009870 tx=0x7f0f9002b8f0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.625+0000 7f0fa77f0640 1 -- 172.21.15.29:0/606109299 shutdown_connections 2024-01-25T15:04:38.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.625+0000 7f0fa77f0640 1 --2- 172.21.15.29:0/606109299 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fa0158b80 0x7f0fa0151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.625+0000 7f0fa77f0640 1 --2- 172.21.15.29:0/606109299 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fa00c8620 0x7f0fa00c6120 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.625+0000 7f0fa77f0640 1 -- 172.21.15.29:0/606109299 >> 172.21.15.29:0/606109299 conn(0x7f0fa00ca010 msgr2=0x7f0fa00ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:38.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.626+0000 7f0fa77f0640 1 -- 172.21.15.29:0/606109299 shutdown_connections 2024-01-25T15:04:38.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.626+0000 7f0fa77f0640 1 -- 172.21.15.29:0/606109299 wait complete. 2024-01-25T15:04:38.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.627+0000 7f0fa77f0640 1 Processor -- start 2024-01-25T15:04:38.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.627+0000 7f0fa77f0640 1 -- start start 2024-01-25T15:04:38.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.627+0000 7f0fa77f0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fa006b490 0x7f0fa00ab340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:38.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.627+0000 7f0fa77f0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fa00c8620 0x7f0fa014f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:38.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.627+0000 7f0fa77f0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fa0158b80 0x7f0fa00c3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:38.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.627+0000 7f0fa77f0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa0150750 con 0x7f0fa006b490 2024-01-25T15:04:38.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.627+0000 7f0fa77f0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa01ee170 con 0x7f0fa0158b80 2024-01-25T15:04:38.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.627+0000 7f0fa77f0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa01ed3b0 con 0x7f0fa00c8620 2024-01-25T15:04:38.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.627+0000 7f0fa558c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fa006b490 0x7f0fa00ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:38.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.627+0000 7f0fa558c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fa006b490 0x7f0fa00ab340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36016/0 (socket says 172.21.15.29:36016) 2024-01-25T15:04:38.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.627+0000 7f0fa558c640 1 -- 172.21.15.29:0/1289021711 learned_addr learned my addr 172.21.15.29:0/1289021711 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:38.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.628+0000 7f0fa5d8d640 1 --2- 172.21.15.29:0/1289021711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fa0158b80 0x7f0fa00c3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:38.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.628+0000 7f0fa4d8b640 1 --2- 172.21.15.29:0/1289021711 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fa00c8620 0x7f0fa014f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:38.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.628+0000 7f0fa558c640 1 -- 172.21.15.29:0/1289021711 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fa00c8620 msgr2=0x7f0fa014f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:38.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.628+0000 7f0fa558c640 1 --2- 172.21.15.29:0/1289021711 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fa00c8620 0x7f0fa014f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.628+0000 7f0fa558c640 1 -- 172.21.15.29:0/1289021711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fa0158b80 msgr2=0x7f0fa00c3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:38.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.628+0000 7f0fa558c640 1 --2- 172.21.15.29:0/1289021711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fa0158b80 0x7f0fa00c3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.628+0000 7f0fa558c640 1 -- 172.21.15.29:0/1289021711 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f900094d0 con 0x7f0fa006b490 2024-01-25T15:04:38.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.628+0000 7f0fa4d8b640 1 --2- 172.21.15.29:0/1289021711 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fa00c8620 0x7f0fa014f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:38.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.628+0000 7f0fa5d8d640 1 --2- 172.21.15.29:0/1289021711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fa0158b80 0x7f0fa00c3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:38.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.628+0000 7f0fa558c640 1 --2- 172.21.15.29:0/1289021711 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fa006b490 0x7f0fa00ab340 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00c400 tx=0x7f0f9c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:38.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.628+0000 7f0f95ffb640 1 -- 172.21.15.29:0/1289021711 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c0052d0 con 0x7f0fa006b490 2024-01-25T15:04:38.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.628+0000 7f0f95ffb640 1 -- 172.21.15.29:0/1289021711 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c005450 con 0x7f0fa006b490 2024-01-25T15:04:38.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.628+0000 7f0f95ffb640 1 -- 172.21.15.29:0/1289021711 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c007260 con 0x7f0fa006b490 2024-01-25T15:04:38.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.628+0000 7f0fa77f0640 1 -- 172.21.15.29:0/1289021711 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa0155b70 con 0x7f0fa006b490 2024-01-25T15:04:38.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.628+0000 7f0fa77f0640 1 -- 172.21.15.29:0/1289021711 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa01ed970 con 0x7f0fa006b490 2024-01-25T15:04:38.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.629+0000 7f0fa77f0640 1 -- 172.21.15.29:0/1289021711 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa01ed4f0 con 0x7f0fa006b490 2024-01-25T15:04:38.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.629+0000 7f0f95ffb640 1 -- 172.21.15.29:0/1289021711 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0f9c0073c0 con 0x7f0fa006b490 2024-01-25T15:04:38.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.630+0000 7f0f95ffb640 1 --2- 172.21.15.29:0/1289021711 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0f8406aed0 0x7f0f8406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:38.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.630+0000 7f0f95ffb640 1 -- 172.21.15.29:0/1289021711 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0f9c088cb0 con 0x7f0fa006b490 2024-01-25T15:04:38.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.630+0000 7f0fa4d8b640 1 --2- 172.21.15.29:0/1289021711 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0f8406aed0 0x7f0f8406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:38.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.630+0000 7f0fa4d8b640 1 --2- 172.21.15.29:0/1289021711 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0f8406aed0 0x7f0f8406d390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f90036000 tx=0x7f0f9003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:38.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.634+0000 7f0f95ffb640 1 -- 172.21.15.29:0/1289021711 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f0fa01ed4f0 con 0x7f0fa006b490 2024-01-25T15:04:38.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.826+0000 7f0fa77f0640 1 -- 172.21.15.29:0/1289021711 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0fa01ed4f0 con 0x7f0fa006b490 2024-01-25T15:04:38.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.826+0000 7f0f95ffb640 1 -- 172.21.15.29:0/1289021711 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0fa01ed4f0 con 0x7f0fa006b490 2024-01-25T15:04:38.827 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-25T15:04:38.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.828+0000 7f0fa77f0640 1 -- 172.21.15.29:0/1289021711 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0f8406aed0 msgr2=0x7f0f8406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:38.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.828+0000 7f0fa77f0640 1 --2- 172.21.15.29:0/1289021711 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0f8406aed0 0x7f0f8406d390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f90036000 tx=0x7f0f9003c040 comp rx=0 tx=0).stop 2024-01-25T15:04:38.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.828+0000 7f0fa77f0640 1 -- 172.21.15.29:0/1289021711 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fa006b490 msgr2=0x7f0fa00ab340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:38.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.828+0000 7f0fa77f0640 1 --2- 172.21.15.29:0/1289021711 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fa006b490 0x7f0fa00ab340 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00c400 tx=0x7f0f9c00c8c0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.828+0000 7f0fa77f0640 1 -- 172.21.15.29:0/1289021711 shutdown_connections 2024-01-25T15:04:38.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.828+0000 7f0fa77f0640 1 --2- 172.21.15.29:0/1289021711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fa0158b80 0x7f0fa00c3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.828+0000 7f0fa77f0640 1 --2- 172.21.15.29:0/1289021711 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fa00c8620 0x7f0fa014f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.828+0000 7f0fa77f0640 1 --2- 172.21.15.29:0/1289021711 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0f8406aed0 0x7f0f8406d390 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.828+0000 7f0fa77f0640 1 --2- 172.21.15.29:0/1289021711 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fa006b490 0x7f0fa00ab340 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.828+0000 7f0fa77f0640 1 -- 172.21.15.29:0/1289021711 >> 172.21.15.29:0/1289021711 conn(0x7f0fa00ca010 msgr2=0x7f0fa00c5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:38.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.828+0000 7f0fa77f0640 1 -- 172.21.15.29:0/1289021711 shutdown_connections 2024-01-25T15:04:38.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.828+0000 7f0fa77f0640 1 -- 172.21.15.29:0/1289021711 wait complete. 2024-01-25T15:04:38.839 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:04:38.839 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:04:38.854 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:04:38.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.993+0000 7fde83325640 1 Processor -- start 2024-01-25T15:04:38.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.994+0000 7fde83325640 1 -- start start 2024-01-25T15:04:38.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.994+0000 7fde83325640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fde7c152160 0x7fde7c06bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:38.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.994+0000 7fde83325640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde7c0c4990 0x7fde7c0c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:38.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.994+0000 7fde83325640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fde7c0c53e0 0x7fde7c0c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:38.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.994+0000 7fde83325640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7c155430 con 0x7fde7c0c53e0 2024-01-25T15:04:38.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.994+0000 7fde83325640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7c154b40 con 0x7fde7c152160 2024-01-25T15:04:38.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.994+0000 7fde83325640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c152540 con 0x7fde7c0c4990 2024-01-25T15:04:38.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.994+0000 7fde818c2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fde7c0c53e0 0x7fde7c0c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:38.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.994+0000 7fde818c2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fde7c0c53e0 0x7fde7c0c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36018/0 (socket says 172.21.15.29:36018) 2024-01-25T15:04:38.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.994+0000 7fde818c2640 1 -- 172.21.15.29:0/1953904343 learned_addr learned my addr 172.21.15.29:0/1953904343 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:38.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.995+0000 7fde808c0640 1 --2- 172.21.15.29:0/1953904343 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde7c0c4990 0x7fde7c0c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:38.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.995+0000 7fde810c1640 1 --2- 172.21.15.29:0/1953904343 >> v2:172.21.15.52:3300/0 conn(0x7fde7c152160 0x7fde7c06bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:38.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.995+0000 7fde818c2640 1 -- 172.21.15.29:0/1953904343 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde7c0c4990 msgr2=0x7fde7c0c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:38.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.995+0000 7fde818c2640 1 --2- 172.21.15.29:0/1953904343 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde7c0c4990 0x7fde7c0c4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.995+0000 7fde818c2640 1 -- 172.21.15.29:0/1953904343 >> v2:172.21.15.52:3300/0 conn(0x7fde7c152160 msgr2=0x7fde7c06bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:38.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.995+0000 7fde818c2640 1 --2- 172.21.15.29:0/1953904343 >> v2:172.21.15.52:3300/0 conn(0x7fde7c152160 0x7fde7c06bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.995+0000 7fde818c2640 1 -- 172.21.15.29:0/1953904343 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c0c64b0 con 0x7fde7c0c53e0 2024-01-25T15:04:38.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.995+0000 7fde808c0640 1 --2- 172.21.15.29:0/1953904343 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde7c0c4990 0x7fde7c0c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:38.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.995+0000 7fde810c1640 1 --2- 172.21.15.29:0/1953904343 >> v2:172.21.15.52:3300/0 conn(0x7fde7c152160 0x7fde7c06bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:38.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.995+0000 7fde818c2640 1 --2- 172.21.15.29:0/1953904343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde7c0c53e0 0x7fde7c0c7f10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0c5a60 tx=0x7fde6c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec2dccddb551501 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:38.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.996+0000 7fde7bfff640 1 -- 172.21.15.29:0/1953904343 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c02c9e0 con 0x7fde7c0c53e0 2024-01-25T15:04:38.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.996+0000 7fde7bfff640 1 -- 172.21.15.29:0/1953904343 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6c02cb40 con 0x7fde7c0c53e0 2024-01-25T15:04:38.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.996+0000 7fde7bfff640 1 -- 172.21.15.29:0/1953904343 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c0343f0 con 0x7fde7c0c53e0 2024-01-25T15:04:38.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.996+0000 7fde83325640 1 -- 172.21.15.29:0/1953904343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde7c0c53e0 msgr2=0x7fde7c0c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:38.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.996+0000 7fde83325640 1 --2- 172.21.15.29:0/1953904343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde7c0c53e0 0x7fde7c0c7f10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0c5a60 tx=0x7fde6c02be40 comp rx=0 tx=0).stop 2024-01-25T15:04:38.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.996+0000 7fde83325640 1 -- 172.21.15.29:0/1953904343 shutdown_connections 2024-01-25T15:04:38.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.996+0000 7fde83325640 1 --2- 172.21.15.29:0/1953904343 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde7c0c4990 0x7fde7c0c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.996+0000 7fde83325640 1 --2- 172.21.15.29:0/1953904343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde7c0c53e0 0x7fde7c0c7f10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.996+0000 7fde83325640 1 --2- 172.21.15.29:0/1953904343 >> v2:172.21.15.52:3300/0 conn(0x7fde7c152160 0x7fde7c06bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:38.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.996+0000 7fde83325640 1 -- 172.21.15.29:0/1953904343 >> 172.21.15.29:0/1953904343 conn(0x7fde7c0ca1f0 msgr2=0x7fde7c0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:38.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.996+0000 7fde83325640 1 -- 172.21.15.29:0/1953904343 shutdown_connections 2024-01-25T15:04:38.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.996+0000 7fde83325640 1 -- 172.21.15.29:0/1953904343 wait complete. 2024-01-25T15:04:39.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.997+0000 7fde83325640 1 Processor -- start 2024-01-25T15:04:39.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.997+0000 7fde83325640 1 -- start start 2024-01-25T15:04:39.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.998+0000 7fde83325640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde7c0c4990 0x7fde7c0ab230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.998+0000 7fde83325640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde7c0c53e0 0x7fde7c1eda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.998+0000 7fde83325640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde7c152160 0x7fde7c1edf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.998+0000 7fde83325640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c1ee490 con 0x7fde7c152160 2024-01-25T15:04:39.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.998+0000 7fde83325640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c1ed510 con 0x7fde7c0c53e0 2024-01-25T15:04:39.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.998+0000 7fde83325640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c1ea490 con 0x7fde7c0c4990 2024-01-25T15:04:39.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.998+0000 7fde818c2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde7c152160 0x7fde7c1edf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.998+0000 7fde818c2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde7c152160 0x7fde7c1edf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36020/0 (socket says 172.21.15.29:36020) 2024-01-25T15:04:39.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.998+0000 7fde818c2640 1 -- 172.21.15.29:0/2929111328 learned_addr learned my addr 172.21.15.29:0/2929111328 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:39.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.998+0000 7fde810c1640 1 --2- 172.21.15.29:0/2929111328 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde7c0c4990 0x7fde7c0ab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.998+0000 7fde808c0640 1 --2- 172.21.15.29:0/2929111328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde7c0c53e0 0x7fde7c1eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.998+0000 7fde818c2640 1 -- 172.21.15.29:0/2929111328 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde7c0c4990 msgr2=0x7fde7c0ab230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.998+0000 7fde818c2640 1 --2- 172.21.15.29:0/2929111328 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde7c0c4990 0x7fde7c0ab230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.999+0000 7fde818c2640 1 -- 172.21.15.29:0/2929111328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde7c0c53e0 msgr2=0x7fde7c1eda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.999+0000 7fde818c2640 1 --2- 172.21.15.29:0/2929111328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde7c0c53e0 0x7fde7c1eda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.999+0000 7fde818c2640 1 -- 172.21.15.29:0/2929111328 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6c009b30 con 0x7fde7c152160 2024-01-25T15:04:39.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.999+0000 7fde808c0640 1 --2- 172.21.15.29:0/2929111328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde7c0c53e0 0x7fde7c1eda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:39.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.999+0000 7fde818c2640 1 --2- 172.21.15.29:0/2929111328 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde7c152160 0x7fde7c1edf50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fde6c036040 tx=0x7fde6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:39.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.999+0000 7fde79ffb640 1 -- 172.21.15.29:0/2929111328 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c009510 con 0x7fde7c152160 2024-01-25T15:04:39.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.999+0000 7fde79ffb640 1 -- 172.21.15.29:0/2929111328 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6c03e450 con 0x7fde7c152160 2024-01-25T15:04:39.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.999+0000 7fde83325640 1 -- 172.21.15.29:0/2929111328 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7c1ea770 con 0x7fde7c152160 2024-01-25T15:04:39.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.999+0000 7fde79ffb640 1 -- 172.21.15.29:0/2929111328 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c03e7e0 con 0x7fde7c152160 2024-01-25T15:04:39.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:38.999+0000 7fde83325640 1 -- 172.21.15.29:0/2929111328 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7c1ead30 con 0x7fde7c152160 2024-01-25T15:04:39.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.000+0000 7fde83325640 1 -- 172.21.15.29:0/2929111328 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7c152680 con 0x7fde7c152160 2024-01-25T15:04:39.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.000+0000 7fde79ffb640 1 -- 172.21.15.29:0/2929111328 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fde6c03e940 con 0x7fde7c152160 2024-01-25T15:04:39.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.001+0000 7fde79ffb640 1 --2- 172.21.15.29:0/2929111328 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fde6806af00 0x7fde6806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.001+0000 7fde79ffb640 1 -- 172.21.15.29:0/2929111328 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fde6c0ac3c0 con 0x7fde7c152160 2024-01-25T15:04:39.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.001+0000 7fde810c1640 1 --2- 172.21.15.29:0/2929111328 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fde6806af00 0x7fde6806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.002+0000 7fde810c1640 1 --2- 172.21.15.29:0/2929111328 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fde6806af00 0x7fde6806d3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0c32a0 tx=0x7fde74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:39.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.005+0000 7fde79ffb640 1 -- 172.21.15.29:0/2929111328 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fde6c076fa0 con 0x7fde7c152160 2024-01-25T15:04:39.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.184+0000 7fde83325640 1 -- 172.21.15.29:0/2929111328 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde7c0a97d0 con 0x7fde7c152160 2024-01-25T15:04:39.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.185+0000 7fde79ffb640 1 -- 172.21.15.29:0/2929111328 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18311 (secure 0 0 0) 0x7fde6c07a5c0 con 0x7fde7c152160 2024-01-25T15:04:39.186 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:39.186 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:31.978871+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:04:39.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.187+0000 7fde83325640 1 -- 172.21.15.29:0/2929111328 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fde6806af00 msgr2=0x7fde6806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.187+0000 7fde83325640 1 --2- 172.21.15.29:0/2929111328 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fde6806af00 0x7fde6806d3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0c32a0 tx=0x7fde74008040 comp rx=0 tx=0).stop 2024-01-25T15:04:39.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.187+0000 7fde83325640 1 -- 172.21.15.29:0/2929111328 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde7c152160 msgr2=0x7fde7c1edf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.187+0000 7fde83325640 1 --2- 172.21.15.29:0/2929111328 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde7c152160 0x7fde7c1edf50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fde6c036040 tx=0x7fde6c004a40 comp rx=0 tx=0).stop 2024-01-25T15:04:39.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.187+0000 7fde83325640 1 -- 172.21.15.29:0/2929111328 shutdown_connections 2024-01-25T15:04:39.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.187+0000 7fde83325640 1 --2- 172.21.15.29:0/2929111328 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fde6806af00 0x7fde6806d3c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.187+0000 7fde83325640 1 --2- 172.21.15.29:0/2929111328 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde7c152160 0x7fde7c1edf50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.187+0000 7fde83325640 1 --2- 172.21.15.29:0/2929111328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde7c0c53e0 0x7fde7c1eda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.187+0000 7fde83325640 1 --2- 172.21.15.29:0/2929111328 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde7c0c4990 0x7fde7c0ab230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.187+0000 7fde83325640 1 -- 172.21.15.29:0/2929111328 >> 172.21.15.29:0/2929111328 conn(0x7fde7c0ca1f0 msgr2=0x7fde7c0c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:39.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.187+0000 7fde83325640 1 -- 172.21.15.29:0/2929111328 shutdown_connections 2024-01-25T15:04:39.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.187+0000 7fde83325640 1 -- 172.21.15.29:0/2929111328 wait complete. 2024-01-25T15:04:39.198 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T15:04:14.955791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T15:04:24.986626+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T15:04:25.873673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-25T15:04:29.578261+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-25T15:04:39.199 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:04:39.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.302+0000 7f808d778640 1 Processor -- start 2024-01-25T15:04:39.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.302+0000 7f808d778640 1 -- start start 2024-01-25T15:04:39.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.303+0000 7f808d778640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8088151d30 0x7f808806a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.303+0000 7f808d778640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f808806cf10 0x7f80881546c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.303+0000 7f808d778640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80880c30d0 con 0x7f808806ac00 2024-01-25T15:04:39.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.303+0000 7f808d778640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f808806ef80 con 0x7f8088151d30 2024-01-25T15:04:39.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.303+0000 7f808d778640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80880c3840 con 0x7f808806cf10 2024-01-25T15:04:39.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.303+0000 7f8086ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8088151d30 0x7f808806a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.303+0000 7f8086ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8088151d30 0x7f808806a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36032/0 (socket says 172.21.15.29:36032) 2024-01-25T15:04:39.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.303+0000 7f8086ffd640 1 -- 172.21.15.29:0/4293384756 learned_addr learned my addr 172.21.15.29:0/4293384756 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:39.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.303+0000 7f80867fc640 1 --2- 172.21.15.29:0/4293384756 >> v2:172.21.15.52:3300/0 conn(0x7f808806cf10 0x7f80881546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.303+0000 7f8086ffd640 1 -- 172.21.15.29:0/4293384756 >> v2:172.21.15.52:3300/0 conn(0x7f808806cf10 msgr2=0x7f80881546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:39.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.303+0000 7f8086ffd640 1 --2- 172.21.15.29:0/4293384756 >> v2:172.21.15.52:3300/0 conn(0x7f808806cf10 0x7f80881546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.304+0000 7f8086ffd640 1 -- 172.21.15.29:0/4293384756 >> v1:172.21.15.52:6789/0 conn(0x7f808806ac00 legacy=0x7f8088154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:39.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.304+0000 7f8086ffd640 1 -- 172.21.15.29:0/4293384756 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8088155310 con 0x7f8088151d30 2024-01-25T15:04:39.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.304+0000 7f8086ffd640 1 --2- 172.21.15.29:0/4293384756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8088151d30 0x7f808806a6c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8088072940 tx=0x7f807802bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cfbb316ad66e908 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:39.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.304+0000 7f8085ffb640 1 -- 172.21.15.29:0/4293384756 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807802c960 con 0x7f8088151d30 2024-01-25T15:04:39.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.304+0000 7f8085ffb640 1 -- 172.21.15.29:0/4293384756 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807802cac0 con 0x7f8088151d30 2024-01-25T15:04:39.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.304+0000 7f8085ffb640 1 -- 172.21.15.29:0/4293384756 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807802ce50 con 0x7f8088151d30 2024-01-25T15:04:39.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.305+0000 7f808d778640 1 -- 172.21.15.29:0/4293384756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8088151d30 msgr2=0x7f808806a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.305+0000 7f808d778640 1 --2- 172.21.15.29:0/4293384756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8088151d30 0x7f808806a6c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8088072940 tx=0x7f807802bdc0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.305+0000 7f808d778640 1 -- 172.21.15.29:0/4293384756 shutdown_connections 2024-01-25T15:04:39.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.305+0000 7f808d778640 1 --2- 172.21.15.29:0/4293384756 >> v2:172.21.15.52:3300/0 conn(0x7f808806cf10 0x7f80881546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.305+0000 7f808d778640 1 --2- 172.21.15.29:0/4293384756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8088151d30 0x7f808806a6c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.305+0000 7f808d778640 1 -- 172.21.15.29:0/4293384756 >> 172.21.15.29:0/4293384756 conn(0x7f80880c39b0 msgr2=0x7f80880c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:39.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.305+0000 7f808d778640 1 -- 172.21.15.29:0/4293384756 shutdown_connections 2024-01-25T15:04:39.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.305+0000 7f808d778640 1 -- 172.21.15.29:0/4293384756 wait complete. 2024-01-25T15:04:39.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.306+0000 7f808d778640 1 Processor -- start 2024-01-25T15:04:39.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.306+0000 7f808d778640 1 -- start start 2024-01-25T15:04:39.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.307+0000 7f808d778640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f808806ac00 0x7f80880bf910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.307+0000 7f808d778640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f808806cf10 0x7f80881e11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.307+0000 7f808d778640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8088151d30 0x7f80881ea570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.307+0000 7f808d778640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80881e1ad0 con 0x7f808806cf10 2024-01-25T15:04:39.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.307+0000 7f808d778640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8088156f80 con 0x7f8088151d30 2024-01-25T15:04:39.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.307+0000 7f808d778640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8088157260 con 0x7f808806ac00 2024-01-25T15:04:39.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.307+0000 7f80867fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f808806cf10 0x7f80881e11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.307+0000 7f80867fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f808806cf10 0x7f80881e11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36042/0 (socket says 172.21.15.29:36042) 2024-01-25T15:04:39.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.307+0000 7f80867fc640 1 -- 172.21.15.29:0/3383117533 learned_addr learned my addr 172.21.15.29:0/3383117533 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:39.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.307+0000 7f80877fe640 1 --2- 172.21.15.29:0/3383117533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8088151d30 0x7f80881ea570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.307+0000 7f8086ffd640 1 --2- 172.21.15.29:0/3383117533 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f808806ac00 0x7f80880bf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.307+0000 7f80867fc640 1 -- 172.21.15.29:0/3383117533 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f808806ac00 msgr2=0x7f80880bf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.307+0000 7f80867fc640 1 --2- 172.21.15.29:0/3383117533 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f808806ac00 0x7f80880bf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.307+0000 7f80867fc640 1 -- 172.21.15.29:0/3383117533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8088151d30 msgr2=0x7f80881ea570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.307+0000 7f80867fc640 1 --2- 172.21.15.29:0/3383117533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8088151d30 0x7f80881ea570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.307+0000 7f80867fc640 1 -- 172.21.15.29:0/3383117533 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8078009b30 con 0x7f808806cf10 2024-01-25T15:04:39.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.308+0000 7f8086ffd640 1 --2- 172.21.15.29:0/3383117533 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f808806ac00 0x7f80880bf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:39.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.308+0000 7f80867fc640 1 --2- 172.21.15.29:0/3383117533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f808806cf10 0x7f80881e11f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f807000d5c0 tx=0x7f807000da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:39.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.308+0000 7f807f7fe640 1 -- 172.21.15.29:0/3383117533 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80700125f0 con 0x7f808806cf10 2024-01-25T15:04:39.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.308+0000 7f807f7fe640 1 -- 172.21.15.29:0/3383117533 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8070012750 con 0x7f808806cf10 2024-01-25T15:04:39.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.308+0000 7f808d778640 1 -- 172.21.15.29:0/3383117533 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8088157540 con 0x7f808806cf10 2024-01-25T15:04:39.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.308+0000 7f807f7fe640 1 -- 172.21.15.29:0/3383117533 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8070012b00 con 0x7f808806cf10 2024-01-25T15:04:39.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.308+0000 7f808d778640 1 -- 172.21.15.29:0/3383117533 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80880bfe50 con 0x7f808806cf10 2024-01-25T15:04:39.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.309+0000 7f808d778640 1 -- 172.21.15.29:0/3383117533 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8088074010 con 0x7f808806cf10 2024-01-25T15:04:39.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.309+0000 7f807f7fe640 1 -- 172.21.15.29:0/3383117533 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8070012c60 con 0x7f808806cf10 2024-01-25T15:04:39.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.310+0000 7f807f7fe640 1 --2- 172.21.15.29:0/3383117533 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f806806aed0 0x7f806806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.310+0000 7f807f7fe640 1 -- 172.21.15.29:0/3383117533 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8070089dd0 con 0x7f808806cf10 2024-01-25T15:04:39.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.310+0000 7f8086ffd640 1 --2- 172.21.15.29:0/3383117533 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f806806aed0 0x7f806806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.310+0000 7f8086ffd640 1 --2- 172.21.15.29:0/3383117533 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f806806aed0 0x7f806806d390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8078035000 tx=0x7f8078030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:39.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.314+0000 7f807f7fe640 1 -- 172.21.15.29:0/3383117533 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f807008e070 con 0x7f808806cf10 2024-01-25T15:04:39.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.491+0000 7f808d778640 1 -- 172.21.15.29:0/3383117533 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f808814fec0 con 0x7f808806cf10 2024-01-25T15:04:39.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.491+0000 7f807f7fe640 1 -- 172.21.15.29:0/3383117533 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8070054910 con 0x7f808806cf10 2024-01-25T15:04:39.492 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-25T15:04:39.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.493+0000 7f808d778640 1 -- 172.21.15.29:0/3383117533 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f806806aed0 msgr2=0x7f806806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.493+0000 7f808d778640 1 --2- 172.21.15.29:0/3383117533 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f806806aed0 0x7f806806d390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8078035000 tx=0x7f8078030000 comp rx=0 tx=0).stop 2024-01-25T15:04:39.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.493+0000 7f808d778640 1 -- 172.21.15.29:0/3383117533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f808806cf10 msgr2=0x7f80881e11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.493+0000 7f808d778640 1 --2- 172.21.15.29:0/3383117533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f808806cf10 0x7f80881e11f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f807000d5c0 tx=0x7f807000da80 comp rx=0 tx=0).stop 2024-01-25T15:04:39.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.493+0000 7f808d778640 1 -- 172.21.15.29:0/3383117533 shutdown_connections 2024-01-25T15:04:39.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.493+0000 7f808d778640 1 --2- 172.21.15.29:0/3383117533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8088151d30 0x7f80881ea570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.493+0000 7f808d778640 1 --2- 172.21.15.29:0/3383117533 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f806806aed0 0x7f806806d390 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.493+0000 7f808d778640 1 --2- 172.21.15.29:0/3383117533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f808806cf10 0x7f80881e11f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.493+0000 7f808d778640 1 --2- 172.21.15.29:0/3383117533 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f808806ac00 0x7f80880bf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.493+0000 7f808d778640 1 -- 172.21.15.29:0/3383117533 >> 172.21.15.29:0/3383117533 conn(0x7f80880c39b0 msgr2=0x7f80881508e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:39.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.493+0000 7f808d778640 1 -- 172.21.15.29:0/3383117533 shutdown_connections 2024-01-25T15:04:39.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.493+0000 7f808d778640 1 -- 172.21.15.29:0/3383117533 wait complete. 2024-01-25T15:04:39.504 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:04:39.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.610+0000 7f28151d0640 1 Processor -- start 2024-01-25T15:04:39.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.611+0000 7f28151d0640 1 -- start start 2024-01-25T15:04:39.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.611+0000 7f28151d0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28100af6c0 0x7f28100c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.611+0000 7f28151d0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f281006d560 0x7f281006b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.611+0000 7f28151d0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f28100c5a70 0x7f281006b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.611+0000 7f28151d0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281006c480 con 0x7f28100c5a70 2024-01-25T15:04:39.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.611+0000 7f28151d0640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2810155290 con 0x7f281006d560 2024-01-25T15:04:39.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.611+0000 7f28151d0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281006bff0 con 0x7f28100af6c0 2024-01-25T15:04:39.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.611+0000 7f280f59e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f28100c5a70 0x7f281006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.611+0000 7f280f59e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f28100c5a70 0x7f281006b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36056/0 (socket says 172.21.15.29:36056) 2024-01-25T15:04:39.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.611+0000 7f280f59e640 1 -- 172.21.15.29:0/119925529 learned_addr learned my addr 172.21.15.29:0/119925529 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:39.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.612+0000 7f280ed9d640 1 --2- 172.21.15.29:0/119925529 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28100af6c0 0x7f28100c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.612+0000 7f280e59c640 1 --2- 172.21.15.29:0/119925529 >> v2:172.21.15.52:3300/0 conn(0x7f281006d560 0x7f281006b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.612+0000 7f280f59e640 1 -- 172.21.15.29:0/119925529 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28100af6c0 msgr2=0x7f28100c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:39.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.612+0000 7f280f59e640 1 --2- 172.21.15.29:0/119925529 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28100af6c0 0x7f28100c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.612+0000 7f280f59e640 1 -- 172.21.15.29:0/119925529 >> v2:172.21.15.52:3300/0 conn(0x7f281006d560 msgr2=0x7f281006b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:39.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.612+0000 7f280f59e640 1 --2- 172.21.15.29:0/119925529 >> v2:172.21.15.52:3300/0 conn(0x7f281006d560 0x7f281006b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.612+0000 7f280f59e640 1 -- 172.21.15.29:0/119925529 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28100afaa0 con 0x7f28100c5a70 2024-01-25T15:04:39.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.612+0000 7f280f59e640 1 --2- 172.21.15.29:0/119925529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28100c5a70 0x7f281006b760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f28100acd80 tx=0x7f280802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44466d484648bb71 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:39.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.612+0000 7f280dd9b640 1 -- 172.21.15.29:0/119925529 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280802ca70 con 0x7f28100c5a70 2024-01-25T15:04:39.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.613+0000 7f280dd9b640 1 -- 172.21.15.29:0/119925529 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280802cbd0 con 0x7f28100c5a70 2024-01-25T15:04:39.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.613+0000 7f280dd9b640 1 -- 172.21.15.29:0/119925529 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28080343f0 con 0x7f28100c5a70 2024-01-25T15:04:39.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.613+0000 7f28151d0640 1 -- 172.21.15.29:0/119925529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28100c5a70 msgr2=0x7f281006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.613+0000 7f28151d0640 1 --2- 172.21.15.29:0/119925529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28100c5a70 0x7f281006b760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f28100acd80 tx=0x7f280802bed0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.613+0000 7f28151d0640 1 -- 172.21.15.29:0/119925529 shutdown_connections 2024-01-25T15:04:39.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.613+0000 7f28151d0640 1 --2- 172.21.15.29:0/119925529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28100c5a70 0x7f281006b760 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.613+0000 7f28151d0640 1 --2- 172.21.15.29:0/119925529 >> v2:172.21.15.52:3300/0 conn(0x7f281006d560 0x7f281006b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.613+0000 7f28151d0640 1 --2- 172.21.15.29:0/119925529 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28100af6c0 0x7f28100c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.613+0000 7f28151d0640 1 -- 172.21.15.29:0/119925529 >> 172.21.15.29:0/119925529 conn(0x7f28100c6ca0 msgr2=0x7f28100c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:39.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.613+0000 7f28151d0640 1 -- 172.21.15.29:0/119925529 shutdown_connections 2024-01-25T15:04:39.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.613+0000 7f28151d0640 1 -- 172.21.15.29:0/119925529 wait complete. 2024-01-25T15:04:39.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.614+0000 7f28151d0640 1 Processor -- start 2024-01-25T15:04:39.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.615+0000 7f28151d0640 1 -- start start 2024-01-25T15:04:39.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.615+0000 7f28151d0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f281006d560 0x7f28100c3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.615+0000 7f28151d0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28100af6c0 0x7f28100bdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.615+0000 7f28151d0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28100c5a70 0x7f28100be200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.615+0000 7f28151d0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28100be740 con 0x7f28100af6c0 2024-01-25T15:04:39.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.615+0000 7f28151d0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28100c4500 con 0x7f281006d560 2024-01-25T15:04:39.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.615+0000 7f28151d0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28100c1d10 con 0x7f28100c5a70 2024-01-25T15:04:39.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.615+0000 7f280e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28100af6c0 0x7f28100bdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.615+0000 7f280e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28100af6c0 0x7f28100bdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36066/0 (socket says 172.21.15.29:36066) 2024-01-25T15:04:39.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.615+0000 7f280e59c640 1 -- 172.21.15.29:0/336265056 learned_addr learned my addr 172.21.15.29:0/336265056 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:39.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.615+0000 7f280f59e640 1 --2- 172.21.15.29:0/336265056 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28100c5a70 0x7f28100be200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.616+0000 7f280ed9d640 1 --2- 172.21.15.29:0/336265056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f281006d560 0x7f28100c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.616+0000 7f280e59c640 1 -- 172.21.15.29:0/336265056 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28100c5a70 msgr2=0x7f28100be200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.616+0000 7f280e59c640 1 --2- 172.21.15.29:0/336265056 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28100c5a70 0x7f28100be200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.616+0000 7f280e59c640 1 -- 172.21.15.29:0/336265056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f281006d560 msgr2=0x7f28100c3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.616+0000 7f280e59c640 1 --2- 172.21.15.29:0/336265056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f281006d560 0x7f28100c3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.616+0000 7f280e59c640 1 -- 172.21.15.29:0/336265056 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2808009b30 con 0x7f28100af6c0 2024-01-25T15:04:39.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.616+0000 7f280f59e640 1 --2- 172.21.15.29:0/336265056 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28100c5a70 0x7f28100be200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:39.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.616+0000 7f280ed9d640 1 --2- 172.21.15.29:0/336265056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f281006d560 0x7f28100c3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:39.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.616+0000 7f280e59c640 1 --2- 172.21.15.29:0/336265056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28100af6c0 0x7f28100bdcc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f280400d7d0 tx=0x7f280400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:39.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.616+0000 7f27f77fe640 1 -- 172.21.15.29:0/336265056 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28040096a0 con 0x7f28100af6c0 2024-01-25T15:04:39.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.616+0000 7f27f77fe640 1 -- 172.21.15.29:0/336265056 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2804009800 con 0x7f28100af6c0 2024-01-25T15:04:39.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.616+0000 7f27f77fe640 1 -- 172.21.15.29:0/336265056 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2804009b90 con 0x7f28100af6c0 2024-01-25T15:04:39.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.616+0000 7f28151d0640 1 -- 172.21.15.29:0/336265056 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28100c1ff0 con 0x7f28100af6c0 2024-01-25T15:04:39.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.616+0000 7f28151d0640 1 -- 172.21.15.29:0/336265056 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28100c25b0 con 0x7f28100af6c0 2024-01-25T15:04:39.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.617+0000 7f28151d0640 1 -- 172.21.15.29:0/336265056 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28100c2770 con 0x7f28100af6c0 2024-01-25T15:04:39.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.618+0000 7f27f77fe640 1 -- 172.21.15.29:0/336265056 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2804009cf0 con 0x7f28100af6c0 2024-01-25T15:04:39.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.618+0000 7f27f77fe640 1 --2- 172.21.15.29:0/336265056 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f27fc06aed0 0x7f27fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.618+0000 7f27f77fe640 1 -- 172.21.15.29:0/336265056 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2804089d80 con 0x7f28100af6c0 2024-01-25T15:04:39.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.618+0000 7f280ed9d640 1 --2- 172.21.15.29:0/336265056 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f27fc06aed0 0x7f27fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.619+0000 7f280ed9d640 1 --2- 172.21.15.29:0/336265056 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f27fc06aed0 0x7f27fc06d390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2800006fd0 tx=0x7f2800008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:39.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.622+0000 7f27f77fe640 1 -- 172.21.15.29:0/336265056 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f28040549f0 con 0x7f28100af6c0 2024-01-25T15:04:39.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.803+0000 7f28151d0640 1 -- 172.21.15.29:0/336265056 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2810074010 con 0x7f28100af6c0 2024-01-25T15:04:39.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.804+0000 7f27f77fe640 1 -- 172.21.15.29:0/336265056 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2804058010 con 0x7f28100af6c0 2024-01-25T15:04:39.805 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:04:39.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.806+0000 7f28151d0640 1 -- 172.21.15.29:0/336265056 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f27fc06aed0 msgr2=0x7f27fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.806+0000 7f28151d0640 1 --2- 172.21.15.29:0/336265056 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f27fc06aed0 0x7f27fc06d390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2800006fd0 tx=0x7f2800008040 comp rx=0 tx=0).stop 2024-01-25T15:04:39.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.806+0000 7f28151d0640 1 -- 172.21.15.29:0/336265056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28100af6c0 msgr2=0x7f28100bdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.806+0000 7f28151d0640 1 --2- 172.21.15.29:0/336265056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28100af6c0 0x7f28100bdcc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f280400d7d0 tx=0x7f280400dc90 comp rx=0 tx=0).stop 2024-01-25T15:04:39.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.806+0000 7f28151d0640 1 -- 172.21.15.29:0/336265056 shutdown_connections 2024-01-25T15:04:39.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.806+0000 7f28151d0640 1 --2- 172.21.15.29:0/336265056 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28100c5a70 0x7f28100be200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.806+0000 7f28151d0640 1 --2- 172.21.15.29:0/336265056 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f27fc06aed0 0x7f27fc06d390 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.806+0000 7f28151d0640 1 --2- 172.21.15.29:0/336265056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28100af6c0 0x7f28100bdcc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.806+0000 7f28151d0640 1 --2- 172.21.15.29:0/336265056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f281006d560 0x7f28100c3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.806+0000 7f28151d0640 1 -- 172.21.15.29:0/336265056 >> 172.21.15.29:0/336265056 conn(0x7f28100c6ca0 msgr2=0x7f2810153d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:39.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.806+0000 7f28151d0640 1 -- 172.21.15.29:0/336265056 shutdown_connections 2024-01-25T15:04:39.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.806+0000 7f28151d0640 1 -- 172.21.15.29:0/336265056 wait complete. 2024-01-25T15:04:39.817 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:04:39.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.922+0000 7fd615702640 1 Processor -- start 2024-01-25T15:04:39.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.922+0000 7fd615702640 1 -- start start 2024-01-25T15:04:39.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.922+0000 7fd615702640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd61006b490 0x7fd6100c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.922+0000 7fd615702640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6100c6770 con 0x7fd6100c8620 2024-01-25T15:04:39.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.922+0000 7fd615702640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd610154f10 con 0x7fd610158b80 2024-01-25T15:04:39.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.922+0000 7fd615702640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6101551f0 con 0x7fd61006b490 2024-01-25T15:04:39.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.922+0000 7fd60f7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd6100c8620 0x7fd610151c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54550/0 (socket says 172.21.15.29:54550) 2024-01-25T15:04:39.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.923+0000 7fd60f7fe640 1 -- 172.21.15.29:0/1037677907 learned_addr learned my addr 172.21.15.29:0/1037677907 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:39.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.923+0000 7fd60effd640 1 --2- 172.21.15.29:0/1037677907 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd61006b490 0x7fd6100c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.923+0000 7fd60dffb640 1 -- 172.21.15.29:0/1037677907 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916912752 0 0) 0x7fd6100c6770 con 0x7fd6100c8620 2024-01-25T15:04:39.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.923+0000 7fd60dffb640 1 -- 172.21.15.29:0/1037677907 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5f8003520 con 0x7fd6100c8620 2024-01-25T15:04:39.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.923+0000 7fd60dffb640 1 -- 172.21.15.29:0/1037677907 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 73230617 0 0) 0x7fd5f8003520 con 0x7fd6100c8620 2024-01-25T15:04:39.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.923+0000 7fd60dffb640 1 -- 172.21.15.29:0/1037677907 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd61006b490 msgr2=0x7fd6100c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:39.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.923+0000 7fd60dffb640 1 --2- 172.21.15.29:0/1037677907 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd61006b490 0x7fd6100c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.923+0000 7fd60dffb640 1 -- 172.21.15.29:0/1037677907 >> v1:172.21.15.52:6789/0 conn(0x7fd610158b80 legacy=0x7fd6100c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.923+0000 7fd60dffb640 1 -- 172.21.15.29:0/1037677907 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6101554d0 con 0x7fd6100c8620 2024-01-25T15:04:39.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.923+0000 7fd60dffb640 1 -- 172.21.15.29:0/1037677907 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7fd6080019f0 con 0x7fd6100c8620 2024-01-25T15:04:39.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.923+0000 7fd60dffb640 1 -- 172.21.15.29:0/1037677907 >> v1:172.21.15.29:6789/0 conn(0x7fd6100c8620 legacy=0x7fd610151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.923+0000 7fd60dffb640 1 --2- 172.21.15.29:0/1037677907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5f8003a10 0x7fd5f8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.923+0000 7fd60dffb640 1 --2- 172.21.15.29:0/1037677907 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd61006b490 0x7fd5f80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.923+0000 7fd60dffb640 1 --2- 172.21.15.29:0/1037677907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f8004d00 0x7fd5f8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.923+0000 7fd60dffb640 1 -- 172.21.15.29:0/1037677907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6101551f0 con 0x7fd5f8003a10 2024-01-25T15:04:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.923+0000 7fd60dffb640 1 -- 172.21.15.29:0/1037677907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f800bb10 con 0x7fd5f8004d00 2024-01-25T15:04:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.923+0000 7fd60dffb640 1 -- 172.21.15.29:0/1037677907 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f800bcd0 con 0x7fd61006b490 2024-01-25T15:04:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.923+0000 7fd60effd640 1 --2- 172.21.15.29:0/1037677907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5f8003a10 0x7fd5f8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.923+0000 7fd60e7fc640 1 --2- 172.21.15.29:0/1037677907 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd61006b490 0x7fd5f80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.923+0000 7fd60f7fe640 1 --2- 172.21.15.29:0/1037677907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f8004d00 0x7fd5f8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.923+0000 7fd60effd640 1 -- 172.21.15.29:0/1037677907 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd61006b490 msgr2=0x7fd5f80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.924+0000 7fd60effd640 1 --2- 172.21.15.29:0/1037677907 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd61006b490 0x7fd5f80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.924+0000 7fd60effd640 1 -- 172.21.15.29:0/1037677907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f8004d00 msgr2=0x7fd5f8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.924+0000 7fd60effd640 1 --2- 172.21.15.29:0/1037677907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f8004d00 0x7fd5f8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.924+0000 7fd60effd640 1 -- 172.21.15.29:0/1037677907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f8003520 con 0x7fd5f8003a10 2024-01-25T15:04:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.924+0000 7fd60f7fe640 1 --2- 172.21.15.29:0/1037677907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f8004d00 0x7fd5f8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.924+0000 7fd60effd640 1 --2- 172.21.15.29:0/1037677907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5f8003a10 0x7fd5f8003e30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd600009ac0 tx=0x7fd5f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11befbb7dc3018f server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:39.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.924+0000 7fd60dffb640 1 -- 172.21.15.29:0/1037677907 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60002c6b0 con 0x7fd5f8003a10 2024-01-25T15:04:39.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.924+0000 7fd60dffb640 1 -- 172.21.15.29:0/1037677907 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60002c810 con 0x7fd5f8003a10 2024-01-25T15:04:39.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.924+0000 7fd60dffb640 1 -- 172.21.15.29:0/1037677907 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60002cba0 con 0x7fd5f8003a10 2024-01-25T15:04:39.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.925+0000 7fd615702640 1 -- 172.21.15.29:0/1037677907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5f8003a10 msgr2=0x7fd5f8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.925+0000 7fd615702640 1 --2- 172.21.15.29:0/1037677907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5f8003a10 0x7fd5f8003e30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd600009ac0 tx=0x7fd5f80057f0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.925+0000 7fd60f7fe640 1 -- 172.21.15.29:0/1037677907 reap_dead start 2024-01-25T15:04:39.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.925+0000 7fd615702640 1 -- 172.21.15.29:0/1037677907 shutdown_connections 2024-01-25T15:04:39.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.925+0000 7fd615702640 1 -- 172.21.15.29:0/1037677907 >> 172.21.15.29:0/1037677907 conn(0x7fd6100ca010 msgr2=0x7fd6100ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:39.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.925+0000 7fd615702640 1 -- 172.21.15.29:0/1037677907 shutdown_connections 2024-01-25T15:04:39.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.925+0000 7fd615702640 1 -- 172.21.15.29:0/1037677907 wait complete. 2024-01-25T15:04:39.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.926+0000 7fd615702640 1 Processor -- start 2024-01-25T15:04:39.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.926+0000 7fd615702640 1 -- start start 2024-01-25T15:04:39.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.927+0000 7fd615702640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f8003a10 0x7fd610156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.927+0000 7fd615702640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6101ed990 0x7fd610148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.927+0000 7fd615702640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd610156230 0x7fd610148790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.927+0000 7fd615702640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6101578a0 con 0x7fd610156230 2024-01-25T15:04:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.927+0000 7fd615702640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6101ea420 con 0x7fd5f8003a10 2024-01-25T15:04:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.927+0000 7fd615702640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6101ede90 con 0x7fd6101ed990 2024-01-25T15:04:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.927+0000 7fd60f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd610156230 0x7fd610148790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.927+0000 7fd60f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd610156230 0x7fd610148790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36090/0 (socket says 172.21.15.29:36090) 2024-01-25T15:04:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.927+0000 7fd60f7fe640 1 -- 172.21.15.29:0/972713093 learned_addr learned my addr 172.21.15.29:0/972713093 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.927+0000 7fd60e7fc640 1 --2- 172.21.15.29:0/972713093 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6101ed990 0x7fd610148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.927+0000 7fd60effd640 1 --2- 172.21.15.29:0/972713093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f8003a10 0x7fd610156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.927+0000 7fd60f7fe640 1 -- 172.21.15.29:0/972713093 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6101ed990 msgr2=0x7fd610148250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.927+0000 7fd60f7fe640 1 --2- 172.21.15.29:0/972713093 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6101ed990 0x7fd610148250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.927+0000 7fd60f7fe640 1 -- 172.21.15.29:0/972713093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f8003a10 msgr2=0x7fd610156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.927+0000 7fd60f7fe640 1 --2- 172.21.15.29:0/972713093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f8003a10 0x7fd610156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.927+0000 7fd60f7fe640 1 -- 172.21.15.29:0/972713093 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd610155b70 con 0x7fd610156230 2024-01-25T15:04:39.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.927+0000 7fd60e7fc640 1 --2- 172.21.15.29:0/972713093 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6101ed990 0x7fd610148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:39.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.927+0000 7fd60effd640 1 --2- 172.21.15.29:0/972713093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f8003a10 0x7fd610156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:39.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.928+0000 7fd60f7fe640 1 --2- 172.21.15.29:0/972713093 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd610156230 0x7fd610148790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd61006cac0 tx=0x7fd60800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:39.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.928+0000 7fd5f77fe640 1 -- 172.21.15.29:0/972713093 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60800eb90 con 0x7fd610156230 2024-01-25T15:04:39.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.928+0000 7fd5f77fe640 1 -- 172.21.15.29:0/972713093 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60800ecf0 con 0x7fd610156230 2024-01-25T15:04:39.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.928+0000 7fd615702640 1 -- 172.21.15.29:0/972713093 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6101ee170 con 0x7fd610156230 2024-01-25T15:04:39.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.928+0000 7fd5f77fe640 1 -- 172.21.15.29:0/972713093 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd608013640 con 0x7fd610156230 2024-01-25T15:04:39.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.928+0000 7fd615702640 1 -- 172.21.15.29:0/972713093 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6101ee730 con 0x7fd610156230 2024-01-25T15:04:39.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.929+0000 7fd615702640 1 -- 172.21.15.29:0/972713093 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6101ee8f0 con 0x7fd610156230 2024-01-25T15:04:39.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.929+0000 7fd5f77fe640 1 -- 172.21.15.29:0/972713093 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fd6080137a0 con 0x7fd610156230 2024-01-25T15:04:39.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.930+0000 7fd5f77fe640 1 --2- 172.21.15.29:0/972713093 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd5fc06af00 0x7fd5fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.930+0000 7fd5f77fe640 1 -- 172.21.15.29:0/972713093 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd608089d30 con 0x7fd610156230 2024-01-25T15:04:39.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.930+0000 7fd60effd640 1 --2- 172.21.15.29:0/972713093 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd5fc06af00 0x7fd5fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.930+0000 7fd60effd640 1 --2- 172.21.15.29:0/972713093 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd5fc06af00 0x7fd5fc06d3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd600036000 tx=0x7fd600030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:39.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:39.934+0000 7fd5f77fe640 1 -- 172.21.15.29:0/972713093 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fd608054910 con 0x7fd610156230 2024-01-25T15:04:40.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.116+0000 7fd615702640 1 -- 172.21.15.29:0/972713093 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd6100aa950 con 0x7fd610156230 2024-01-25T15:04:40.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.116+0000 7fd5f77fe640 1 -- 172.21.15.29:0/972713093 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd608057f30 con 0x7fd610156230 2024-01-25T15:04:40.117 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-25T15:04:40.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.118+0000 7fd615702640 1 -- 172.21.15.29:0/972713093 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd5fc06af00 msgr2=0x7fd5fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:40.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.118+0000 7fd615702640 1 --2- 172.21.15.29:0/972713093 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd5fc06af00 0x7fd5fc06d3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd600036000 tx=0x7fd600030000 comp rx=0 tx=0).stop 2024-01-25T15:04:40.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.118+0000 7fd615702640 1 -- 172.21.15.29:0/972713093 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd610156230 msgr2=0x7fd610148790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:40.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.118+0000 7fd615702640 1 --2- 172.21.15.29:0/972713093 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd610156230 0x7fd610148790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd61006cac0 tx=0x7fd60800e530 comp rx=0 tx=0).stop 2024-01-25T15:04:40.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.118+0000 7fd615702640 1 -- 172.21.15.29:0/972713093 shutdown_connections 2024-01-25T15:04:40.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.118+0000 7fd615702640 1 --2- 172.21.15.29:0/972713093 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd5fc06af00 0x7fd5fc06d3c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.118+0000 7fd615702640 1 --2- 172.21.15.29:0/972713093 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd610156230 0x7fd610148790 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.118+0000 7fd615702640 1 --2- 172.21.15.29:0/972713093 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd6101ed990 0x7fd610148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.118+0000 7fd615702640 1 --2- 172.21.15.29:0/972713093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f8003a10 0x7fd610156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.118+0000 7fd615702640 1 -- 172.21.15.29:0/972713093 >> 172.21.15.29:0/972713093 conn(0x7fd6100ca010 msgr2=0x7fd6100c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:40.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.118+0000 7fd615702640 1 -- 172.21.15.29:0/972713093 shutdown_connections 2024-01-25T15:04:40.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.118+0000 7fd615702640 1 -- 172.21.15.29:0/972713093 wait complete. 2024-01-25T15:04:40.129 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-25T15:04:40.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.233+0000 7f8abf5a4640 1 Processor -- start 2024-01-25T15:04:40.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.233+0000 7f8abf5a4640 1 -- start start 2024-01-25T15:04:40.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.234+0000 7f8abf5a4640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ab8152090 0x7f8ab80c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:40.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.234+0000 7f8abf5a4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8ab8155750 0x7f8ab80c4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:40.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.234+0000 7f8abf5a4640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab80c9b40 con 0x7f8ab80c50e0 2024-01-25T15:04:40.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.234+0000 7f8abf5a4640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab8154a80 con 0x7f8ab8155750 2024-01-25T15:04:40.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.234+0000 7f8abf5a4640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab81552c0 con 0x7f8ab8152090 2024-01-25T15:04:40.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.234+0000 7f8abd340640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ab8152090 0x7f8ab80c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:40.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.234+0000 7f8abd340640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ab8152090 0x7f8ab80c5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:51582/0 (socket says 172.21.15.29:51582) 2024-01-25T15:04:40.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.234+0000 7f8abd340640 1 -- 172.21.15.29:0/2614326164 learned_addr learned my addr 172.21.15.29:0/2614326164 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:40.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.234+0000 7f8abcb3f640 1 --2- 172.21.15.29:0/2614326164 >> v2:172.21.15.52:3300/0 conn(0x7f8ab8155750 0x7f8ab80c4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:40.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.234+0000 7f8abd340640 1 -- 172.21.15.29:0/2614326164 >> v2:172.21.15.52:3300/0 conn(0x7f8ab8155750 msgr2=0x7f8ab80c4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:40.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.234+0000 7f8abd340640 1 --2- 172.21.15.29:0/2614326164 >> v2:172.21.15.52:3300/0 conn(0x7f8ab8155750 0x7f8ab80c4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.234+0000 7f8abd340640 1 -- 172.21.15.29:0/2614326164 >> v1:172.21.15.52:6789/0 conn(0x7f8ab80c50e0 legacy=0x7f8ab80c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:40.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.234+0000 7f8abd340640 1 -- 172.21.15.29:0/2614326164 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab80c6680 con 0x7f8ab8152090 2024-01-25T15:04:40.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.234+0000 7f8aaffff640 1 -- 172.21.15.29:0/2614326164 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188766731 0 0) 0x7f8ab0001490 con 0x7f8ab80c50e0 2024-01-25T15:04:40.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.235+0000 7f8abd340640 1 --2- 172.21.15.29:0/2614326164 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ab8152090 0x7f8ab80c5e10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4009870 tx=0x7f8ab402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=183fb8399db107a5 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:40.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.235+0000 7f8aaffff640 1 -- 172.21.15.29:0/2614326164 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4031640 con 0x7f8ab8152090 2024-01-25T15:04:40.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.235+0000 7f8aaffff640 1 -- 172.21.15.29:0/2614326164 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab40317a0 con 0x7f8ab8152090 2024-01-25T15:04:40.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.235+0000 7f8aaffff640 1 -- 172.21.15.29:0/2614326164 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4031b30 con 0x7f8ab8152090 2024-01-25T15:04:40.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.236+0000 7f8abf5a4640 1 -- 172.21.15.29:0/2614326164 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ab8152090 msgr2=0x7f8ab80c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:40.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.236+0000 7f8abf5a4640 1 --2- 172.21.15.29:0/2614326164 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ab8152090 0x7f8ab80c5e10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4009870 tx=0x7f8ab402b8f0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.236+0000 7f8abf5a4640 1 -- 172.21.15.29:0/2614326164 shutdown_connections 2024-01-25T15:04:40.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.236+0000 7f8abf5a4640 1 --2- 172.21.15.29:0/2614326164 >> v2:172.21.15.52:3300/0 conn(0x7f8ab8155750 0x7f8ab80c4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.236+0000 7f8abf5a4640 1 --2- 172.21.15.29:0/2614326164 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ab8152090 0x7f8ab80c5e10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.236+0000 7f8abf5a4640 1 -- 172.21.15.29:0/2614326164 >> 172.21.15.29:0/2614326164 conn(0x7f8ab80ca000 msgr2=0x7f8ab80ca3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:40.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.236+0000 7f8abf5a4640 1 -- 172.21.15.29:0/2614326164 shutdown_connections 2024-01-25T15:04:40.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.236+0000 7f8abf5a4640 1 -- 172.21.15.29:0/2614326164 wait complete. 2024-01-25T15:04:40.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.237+0000 7f8abf5a4640 1 Processor -- start 2024-01-25T15:04:40.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.237+0000 7f8abf5a4640 1 -- start start 2024-01-25T15:04:40.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.238+0000 7f8abf5a4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ab80c50e0 0x7f8ab80aa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:40.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.238+0000 7f8abf5a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ab8152090 0x7f8ab80c3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:40.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.238+0000 7f8abf5a4640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ab8155750 0x7f8ab8156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:40.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.238+0000 7f8abf5a4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab81443d0 con 0x7f8ab8152090 2024-01-25T15:04:40.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.238+0000 7f8abf5a4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab8156000 con 0x7f8ab80c50e0 2024-01-25T15:04:40.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.238+0000 7f8abf5a4640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab81578b0 con 0x7f8ab8155750 2024-01-25T15:04:40.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.238+0000 7f8abcb3f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ab8152090 0x7f8ab80c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:40.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.238+0000 7f8abcb3f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ab8152090 0x7f8ab80c3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36102/0 (socket says 172.21.15.29:36102) 2024-01-25T15:04:40.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.238+0000 7f8abcb3f640 1 -- 172.21.15.29:0/3113215621 learned_addr learned my addr 172.21.15.29:0/3113215621 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:40.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.238+0000 7f8abd340640 1 --2- 172.21.15.29:0/3113215621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ab80c50e0 0x7f8ab80aa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:40.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.238+0000 7f8abdb41640 1 --2- 172.21.15.29:0/3113215621 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ab8155750 0x7f8ab8156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:40.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.238+0000 7f8abcb3f640 1 -- 172.21.15.29:0/3113215621 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ab8155750 msgr2=0x7f8ab8156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:40.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.238+0000 7f8abcb3f640 1 --2- 172.21.15.29:0/3113215621 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ab8155750 0x7f8ab8156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.238+0000 7f8abcb3f640 1 -- 172.21.15.29:0/3113215621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ab80c50e0 msgr2=0x7f8ab80aa9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:40.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.238+0000 7f8abcb3f640 1 --2- 172.21.15.29:0/3113215621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ab80c50e0 0x7f8ab80aa9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.238+0000 7f8abcb3f640 1 -- 172.21.15.29:0/3113215621 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab40094d0 con 0x7f8ab8152090 2024-01-25T15:04:40.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.238+0000 7f8abcb3f640 1 --2- 172.21.15.29:0/3113215621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ab8152090 0x7f8ab80c3420 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800e840 tx=0x7f8aa800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:40.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.239+0000 7f8aadffb640 1 -- 172.21.15.29:0/3113215621 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80094f0 con 0x7f8ab8152090 2024-01-25T15:04:40.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.239+0000 7f8aadffb640 1 -- 172.21.15.29:0/3113215621 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa800c940 con 0x7f8ab8152090 2024-01-25T15:04:40.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.239+0000 7f8abf5a4640 1 -- 172.21.15.29:0/3113215621 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab81445b0 con 0x7f8ab8152090 2024-01-25T15:04:40.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.239+0000 7f8aadffb640 1 -- 172.21.15.29:0/3113215621 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa800ccd0 con 0x7f8ab8152090 2024-01-25T15:04:40.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.239+0000 7f8abf5a4640 1 -- 172.21.15.29:0/3113215621 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab81eb500 con 0x7f8ab8152090 2024-01-25T15:04:40.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.240+0000 7f8abf5a4640 1 -- 172.21.15.29:0/3113215621 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab8067be0 con 0x7f8ab8152090 2024-01-25T15:04:40.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.240+0000 7f8aadffb640 1 -- 172.21.15.29:0/3113215621 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8aa8013470 con 0x7f8ab8152090 2024-01-25T15:04:40.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.240+0000 7f8aadffb640 1 --2- 172.21.15.29:0/3113215621 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8a9c06aed0 0x7f8a9c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:40.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.241+0000 7f8aadffb640 1 -- 172.21.15.29:0/3113215621 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8aa8089940 con 0x7f8ab8152090 2024-01-25T15:04:40.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.241+0000 7f8abd340640 1 --2- 172.21.15.29:0/3113215621 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8a9c06aed0 0x7f8a9c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:40.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.241+0000 7f8abd340640 1 --2- 172.21.15.29:0/3113215621 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8a9c06aed0 0x7f8a9c06d390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4036000 tx=0x7f8ab403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:40.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.245+0000 7f8aadffb640 1 -- 172.21.15.29:0/3113215621 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8aa80545e0 con 0x7f8ab8152090 2024-01-25T15:04:40.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.422+0000 7f8abf5a4640 1 -- 172.21.15.29:0/3113215621 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8ab808be00 con 0x7f8ab8152090 2024-01-25T15:04:40.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.422+0000 7f8aadffb640 1 -- 172.21.15.29:0/3113215621 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8aa8057c00 con 0x7f8ab8152090 2024-01-25T15:04:40.423 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:04:40.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.424+0000 7f8abf5a4640 1 -- 172.21.15.29:0/3113215621 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8a9c06aed0 msgr2=0x7f8a9c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:40.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.424+0000 7f8abf5a4640 1 --2- 172.21.15.29:0/3113215621 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8a9c06aed0 0x7f8a9c06d390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4036000 tx=0x7f8ab403d040 comp rx=0 tx=0).stop 2024-01-25T15:04:40.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.424+0000 7f8abf5a4640 1 -- 172.21.15.29:0/3113215621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ab8152090 msgr2=0x7f8ab80c3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:40.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.424+0000 7f8abf5a4640 1 --2- 172.21.15.29:0/3113215621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ab8152090 0x7f8ab80c3420 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800e840 tx=0x7f8aa800ed00 comp rx=0 tx=0).stop 2024-01-25T15:04:40.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.424+0000 7f8abf5a4640 1 -- 172.21.15.29:0/3113215621 shutdown_connections 2024-01-25T15:04:40.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.424+0000 7f8abf5a4640 1 --2- 172.21.15.29:0/3113215621 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ab8155750 0x7f8ab8156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.424+0000 7f8abf5a4640 1 --2- 172.21.15.29:0/3113215621 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8a9c06aed0 0x7f8a9c06d390 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.424+0000 7f8abf5a4640 1 --2- 172.21.15.29:0/3113215621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ab8152090 0x7f8ab80c3420 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.424+0000 7f8abf5a4640 1 --2- 172.21.15.29:0/3113215621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ab80c50e0 0x7f8ab80aa9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.424+0000 7f8abf5a4640 1 -- 172.21.15.29:0/3113215621 >> 172.21.15.29:0/3113215621 conn(0x7f8ab80ca000 msgr2=0x7f8ab806b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:40.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.424+0000 7f8abf5a4640 1 -- 172.21.15.29:0/3113215621 shutdown_connections 2024-01-25T15:04:40.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.424+0000 7f8abf5a4640 1 -- 172.21.15.29:0/3113215621 wait complete. 2024-01-25T15:04:40.436 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-25T15:04:40.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.538+0000 7fdb2b2a6640 1 Processor -- start 2024-01-25T15:04:40.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.538+0000 7fdb2b2a6640 1 -- start start 2024-01-25T15:04:40.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.539+0000 7fdb2b2a6640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb24152090 0x7fdb240c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:40.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.539+0000 7fdb2b2a6640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb240c9b40 con 0x7fdb240c7f00 2024-01-25T15:04:40.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.539+0000 7fdb2b2a6640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb241552c0 con 0x7fdb24155750 2024-01-25T15:04:40.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.539+0000 7fdb2b2a6640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb24154a80 con 0x7fdb24152090 2024-01-25T15:04:40.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.539+0000 7fdb29843640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fdb240c7f00 0x7fdb2415f320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54562/0 (socket says 172.21.15.29:54562) 2024-01-25T15:04:40.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.539+0000 7fdb29843640 1 -- 172.21.15.29:0/3620224874 learned_addr learned my addr 172.21.15.29:0/3620224874 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:40.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.539+0000 7fdb29042640 1 --2- 172.21.15.29:0/3620224874 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb24152090 0x7fdb240c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:40.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.539+0000 7fdb23fff640 1 -- 172.21.15.29:0/3620224874 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033031215 0 0) 0x7fdb14001110 con 0x7fdb240c7f00 2024-01-25T15:04:40.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.539+0000 7fdb23fff640 1 -- 172.21.15.29:0/3620224874 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb0c003520 con 0x7fdb240c7f00 2024-01-25T15:04:40.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.539+0000 7fdb29042640 1 -- 172.21.15.29:0/3620224874 >> v1:172.21.15.52:6789/0 conn(0x7fdb24155750 legacy=0x7fdb240c4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:40.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.539+0000 7fdb23fff640 1 -- 172.21.15.29:0/3620224874 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248264008 0 0) 0x7fdb241552c0 con 0x7fdb24155750 2024-01-25T15:04:40.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.539+0000 7fdb29042640 1 -- 172.21.15.29:0/3620224874 >> v1:172.21.15.29:6789/0 conn(0x7fdb240c7f00 legacy=0x7fdb2415f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:40.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.539+0000 7fdb29042640 1 -- 172.21.15.29:0/3620224874 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb240c6680 con 0x7fdb24152090 2024-01-25T15:04:40.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.540+0000 7fdb29042640 1 --2- 172.21.15.29:0/3620224874 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb24152090 0x7fdb240c5e10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c009dc0 tx=0x7fdb1c02be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=494e83085dc35df server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:40.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.540+0000 7fdb23fff640 1 -- 172.21.15.29:0/3620224874 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c02cc40 con 0x7fdb24152090 2024-01-25T15:04:40.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.540+0000 7fdb23fff640 1 -- 172.21.15.29:0/3620224874 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1c02cda0 con 0x7fdb24152090 2024-01-25T15:04:40.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.540+0000 7fdb23fff640 1 -- 172.21.15.29:0/3620224874 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c034640 con 0x7fdb24152090 2024-01-25T15:04:40.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.541+0000 7fdb2b2a6640 1 -- 172.21.15.29:0/3620224874 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb24152090 msgr2=0x7fdb240c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:40.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.541+0000 7fdb2b2a6640 1 --2- 172.21.15.29:0/3620224874 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb24152090 0x7fdb240c5e10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c009dc0 tx=0x7fdb1c02be90 comp rx=0 tx=0).stop 2024-01-25T15:04:40.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.541+0000 7fdb2b2a6640 1 -- 172.21.15.29:0/3620224874 shutdown_connections 2024-01-25T15:04:40.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.541+0000 7fdb2b2a6640 1 --2- 172.21.15.29:0/3620224874 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb24152090 0x7fdb240c5e10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.541+0000 7fdb2b2a6640 1 -- 172.21.15.29:0/3620224874 >> 172.21.15.29:0/3620224874 conn(0x7fdb240ca000 msgr2=0x7fdb240ca3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:40.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.541+0000 7fdb2b2a6640 1 -- 172.21.15.29:0/3620224874 shutdown_connections 2024-01-25T15:04:40.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.541+0000 7fdb2b2a6640 1 -- 172.21.15.29:0/3620224874 wait complete. 2024-01-25T15:04:40.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.542+0000 7fdb2b2a6640 1 Processor -- start 2024-01-25T15:04:40.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.542+0000 7fdb2b2a6640 1 -- start start 2024-01-25T15:04:40.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.543+0000 7fdb2b2a6640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb240c7f00 0x7fdb241eb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:40.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.543+0000 7fdb2b2a6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb24152090 0x7fdb241eaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:40.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.543+0000 7fdb2b2a6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb24155750 0x7fdb24158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:40.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.543+0000 7fdb2b2a6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2414e460 con 0x7fdb24155750 2024-01-25T15:04:40.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.543+0000 7fdb2b2a6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb241ea620 con 0x7fdb24152090 2024-01-25T15:04:40.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.543+0000 7fdb2b2a6640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2414ce00 con 0x7fdb240c7f00 2024-01-25T15:04:40.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.543+0000 7fdb29843640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb24155750 0x7fdb24158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:40.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.543+0000 7fdb29843640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb24155750 0x7fdb24158260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36106/0 (socket says 172.21.15.29:36106) 2024-01-25T15:04:40.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.543+0000 7fdb29843640 1 -- 172.21.15.29:0/531627649 learned_addr learned my addr 172.21.15.29:0/531627649 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:40.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.543+0000 7fdb29042640 1 --2- 172.21.15.29:0/531627649 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb240c7f00 0x7fdb241eb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:40.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.543+0000 7fdb28841640 1 --2- 172.21.15.29:0/531627649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb24152090 0x7fdb241eaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:40.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.543+0000 7fdb29843640 1 -- 172.21.15.29:0/531627649 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb240c7f00 msgr2=0x7fdb241eb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:40.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.543+0000 7fdb29843640 1 --2- 172.21.15.29:0/531627649 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb240c7f00 0x7fdb241eb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.543+0000 7fdb29843640 1 -- 172.21.15.29:0/531627649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb24152090 msgr2=0x7fdb241eaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:40.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.543+0000 7fdb29843640 1 --2- 172.21.15.29:0/531627649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb24152090 0x7fdb241eaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.543+0000 7fdb29843640 1 -- 172.21.15.29:0/531627649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c009a70 con 0x7fdb24155750 2024-01-25T15:04:40.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.543+0000 7fdb29042640 1 --2- 172.21.15.29:0/531627649 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb240c7f00 0x7fdb241eb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:40.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.543+0000 7fdb29843640 1 --2- 172.21.15.29:0/531627649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb24155750 0x7fdb24158260 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400c700 tx=0x7fdb1400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:40.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.544+0000 7fdb21ffb640 1 -- 172.21.15.29:0/531627649 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14005ab0 con 0x7fdb24155750 2024-01-25T15:04:40.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.544+0000 7fdb21ffb640 1 -- 172.21.15.29:0/531627649 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb14005c10 con 0x7fdb24155750 2024-01-25T15:04:40.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.544+0000 7fdb2b2a6640 1 -- 172.21.15.29:0/531627649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb241ea2d0 con 0x7fdb24155750 2024-01-25T15:04:40.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.544+0000 7fdb21ffb640 1 -- 172.21.15.29:0/531627649 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14001d50 con 0x7fdb24155750 2024-01-25T15:04:40.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.544+0000 7fdb2b2a6640 1 -- 172.21.15.29:0/531627649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb241476a0 con 0x7fdb24155750 2024-01-25T15:04:40.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.545+0000 7fdb2b2a6640 1 -- 172.21.15.29:0/531627649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb2408be00 con 0x7fdb24155750 2024-01-25T15:04:40.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.545+0000 7fdb21ffb640 1 -- 172.21.15.29:0/531627649 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fdb14007070 con 0x7fdb24155750 2024-01-25T15:04:40.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.546+0000 7fdb21ffb640 1 --2- 172.21.15.29:0/531627649 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdb1006aed0 0x7fdb1006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:40.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.546+0000 7fdb21ffb640 1 -- 172.21.15.29:0/531627649 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdb14088ca0 con 0x7fdb24155750 2024-01-25T15:04:40.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.546+0000 7fdb29042640 1 --2- 172.21.15.29:0/531627649 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdb1006aed0 0x7fdb1006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:40.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.546+0000 7fdb29042640 1 --2- 172.21.15.29:0/531627649 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdb1006aed0 0x7fdb1006d390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c036000 tx=0x7fdb1c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:40.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.550+0000 7fdb21ffb640 1 -- 172.21.15.29:0/531627649 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fdb14053910 con 0x7fdb24155750 2024-01-25T15:04:40.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.742+0000 7fdb2b2a6640 1 -- 172.21.15.29:0/531627649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdb240c9b40 con 0x7fdb24155750 2024-01-25T15:04:40.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.742+0000 7fdb21ffb640 1 -- 172.21.15.29:0/531627649 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdb240c9b40 con 0x7fdb24155750 2024-01-25T15:04:40.743 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-25T15:04:40.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.744+0000 7fdb2b2a6640 1 -- 172.21.15.29:0/531627649 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdb1006aed0 msgr2=0x7fdb1006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:40.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.744+0000 7fdb2b2a6640 1 --2- 172.21.15.29:0/531627649 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdb1006aed0 0x7fdb1006d390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c036000 tx=0x7fdb1c030000 comp rx=0 tx=0).stop 2024-01-25T15:04:40.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.744+0000 7fdb2b2a6640 1 -- 172.21.15.29:0/531627649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb24155750 msgr2=0x7fdb24158260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:40.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.744+0000 7fdb2b2a6640 1 --2- 172.21.15.29:0/531627649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb24155750 0x7fdb24158260 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400c700 tx=0x7fdb1400cbc0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.744+0000 7fdb2b2a6640 1 -- 172.21.15.29:0/531627649 shutdown_connections 2024-01-25T15:04:40.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.744+0000 7fdb2b2a6640 1 --2- 172.21.15.29:0/531627649 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdb1006aed0 0x7fdb1006d390 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.744+0000 7fdb2b2a6640 1 --2- 172.21.15.29:0/531627649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb24155750 0x7fdb24158260 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.744+0000 7fdb2b2a6640 1 --2- 172.21.15.29:0/531627649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb24152090 0x7fdb241eaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.744+0000 7fdb2b2a6640 1 --2- 172.21.15.29:0/531627649 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb240c7f00 0x7fdb241eb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.744+0000 7fdb2b2a6640 1 -- 172.21.15.29:0/531627649 >> 172.21.15.29:0/531627649 conn(0x7fdb240ca000 msgr2=0x7fdb2406b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:40.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.744+0000 7fdb2b2a6640 1 -- 172.21.15.29:0/531627649 shutdown_connections 2024-01-25T15:04:40.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:40.744+0000 7fdb2b2a6640 1 -- 172.21.15.29:0/531627649 wait complete. 2024-01-25T15:04:40.755 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2024-01-25T15:04:40.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:40.756 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-01-25T15:04:40.781 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:ceph-fuse[43268]: fuse finished with error 0 and tester_r 0 2024-01-25T15:04:40.782 INFO:teuthology.orchestra.run:waiting for 300 2024-01-25T15:04:40.814 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-01-25T15:04:40.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:40.815 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-01-25T15:04:40.882 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:04:41.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.022+0000 7f783f26e640 1 Processor -- start 2024-01-25T15:04:41.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.022+0000 7f783f26e640 1 -- start start 2024-01-25T15:04:41.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.023+0000 7f783f26e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f78380c55e0 0x7f7838155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:41.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.023+0000 7f783f26e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78380c4f00 0x7f78380c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:41.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.023+0000 7f783f26e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78380c66c0 con 0x7f78381520b0 2024-01-25T15:04:41.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.023+0000 7f783f26e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f783806cfc0 con 0x7f78380c55e0 2024-01-25T15:04:41.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.023+0000 7f783f26e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7838152490 con 0x7f78380c4f00 2024-01-25T15:04:41.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.023+0000 7f783d80b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78380c4f00 0x7f78380c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:41.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.023+0000 7f783c809640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f78380c55e0 0x7f7838155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:41.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.023+0000 7f783d80b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78380c4f00 0x7f78380c5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:51616/0 (socket says 172.21.15.29:51616) 2024-01-25T15:04:41.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.023+0000 7f783d80b640 1 -- 172.21.15.29:0/3504407212 learned_addr learned my addr 172.21.15.29:0/3504407212 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:41.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.024+0000 7f783d80b640 1 -- 172.21.15.29:0/3504407212 >> v2:172.21.15.52:3300/0 conn(0x7f78380c55e0 msgr2=0x7f7838155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:41.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.024+0000 7f783d80b640 1 --2- 172.21.15.29:0/3504407212 >> v2:172.21.15.52:3300/0 conn(0x7f78380c55e0 0x7f7838155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.024+0000 7f783d80b640 1 -- 172.21.15.29:0/3504407212 >> v1:172.21.15.52:6789/0 conn(0x7f78381520b0 legacy=0x7f78380c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:41.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.024+0000 7f783d80b640 1 -- 172.21.15.29:0/3504407212 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78380c8830 con 0x7f78380c4f00 2024-01-25T15:04:41.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.025+0000 7f783d80b640 1 --2- 172.21.15.29:0/3504407212 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78380c4f00 0x7f78380c5b30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7830009870 tx=0x7f783002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32569ba85eb0ef24 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:41.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.025+0000 7f7837fff640 1 -- 172.21.15.29:0/3504407212 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830031640 con 0x7f78380c4f00 2024-01-25T15:04:41.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.025+0000 7f7837fff640 1 -- 172.21.15.29:0/3504407212 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78300317a0 con 0x7f78380c4f00 2024-01-25T15:04:41.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.025+0000 7f7837fff640 1 -- 172.21.15.29:0/3504407212 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830031b30 con 0x7f78380c4f00 2024-01-25T15:04:41.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.025+0000 7f783f26e640 1 -- 172.21.15.29:0/3504407212 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78380c4f00 msgr2=0x7f78380c5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:41.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.025+0000 7f783f26e640 1 --2- 172.21.15.29:0/3504407212 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78380c4f00 0x7f78380c5b30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7830009870 tx=0x7f783002b8f0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.025+0000 7f783f26e640 1 -- 172.21.15.29:0/3504407212 shutdown_connections 2024-01-25T15:04:41.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.025+0000 7f783f26e640 1 --2- 172.21.15.29:0/3504407212 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78380c4f00 0x7f78380c5b30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.025+0000 7f783f26e640 1 --2- 172.21.15.29:0/3504407212 >> v2:172.21.15.52:3300/0 conn(0x7f78380c55e0 0x7f7838155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.025+0000 7f783f26e640 1 -- 172.21.15.29:0/3504407212 >> 172.21.15.29:0/3504407212 conn(0x7f78380ca220 msgr2=0x7f78380ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:41.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.025+0000 7f783f26e640 1 -- 172.21.15.29:0/3504407212 shutdown_connections 2024-01-25T15:04:41.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.025+0000 7f783f26e640 1 -- 172.21.15.29:0/3504407212 wait complete. 2024-01-25T15:04:41.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.027+0000 7f783f26e640 1 Processor -- start 2024-01-25T15:04:41.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.027+0000 7f783f26e640 1 -- start start 2024-01-25T15:04:41.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.027+0000 7f783f26e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78380c4f00 0x7f783814de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:41.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.027+0000 7f783f26e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78381520b0 0x7f78380aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:41.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.027+0000 7f783f26e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78381ea1d0 0x7f78381485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:41.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.027+0000 7f783f26e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78381eb230 con 0x7f78381520b0 2024-01-25T15:04:41.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.027+0000 7f783f26e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783814e350 con 0x7f78380c4f00 2024-01-25T15:04:41.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.027+0000 7f783f26e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78381ea6b0 con 0x7f78381ea1d0 2024-01-25T15:04:41.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.027+0000 7f783c809640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78381520b0 0x7f78380aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:41.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.027+0000 7f783c809640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78381520b0 0x7f78380aaf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36108/0 (socket says 172.21.15.29:36108) 2024-01-25T15:04:41.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.027+0000 7f783c809640 1 -- 172.21.15.29:0/1081122356 learned_addr learned my addr 172.21.15.29:0/1081122356 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:41.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.027+0000 7f783d80b640 1 --2- 172.21.15.29:0/1081122356 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78381ea1d0 0x7f78381485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:41.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.027+0000 7f783d00a640 1 --2- 172.21.15.29:0/1081122356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78380c4f00 0x7f783814de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:41.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.028+0000 7f783c809640 1 -- 172.21.15.29:0/1081122356 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78381ea1d0 msgr2=0x7f78381485b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:41.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.028+0000 7f783c809640 1 --2- 172.21.15.29:0/1081122356 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78381ea1d0 0x7f78381485b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.028+0000 7f783c809640 1 -- 172.21.15.29:0/1081122356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78380c4f00 msgr2=0x7f783814de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:41.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.028+0000 7f783c809640 1 --2- 172.21.15.29:0/1081122356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78380c4f00 0x7f783814de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.028+0000 7f783c809640 1 -- 172.21.15.29:0/1081122356 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78300094d0 con 0x7f78381520b0 2024-01-25T15:04:41.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.028+0000 7f783c809640 1 --2- 172.21.15.29:0/1081122356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78381520b0 0x7f78380aaf30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f782c00e9e0 tx=0x7f782c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:41.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.028+0000 7f7835ffb640 1 -- 172.21.15.29:0/1081122356 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c009670 con 0x7f78381520b0 2024-01-25T15:04:41.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.028+0000 7f7835ffb640 1 -- 172.21.15.29:0/1081122356 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782c00c9d0 con 0x7f78381520b0 2024-01-25T15:04:41.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.028+0000 7f783f26e640 1 -- 172.21.15.29:0/1081122356 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78381ea990 con 0x7f78381520b0 2024-01-25T15:04:41.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.028+0000 7f7835ffb640 1 -- 172.21.15.29:0/1081122356 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c00cd80 con 0x7f78381520b0 2024-01-25T15:04:41.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.028+0000 7f783f26e640 1 -- 172.21.15.29:0/1081122356 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78381eaf50 con 0x7f78381520b0 2024-01-25T15:04:41.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.029+0000 7f783f26e640 1 -- 172.21.15.29:0/1081122356 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7838074080 con 0x7f78381520b0 2024-01-25T15:04:41.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.030+0000 7f7835ffb640 1 -- 172.21.15.29:0/1081122356 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f782c013470 con 0x7f78381520b0 2024-01-25T15:04:41.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.030+0000 7f7835ffb640 1 --2- 172.21.15.29:0/1081122356 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f782406aed0 0x7f782406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:41.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.030+0000 7f7835ffb640 1 -- 172.21.15.29:0/1081122356 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f782c089a80 con 0x7f78381520b0 2024-01-25T15:04:41.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.030+0000 7f783d00a640 1 --2- 172.21.15.29:0/1081122356 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f782406aed0 0x7f782406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:41.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.031+0000 7f783d00a640 1 --2- 172.21.15.29:0/1081122356 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f782406aed0 0x7f782406d390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7828001e70 tx=0x7f7828009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:41.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.034+0000 7f7835ffb640 1 -- 172.21.15.29:0/1081122356 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f782c0547a0 con 0x7f78381520b0 2024-01-25T15:04:41.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.217+0000 7f783f26e640 1 -- 172.21.15.29:0/1081122356 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f783814c350 con 0x7f78381520b0 2024-01-25T15:04:41.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.218+0000 7f7835ffb640 1 -- 172.21.15.29:0/1081122356 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18311 (secure 0 0 0) 0x7f782c017090 con 0x7f78381520b0 2024-01-25T15:04:41.219 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:41.219 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:31.978871+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:04:41.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.220+0000 7f783f26e640 1 -- 172.21.15.29:0/1081122356 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f782406aed0 msgr2=0x7f782406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:41.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.220+0000 7f783f26e640 1 --2- 172.21.15.29:0/1081122356 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f782406aed0 0x7f782406d390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7828001e70 tx=0x7f7828009040 comp rx=0 tx=0).stop 2024-01-25T15:04:41.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.220+0000 7f783f26e640 1 -- 172.21.15.29:0/1081122356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78381520b0 msgr2=0x7f78380aaf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:41.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.220+0000 7f783f26e640 1 --2- 172.21.15.29:0/1081122356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78381520b0 0x7f78380aaf30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f782c00e9e0 tx=0x7f782c00eea0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.220+0000 7f783f26e640 1 -- 172.21.15.29:0/1081122356 shutdown_connections 2024-01-25T15:04:41.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.220+0000 7f783f26e640 1 --2- 172.21.15.29:0/1081122356 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78381ea1d0 0x7f78381485b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.220+0000 7f783f26e640 1 --2- 172.21.15.29:0/1081122356 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f782406aed0 0x7f782406d390 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.220+0000 7f783f26e640 1 --2- 172.21.15.29:0/1081122356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78381520b0 0x7f78380aaf30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.220+0000 7f783f26e640 1 --2- 172.21.15.29:0/1081122356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78380c4f00 0x7f783814de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.220+0000 7f783f26e640 1 -- 172.21.15.29:0/1081122356 >> 172.21.15.29:0/1081122356 conn(0x7f78380ca220 msgr2=0x7f78381540a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:41.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.220+0000 7f783f26e640 1 -- 172.21.15.29:0/1081122356 shutdown_connections 2024-01-25T15:04:41.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.220+0000 7f783f26e640 1 -- 172.21.15.29:0/1081122356 wait complete. 2024-01-25T15:04:41.232 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:04:41.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.332+0000 7f40aa79e640 1 Processor -- start 2024-01-25T15:04:41.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.332+0000 7f40aa79e640 1 -- start start 2024-01-25T15:04:41.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.333+0000 7f40aa79e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f40a40c6980 0x7f40a41530b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:41.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.333+0000 7f40aa79e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f40a40c3c30 0x7f40a40c8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:41.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.333+0000 7f40aa79e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a40c3100 con 0x7f40a414c6f0 2024-01-25T15:04:41.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.333+0000 7f40aa79e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a40c41d0 con 0x7f40a40c3c30 2024-01-25T15:04:41.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.333+0000 7f40aa79e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a41525d0 con 0x7f40a40c6980 2024-01-25T15:04:41.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.333+0000 7f40a8d3b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f40a40c3c30 0x7f40a40c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:41.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.333+0000 7f40a3fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f40a414c6f0 0x7f40a40c29f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54572/0 (socket says 172.21.15.29:54572) 2024-01-25T15:04:41.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.333+0000 7f40a3fff640 1 -- 172.21.15.29:0/2792242537 learned_addr learned my addr 172.21.15.29:0/2792242537 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.333+0000 7f40a37fe640 1 --2- 172.21.15.29:0/2792242537 >> v2:172.21.15.52:3300/0 conn(0x7f40a40c6980 0x7f40a41530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.334+0000 7f40a8d3b640 1 -- 172.21.15.29:0/2792242537 >> v2:172.21.15.52:3300/0 conn(0x7f40a40c6980 msgr2=0x7f40a41530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.334+0000 7f40a8d3b640 1 --2- 172.21.15.29:0/2792242537 >> v2:172.21.15.52:3300/0 conn(0x7f40a40c6980 0x7f40a41530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.334+0000 7f40a8d3b640 1 -- 172.21.15.29:0/2792242537 >> v1:172.21.15.29:6789/0 conn(0x7f40a414c6f0 legacy=0x7f40a40c29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.334+0000 7f40a8d3b640 1 -- 172.21.15.29:0/2792242537 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a41528b0 con 0x7f40a40c3c30 2024-01-25T15:04:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.334+0000 7f40a8d3b640 1 --2- 172.21.15.29:0/2792242537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40a40c3c30 0x7f40a40c8360 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f40a40a7cc0 tx=0x7f409c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82baea4d6fef72e5 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.334+0000 7f40a2ffd640 1 -- 172.21.15.29:0/2792242537 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c02cc80 con 0x7f40a40c3c30 2024-01-25T15:04:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.334+0000 7f40a2ffd640 1 -- 172.21.15.29:0/2792242537 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409c02cde0 con 0x7f40a40c3c30 2024-01-25T15:04:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.334+0000 7f40a2ffd640 1 -- 172.21.15.29:0/2792242537 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c034660 con 0x7f40a40c3c30 2024-01-25T15:04:41.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.335+0000 7f40aa79e640 1 -- 172.21.15.29:0/2792242537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40a40c3c30 msgr2=0x7f40a40c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:41.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.335+0000 7f40aa79e640 1 --2- 172.21.15.29:0/2792242537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40a40c3c30 0x7f40a40c8360 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f40a40a7cc0 tx=0x7f409c02bed0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.335+0000 7f40aa79e640 1 -- 172.21.15.29:0/2792242537 shutdown_connections 2024-01-25T15:04:41.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.335+0000 7f40aa79e640 1 --2- 172.21.15.29:0/2792242537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40a40c3c30 0x7f40a40c8360 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.335+0000 7f40aa79e640 1 --2- 172.21.15.29:0/2792242537 >> v2:172.21.15.52:3300/0 conn(0x7f40a40c6980 0x7f40a41530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.335+0000 7f40aa79e640 1 -- 172.21.15.29:0/2792242537 >> 172.21.15.29:0/2792242537 conn(0x7f40a406a8a0 msgr2=0x7f40a406acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:41.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.335+0000 7f40aa79e640 1 -- 172.21.15.29:0/2792242537 shutdown_connections 2024-01-25T15:04:41.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.335+0000 7f40aa79e640 1 -- 172.21.15.29:0/2792242537 wait complete. 2024-01-25T15:04:41.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.336+0000 7f40aa79e640 1 Processor -- start 2024-01-25T15:04:41.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.336+0000 7f40aa79e640 1 -- start start 2024-01-25T15:04:41.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.337+0000 7f40aa79e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40a40c3c30 0x7f40a414d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:41.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.337+0000 7f40aa79e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40a40c6980 0x7f40a4142300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:41.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.337+0000 7f40aa79e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40a414c6f0 0x7f40a4142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:41.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.337+0000 7f40aa79e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a4070b20 con 0x7f40a40c3c30 2024-01-25T15:04:41.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.337+0000 7f40aa79e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a41568b0 con 0x7f40a40c6980 2024-01-25T15:04:41.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.337+0000 7f40aa79e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a406e920 con 0x7f40a414c6f0 2024-01-25T15:04:41.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.337+0000 7f40a3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40a40c3c30 0x7f40a414d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:41.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.337+0000 7f40a3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40a40c3c30 0x7f40a414d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36138/0 (socket says 172.21.15.29:36138) 2024-01-25T15:04:41.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.337+0000 7f40a3fff640 1 -- 172.21.15.29:0/3852887822 learned_addr learned my addr 172.21.15.29:0/3852887822 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:41.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.337+0000 7f40a8d3b640 1 --2- 172.21.15.29:0/3852887822 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40a414c6f0 0x7f40a4142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:41.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.337+0000 7f40a37fe640 1 --2- 172.21.15.29:0/3852887822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40a40c6980 0x7f40a4142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:41.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.337+0000 7f40a3fff640 1 -- 172.21.15.29:0/3852887822 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40a414c6f0 msgr2=0x7f40a4142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:41.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.337+0000 7f40a3fff640 1 --2- 172.21.15.29:0/3852887822 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40a414c6f0 0x7f40a4142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.337+0000 7f40a3fff640 1 -- 172.21.15.29:0/3852887822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40a40c6980 msgr2=0x7f40a4142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:41.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.337+0000 7f40a3fff640 1 --2- 172.21.15.29:0/3852887822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40a40c6980 0x7f40a4142300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.337+0000 7f40a3fff640 1 -- 172.21.15.29:0/3852887822 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409c009a70 con 0x7f40a40c3c30 2024-01-25T15:04:41.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.338+0000 7f40a3fff640 1 --2- 172.21.15.29:0/3852887822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40a40c3c30 0x7f40a414d020 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f408c00c3c0 tx=0x7f408c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:41.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.338+0000 7f40a0ff9640 1 -- 172.21.15.29:0/3852887822 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c005ce0 con 0x7f40a40c3c30 2024-01-25T15:04:41.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.338+0000 7f40a0ff9640 1 -- 172.21.15.29:0/3852887822 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408c005e40 con 0x7f40a40c3c30 2024-01-25T15:04:41.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.338+0000 7f40aa79e640 1 -- 172.21.15.29:0/3852887822 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a414fbd0 con 0x7f40a40c3c30 2024-01-25T15:04:41.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.338+0000 7f40a0ff9640 1 -- 172.21.15.29:0/3852887822 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c0072d0 con 0x7f40a40c3c30 2024-01-25T15:04:41.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.338+0000 7f40aa79e640 1 -- 172.21.15.29:0/3852887822 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a4070840 con 0x7f40a40c3c30 2024-01-25T15:04:41.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.339+0000 7f40aa79e640 1 -- 172.21.15.29:0/3852887822 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a406eae0 con 0x7f40a40c3c30 2024-01-25T15:04:41.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.339+0000 7f40a0ff9640 1 -- 172.21.15.29:0/3852887822 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f408c007430 con 0x7f40a40c3c30 2024-01-25T15:04:41.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.340+0000 7f40a0ff9640 1 --2- 172.21.15.29:0/3852887822 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f408406af00 0x7f408406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:41.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.340+0000 7f40a0ff9640 1 -- 172.21.15.29:0/3852887822 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f408c088d20 con 0x7f40a40c3c30 2024-01-25T15:04:41.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.340+0000 7f40a37fe640 1 --2- 172.21.15.29:0/3852887822 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f408406af00 0x7f408406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:41.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.340+0000 7f40a37fe640 1 --2- 172.21.15.29:0/3852887822 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f408406af00 0x7f408406d3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f40a4147c00 tx=0x7f4094008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:41.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.344+0000 7f40a0ff9640 1 -- 172.21.15.29:0/3852887822 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f408c053a40 con 0x7f40a40c3c30 2024-01-25T15:04:41.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.528+0000 7f40aa79e640 1 -- 172.21.15.29:0/3852887822 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40a4074080 con 0x7f40a40c3c30 2024-01-25T15:04:41.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.529+0000 7f40a0ff9640 1 -- 172.21.15.29:0/3852887822 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18311 (secure 0 0 0) 0x7f408c017020 con 0x7f40a40c3c30 2024-01-25T15:04:41.530 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:41.530 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:31.978871+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:04:41.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.531+0000 7f40aa79e640 1 -- 172.21.15.29:0/3852887822 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f408406af00 msgr2=0x7f408406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:41.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.531+0000 7f40aa79e640 1 --2- 172.21.15.29:0/3852887822 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f408406af00 0x7f408406d3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f40a4147c00 tx=0x7f4094008040 comp rx=0 tx=0).stop 2024-01-25T15:04:41.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.531+0000 7f40aa79e640 1 -- 172.21.15.29:0/3852887822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40a40c3c30 msgr2=0x7f40a414d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:41.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.531+0000 7f40aa79e640 1 --2- 172.21.15.29:0/3852887822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40a40c3c30 0x7f40a414d020 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f408c00c3c0 tx=0x7f408c00c880 comp rx=0 tx=0).stop 2024-01-25T15:04:41.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.531+0000 7f40aa79e640 1 -- 172.21.15.29:0/3852887822 shutdown_connections 2024-01-25T15:04:41.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.531+0000 7f40aa79e640 1 --2- 172.21.15.29:0/3852887822 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f40a414c6f0 0x7f40a4142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.531+0000 7f40aa79e640 1 --2- 172.21.15.29:0/3852887822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40a40c6980 0x7f40a4142300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.531+0000 7f40aa79e640 1 --2- 172.21.15.29:0/3852887822 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f408406af00 0x7f408406d3c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.531+0000 7f40aa79e640 1 --2- 172.21.15.29:0/3852887822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40a40c3c30 0x7f40a414d020 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.531+0000 7f40aa79e640 1 -- 172.21.15.29:0/3852887822 >> 172.21.15.29:0/3852887822 conn(0x7f40a406a8a0 msgr2=0x7f40a40c82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:41.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.531+0000 7f40aa79e640 1 -- 172.21.15.29:0/3852887822 shutdown_connections 2024-01-25T15:04:41.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.531+0000 7f40aa79e640 1 -- 172.21.15.29:0/3852887822 wait complete. 2024-01-25T15:04:41.543 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-25T15:04:41.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.646+0000 7effc9b82640 1 Processor -- start 2024-01-25T15:04:41.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.647+0000 7effc9b82640 1 -- start start 2024-01-25T15:04:41.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.647+0000 7effc9b82640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effc406d560 0x7effc406b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:41.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.647+0000 7effc9b82640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc40afaa0 con 0x7effc40af6c0 2024-01-25T15:04:41.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.647+0000 7effc9b82640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc40c6060 con 0x7effc40c4fe0 2024-01-25T15:04:41.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.647+0000 7effc9b82640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc406c480 con 0x7effc406d560 2024-01-25T15:04:41.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.647+0000 7effc37fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7effc40af6c0 0x7effc40c5530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54574/0 (socket says 172.21.15.29:54574) 2024-01-25T15:04:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.647+0000 7effc37fe640 1 -- 172.21.15.29:0/3053965672 learned_addr learned my addr 172.21.15.29:0/3053965672 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc2ffd640 1 --2- 172.21.15.29:0/3053965672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effc406d560 0x7effc406b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc27fc640 1 -- 172.21.15.29:0/3053965672 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1806299612 0 0) 0x7effc40afaa0 con 0x7effc40af6c0 2024-01-25T15:04:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc27fc640 1 -- 172.21.15.29:0/3053965672 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effac003520 con 0x7effc40af6c0 2024-01-25T15:04:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc27fc640 1 -- 172.21.15.29:0/3053965672 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3631466174 0 0) 0x7effac003520 con 0x7effc40af6c0 2024-01-25T15:04:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc27fc640 1 -- 172.21.15.29:0/3053965672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effc406d560 msgr2=0x7effc406b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc27fc640 1 --2- 172.21.15.29:0/3053965672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effc406d560 0x7effc406b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc27fc640 1 -- 172.21.15.29:0/3053965672 >> v1:172.21.15.52:6789/0 conn(0x7effc40c4fe0 legacy=0x7effc406b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc27fc640 1 -- 172.21.15.29:0/3053965672 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc4155480 con 0x7effc40af6c0 2024-01-25T15:04:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc27fc640 1 -- 172.21.15.29:0/3053965672 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7effb4001670 con 0x7effc40af6c0 2024-01-25T15:04:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc27fc640 1 -- 172.21.15.29:0/3053965672 >> v1:172.21.15.29:6789/0 conn(0x7effc40af6c0 legacy=0x7effc40c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc27fc640 1 --2- 172.21.15.29:0/3053965672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effc406d560 0x7effac003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc27fc640 1 --2- 172.21.15.29:0/3053965672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effac003f90 0x7effac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc27fc640 1 --2- 172.21.15.29:0/3053965672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effac004d00 0x7effac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:41.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc27fc640 1 -- 172.21.15.29:0/3053965672 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc406c480 con 0x7effac004d00 2024-01-25T15:04:41.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc27fc640 1 -- 172.21.15.29:0/3053965672 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac00bae0 con 0x7effac003f90 2024-01-25T15:04:41.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc27fc640 1 -- 172.21.15.29:0/3053965672 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effac00bca0 con 0x7effc406d560 2024-01-25T15:04:41.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc37fe640 1 --2- 172.21.15.29:0/3053965672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effc406d560 0x7effac003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:41.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc3fff640 1 --2- 172.21.15.29:0/3053965672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effac004d00 0x7effac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:41.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc2ffd640 1 --2- 172.21.15.29:0/3053965672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effac003f90 0x7effac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:41.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc37fe640 1 -- 172.21.15.29:0/3053965672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effac003f90 msgr2=0x7effac0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:41.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc37fe640 1 --2- 172.21.15.29:0/3053965672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effac003f90 0x7effac0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc37fe640 1 -- 172.21.15.29:0/3053965672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effac004d00 msgr2=0x7effac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:41.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc37fe640 1 --2- 172.21.15.29:0/3053965672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effac004d00 0x7effac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc37fe640 1 -- 172.21.15.29:0/3053965672 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac003520 con 0x7effc406d560 2024-01-25T15:04:41.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.648+0000 7effc3fff640 1 --2- 172.21.15.29:0/3053965672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effac004d00 0x7effac005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:41.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.649+0000 7effc37fe640 1 --2- 172.21.15.29:0/3053965672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effc406d560 0x7effac003a10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7effb400c190 tx=0x7effac0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e002214dd7b4b8e server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:41.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.649+0000 7effc27fc640 1 -- 172.21.15.29:0/3053965672 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb4005ad0 con 0x7effc406d560 2024-01-25T15:04:41.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.649+0000 7effc27fc640 1 -- 172.21.15.29:0/3053965672 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb4005c50 con 0x7effc406d560 2024-01-25T15:04:41.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.649+0000 7effc27fc640 1 -- 172.21.15.29:0/3053965672 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb402c7e0 con 0x7effc406d560 2024-01-25T15:04:41.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.650+0000 7effc9b82640 1 -- 172.21.15.29:0/3053965672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effc406d560 msgr2=0x7effac003a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:41.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.650+0000 7effc9b82640 1 --2- 172.21.15.29:0/3053965672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effc406d560 0x7effac003a10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7effb400c190 tx=0x7effac0057f0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.650+0000 7effc3fff640 1 -- 172.21.15.29:0/3053965672 reap_dead start 2024-01-25T15:04:41.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.650+0000 7effc9b82640 1 -- 172.21.15.29:0/3053965672 shutdown_connections 2024-01-25T15:04:41.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.650+0000 7effc9b82640 1 -- 172.21.15.29:0/3053965672 >> 172.21.15.29:0/3053965672 conn(0x7effc40c6ca0 msgr2=0x7effc40c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:41.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.650+0000 7effc9b82640 1 -- 172.21.15.29:0/3053965672 shutdown_connections 2024-01-25T15:04:41.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.650+0000 7effc9b82640 1 -- 172.21.15.29:0/3053965672 wait complete. 2024-01-25T15:04:41.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.651+0000 7effc9b82640 1 Processor -- start 2024-01-25T15:04:41.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.651+0000 7effc9b82640 1 -- start start 2024-01-25T15:04:41.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.652+0000 7effc9b82640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc406d560 0x7effc41ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:41.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.652+0000 7effc9b82640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effc40c1260 0x7effc40c2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:41.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.652+0000 7effc9b82640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effc40c2890 0x7effc4155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:41.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.652+0000 7effc9b82640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc40c3b80 con 0x7effc40c1260 2024-01-25T15:04:41.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.652+0000 7effc9b82640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc40c1ec0 con 0x7effc406d560 2024-01-25T15:04:41.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.652+0000 7effc9b82640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc4158790 con 0x7effc40c2890 2024-01-25T15:04:41.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.652+0000 7effc2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effc40c1260 0x7effc40c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:41.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.652+0000 7effc2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effc40c1260 0x7effc40c2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36156/0 (socket says 172.21.15.29:36156) 2024-01-25T15:04:41.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.652+0000 7effc2ffd640 1 -- 172.21.15.29:0/2926159731 learned_addr learned my addr 172.21.15.29:0/2926159731 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:41.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.652+0000 7effc37fe640 1 --2- 172.21.15.29:0/2926159731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc406d560 0x7effc41ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:41.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.652+0000 7effc3fff640 1 --2- 172.21.15.29:0/2926159731 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effc40c2890 0x7effc4155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:41.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.652+0000 7effc2ffd640 1 -- 172.21.15.29:0/2926159731 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effc40c2890 msgr2=0x7effc4155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:41.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.652+0000 7effc2ffd640 1 --2- 172.21.15.29:0/2926159731 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effc40c2890 0x7effc4155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.652+0000 7effc2ffd640 1 -- 172.21.15.29:0/2926159731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc406d560 msgr2=0x7effc41ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:41.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.652+0000 7effc2ffd640 1 --2- 172.21.15.29:0/2926159731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc406d560 0x7effc41ed7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:41.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.652+0000 7effc2ffd640 1 -- 172.21.15.29:0/2926159731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc4157a40 con 0x7effc40c1260 2024-01-25T15:04:41.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.652+0000 7effc37fe640 1 --2- 172.21.15.29:0/2926159731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc406d560 0x7effc41ed7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:41.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.652+0000 7effc2ffd640 1 --2- 172.21.15.29:0/2926159731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effc40c1260 0x7effc40c2350 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7effb8011930 tx=0x7effb8011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:41.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.653+0000 7effabfff640 1 -- 172.21.15.29:0/2926159731 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb800faf0 con 0x7effc40c1260 2024-01-25T15:04:41.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.653+0000 7effabfff640 1 -- 172.21.15.29:0/2926159731 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb800fc50 con 0x7effc40c1260 2024-01-25T15:04:41.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.653+0000 7effc9b82640 1 -- 172.21.15.29:0/2926159731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc4158a30 con 0x7effc40c1260 2024-01-25T15:04:41.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.653+0000 7effabfff640 1 -- 172.21.15.29:0/2926159731 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb8014440 con 0x7effc40c1260 2024-01-25T15:04:41.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.653+0000 7effc9b82640 1 -- 172.21.15.29:0/2926159731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc41ee2d0 con 0x7effc40c1260 2024-01-25T15:04:41.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.653+0000 7effc9b82640 1 -- 172.21.15.29:0/2926159731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc41ee490 con 0x7effc40c1260 2024-01-25T15:04:41.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.654+0000 7effabfff640 1 -- 172.21.15.29:0/2926159731 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7effb80145a0 con 0x7effc40c1260 2024-01-25T15:04:41.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.654+0000 7effabfff640 1 --2- 172.21.15.29:0/2926159731 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7effb006af00 0x7effb006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:41.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.654+0000 7effabfff640 1 -- 172.21.15.29:0/2926159731 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7effb808a000 con 0x7effc40c1260 2024-01-25T15:04:41.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.654+0000 7effc37fe640 1 --2- 172.21.15.29:0/2926159731 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7effb006af00 0x7effb006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:41.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.655+0000 7effc37fe640 1 --2- 172.21.15.29:0/2926159731 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7effb006af00 0x7effb006d3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7effb4034000 tx=0x7effb4009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:41.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.659+0000 7effabfff640 1 -- 172.21.15.29:0/2926159731 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7effc41ee490 con 0x7effc40c1260 2024-01-25T15:04:41.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:41.875+0000 7effc9b82640 1 -- 172.21.15.29:0/2926159731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7effc41ee460 con 0x7effc40c1260 2024-01-25T15:04:42.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.597+0000 7effabfff640 1 -- 172.21.15.29:0/2926159731 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7effb8054c70 con 0x7effc40c1260 2024-01-25T15:04:42.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.599+0000 7effc9b82640 1 -- 172.21.15.29:0/2926159731 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7effb006af00 msgr2=0x7effb006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:42.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.599+0000 7effc9b82640 1 --2- 172.21.15.29:0/2926159731 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7effb006af00 0x7effb006d3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7effb4034000 tx=0x7effb4009030 comp rx=0 tx=0).stop 2024-01-25T15:04:42.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.599+0000 7effc9b82640 1 -- 172.21.15.29:0/2926159731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effc40c1260 msgr2=0x7effc40c2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:42.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.599+0000 7effc9b82640 1 --2- 172.21.15.29:0/2926159731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effc40c1260 0x7effc40c2350 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7effb8011930 tx=0x7effb8011df0 comp rx=0 tx=0).stop 2024-01-25T15:04:42.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.599+0000 7effc9b82640 1 -- 172.21.15.29:0/2926159731 shutdown_connections 2024-01-25T15:04:42.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.599+0000 7effc9b82640 1 --2- 172.21.15.29:0/2926159731 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effc40c2890 0x7effc4155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:42.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.599+0000 7effc9b82640 1 --2- 172.21.15.29:0/2926159731 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7effb006af00 0x7effb006d3c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:42.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.599+0000 7effc9b82640 1 --2- 172.21.15.29:0/2926159731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effc40c1260 0x7effc40c2350 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:42.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.599+0000 7effc9b82640 1 --2- 172.21.15.29:0/2926159731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc406d560 0x7effc41ed7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:42.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.599+0000 7effc9b82640 1 -- 172.21.15.29:0/2926159731 >> 172.21.15.29:0/2926159731 conn(0x7effc40c6ca0 msgr2=0x7effc4153c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:42.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.600+0000 7effc9b82640 1 -- 172.21.15.29:0/2926159731 shutdown_connections 2024-01-25T15:04:42.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.600+0000 7effc9b82640 1 -- 172.21.15.29:0/2926159731 wait complete. 2024-01-25T15:04:42.613 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-01-25T15:04:42.614 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-25T15:04:42.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.724+0000 7f5a2ca48640 1 Processor -- start 2024-01-25T15:04:42.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.724+0000 7f5a2ca48640 1 -- start start 2024-01-25T15:04:42.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.724+0000 7f5a2ca48640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5a280ad0b0 0x7f5a280c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:42.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.724+0000 7f5a2ca48640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a280c7890 0x7f5a28152590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:42.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.724+0000 7f5a2ca48640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a280ad540 con 0x7f5a28149190 2024-01-25T15:04:42.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.724+0000 7f5a2ca48640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a28070d40 con 0x7f5a280ad0b0 2024-01-25T15:04:42.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.724+0000 7f5a2ca48640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a28155c00 con 0x7f5a280c7890 2024-01-25T15:04:42.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.725+0000 7f5a1ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5a280ad0b0 0x7f5a280c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:42.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.725+0000 7f5a2659c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5a28149190 0x7f5a28070510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54590/0 (socket says 172.21.15.29:54590) 2024-01-25T15:04:42.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.725+0000 7f5a2659c640 1 -- 172.21.15.29:0/1189202198 learned_addr learned my addr 172.21.15.29:0/1189202198 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:42.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.725+0000 7f5a26d9d640 1 --2- 172.21.15.29:0/1189202198 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a280c7890 0x7f5a28152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:42.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.725+0000 7f5a1ffff640 1 -- 172.21.15.29:0/1189202198 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a280c7890 msgr2=0x7f5a28152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:42.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.725+0000 7f5a1ffff640 1 --2- 172.21.15.29:0/1189202198 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a280c7890 0x7f5a28152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:42.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.725+0000 7f5a1ffff640 1 -- 172.21.15.29:0/1189202198 >> v1:172.21.15.29:6789/0 conn(0x7f5a28149190 legacy=0x7f5a28070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:42.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.725+0000 7f5a1ffff640 1 -- 172.21.15.29:0/1189202198 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a28155ee0 con 0x7f5a280ad0b0 2024-01-25T15:04:42.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.725+0000 7f5a25d9b640 1 -- 172.21.15.29:0/1189202198 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966569646 0 0) 0x7f5a18001110 con 0x7f5a28149190 2024-01-25T15:04:42.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.726+0000 7f5a1ffff640 1 --2- 172.21.15.29:0/1189202198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a280ad0b0 0x7f5a280c7350 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5a100097a0 tx=0x7f5a1002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949e141659fbb5fe server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:42.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.726+0000 7f5a25d9b640 1 -- 172.21.15.29:0/1189202198 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a10031830 con 0x7f5a280ad0b0 2024-01-25T15:04:42.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.726+0000 7f5a25d9b640 1 -- 172.21.15.29:0/1189202198 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a10031990 con 0x7f5a280ad0b0 2024-01-25T15:04:42.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.726+0000 7f5a25d9b640 1 -- 172.21.15.29:0/1189202198 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a10031d20 con 0x7f5a280ad0b0 2024-01-25T15:04:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.726+0000 7f5a2ca48640 1 -- 172.21.15.29:0/1189202198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a280ad0b0 msgr2=0x7f5a280c7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.726+0000 7f5a2ca48640 1 --2- 172.21.15.29:0/1189202198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a280ad0b0 0x7f5a280c7350 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5a100097a0 tx=0x7f5a1002b8d0 comp rx=0 tx=0).stop 2024-01-25T15:04:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.726+0000 7f5a2ca48640 1 -- 172.21.15.29:0/1189202198 shutdown_connections 2024-01-25T15:04:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.726+0000 7f5a2ca48640 1 --2- 172.21.15.29:0/1189202198 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a280c7890 0x7f5a28152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.726+0000 7f5a2ca48640 1 --2- 172.21.15.29:0/1189202198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a280ad0b0 0x7f5a280c7350 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.726+0000 7f5a2ca48640 1 -- 172.21.15.29:0/1189202198 >> 172.21.15.29:0/1189202198 conn(0x7f5a280c7f80 msgr2=0x7f5a280c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.726+0000 7f5a2ca48640 1 -- 172.21.15.29:0/1189202198 shutdown_connections 2024-01-25T15:04:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.726+0000 7f5a2ca48640 1 -- 172.21.15.29:0/1189202198 wait complete. 2024-01-25T15:04:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.728+0000 7f5a2ca48640 1 Processor -- start 2024-01-25T15:04:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.728+0000 7f5a2ca48640 1 -- start start 2024-01-25T15:04:42.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.728+0000 7f5a2ca48640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a280ad0b0 0x7f5a280c1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.728+0000 7f5a2ca48640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a280c7890 0x7f5a281ea5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.728+0000 7f5a2ca48640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a28149190 0x7f5a281eab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.728+0000 7f5a2ca48640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a281dce20 con 0x7f5a280ad0b0 2024-01-25T15:04:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.728+0000 7f5a2ca48640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a28145f80 con 0x7f5a280c7890 2024-01-25T15:04:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.728+0000 7f5a2ca48640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2806d2f0 con 0x7f5a28149190 2024-01-25T15:04:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.728+0000 7f5a2659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a280ad0b0 0x7f5a280c1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.728+0000 7f5a2659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a280ad0b0 0x7f5a280c1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36182/0 (socket says 172.21.15.29:36182) 2024-01-25T15:04:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.728+0000 7f5a2659c640 1 -- 172.21.15.29:0/2998654233 learned_addr learned my addr 172.21.15.29:0/2998654233 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.729+0000 7f5a26d9d640 1 --2- 172.21.15.29:0/2998654233 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a28149190 0x7f5a281eab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.729+0000 7f5a1ffff640 1 --2- 172.21.15.29:0/2998654233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a280c7890 0x7f5a281ea5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.729+0000 7f5a2659c640 1 -- 172.21.15.29:0/2998654233 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a28149190 msgr2=0x7f5a281eab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.729+0000 7f5a2659c640 1 --2- 172.21.15.29:0/2998654233 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a28149190 0x7f5a281eab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:42.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.729+0000 7f5a2659c640 1 -- 172.21.15.29:0/2998654233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a280c7890 msgr2=0x7f5a281ea5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:42.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.729+0000 7f5a2659c640 1 --2- 172.21.15.29:0/2998654233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a280c7890 0x7f5a281ea5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:42.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.729+0000 7f5a2659c640 1 -- 172.21.15.29:0/2998654233 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a10009400 con 0x7f5a280ad0b0 2024-01-25T15:04:42.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.729+0000 7f5a1ffff640 1 --2- 172.21.15.29:0/2998654233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a280c7890 0x7f5a281ea5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:42.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.729+0000 7f5a26d9d640 1 --2- 172.21.15.29:0/2998654233 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a28149190 0x7f5a281eab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:42.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.729+0000 7f5a2659c640 1 --2- 172.21.15.29:0/2998654233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a280ad0b0 0x7f5a280c1620 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5a1800c400 tx=0x7f5a1800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:42.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.729+0000 7f5a1effd640 1 -- 172.21.15.29:0/2998654233 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18005ce0 con 0x7f5a280ad0b0 2024-01-25T15:04:42.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.729+0000 7f5a1effd640 1 -- 172.21.15.29:0/2998654233 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a18005e40 con 0x7f5a280ad0b0 2024-01-25T15:04:42.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.729+0000 7f5a1effd640 1 -- 172.21.15.29:0/2998654233 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18007310 con 0x7f5a280ad0b0 2024-01-25T15:04:42.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.729+0000 7f5a2ca48640 1 -- 172.21.15.29:0/2998654233 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a281ee3d0 con 0x7f5a280ad0b0 2024-01-25T15:04:42.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.729+0000 7f5a2ca48640 1 -- 172.21.15.29:0/2998654233 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a280c1b60 con 0x7f5a280ad0b0 2024-01-25T15:04:42.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.730+0000 7f5a2ca48640 1 -- 172.21.15.29:0/2998654233 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a281ee230 con 0x7f5a280ad0b0 2024-01-25T15:04:42.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.731+0000 7f5a1effd640 1 -- 172.21.15.29:0/2998654233 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f5a18007470 con 0x7f5a280ad0b0 2024-01-25T15:04:42.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.731+0000 7f5a1effd640 1 --2- 172.21.15.29:0/2998654233 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5a0806aed0 0x7f5a0806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:42.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.731+0000 7f5a1effd640 1 -- 172.21.15.29:0/2998654233 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5a18088d20 con 0x7f5a280ad0b0 2024-01-25T15:04:42.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.731+0000 7f5a1ffff640 1 --2- 172.21.15.29:0/2998654233 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5a0806aed0 0x7f5a0806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:42.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.732+0000 7f5a1ffff640 1 --2- 172.21.15.29:0/2998654233 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5a0806aed0 0x7f5a0806d390 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5a10036000 tx=0x7f5a10008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:42.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.735+0000 7f5a1effd640 1 -- 172.21.15.29:0/2998654233 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f5a281ee230 con 0x7f5a280ad0b0 2024-01-25T15:04:42.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:42.951+0000 7f5a2ca48640 1 -- 172.21.15.29:0/2998654233 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5a280ad540 con 0x7f5a280ad0b0 2024-01-25T15:04:43.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.601+0000 7f5a1effd640 1 -- 172.21.15.29:0/2998654233 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5a280ad540 con 0x7f5a280ad0b0 2024-01-25T15:04:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.604+0000 7f5a2ca48640 1 -- 172.21.15.29:0/2998654233 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5a0806aed0 msgr2=0x7f5a0806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.604+0000 7f5a2ca48640 1 --2- 172.21.15.29:0/2998654233 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5a0806aed0 0x7f5a0806d390 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5a10036000 tx=0x7f5a10008030 comp rx=0 tx=0).stop 2024-01-25T15:04:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.604+0000 7f5a2ca48640 1 -- 172.21.15.29:0/2998654233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a280ad0b0 msgr2=0x7f5a280c1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.604+0000 7f5a2ca48640 1 --2- 172.21.15.29:0/2998654233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a280ad0b0 0x7f5a280c1620 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5a1800c400 tx=0x7f5a1800c8c0 comp rx=0 tx=0).stop 2024-01-25T15:04:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.604+0000 7f5a2ca48640 1 -- 172.21.15.29:0/2998654233 shutdown_connections 2024-01-25T15:04:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.604+0000 7f5a2ca48640 1 --2- 172.21.15.29:0/2998654233 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a28149190 0x7f5a281eab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.604+0000 7f5a2ca48640 1 --2- 172.21.15.29:0/2998654233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a280c7890 0x7f5a281ea5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:43.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.604+0000 7f5a2ca48640 1 --2- 172.21.15.29:0/2998654233 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5a0806aed0 0x7f5a0806d390 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:43.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.604+0000 7f5a2ca48640 1 --2- 172.21.15.29:0/2998654233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a280ad0b0 0x7f5a280c1620 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:43.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.604+0000 7f5a2ca48640 1 -- 172.21.15.29:0/2998654233 >> 172.21.15.29:0/2998654233 conn(0x7f5a280c7f80 msgr2=0x7f5a28154290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:43.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.604+0000 7f5a2ca48640 1 -- 172.21.15.29:0/2998654233 shutdown_connections 2024-01-25T15:04:43.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.604+0000 7f5a2ca48640 1 -- 172.21.15.29:0/2998654233 wait complete. 2024-01-25T15:04:43.617 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-25T15:04:43.618 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:04:43.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.723+0000 7f21961b7640 1 Processor -- start 2024-01-25T15:04:43.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.723+0000 7f21961b7640 1 -- start start 2024-01-25T15:04:43.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.724+0000 7f21961b7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f21901520b0 0x7f2190155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:43.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.724+0000 7f21961b7640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f21900c4f00 0x7f21900c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:43.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.724+0000 7f21961b7640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21900c66c0 con 0x7f21900c55e0 2024-01-25T15:04:43.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.724+0000 7f21961b7640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f219006cfc0 con 0x7f21901520b0 2024-01-25T15:04:43.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.724+0000 7f21961b7640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2190152490 con 0x7f21900c4f00 2024-01-25T15:04:43.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.724+0000 7f218f7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f21901520b0 0x7f2190155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:43.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.724+0000 7f218f7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f21901520b0 0x7f2190155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36188/0 (socket says 172.21.15.29:36188) 2024-01-25T15:04:43.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.724+0000 7f218f7fe640 1 -- 172.21.15.29:0/89396660 learned_addr learned my addr 172.21.15.29:0/89396660 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:43.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.724+0000 7f218ffff640 1 --2- 172.21.15.29:0/89396660 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f21900c4f00 0x7f21900c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:43.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.724+0000 7f218f7fe640 1 -- 172.21.15.29:0/89396660 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f21900c4f00 msgr2=0x7f21900c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:43.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.724+0000 7f218f7fe640 1 --2- 172.21.15.29:0/89396660 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f21900c4f00 0x7f21900c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:43.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.724+0000 7f218f7fe640 1 -- 172.21.15.29:0/89396660 >> v1:172.21.15.52:6789/0 conn(0x7f21900c55e0 legacy=0x7f21900c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:43.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.724+0000 7f218f7fe640 1 -- 172.21.15.29:0/89396660 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21900c8830 con 0x7f21901520b0 2024-01-25T15:04:43.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.725+0000 7f218f7fe640 1 --2- 172.21.15.29:0/89396660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21901520b0 0x7f2190155570 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2180009870 tx=0x7f218002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669955491ef8b396 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:43.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.725+0000 7f218e7fc640 1 -- 172.21.15.29:0/89396660 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2180031640 con 0x7f21901520b0 2024-01-25T15:04:43.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.725+0000 7f218e7fc640 1 -- 172.21.15.29:0/89396660 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21800317a0 con 0x7f21901520b0 2024-01-25T15:04:43.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.725+0000 7f218e7fc640 1 -- 172.21.15.29:0/89396660 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2180031b30 con 0x7f21901520b0 2024-01-25T15:04:43.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.726+0000 7f21961b7640 1 -- 172.21.15.29:0/89396660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21901520b0 msgr2=0x7f2190155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:43.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.726+0000 7f21961b7640 1 --2- 172.21.15.29:0/89396660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21901520b0 0x7f2190155570 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2180009870 tx=0x7f218002b8f0 comp rx=0 tx=0).stop 2024-01-25T15:04:43.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.726+0000 7f21961b7640 1 -- 172.21.15.29:0/89396660 shutdown_connections 2024-01-25T15:04:43.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.726+0000 7f21961b7640 1 --2- 172.21.15.29:0/89396660 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f21900c4f00 0x7f21900c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:43.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.726+0000 7f21961b7640 1 --2- 172.21.15.29:0/89396660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21901520b0 0x7f2190155570 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:43.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.726+0000 7f21961b7640 1 -- 172.21.15.29:0/89396660 >> 172.21.15.29:0/89396660 conn(0x7f21900ca220 msgr2=0x7f21900ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:43.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.726+0000 7f21961b7640 1 -- 172.21.15.29:0/89396660 shutdown_connections 2024-01-25T15:04:43.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.726+0000 7f21961b7640 1 -- 172.21.15.29:0/89396660 wait complete. 2024-01-25T15:04:43.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.727+0000 7f21961b7640 1 Processor -- start 2024-01-25T15:04:43.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.727+0000 7f21961b7640 1 -- start start 2024-01-25T15:04:43.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.728+0000 7f21961b7640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f21900c4f00 0x7f2190155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:43.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.728+0000 7f21961b7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21901520b0 0x7f21900bf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:43.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.728+0000 7f21961b7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21901564e0 0x7f21900ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:43.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.728+0000 7f21961b7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2190158e20 con 0x7f21901520b0 2024-01-25T15:04:43.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.728+0000 7f21961b7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21900bfc70 con 0x7f21901564e0 2024-01-25T15:04:43.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.728+0000 7f21961b7640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2190158b40 con 0x7f21900c4f00 2024-01-25T15:04:43.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.728+0000 7f218effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21901520b0 0x7f21900bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:43.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.728+0000 7f218effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21901520b0 0x7f21900bf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36202/0 (socket says 172.21.15.29:36202) 2024-01-25T15:04:43.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.728+0000 7f218effd640 1 -- 172.21.15.29:0/3326082615 learned_addr learned my addr 172.21.15.29:0/3326082615 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:43.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.728+0000 7f218ffff640 1 --2- 172.21.15.29:0/3326082615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21901564e0 0x7f21900ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:43.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.728+0000 7f218f7fe640 1 --2- 172.21.15.29:0/3326082615 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f21900c4f00 0x7f2190155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:43.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.728+0000 7f218effd640 1 -- 172.21.15.29:0/3326082615 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f21900c4f00 msgr2=0x7f2190155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:43.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.728+0000 7f218effd640 1 --2- 172.21.15.29:0/3326082615 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f21900c4f00 0x7f2190155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:43.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.728+0000 7f218effd640 1 -- 172.21.15.29:0/3326082615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21901564e0 msgr2=0x7f21900ab4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:43.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.728+0000 7f218effd640 1 --2- 172.21.15.29:0/3326082615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21901564e0 0x7f21900ab4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:43.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.728+0000 7f218effd640 1 -- 172.21.15.29:0/3326082615 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21800094d0 con 0x7f21901520b0 2024-01-25T15:04:43.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.729+0000 7f218effd640 1 --2- 172.21.15.29:0/3326082615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21901520b0 0x7f21900bf730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f218400c400 tx=0x7f218400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:43.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.729+0000 7f2177fff640 1 -- 172.21.15.29:0/3326082615 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21840052d0 con 0x7f21901520b0 2024-01-25T15:04:43.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.729+0000 7f2177fff640 1 -- 172.21.15.29:0/3326082615 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2184005450 con 0x7f21901520b0 2024-01-25T15:04:43.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.729+0000 7f2177fff640 1 -- 172.21.15.29:0/3326082615 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184007260 con 0x7f21901520b0 2024-01-25T15:04:43.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.729+0000 7f21961b7640 1 -- 172.21.15.29:0/3326082615 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21900c0160 con 0x7f21901520b0 2024-01-25T15:04:43.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.729+0000 7f21961b7640 1 -- 172.21.15.29:0/3326082615 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21900c0720 con 0x7f21901520b0 2024-01-25T15:04:43.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.730+0000 7f21961b7640 1 -- 172.21.15.29:0/3326082615 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21900c1160 con 0x7f21901520b0 2024-01-25T15:04:43.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.730+0000 7f2177fff640 1 -- 172.21.15.29:0/3326082615 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f21840073c0 con 0x7f21901520b0 2024-01-25T15:04:43.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.731+0000 7f2177fff640 1 --2- 172.21.15.29:0/3326082615 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f217c06aed0 0x7f217c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:43.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.731+0000 7f2177fff640 1 -- 172.21.15.29:0/3326082615 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2184088c10 con 0x7f21901520b0 2024-01-25T15:04:43.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.731+0000 7f218f7fe640 1 --2- 172.21.15.29:0/3326082615 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f217c06aed0 0x7f217c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:43.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.731+0000 7f218f7fe640 1 --2- 172.21.15.29:0/3326082615 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f217c06aed0 0x7f217c06d390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2180036000 tx=0x7f218003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:43.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.735+0000 7f2177fff640 1 -- 172.21.15.29:0/3326082615 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2184053930 con 0x7f21901520b0 2024-01-25T15:04:43.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.954+0000 7f21961b7640 1 -- 172.21.15.29:0/3326082615 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21900bf450 con 0x7f21901520b0 2024-01-25T15:04:43.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.955+0000 7f2177fff640 1 -- 172.21.15.29:0/3326082615 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4931 (secure 0 0 0) 0x7f21900bf450 con 0x7f21901520b0 2024-01-25T15:04:43.956 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:43.956 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6836/2584242962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2584242962},{"type":"v1","addr":"172.21.15.52:6836","nonce":2584242962}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1800543981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1800543981},{"type":"v1","addr":"172.21.15.29:6834","nonce":1800543981}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3686497601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3686497601},{"type":"v1","addr":"172.21.15.29:6835","nonce":3686497601}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:04:26.896909+0000","modified":"2024-01-25T15:04:42.952775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6837/417879912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6835","nonce":417879912},{"type":"v1","addr":"172.21.15.52:6837","nonce":417879912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-25T15:04:43.956 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-01-25T15:04:43.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.957+0000 7f21961b7640 1 -- 172.21.15.29:0/3326082615 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f217c06aed0 msgr2=0x7f217c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:43.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.957+0000 7f21961b7640 1 --2- 172.21.15.29:0/3326082615 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f217c06aed0 0x7f217c06d390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2180036000 tx=0x7f218003c040 comp rx=0 tx=0).stop 2024-01-25T15:04:43.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.957+0000 7f21961b7640 1 -- 172.21.15.29:0/3326082615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21901520b0 msgr2=0x7f21900bf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:43.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.957+0000 7f21961b7640 1 --2- 172.21.15.29:0/3326082615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21901520b0 0x7f21900bf730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f218400c400 tx=0x7f218400c8c0 comp rx=0 tx=0).stop 2024-01-25T15:04:43.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.957+0000 7f21961b7640 1 -- 172.21.15.29:0/3326082615 shutdown_connections 2024-01-25T15:04:43.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.957+0000 7f21961b7640 1 --2- 172.21.15.29:0/3326082615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21901564e0 0x7f21900ab4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:43.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.957+0000 7f21961b7640 1 --2- 172.21.15.29:0/3326082615 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f217c06aed0 0x7f217c06d390 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:43.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.957+0000 7f21961b7640 1 --2- 172.21.15.29:0/3326082615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21901520b0 0x7f21900bf730 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:43.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.957+0000 7f21961b7640 1 --2- 172.21.15.29:0/3326082615 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f21900c4f00 0x7f2190155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:43.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.957+0000 7f21961b7640 1 -- 172.21.15.29:0/3326082615 >> 172.21.15.29:0/3326082615 conn(0x7f21900ca220 msgr2=0x7f21900ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:43.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.957+0000 7f21961b7640 1 -- 172.21.15.29:0/3326082615 shutdown_connections 2024-01-25T15:04:43.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:43.957+0000 7f21961b7640 1 -- 172.21.15.29:0/3326082615 wait complete. 2024-01-25T15:04:43.968 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:04:44.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.069+0000 7f75274bb640 1 Processor -- start 2024-01-25T15:04:44.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.069+0000 7f75274bb640 1 -- start start 2024-01-25T15:04:44.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.069+0000 7f75274bb640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75201520b0 0x7f7520155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.069+0000 7f75274bb640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f75200c4f00 0x7f75200c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.069+0000 7f75274bb640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75200c66c0 con 0x7f75200c55e0 2024-01-25T15:04:44.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.069+0000 7f75274bb640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752006cfc0 con 0x7f75200c4f00 2024-01-25T15:04:44.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.069+0000 7f75274bb640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7520152490 con 0x7f75201520b0 2024-01-25T15:04:44.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.070+0000 7f7525a58640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f75200c4f00 0x7f75200c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.070+0000 7f7524a56640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f75200c55e0 0x7f75200c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54592/0 (socket says 172.21.15.29:54592) 2024-01-25T15:04:44.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.070+0000 7f7524a56640 1 -- 172.21.15.29:0/371541415 learned_addr learned my addr 172.21.15.29:0/371541415 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:44.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.070+0000 7f7525257640 1 --2- 172.21.15.29:0/371541415 >> v2:172.21.15.52:3300/0 conn(0x7f75201520b0 0x7f7520155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.070+0000 7f7525a58640 1 -- 172.21.15.29:0/371541415 >> v2:172.21.15.52:3300/0 conn(0x7f75201520b0 msgr2=0x7f7520155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:44.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.070+0000 7f7525a58640 1 --2- 172.21.15.29:0/371541415 >> v2:172.21.15.52:3300/0 conn(0x7f75201520b0 0x7f7520155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.070+0000 7f7525a58640 1 -- 172.21.15.29:0/371541415 >> v1:172.21.15.29:6789/0 conn(0x7f75200c55e0 legacy=0x7f75200c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.070+0000 7f7525a58640 1 -- 172.21.15.29:0/371541415 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75200c8830 con 0x7f75200c4f00 2024-01-25T15:04:44.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.071+0000 7f7525a58640 1 --2- 172.21.15.29:0/371541415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75200c4f00 0x7f75200c5b30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f752008bbe0 tx=0x7f751802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c54ef54c733c22 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:44.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.071+0000 7f7517fff640 1 -- 172.21.15.29:0/371541415 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751802cbf0 con 0x7f75200c4f00 2024-01-25T15:04:44.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.071+0000 7f7517fff640 1 -- 172.21.15.29:0/371541415 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751802cd50 con 0x7f75200c4f00 2024-01-25T15:04:44.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.071+0000 7f7517fff640 1 -- 172.21.15.29:0/371541415 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7518034660 con 0x7f75200c4f00 2024-01-25T15:04:44.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.071+0000 7f75274bb640 1 -- 172.21.15.29:0/371541415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75200c4f00 msgr2=0x7f75200c5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.071+0000 7f75274bb640 1 --2- 172.21.15.29:0/371541415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75200c4f00 0x7f75200c5b30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f752008bbe0 tx=0x7f751802be40 comp rx=0 tx=0).stop 2024-01-25T15:04:44.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.071+0000 7f75274bb640 1 -- 172.21.15.29:0/371541415 shutdown_connections 2024-01-25T15:04:44.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.071+0000 7f75274bb640 1 --2- 172.21.15.29:0/371541415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75200c4f00 0x7f75200c5b30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.071+0000 7f75274bb640 1 --2- 172.21.15.29:0/371541415 >> v2:172.21.15.52:3300/0 conn(0x7f75201520b0 0x7f7520155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.071+0000 7f75274bb640 1 -- 172.21.15.29:0/371541415 >> 172.21.15.29:0/371541415 conn(0x7f75200ca220 msgr2=0x7f75200ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:44.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.071+0000 7f75274bb640 1 -- 172.21.15.29:0/371541415 shutdown_connections 2024-01-25T15:04:44.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.071+0000 7f75274bb640 1 -- 172.21.15.29:0/371541415 wait complete. 2024-01-25T15:04:44.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.072+0000 7f75274bb640 1 Processor -- start 2024-01-25T15:04:44.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.073+0000 7f75274bb640 1 -- start start 2024-01-25T15:04:44.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.073+0000 7f75274bb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75200c4f00 0x7f752014cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.073+0000 7f75274bb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75201520b0 0x7f75201eab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.073+0000 7f75274bb640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f752014dca0 0x7f752014a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.073+0000 7f75274bb640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752014e420 con 0x7f75201520b0 2024-01-25T15:04:44.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.073+0000 7f75274bb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752014b220 con 0x7f75200c4f00 2024-01-25T15:04:44.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.073+0000 7f75274bb640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752014cb40 con 0x7f752014dca0 2024-01-25T15:04:44.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.073+0000 7f7524a56640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75201520b0 0x7f75201eab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.073+0000 7f7524a56640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75201520b0 0x7f75201eab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36234/0 (socket says 172.21.15.29:36234) 2024-01-25T15:04:44.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.073+0000 7f7524a56640 1 -- 172.21.15.29:0/120777961 learned_addr learned my addr 172.21.15.29:0/120777961 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:44.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.073+0000 7f7525a58640 1 --2- 172.21.15.29:0/120777961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f752014dca0 0x7f752014a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.073+0000 7f7525257640 1 --2- 172.21.15.29:0/120777961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75200c4f00 0x7f752014cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.074+0000 7f7524a56640 1 -- 172.21.15.29:0/120777961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f752014dca0 msgr2=0x7f752014a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.074+0000 7f7524a56640 1 --2- 172.21.15.29:0/120777961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f752014dca0 0x7f752014a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.074+0000 7f7524a56640 1 -- 172.21.15.29:0/120777961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75200c4f00 msgr2=0x7f752014cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.074+0000 7f7524a56640 1 --2- 172.21.15.29:0/120777961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75200c4f00 0x7f752014cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.074+0000 7f7524a56640 1 -- 172.21.15.29:0/120777961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7518009a70 con 0x7f75201520b0 2024-01-25T15:04:44.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.074+0000 7f7525a58640 1 --2- 172.21.15.29:0/120777961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f752014dca0 0x7f752014a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:44.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.074+0000 7f7525257640 1 --2- 172.21.15.29:0/120777961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75200c4f00 0x7f752014cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:44.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.074+0000 7f7524a56640 1 --2- 172.21.15.29:0/120777961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75201520b0 0x7f75201eab50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f751000c430 tx=0x7f751000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:44.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.074+0000 7f7515ffb640 1 -- 172.21.15.29:0/120777961 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7510005ce0 con 0x7f75201520b0 2024-01-25T15:04:44.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.074+0000 7f7515ffb640 1 -- 172.21.15.29:0/120777961 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7510005e40 con 0x7f75201520b0 2024-01-25T15:04:44.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.074+0000 7f75274bb640 1 -- 172.21.15.29:0/120777961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75201eb090 con 0x7f75201520b0 2024-01-25T15:04:44.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.074+0000 7f7515ffb640 1 -- 172.21.15.29:0/120777961 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75100072f0 con 0x7f75201520b0 2024-01-25T15:04:44.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.074+0000 7f75274bb640 1 -- 172.21.15.29:0/120777961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752014c4f0 con 0x7f75201520b0 2024-01-25T15:04:44.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.075+0000 7f75274bb640 1 -- 172.21.15.29:0/120777961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752014c350 con 0x7f75201520b0 2024-01-25T15:04:44.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.075+0000 7f7515ffb640 1 -- 172.21.15.29:0/120777961 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7510007450 con 0x7f75201520b0 2024-01-25T15:04:44.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.076+0000 7f7515ffb640 1 --2- 172.21.15.29:0/120777961 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f750406af00 0x7f750406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.076+0000 7f7515ffb640 1 -- 172.21.15.29:0/120777961 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7510088eb0 con 0x7f75201520b0 2024-01-25T15:04:44.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.076+0000 7f7525257640 1 --2- 172.21.15.29:0/120777961 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f750406af00 0x7f750406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.077+0000 7f7525257640 1 --2- 172.21.15.29:0/120777961 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f750406af00 0x7f750406d3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f75201ed620 tx=0x7f751c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:44.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.080+0000 7f7515ffb640 1 -- 172.21.15.29:0/120777961 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f752014c350 con 0x7f75201520b0 2024-01-25T15:04:44.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.263+0000 7f75274bb640 1 -- 172.21.15.29:0/120777961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f752014c350 con 0x7f75201520b0 2024-01-25T15:04:44.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.265+0000 7f7515ffb640 1 -- 172.21.15.29:0/120777961 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18311 (secure 0 0 0) 0x7f752014c350 con 0x7f75201520b0 2024-01-25T15:04:44.265 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:44.266 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:31.978871+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:04:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.267+0000 7f75274bb640 1 -- 172.21.15.29:0/120777961 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f750406af00 msgr2=0x7f750406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.267+0000 7f75274bb640 1 --2- 172.21.15.29:0/120777961 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f750406af00 0x7f750406d3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f75201ed620 tx=0x7f751c008040 comp rx=0 tx=0).stop 2024-01-25T15:04:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.267+0000 7f75274bb640 1 -- 172.21.15.29:0/120777961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75201520b0 msgr2=0x7f75201eab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.267+0000 7f75274bb640 1 --2- 172.21.15.29:0/120777961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75201520b0 0x7f75201eab50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f751000c430 tx=0x7f751000c8f0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.267+0000 7f75274bb640 1 -- 172.21.15.29:0/120777961 shutdown_connections 2024-01-25T15:04:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.267+0000 7f75274bb640 1 --2- 172.21.15.29:0/120777961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f752014dca0 0x7f752014a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.267+0000 7f75274bb640 1 --2- 172.21.15.29:0/120777961 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f750406af00 0x7f750406d3c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.267+0000 7f75274bb640 1 --2- 172.21.15.29:0/120777961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75201520b0 0x7f75201eab50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.267+0000 7f75274bb640 1 --2- 172.21.15.29:0/120777961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75200c4f00 0x7f752014cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.267+0000 7f75274bb640 1 -- 172.21.15.29:0/120777961 >> 172.21.15.29:0/120777961 conn(0x7f75200ca220 msgr2=0x7f75200ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.267+0000 7f75274bb640 1 -- 172.21.15.29:0/120777961 shutdown_connections 2024-01-25T15:04:44.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.267+0000 7f75274bb640 1 -- 172.21.15.29:0/120777961 wait complete. 2024-01-25T15:04:44.278 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-25T15:04:44.279 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-25T15:04:44.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.379+0000 7f73e1a75640 1 Processor -- start 2024-01-25T15:04:44.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.379+0000 7f73e1a75640 1 -- start start 2024-01-25T15:04:44.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.379+0000 7f73e1a75640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f73dc06b690 0x7f73dc1551a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73e1a75640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73dc1521d0 con 0x7f73dc06b2b0 2024-01-25T15:04:44.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73e1a75640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73dc1556e0 con 0x7f73dc0c66b0 2024-01-25T15:04:44.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73e1a75640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73dc06be50 con 0x7f73dc06b690 2024-01-25T15:04:44.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73db7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f73dc06b2b0 0x7f73dc0c5fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54604/0 (socket says 172.21.15.29:54604) 2024-01-25T15:04:44.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73db7fe640 1 -- 172.21.15.29:0/2910356214 learned_addr learned my addr 172.21.15.29:0/2910356214 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:44.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73dbfff640 1 --2- 172.21.15.29:0/2910356214 >> v2:172.21.15.52:3300/0 conn(0x7f73dc06b690 0x7f73dc1551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73da7fc640 1 -- 172.21.15.29:0/2910356214 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972509019 0 0) 0x7f73dc1521d0 con 0x7f73dc06b2b0 2024-01-25T15:04:44.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73da7fc640 1 -- 172.21.15.29:0/2910356214 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73c4003520 con 0x7f73dc06b2b0 2024-01-25T15:04:44.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73da7fc640 1 -- 172.21.15.29:0/2910356214 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 471833061 0 0) 0x7f73c4003520 con 0x7f73dc06b2b0 2024-01-25T15:04:44.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73da7fc640 1 -- 172.21.15.29:0/2910356214 >> v2:172.21.15.52:3300/0 conn(0x7f73dc06b690 msgr2=0x7f73dc1551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:44.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73da7fc640 1 --2- 172.21.15.29:0/2910356214 >> v2:172.21.15.52:3300/0 conn(0x7f73dc06b690 0x7f73dc1551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73da7fc640 1 -- 172.21.15.29:0/2910356214 >> v1:172.21.15.52:6789/0 conn(0x7f73dc0c66b0 legacy=0x7f73dc15d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73da7fc640 1 -- 172.21.15.29:0/2910356214 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc0c5b10 con 0x7f73dc06b2b0 2024-01-25T15:04:44.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73da7fc640 1 -- 172.21.15.29:0/2910356214 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f73cc001670 con 0x7f73dc06b2b0 2024-01-25T15:04:44.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73da7fc640 1 -- 172.21.15.29:0/2910356214 >> v1:172.21.15.29:6789/0 conn(0x7f73dc06b2b0 legacy=0x7f73dc0c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73da7fc640 1 --2- 172.21.15.29:0/2910356214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c4003970 0x7f73c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73da7fc640 1 --2- 172.21.15.29:0/2910356214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73c40047c0 0x7f73c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73da7fc640 1 --2- 172.21.15.29:0/2910356214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73c4005180 0x7f73c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73da7fc640 1 -- 172.21.15.29:0/2910356214 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc06be50 con 0x7f73c4003970 2024-01-25T15:04:44.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73da7fc640 1 -- 172.21.15.29:0/2910356214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c400c120 con 0x7f73c4005180 2024-01-25T15:04:44.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73da7fc640 1 -- 172.21.15.29:0/2910356214 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c400c2e0 con 0x7f73c40047c0 2024-01-25T15:04:44.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73db7fe640 1 --2- 172.21.15.29:0/2910356214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c4003970 0x7f73c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73daffd640 1 --2- 172.21.15.29:0/2910356214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73c40047c0 0x7f73c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.380+0000 7f73dbfff640 1 --2- 172.21.15.29:0/2910356214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73c4005180 0x7f73c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.381+0000 7f73db7fe640 1 -- 172.21.15.29:0/2910356214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73c40047c0 msgr2=0x7f73c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:44.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.381+0000 7f73db7fe640 1 --2- 172.21.15.29:0/2910356214 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73c40047c0 0x7f73c4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.381+0000 7f73db7fe640 1 -- 172.21.15.29:0/2910356214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73c4005180 msgr2=0x7f73c400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:44.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.381+0000 7f73db7fe640 1 --2- 172.21.15.29:0/2910356214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73c4005180 0x7f73c400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.381+0000 7f73dbfff640 1 -- 172.21.15.29:0/2910356214 reap_dead start 2024-01-25T15:04:44.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.381+0000 7f73db7fe640 1 -- 172.21.15.29:0/2910356214 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c4003520 con 0x7f73c4003970 2024-01-25T15:04:44.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.381+0000 7f73db7fe640 1 --2- 172.21.15.29:0/2910356214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c4003970 0x7f73c4003d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f73cc00c190 tx=0x7f73c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b87c69897dfaa8ac server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:44.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.382+0000 7f73da7fc640 1 -- 172.21.15.29:0/2910356214 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc005ad0 con 0x7f73c4003970 2024-01-25T15:04:44.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.382+0000 7f73da7fc640 1 -- 172.21.15.29:0/2910356214 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73cc005c30 con 0x7f73c4003970 2024-01-25T15:04:44.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.382+0000 7f73da7fc640 1 -- 172.21.15.29:0/2910356214 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc02c830 con 0x7f73c4003970 2024-01-25T15:04:44.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.382+0000 7f73e1a75640 1 -- 172.21.15.29:0/2910356214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c4003970 msgr2=0x7f73c4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.382+0000 7f73e1a75640 1 --2- 172.21.15.29:0/2910356214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c4003970 0x7f73c4003d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f73cc00c190 tx=0x7f73c40057f0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.382+0000 7f73e1a75640 1 -- 172.21.15.29:0/2910356214 shutdown_connections 2024-01-25T15:04:44.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.382+0000 7f73e1a75640 1 --2- 172.21.15.29:0/2910356214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c4003970 0x7f73c4003d90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.382+0000 7f73e1a75640 1 -- 172.21.15.29:0/2910356214 >> 172.21.15.29:0/2910356214 conn(0x7f73dc0ca1f0 msgr2=0x7f73dc0ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:44.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.382+0000 7f73e1a75640 1 -- 172.21.15.29:0/2910356214 shutdown_connections 2024-01-25T15:04:44.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.382+0000 7f73e1a75640 1 -- 172.21.15.29:0/2910356214 wait complete. 2024-01-25T15:04:44.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.383+0000 7f73e1a75640 1 Processor -- start 2024-01-25T15:04:44.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.383+0000 7f73e1a75640 1 -- start start 2024-01-25T15:04:44.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.384+0000 7f73e1a75640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c4003970 0x7f73dc0acc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.384+0000 7f73e1a75640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73dc1ed6c0 0x7f73dc0af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.384+0000 7f73e1a75640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73dc158340 0x7f73dc1587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.384+0000 7f73e1a75640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc0c3670 con 0x7f73c4003970 2024-01-25T15:04:44.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.384+0000 7f73e1a75640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc1481a0 con 0x7f73dc1ed6c0 2024-01-25T15:04:44.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.384+0000 7f73e1a75640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc0ad390 con 0x7f73dc158340 2024-01-25T15:04:44.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.384+0000 7f73db7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c4003970 0x7f73dc0acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.384+0000 7f73db7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c4003970 0x7f73dc0acc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36258/0 (socket says 172.21.15.29:36258) 2024-01-25T15:04:44.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.384+0000 7f73db7fe640 1 -- 172.21.15.29:0/3108927638 learned_addr learned my addr 172.21.15.29:0/3108927638 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:44.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.384+0000 7f73daffd640 1 --2- 172.21.15.29:0/3108927638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73dc1ed6c0 0x7f73dc0af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.384+0000 7f73dbfff640 1 --2- 172.21.15.29:0/3108927638 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73dc158340 0x7f73dc1587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.385+0000 7f73db7fe640 1 -- 172.21.15.29:0/3108927638 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73dc158340 msgr2=0x7f73dc1587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.385+0000 7f73db7fe640 1 --2- 172.21.15.29:0/3108927638 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73dc158340 0x7f73dc1587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.385+0000 7f73db7fe640 1 -- 172.21.15.29:0/3108927638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73dc1ed6c0 msgr2=0x7f73dc0af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.385+0000 7f73db7fe640 1 --2- 172.21.15.29:0/3108927638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73dc1ed6c0 0x7f73dc0af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.385+0000 7f73db7fe640 1 -- 172.21.15.29:0/3108927638 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc0ad670 con 0x7f73c4003970 2024-01-25T15:04:44.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.385+0000 7f73db7fe640 1 --2- 172.21.15.29:0/3108927638 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c4003970 0x7f73dc0acc90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f73cc000f60 tx=0x7f73cc02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:44.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.385+0000 7f73c3fff640 1 -- 172.21.15.29:0/3108927638 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc03c040 con 0x7f73c4003970 2024-01-25T15:04:44.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.385+0000 7f73c3fff640 1 -- 172.21.15.29:0/3108927638 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73cc02cc40 con 0x7f73c4003970 2024-01-25T15:04:44.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.385+0000 7f73e1a75640 1 -- 172.21.15.29:0/3108927638 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73dc0ad950 con 0x7f73c4003970 2024-01-25T15:04:44.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.385+0000 7f73c3fff640 1 -- 172.21.15.29:0/3108927638 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc007070 con 0x7f73c4003970 2024-01-25T15:04:44.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.385+0000 7f73e1a75640 1 -- 172.21.15.29:0/3108927638 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73dc0adf10 con 0x7f73c4003970 2024-01-25T15:04:44.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.386+0000 7f73e1a75640 1 -- 172.21.15.29:0/3108927638 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73dc0ae0a0 con 0x7f73c4003970 2024-01-25T15:04:44.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.386+0000 7f73c3fff640 1 -- 172.21.15.29:0/3108927638 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f73cc032070 con 0x7f73c4003970 2024-01-25T15:04:44.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.387+0000 7f73c3fff640 1 --2- 172.21.15.29:0/3108927638 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f73c806af00 0x7f73c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.387+0000 7f73c3fff640 1 -- 172.21.15.29:0/3108927638 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f73cc0aac00 con 0x7f73c4003970 2024-01-25T15:04:44.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.387+0000 7f73daffd640 1 --2- 172.21.15.29:0/3108927638 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f73c806af00 0x7f73c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.387+0000 7f73daffd640 1 --2- 172.21.15.29:0/3108927638 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f73c806af00 0x7f73c806d3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f73d0000c00 tx=0x7f73d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:44.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.391+0000 7f73c3fff640 1 -- 172.21.15.29:0/3108927638 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f73cc0757d0 con 0x7f73c4003970 2024-01-25T15:04:44.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.565+0000 7f73e1a75640 1 -- 172.21.15.29:0/3108927638 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73dc0c54c0 con 0x7f73c806af00 2024-01-25T15:04:44.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.575+0000 7f73c3fff640 1 -- 172.21.15.29:0/3108927638 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345299 (secure 0 0 0) 0x7f73d0001410 con 0x7f73c806af00 2024-01-25T15:04:44.580 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:44.582 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-25T15:04:44.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.579+0000 7f73e1a75640 1 -- 172.21.15.29:0/3108927638 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f73c806af00 msgr2=0x7f73c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.579+0000 7f73e1a75640 1 --2- 172.21.15.29:0/3108927638 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f73c806af00 0x7f73c806d3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f73d0000c00 tx=0x7f73d0009040 comp rx=0 tx=0).stop 2024-01-25T15:04:44.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.579+0000 7f73e1a75640 1 -- 172.21.15.29:0/3108927638 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c4003970 msgr2=0x7f73dc0acc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.579+0000 7f73e1a75640 1 --2- 172.21.15.29:0/3108927638 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c4003970 0x7f73dc0acc90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f73cc000f60 tx=0x7f73cc02e070 comp rx=0 tx=0).stop 2024-01-25T15:04:44.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.579+0000 7f73e1a75640 1 -- 172.21.15.29:0/3108927638 shutdown_connections 2024-01-25T15:04:44.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.579+0000 7f73e1a75640 1 --2- 172.21.15.29:0/3108927638 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f73dc158340 0x7f73dc1587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.579+0000 7f73e1a75640 1 --2- 172.21.15.29:0/3108927638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73dc1ed6c0 0x7f73dc0af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.579+0000 7f73e1a75640 1 --2- 172.21.15.29:0/3108927638 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f73c806af00 0x7f73c806d3c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.579+0000 7f73e1a75640 1 --2- 172.21.15.29:0/3108927638 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c4003970 0x7f73dc0acc90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.579+0000 7f73e1a75640 1 -- 172.21.15.29:0/3108927638 >> 172.21.15.29:0/3108927638 conn(0x7f73dc0ca1f0 msgr2=0x7f73dc152590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:44.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.579+0000 7f73e1a75640 1 -- 172.21.15.29:0/3108927638 shutdown_connections 2024-01-25T15:04:44.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.579+0000 7f73e1a75640 1 -- 172.21.15.29:0/3108927638 wait complete. 2024-01-25T15:04:44.590 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-01-25T15:04:42.919049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594866,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248496,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754726224,"statfs":{"total":773094113280,"available":772839653376,"internally_reserved":0,"allocated":3284992,"data_stored":1988068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2088,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.402236"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027891+0000","last_change":"2024-01-25T15:04:26.549355+0000","last_active":"2024-01-25T15:04:33.027891+0000","last_peered":"2024-01-25T15:04:33.027891+0000","last_clean":"2024-01-25T15:04:33.027891+0000","last_became_active":"2024-01-25T15:04:26.549068+0000","last_became_peered":"2024-01-25T15:04:26.549068+0000","last_unstale":"2024-01-25T15:04:33.027891+0000","last_undegraded":"2024-01-25T15:04:33.027891+0000","last_fullsized":"2024-01-25T15:04:33.027891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:30:22.770050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518335+0000","last_change":"2024-01-25T15:04:27.536360+0000","last_active":"2024-01-25T15:04:32.518335+0000","last_peered":"2024-01-25T15:04:32.518335+0000","last_clean":"2024-01-25T15:04:32.518335+0000","last_became_active":"2024-01-25T15:04:27.534273+0000","last_became_peered":"2024-01-25T15:04:27.534273+0000","last_unstale":"2024-01-25T15:04:32.518335+0000","last_undegraded":"2024-01-25T15:04:32.518335+0000","last_fullsized":"2024-01-25T15:04:32.518335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:47:59.032295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517804+0000","last_change":"2024-01-25T15:04:31.803406+0000","last_active":"2024-01-25T15:04:32.517804+0000","last_peered":"2024-01-25T15:04:32.517804+0000","last_clean":"2024-01-25T15:04:32.517804+0000","last_became_active":"2024-01-25T15:04:31.803079+0000","last_became_peered":"2024-01-25T15:04:31.803079+0000","last_unstale":"2024-01-25T15:04:32.517804+0000","last_undegraded":"2024-01-25T15:04:32.517804+0000","last_fullsized":"2024-01-25T15:04:32.517804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:25:43.747285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518611+0000","last_change":"2024-01-25T15:04:26.545449+0000","last_active":"2024-01-25T15:04:32.518611+0000","last_peered":"2024-01-25T15:04:32.518611+0000","last_clean":"2024-01-25T15:04:32.518611+0000","last_became_active":"2024-01-25T15:04:26.545144+0000","last_became_peered":"2024-01-25T15:04:26.545144+0000","last_unstale":"2024-01-25T15:04:32.518611+0000","last_undegraded":"2024-01-25T15:04:32.518611+0000","last_fullsized":"2024-01-25T15:04:32.518611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:56:52.022913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027714+0000","last_change":"2024-01-25T15:04:27.523808+0000","last_active":"2024-01-25T15:04:33.027714+0000","last_peered":"2024-01-25T15:04:33.027714+0000","last_clean":"2024-01-25T15:04:33.027714+0000","last_became_active":"2024-01-25T15:04:27.523173+0000","last_became_peered":"2024-01-25T15:04:27.523173+0000","last_unstale":"2024-01-25T15:04:33.027714+0000","last_undegraded":"2024-01-25T15:04:33.027714+0000","last_fullsized":"2024-01-25T15:04:33.027714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:30.257021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227919+0000","last_change":"2024-01-25T15:04:31.589158+0000","last_active":"2024-01-25T15:04:33.227919+0000","last_peered":"2024-01-25T15:04:33.227919+0000","last_clean":"2024-01-25T15:04:33.227919+0000","last_became_active":"2024-01-25T15:04:31.588664+0000","last_became_peered":"2024-01-25T15:04:31.588664+0000","last_unstale":"2024-01-25T15:04:33.227919+0000","last_undegraded":"2024-01-25T15:04:33.227919+0000","last_fullsized":"2024-01-25T15:04:33.227919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:34.289728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228764+0000","last_change":"2024-01-25T15:04:26.548904+0000","last_active":"2024-01-25T15:04:33.228764+0000","last_peered":"2024-01-25T15:04:33.228764+0000","last_clean":"2024-01-25T15:04:33.228764+0000","last_became_active":"2024-01-25T15:04:26.548603+0000","last_became_peered":"2024-01-25T15:04:26.548603+0000","last_unstale":"2024-01-25T15:04:33.228764+0000","last_undegraded":"2024-01-25T15:04:33.228764+0000","last_fullsized":"2024-01-25T15:04:33.228764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:04:15.478889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227876+0000","last_change":"2024-01-25T15:04:27.524924+0000","last_active":"2024-01-25T15:04:33.227876+0000","last_peered":"2024-01-25T15:04:33.227876+0000","last_clean":"2024-01-25T15:04:33.227876+0000","last_became_active":"2024-01-25T15:04:27.524657+0000","last_became_peered":"2024-01-25T15:04:27.524657+0000","last_unstale":"2024-01-25T15:04:33.227876+0000","last_undegraded":"2024-01-25T15:04:33.227876+0000","last_fullsized":"2024-01-25T15:04:33.227876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:13:43.582651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228255+0000","last_change":"2024-01-25T15:04:31.589682+0000","last_active":"2024-01-25T15:04:33.228255+0000","last_peered":"2024-01-25T15:04:33.228255+0000","last_clean":"2024-01-25T15:04:33.228255+0000","last_became_active":"2024-01-25T15:04:31.589163+0000","last_became_peered":"2024-01-25T15:04:31.589163+0000","last_unstale":"2024-01-25T15:04:33.228255+0000","last_undegraded":"2024-01-25T15:04:33.228255+0000","last_fullsized":"2024-01-25T15:04:33.228255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:48:03.065003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228571+0000","last_change":"2024-01-25T15:04:26.550079+0000","last_active":"2024-01-25T15:04:33.228571+0000","last_peered":"2024-01-25T15:04:33.228571+0000","last_clean":"2024-01-25T15:04:33.228571+0000","last_became_active":"2024-01-25T15:04:26.549674+0000","last_became_peered":"2024-01-25T15:04:26.549674+0000","last_unstale":"2024-01-25T15:04:33.228571+0000","last_undegraded":"2024-01-25T15:04:33.228571+0000","last_fullsized":"2024-01-25T15:04:33.228571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:08:52.043568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228692+0000","last_change":"2024-01-25T15:04:27.523220+0000","last_active":"2024-01-25T15:04:33.228692+0000","last_peered":"2024-01-25T15:04:33.228692+0000","last_clean":"2024-01-25T15:04:33.228692+0000","last_became_active":"2024-01-25T15:04:27.522900+0000","last_became_peered":"2024-01-25T15:04:27.522900+0000","last_unstale":"2024-01-25T15:04:33.228692+0000","last_undegraded":"2024-01-25T15:04:33.228692+0000","last_fullsized":"2024-01-25T15:04:33.228692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:29:19.932806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228034+0000","last_change":"2024-01-25T15:04:31.582261+0000","last_active":"2024-01-25T15:04:33.228034+0000","last_peered":"2024-01-25T15:04:33.228034+0000","last_clean":"2024-01-25T15:04:33.228034+0000","last_became_active":"2024-01-25T15:04:31.581830+0000","last_became_peered":"2024-01-25T15:04:31.581830+0000","last_unstale":"2024-01-25T15:04:33.228034+0000","last_undegraded":"2024-01-25T15:04:33.228034+0000","last_fullsized":"2024-01-25T15:04:33.228034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:45:12.093528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518616+0000","last_change":"2024-01-25T15:04:27.528164+0000","last_active":"2024-01-25T15:04:32.518616+0000","last_peered":"2024-01-25T15:04:32.518616+0000","last_clean":"2024-01-25T15:04:32.518616+0000","last_became_active":"2024-01-25T15:04:27.527873+0000","last_became_peered":"2024-01-25T15:04:27.527873+0000","last_unstale":"2024-01-25T15:04:32.518616+0000","last_undegraded":"2024-01-25T15:04:32.518616+0000","last_fullsized":"2024-01-25T15:04:32.518616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:30:17.007992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229067+0000","last_change":"2024-01-25T15:04:26.552160+0000","last_active":"2024-01-25T15:04:33.229067+0000","last_peered":"2024-01-25T15:04:33.229067+0000","last_clean":"2024-01-25T15:04:33.229067+0000","last_became_active":"2024-01-25T15:04:26.551735+0000","last_became_peered":"2024-01-25T15:04:26.551735+0000","last_unstale":"2024-01-25T15:04:33.229067+0000","last_undegraded":"2024-01-25T15:04:33.229067+0000","last_fullsized":"2024-01-25T15:04:33.229067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:04:56.733153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229250+0000","last_change":"2024-01-25T15:04:31.589097+0000","last_active":"2024-01-25T15:04:33.229250+0000","last_peered":"2024-01-25T15:04:33.229250+0000","last_clean":"2024-01-25T15:04:33.229250+0000","last_became_active":"2024-01-25T15:04:31.588673+0000","last_became_peered":"2024-01-25T15:04:31.588673+0000","last_unstale":"2024-01-25T15:04:33.229250+0000","last_undegraded":"2024-01-25T15:04:33.229250+0000","last_fullsized":"2024-01-25T15:04:33.229250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:58:33.277497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518113+0000","last_change":"2024-01-25T15:04:27.537840+0000","last_active":"2024-01-25T15:04:32.518113+0000","last_peered":"2024-01-25T15:04:32.518113+0000","last_clean":"2024-01-25T15:04:32.518113+0000","last_became_active":"2024-01-25T15:04:27.537456+0000","last_became_peered":"2024-01-25T15:04:27.537456+0000","last_unstale":"2024-01-25T15:04:32.518113+0000","last_undegraded":"2024-01-25T15:04:32.518113+0000","last_fullsized":"2024-01-25T15:04:32.518113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:45:08.060821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188403+0000","last_change":"2024-01-25T15:04:26.548251+0000","last_active":"2024-01-25T15:04:33.188403+0000","last_peered":"2024-01-25T15:04:33.188403+0000","last_clean":"2024-01-25T15:04:33.188403+0000","last_became_active":"2024-01-25T15:04:26.547939+0000","last_became_peered":"2024-01-25T15:04:26.547939+0000","last_unstale":"2024-01-25T15:04:33.188403+0000","last_undegraded":"2024-01-25T15:04:33.188403+0000","last_fullsized":"2024-01-25T15:04:33.188403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:04:56.733153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228362+0000","last_change":"2024-01-25T15:04:31.590194+0000","last_active":"2024-01-25T15:04:33.228362+0000","last_peered":"2024-01-25T15:04:33.228362+0000","last_clean":"2024-01-25T15:04:33.228362+0000","last_became_active":"2024-01-25T15:04:31.589755+0000","last_became_peered":"2024-01-25T15:04:31.589755+0000","last_unstale":"2024-01-25T15:04:33.228362+0000","last_undegraded":"2024-01-25T15:04:33.228362+0000","last_fullsized":"2024-01-25T15:04:33.228362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:13:47.615358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518097+0000","last_change":"2024-01-25T15:04:27.529881+0000","last_active":"2024-01-25T15:04:32.518097+0000","last_peered":"2024-01-25T15:04:32.518097+0000","last_clean":"2024-01-25T15:04:32.518097+0000","last_became_active":"2024-01-25T15:04:27.529347+0000","last_became_peered":"2024-01-25T15:04:27.529347+0000","last_unstale":"2024-01-25T15:04:32.518097+0000","last_undegraded":"2024-01-25T15:04:32.518097+0000","last_fullsized":"2024-01-25T15:04:32.518097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:19:41.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188030+0000","last_change":"2024-01-25T15:04:26.549223+0000","last_active":"2024-01-25T15:04:33.188030+0000","last_peered":"2024-01-25T15:04:33.188030+0000","last_clean":"2024-01-25T15:04:33.188030+0000","last_became_active":"2024-01-25T15:04:26.548915+0000","last_became_peered":"2024-01-25T15:04:26.548915+0000","last_unstale":"2024-01-25T15:04:33.188030+0000","last_undegraded":"2024-01-25T15:04:33.188030+0000","last_fullsized":"2024-01-25T15:04:33.188030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:08:52.043568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188626+0000","last_change":"2024-01-25T15:04:31.801159+0000","last_active":"2024-01-25T15:04:33.188626+0000","last_peered":"2024-01-25T15:04:33.188626+0000","last_clean":"2024-01-25T15:04:33.188626+0000","last_became_active":"2024-01-25T15:04:31.800733+0000","last_became_peered":"2024-01-25T15:04:31.800733+0000","last_unstale":"2024-01-25T15:04:33.188626+0000","last_undegraded":"2024-01-25T15:04:33.188626+0000","last_fullsized":"2024-01-25T15:04:33.188626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:58:07.965682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229691+0000","last_change":"2024-01-25T15:04:27.529655+0000","last_active":"2024-01-25T15:04:33.229691+0000","last_peered":"2024-01-25T15:04:33.229691+0000","last_clean":"2024-01-25T15:04:33.229691+0000","last_became_active":"2024-01-25T15:04:27.529390+0000","last_became_peered":"2024-01-25T15:04:27.529390+0000","last_unstale":"2024-01-25T15:04:33.229691+0000","last_undegraded":"2024-01-25T15:04:33.229691+0000","last_fullsized":"2024-01-25T15:04:33.229691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:15:45.949448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227503+0000","last_change":"2024-01-25T15:04:26.548483+0000","last_active":"2024-01-25T15:04:33.227503+0000","last_peered":"2024-01-25T15:04:33.227503+0000","last_clean":"2024-01-25T15:04:33.227503+0000","last_became_active":"2024-01-25T15:04:26.548215+0000","last_became_peered":"2024-01-25T15:04:26.548215+0000","last_unstale":"2024-01-25T15:04:33.227503+0000","last_undegraded":"2024-01-25T15:04:33.227503+0000","last_fullsized":"2024-01-25T15:04:33.227503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:17:49.229771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228793+0000","last_change":"2024-01-25T15:04:31.588835+0000","last_active":"2024-01-25T15:04:33.228793+0000","last_peered":"2024-01-25T15:04:33.228793+0000","last_clean":"2024-01-25T15:04:33.228793+0000","last_became_active":"2024-01-25T15:04:31.588379+0000","last_became_peered":"2024-01-25T15:04:31.588379+0000","last_unstale":"2024-01-25T15:04:33.228793+0000","last_undegraded":"2024-01-25T15:04:33.228793+0000","last_fullsized":"2024-01-25T15:04:33.228793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:07:22.654442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.028081+0000","last_change":"2024-01-25T15:04:27.526537+0000","last_active":"2024-01-25T15:04:33.028081+0000","last_peered":"2024-01-25T15:04:33.028081+0000","last_clean":"2024-01-25T15:04:33.028081+0000","last_became_active":"2024-01-25T15:04:27.526228+0000","last_became_peered":"2024-01-25T15:04:27.526228+0000","last_unstale":"2024-01-25T15:04:33.028081+0000","last_undegraded":"2024-01-25T15:04:33.028081+0000","last_fullsized":"2024-01-25T15:04:33.028081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:30:17.007992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519264+0000","last_change":"2024-01-25T15:04:26.548972+0000","last_active":"2024-01-25T15:04:32.519264+0000","last_peered":"2024-01-25T15:04:32.519264+0000","last_clean":"2024-01-25T15:04:32.519264+0000","last_became_active":"2024-01-25T15:04:26.548698+0000","last_became_peered":"2024-01-25T15:04:26.548698+0000","last_unstale":"2024-01-25T15:04:32.519264+0000","last_undegraded":"2024-01-25T15:04:32.519264+0000","last_fullsized":"2024-01-25T15:04:32.519264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:04:56.733153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229547+0000","last_change":"2024-01-25T15:04:31.802696+0000","last_active":"2024-01-25T15:04:33.229547+0000","last_peered":"2024-01-25T15:04:33.229547+0000","last_clean":"2024-01-25T15:04:33.229547+0000","last_became_active":"2024-01-25T15:04:31.802303+0000","last_became_peered":"2024-01-25T15:04:31.802303+0000","last_unstale":"2024-01-25T15:04:33.229547+0000","last_undegraded":"2024-01-25T15:04:33.229547+0000","last_fullsized":"2024-01-25T15:04:33.229547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:47:52.136422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518826+0000","last_change":"2024-01-25T15:04:27.539946+0000","last_active":"2024-01-25T15:04:32.518826+0000","last_peered":"2024-01-25T15:04:32.518826+0000","last_clean":"2024-01-25T15:04:32.518826+0000","last_became_active":"2024-01-25T15:04:27.539623+0000","last_became_peered":"2024-01-25T15:04:27.539623+0000","last_unstale":"2024-01-25T15:04:32.518826+0000","last_undegraded":"2024-01-25T15:04:32.518826+0000","last_fullsized":"2024-01-25T15:04:32.518826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:07:18.621735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188491+0000","last_change":"2024-01-25T15:04:26.545936+0000","last_active":"2024-01-25T15:04:33.188491+0000","last_peered":"2024-01-25T15:04:33.188491+0000","last_clean":"2024-01-25T15:04:33.188491+0000","last_became_active":"2024-01-25T15:04:26.545607+0000","last_became_peered":"2024-01-25T15:04:26.545607+0000","last_unstale":"2024-01-25T15:04:33.188491+0000","last_undegraded":"2024-01-25T15:04:33.188491+0000","last_fullsized":"2024-01-25T15:04:33.188491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:15:44.944688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517706+0000","last_change":"2024-01-25T15:04:31.804100+0000","last_active":"2024-01-25T15:04:32.517706+0000","last_peered":"2024-01-25T15:04:32.517706+0000","last_clean":"2024-01-25T15:04:32.517706+0000","last_became_active":"2024-01-25T15:04:31.803678+0000","last_became_peered":"2024-01-25T15:04:31.803678+0000","last_unstale":"2024-01-25T15:04:32.517706+0000","last_undegraded":"2024-01-25T15:04:32.517706+0000","last_fullsized":"2024-01-25T15:04:32.517706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:41:20.297981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188527+0000","last_change":"2024-01-25T15:04:27.530931+0000","last_active":"2024-01-25T15:04:33.188527+0000","last_peered":"2024-01-25T15:04:33.188527+0000","last_clean":"2024-01-25T15:04:33.188527+0000","last_became_active":"2024-01-25T15:04:27.530621+0000","last_became_peered":"2024-01-25T15:04:27.530621+0000","last_unstale":"2024-01-25T15:04:33.188527+0000","last_undegraded":"2024-01-25T15:04:33.188527+0000","last_fullsized":"2024-01-25T15:04:33.188527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:19:41.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228955+0000","last_change":"2024-01-25T15:04:26.548270+0000","last_active":"2024-01-25T15:04:33.228955+0000","last_peered":"2024-01-25T15:04:33.228955+0000","last_clean":"2024-01-25T15:04:33.228955+0000","last_became_active":"2024-01-25T15:04:26.547977+0000","last_became_peered":"2024-01-25T15:04:26.547977+0000","last_unstale":"2024-01-25T15:04:33.228955+0000","last_undegraded":"2024-01-25T15:04:33.228955+0000","last_fullsized":"2024-01-25T15:04:33.228955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:40:17.099358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027687+0000","last_change":"2024-01-25T15:04:31.800974+0000","last_active":"2024-01-25T15:04:33.027687+0000","last_peered":"2024-01-25T15:04:33.027687+0000","last_clean":"2024-01-25T15:04:33.027687+0000","last_became_active":"2024-01-25T15:04:31.800562+0000","last_became_peered":"2024-01-25T15:04:31.800562+0000","last_unstale":"2024-01-25T15:04:33.027687+0000","last_undegraded":"2024-01-25T15:04:33.027687+0000","last_fullsized":"2024-01-25T15:04:33.027687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:55:06.438077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228790+0000","last_change":"2024-01-25T15:04:27.531901+0000","last_active":"2024-01-25T15:04:33.228790+0000","last_peered":"2024-01-25T15:04:33.228790+0000","last_clean":"2024-01-25T15:04:33.228790+0000","last_became_active":"2024-01-25T15:04:27.531519+0000","last_became_peered":"2024-01-25T15:04:27.531519+0000","last_unstale":"2024-01-25T15:04:33.228790+0000","last_undegraded":"2024-01-25T15:04:33.228790+0000","last_fullsized":"2024-01-25T15:04:33.228790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:47:48.103715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188610+0000","last_change":"2024-01-25T15:04:26.544391+0000","last_active":"2024-01-25T15:04:33.188610+0000","last_peered":"2024-01-25T15:04:33.188610+0000","last_clean":"2024-01-25T15:04:33.188610+0000","last_became_active":"2024-01-25T15:04:26.544092+0000","last_became_peered":"2024-01-25T15:04:26.544092+0000","last_unstale":"2024-01-25T15:04:33.188610+0000","last_undegraded":"2024-01-25T15:04:33.188610+0000","last_fullsized":"2024-01-25T15:04:33.188610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:17:49.229771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188192+0000","last_change":"2024-01-25T15:04:31.588590+0000","last_active":"2024-01-25T15:04:33.188192+0000","last_peered":"2024-01-25T15:04:33.188192+0000","last_clean":"2024-01-25T15:04:33.188192+0000","last_became_active":"2024-01-25T15:04:31.588221+0000","last_became_peered":"2024-01-25T15:04:31.588221+0000","last_unstale":"2024-01-25T15:04:33.188192+0000","last_undegraded":"2024-01-25T15:04:33.188192+0000","last_fullsized":"2024-01-25T15:04:33.188192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:04.647058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229204+0000","last_change":"2024-01-25T15:04:27.535794+0000","last_active":"2024-01-25T15:04:33.229204+0000","last_peered":"2024-01-25T15:04:33.229204+0000","last_clean":"2024-01-25T15:04:33.229204+0000","last_became_active":"2024-01-25T15:04:27.535528+0000","last_became_peered":"2024-01-25T15:04:27.535528+0000","last_unstale":"2024-01-25T15:04:33.229204+0000","last_undegraded":"2024-01-25T15:04:33.229204+0000","last_fullsized":"2024-01-25T15:04:33.229204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:04:57.737913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229149+0000","last_change":"2024-01-25T15:04:26.543493+0000","last_active":"2024-01-25T15:04:33.229149+0000","last_peered":"2024-01-25T15:04:33.229149+0000","last_clean":"2024-01-25T15:04:33.229149+0000","last_became_active":"2024-01-25T15:04:26.543214+0000","last_became_peered":"2024-01-25T15:04:26.543214+0000","last_unstale":"2024-01-25T15:04:33.229149+0000","last_undegraded":"2024-01-25T15:04:33.229149+0000","last_fullsized":"2024-01-25T15:04:33.229149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:56:52.022913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188481+0000","last_change":"2024-01-25T15:04:31.589300+0000","last_active":"2024-01-25T15:04:33.188481+0000","last_peered":"2024-01-25T15:04:33.188481+0000","last_clean":"2024-01-25T15:04:33.188481+0000","last_became_active":"2024-01-25T15:04:31.588325+0000","last_became_peered":"2024-01-25T15:04:31.588325+0000","last_unstale":"2024-01-25T15:04:33.188481+0000","last_undegraded":"2024-01-25T15:04:33.188481+0000","last_fullsized":"2024-01-25T15:04:33.188481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:55:06.438077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.187995+0000","last_change":"2024-01-25T15:04:27.530775+0000","last_active":"2024-01-25T15:04:33.187995+0000","last_peered":"2024-01-25T15:04:33.187995+0000","last_clean":"2024-01-25T15:04:33.187995+0000","last_became_active":"2024-01-25T15:04:27.530457+0000","last_became_peered":"2024-01-25T15:04:27.530457+0000","last_unstale":"2024-01-25T15:04:33.187995+0000","last_undegraded":"2024-01-25T15:04:33.187995+0000","last_fullsized":"2024-01-25T15:04:33.187995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:30:17.007992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519122+0000","last_change":"2024-01-25T15:04:26.542850+0000","last_active":"2024-01-25T15:04:32.519122+0000","last_peered":"2024-01-25T15:04:32.519122+0000","last_clean":"2024-01-25T15:04:32.519122+0000","last_became_active":"2024-01-25T15:04:26.542553+0000","last_became_peered":"2024-01-25T15:04:26.542553+0000","last_unstale":"2024-01-25T15:04:32.519122+0000","last_undegraded":"2024-01-25T15:04:32.519122+0000","last_fullsized":"2024-01-25T15:04:32.519122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:00:16.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188633+0000","last_change":"2024-01-25T15:04:31.587087+0000","last_active":"2024-01-25T15:04:33.188633+0000","last_peered":"2024-01-25T15:04:33.188633+0000","last_clean":"2024-01-25T15:04:33.188633+0000","last_became_active":"2024-01-25T15:04:31.586473+0000","last_became_peered":"2024-01-25T15:04:31.586473+0000","last_unstale":"2024-01-25T15:04:33.188633+0000","last_undegraded":"2024-01-25T15:04:33.188633+0000","last_fullsized":"2024-01-25T15:04:33.188633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:48:53.794961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027426+0000","last_change":"2024-01-25T15:04:27.523437+0000","last_active":"2024-01-25T15:04:33.027426+0000","last_peered":"2024-01-25T15:04:33.027426+0000","last_clean":"2024-01-25T15:04:33.027426+0000","last_became_active":"2024-01-25T15:04:27.523120+0000","last_became_peered":"2024-01-25T15:04:27.523120+0000","last_unstale":"2024-01-25T15:04:33.027426+0000","last_undegraded":"2024-01-25T15:04:33.027426+0000","last_fullsized":"2024-01-25T15:04:33.027426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:55:39.574847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227614+0000","last_change":"2024-01-25T15:04:26.548357+0000","last_active":"2024-01-25T15:04:33.227614+0000","last_peered":"2024-01-25T15:04:33.227614+0000","last_clean":"2024-01-25T15:04:33.227614+0000","last_became_active":"2024-01-25T15:04:26.548083+0000","last_became_peered":"2024-01-25T15:04:26.548083+0000","last_unstale":"2024-01-25T15:04:33.227614+0000","last_undegraded":"2024-01-25T15:04:33.227614+0000","last_fullsized":"2024-01-25T15:04:33.227614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:15:44.944688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.028012+0000","last_change":"2024-01-25T15:04:31.802800+0000","last_active":"2024-01-25T15:04:33.028012+0000","last_peered":"2024-01-25T15:04:33.028012+0000","last_clean":"2024-01-25T15:04:33.028012+0000","last_became_active":"2024-01-25T15:04:31.802424+0000","last_became_peered":"2024-01-25T15:04:31.802424+0000","last_unstale":"2024-01-25T15:04:33.028012+0000","last_undegraded":"2024-01-25T15:04:33.028012+0000","last_fullsized":"2024-01-25T15:04:33.028012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:21:03.688233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517912+0000","last_change":"2024-01-25T15:04:27.540477+0000","last_active":"2024-01-25T15:04:32.517912+0000","last_peered":"2024-01-25T15:04:32.517912+0000","last_clean":"2024-01-25T15:04:32.517912+0000","last_became_active":"2024-01-25T15:04:27.539902+0000","last_became_peered":"2024-01-25T15:04:27.539902+0000","last_unstale":"2024-01-25T15:04:32.517912+0000","last_undegraded":"2024-01-25T15:04:32.517912+0000","last_fullsized":"2024-01-25T15:04:32.517912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:58:29.244789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228206+0000","last_change":"2024-01-25T15:04:26.552279+0000","last_active":"2024-01-25T15:04:33.228206+0000","last_peered":"2024-01-25T15:04:33.228206+0000","last_clean":"2024-01-25T15:04:33.228206+0000","last_became_active":"2024-01-25T15:04:26.552022+0000","last_became_peered":"2024-01-25T15:04:26.552022+0000","last_unstale":"2024-01-25T15:04:33.228206+0000","last_undegraded":"2024-01-25T15:04:33.228206+0000","last_fullsized":"2024-01-25T15:04:33.228206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:30:22.770050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227688+0000","last_change":"2024-01-25T15:04:16.181635+0000","last_active":"2024-01-25T15:04:33.227688+0000","last_peered":"2024-01-25T15:04:33.227688+0000","last_clean":"2024-01-25T15:04:33.227688+0000","last_became_active":"2024-01-25T15:04:16.179890+0000","last_became_peered":"2024-01-25T15:04:16.179890+0000","last_unstale":"2024-01-25T15:04:33.227688+0000","last_undegraded":"2024-01-25T15:04:33.227688+0000","last_fullsized":"2024-01-25T15:04:33.227688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_clean_scrub_stamp":"2024-01-25T15:04:14.956188+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:49:00.618327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518629+0000","last_change":"2024-01-25T15:04:31.805290+0000","last_active":"2024-01-25T15:04:32.518629+0000","last_peered":"2024-01-25T15:04:32.518629+0000","last_clean":"2024-01-25T15:04:32.518629+0000","last_became_active":"2024-01-25T15:04:31.804864+0000","last_became_peered":"2024-01-25T15:04:31.804864+0000","last_unstale":"2024-01-25T15:04:32.518629+0000","last_undegraded":"2024-01-25T15:04:32.518629+0000","last_fullsized":"2024-01-25T15:04:32.518629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:04.647058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228586+0000","last_change":"2024-01-25T15:04:27.541813+0000","last_active":"2024-01-25T15:04:33.228586+0000","last_peered":"2024-01-25T15:04:33.228586+0000","last_clean":"2024-01-25T15:04:33.228586+0000","last_became_active":"2024-01-25T15:04:27.541486+0000","last_became_peered":"2024-01-25T15:04:27.541486+0000","last_unstale":"2024-01-25T15:04:33.228586+0000","last_undegraded":"2024-01-25T15:04:33.228586+0000","last_fullsized":"2024-01-25T15:04:33.228586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:55:02.405369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519311+0000","last_change":"2024-01-25T15:04:26.552363+0000","last_active":"2024-01-25T15:04:32.519311+0000","last_peered":"2024-01-25T15:04:32.519311+0000","last_clean":"2024-01-25T15:04:32.519311+0000","last_became_active":"2024-01-25T15:04:26.552012+0000","last_became_peered":"2024-01-25T15:04:26.552012+0000","last_unstale":"2024-01-25T15:04:32.519311+0000","last_undegraded":"2024-01-25T15:04:32.519311+0000","last_fullsized":"2024-01-25T15:04:32.519311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:30:22.770050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518534+0000","last_change":"2024-01-25T15:04:31.803682+0000","last_active":"2024-01-25T15:04:32.518534+0000","last_peered":"2024-01-25T15:04:32.518534+0000","last_clean":"2024-01-25T15:04:32.518534+0000","last_became_active":"2024-01-25T15:04:31.803296+0000","last_became_peered":"2024-01-25T15:04:31.803296+0000","last_unstale":"2024-01-25T15:04:32.518534+0000","last_undegraded":"2024-01-25T15:04:32.518534+0000","last_fullsized":"2024-01-25T15:04:32.518534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:58:33.277497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227972+0000","last_change":"2024-01-25T15:04:27.536077+0000","last_active":"2024-01-25T15:04:33.227972+0000","last_peered":"2024-01-25T15:04:33.227972+0000","last_clean":"2024-01-25T15:04:33.227972+0000","last_became_active":"2024-01-25T15:04:27.535816+0000","last_became_peered":"2024-01-25T15:04:27.535816+0000","last_unstale":"2024-01-25T15:04:33.227972+0000","last_undegraded":"2024-01-25T15:04:33.227972+0000","last_fullsized":"2024-01-25T15:04:33.227972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:58:03.932974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188722+0000","last_change":"2024-01-25T15:04:26.540088+0000","last_active":"2024-01-25T15:04:33.188722+0000","last_peered":"2024-01-25T15:04:33.188722+0000","last_clean":"2024-01-25T15:04:33.188722+0000","last_became_active":"2024-01-25T15:04:26.539758+0000","last_became_peered":"2024-01-25T15:04:26.539758+0000","last_unstale":"2024-01-25T15:04:33.188722+0000","last_undegraded":"2024-01-25T15:04:33.188722+0000","last_fullsized":"2024-01-25T15:04:33.188722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:09:05.578946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027869+0000","last_change":"2024-01-25T15:04:31.588679+0000","last_active":"2024-01-25T15:04:33.027869+0000","last_peered":"2024-01-25T15:04:33.027869+0000","last_clean":"2024-01-25T15:04:33.027869+0000","last_became_active":"2024-01-25T15:04:31.588266+0000","last_became_peered":"2024-01-25T15:04:31.588266+0000","last_unstale":"2024-01-25T15:04:33.027869+0000","last_undegraded":"2024-01-25T15:04:33.027869+0000","last_fullsized":"2024-01-25T15:04:33.027869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:48:53.794961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229583+0000","last_change":"2024-01-25T15:04:27.539641+0000","last_active":"2024-01-25T15:04:33.229583+0000","last_peered":"2024-01-25T15:04:33.229583+0000","last_clean":"2024-01-25T15:04:33.229583+0000","last_became_active":"2024-01-25T15:04:27.539345+0000","last_became_peered":"2024-01-25T15:04:27.539345+0000","last_unstale":"2024-01-25T15:04:33.229583+0000","last_undegraded":"2024-01-25T15:04:33.229583+0000","last_fullsized":"2024-01-25T15:04:33.229583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:53:55.186236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519214+0000","last_change":"2024-01-25T15:04:26.534562+0000","last_active":"2024-01-25T15:04:32.519214+0000","last_peered":"2024-01-25T15:04:32.519214+0000","last_clean":"2024-01-25T15:04:32.519214+0000","last_became_active":"2024-01-25T15:04:26.534281+0000","last_became_peered":"2024-01-25T15:04:26.534281+0000","last_unstale":"2024-01-25T15:04:32.519214+0000","last_undegraded":"2024-01-25T15:04:32.519214+0000","last_fullsized":"2024-01-25T15:04:32.519214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:05:27.178453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227545+0000","last_change":"2024-01-25T15:04:31.802670+0000","last_active":"2024-01-25T15:04:33.227545+0000","last_peered":"2024-01-25T15:04:33.227545+0000","last_clean":"2024-01-25T15:04:33.227545+0000","last_became_active":"2024-01-25T15:04:31.802294+0000","last_became_peered":"2024-01-25T15:04:31.802294+0000","last_unstale":"2024-01-25T15:04:33.227545+0000","last_undegraded":"2024-01-25T15:04:33.227545+0000","last_fullsized":"2024-01-25T15:04:33.227545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:53:59.218943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228093+0000","last_change":"2024-01-25T15:04:27.539159+0000","last_active":"2024-01-25T15:04:33.228093+0000","last_peered":"2024-01-25T15:04:33.228093+0000","last_clean":"2024-01-25T15:04:33.228093+0000","last_became_active":"2024-01-25T15:04:27.538865+0000","last_became_peered":"2024-01-25T15:04:27.538865+0000","last_unstale":"2024-01-25T15:04:33.228093+0000","last_undegraded":"2024-01-25T15:04:33.228093+0000","last_fullsized":"2024-01-25T15:04:33.228093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:47:48.103715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228169+0000","last_change":"2024-01-25T15:04:26.545573+0000","last_active":"2024-01-25T15:04:33.228169+0000","last_peered":"2024-01-25T15:04:33.228169+0000","last_clean":"2024-01-25T15:04:33.228169+0000","last_became_active":"2024-01-25T15:04:26.545279+0000","last_became_peered":"2024-01-25T15:04:26.545279+0000","last_unstale":"2024-01-25T15:04:33.228169+0000","last_undegraded":"2024-01-25T15:04:33.228169+0000","last_fullsized":"2024-01-25T15:04:33.228169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:45:28.838538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229521+0000","last_change":"2024-01-25T15:04:31.590311+0000","last_active":"2024-01-25T15:04:33.229521+0000","last_peered":"2024-01-25T15:04:33.229521+0000","last_clean":"2024-01-25T15:04:33.229521+0000","last_became_active":"2024-01-25T15:04:31.589798+0000","last_became_peered":"2024-01-25T15:04:31.589798+0000","last_unstale":"2024-01-25T15:04:33.229521+0000","last_undegraded":"2024-01-25T15:04:33.229521+0000","last_fullsized":"2024-01-25T15:04:33.229521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:04.647058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227885+0000","last_change":"2024-01-25T15:04:27.539911+0000","last_active":"2024-01-25T15:04:33.227885+0000","last_peered":"2024-01-25T15:04:33.227885+0000","last_clean":"2024-01-25T15:04:33.227885+0000","last_became_active":"2024-01-25T15:04:27.539414+0000","last_became_peered":"2024-01-25T15:04:27.539414+0000","last_unstale":"2024-01-25T15:04:33.227885+0000","last_undegraded":"2024-01-25T15:04:33.227885+0000","last_fullsized":"2024-01-25T15:04:33.227885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:07:18.621735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518745+0000","last_change":"2024-01-25T15:04:26.538656+0000","last_active":"2024-01-25T15:04:32.518745+0000","last_peered":"2024-01-25T15:04:32.518745+0000","last_clean":"2024-01-25T15:04:32.518745+0000","last_became_active":"2024-01-25T15:04:26.538352+0000","last_became_peered":"2024-01-25T15:04:26.538352+0000","last_unstale":"2024-01-25T15:04:32.518745+0000","last_undegraded":"2024-01-25T15:04:32.518745+0000","last_fullsized":"2024-01-25T15:04:32.518745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:56:52.022913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027848+0000","last_change":"2024-01-25T15:04:31.581015+0000","last_active":"2024-01-25T15:04:33.027848+0000","last_peered":"2024-01-25T15:04:33.027848+0000","last_clean":"2024-01-25T15:04:33.027848+0000","last_became_active":"2024-01-25T15:04:31.580253+0000","last_became_peered":"2024-01-25T15:04:31.580253+0000","last_unstale":"2024-01-25T15:04:33.027848+0000","last_undegraded":"2024-01-25T15:04:33.027848+0000","last_fullsized":"2024-01-25T15:04:33.027848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:58:07.965682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518484+0000","last_change":"2024-01-25T15:04:27.536648+0000","last_active":"2024-01-25T15:04:32.518484+0000","last_peered":"2024-01-25T15:04:32.518484+0000","last_clean":"2024-01-25T15:04:32.518484+0000","last_became_active":"2024-01-25T15:04:27.536010+0000","last_became_peered":"2024-01-25T15:04:27.536010+0000","last_unstale":"2024-01-25T15:04:32.518484+0000","last_undegraded":"2024-01-25T15:04:32.518484+0000","last_fullsized":"2024-01-25T15:04:32.518484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:48.199996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518565+0000","last_change":"2024-01-25T15:04:26.540469+0000","last_active":"2024-01-25T15:04:32.518565+0000","last_peered":"2024-01-25T15:04:32.518565+0000","last_clean":"2024-01-25T15:04:32.518565+0000","last_became_active":"2024-01-25T15:04:26.540180+0000","last_became_peered":"2024-01-25T15:04:26.540180+0000","last_unstale":"2024-01-25T15:04:32.518565+0000","last_undegraded":"2024-01-25T15:04:32.518565+0000","last_fullsized":"2024-01-25T15:04:32.518565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:56:52.022913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518587+0000","last_change":"2024-01-25T15:04:31.804865+0000","last_active":"2024-01-25T15:04:32.518587+0000","last_peered":"2024-01-25T15:04:32.518587+0000","last_clean":"2024-01-25T15:04:32.518587+0000","last_became_active":"2024-01-25T15:04:31.804470+0000","last_became_peered":"2024-01-25T15:04:31.804470+0000","last_unstale":"2024-01-25T15:04:32.518587+0000","last_undegraded":"2024-01-25T15:04:32.518587+0000","last_fullsized":"2024-01-25T15:04:32.518587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:11:49.452494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228951+0000","last_change":"2024-01-25T15:04:27.541056+0000","last_active":"2024-01-25T15:04:33.228951+0000","last_peered":"2024-01-25T15:04:33.228951+0000","last_clean":"2024-01-25T15:04:33.228951+0000","last_became_active":"2024-01-25T15:04:27.539554+0000","last_became_peered":"2024-01-25T15:04:27.539554+0000","last_unstale":"2024-01-25T15:04:33.228951+0000","last_undegraded":"2024-01-25T15:04:33.228951+0000","last_fullsized":"2024-01-25T15:04:33.228951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:00.614350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229053+0000","last_change":"2024-01-25T15:04:26.551429+0000","last_active":"2024-01-25T15:04:33.229053+0000","last_peered":"2024-01-25T15:04:33.229053+0000","last_clean":"2024-01-25T15:04:33.229053+0000","last_became_active":"2024-01-25T15:04:26.551181+0000","last_became_peered":"2024-01-25T15:04:26.551181+0000","last_unstale":"2024-01-25T15:04:33.229053+0000","last_undegraded":"2024-01-25T15:04:33.229053+0000","last_fullsized":"2024-01-25T15:04:33.229053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:00:16.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518432+0000","last_change":"2024-01-25T15:04:31.800938+0000","last_active":"2024-01-25T15:04:32.518432+0000","last_peered":"2024-01-25T15:04:32.518432+0000","last_clean":"2024-01-25T15:04:32.518432+0000","last_became_active":"2024-01-25T15:04:31.800545+0000","last_became_peered":"2024-01-25T15:04:31.800545+0000","last_unstale":"2024-01-25T15:04:32.518432+0000","last_undegraded":"2024-01-25T15:04:32.518432+0000","last_fullsized":"2024-01-25T15:04:32.518432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:26:14.960523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027624+0000","last_change":"2024-01-25T15:04:27.534211+0000","last_active":"2024-01-25T15:04:33.027624+0000","last_peered":"2024-01-25T15:04:33.027624+0000","last_clean":"2024-01-25T15:04:33.027624+0000","last_became_active":"2024-01-25T15:04:27.533793+0000","last_became_peered":"2024-01-25T15:04:27.533793+0000","last_unstale":"2024-01-25T15:04:33.027624+0000","last_undegraded":"2024-01-25T15:04:33.027624+0000","last_fullsized":"2024-01-25T15:04:33.027624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:55:36.165047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027906+0000","last_change":"2024-01-25T15:04:26.547052+0000","last_active":"2024-01-25T15:04:33.027906+0000","last_peered":"2024-01-25T15:04:33.027906+0000","last_clean":"2024-01-25T15:04:33.027906+0000","last_became_active":"2024-01-25T15:04:26.546739+0000","last_became_peered":"2024-01-25T15:04:26.546739+0000","last_unstale":"2024-01-25T15:04:33.027906+0000","last_undegraded":"2024-01-25T15:04:33.027906+0000","last_fullsized":"2024-01-25T15:04:33.027906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:05:27.178453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228631+0000","last_change":"2024-01-25T15:04:31.801553+0000","last_active":"2024-01-25T15:04:33.228631+0000","last_peered":"2024-01-25T15:04:33.228631+0000","last_clean":"2024-01-25T15:04:33.228631+0000","last_became_active":"2024-01-25T15:04:31.801117+0000","last_became_peered":"2024-01-25T15:04:31.801117+0000","last_unstale":"2024-01-25T15:04:33.228631+0000","last_undegraded":"2024-01-25T15:04:33.228631+0000","last_fullsized":"2024-01-25T15:04:33.228631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:41:20.297981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228502+0000","last_change":"2024-01-25T15:04:27.542771+0000","last_active":"2024-01-25T15:04:33.228502+0000","last_peered":"2024-01-25T15:04:33.228502+0000","last_clean":"2024-01-25T15:04:33.228502+0000","last_became_active":"2024-01-25T15:04:27.542443+0000","last_became_peered":"2024-01-25T15:04:27.542443+0000","last_unstale":"2024-01-25T15:04:33.228502+0000","last_undegraded":"2024-01-25T15:04:33.228502+0000","last_fullsized":"2024-01-25T15:04:33.228502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:13:43.582651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:36.428981+0000","last_change":"2024-01-25T15:04:26.543626+0000","last_active":"2024-01-25T15:04:36.428981+0000","last_peered":"2024-01-25T15:04:36.428981+0000","last_clean":"2024-01-25T15:04:36.428981+0000","last_became_active":"2024-01-25T15:04:26.543134+0000","last_became_peered":"2024-01-25T15:04:26.543134+0000","last_unstale":"2024-01-25T15:04:36.428981+0000","last_undegraded":"2024-01-25T15:04:36.428981+0000","last_fullsized":"2024-01-25T15:04:36.428981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:17:49.229771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3700,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188193+0000","last_change":"2024-01-25T15:04:31.590781+0000","last_active":"2024-01-25T15:04:33.188193+0000","last_peered":"2024-01-25T15:04:33.188193+0000","last_clean":"2024-01-25T15:04:33.188193+0000","last_became_active":"2024-01-25T15:04:31.589830+0000","last_became_peered":"2024-01-25T15:04:31.589830+0000","last_unstale":"2024-01-25T15:04:33.188193+0000","last_undegraded":"2024-01-25T15:04:33.188193+0000","last_fullsized":"2024-01-25T15:04:33.188193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:47:52.136422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228853+0000","last_change":"2024-01-25T15:04:27.530991+0000","last_active":"2024-01-25T15:04:33.228853+0000","last_peered":"2024-01-25T15:04:33.228853+0000","last_clean":"2024-01-25T15:04:33.228853+0000","last_became_active":"2024-01-25T15:04:27.530694+0000","last_became_peered":"2024-01-25T15:04:27.530694+0000","last_unstale":"2024-01-25T15:04:33.228853+0000","last_undegraded":"2024-01-25T15:04:33.228853+0000","last_fullsized":"2024-01-25T15:04:33.228853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:04:16.483649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188688+0000","last_change":"2024-01-25T15:04:26.552321+0000","last_active":"2024-01-25T15:04:33.188688+0000","last_peered":"2024-01-25T15:04:33.188688+0000","last_clean":"2024-01-25T15:04:33.188688+0000","last_became_active":"2024-01-25T15:04:26.552007+0000","last_became_peered":"2024-01-25T15:04:26.552007+0000","last_unstale":"2024-01-25T15:04:33.188688+0000","last_undegraded":"2024-01-25T15:04:33.188688+0000","last_fullsized":"2024-01-25T15:04:33.188688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:56:52.022913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228472+0000","last_change":"2024-01-25T15:04:31.589216+0000","last_active":"2024-01-25T15:04:33.228472+0000","last_peered":"2024-01-25T15:04:33.228472+0000","last_clean":"2024-01-25T15:04:33.228472+0000","last_became_active":"2024-01-25T15:04:31.588411+0000","last_became_peered":"2024-01-25T15:04:31.588411+0000","last_unstale":"2024-01-25T15:04:33.228472+0000","last_undegraded":"2024-01-25T15:04:33.228472+0000","last_fullsized":"2024-01-25T15:04:33.228472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:29:23.965513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027809+0000","last_change":"2024-01-25T15:04:27.524082+0000","last_active":"2024-01-25T15:04:33.027809+0000","last_peered":"2024-01-25T15:04:33.027809+0000","last_clean":"2024-01-25T15:04:33.027809+0000","last_became_active":"2024-01-25T15:04:27.523538+0000","last_became_peered":"2024-01-25T15:04:27.523538+0000","last_unstale":"2024-01-25T15:04:33.027809+0000","last_undegraded":"2024-01-25T15:04:33.027809+0000","last_fullsized":"2024-01-25T15:04:33.027809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:45:08.060821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229389+0000","last_change":"2024-01-25T15:04:26.546430+0000","last_active":"2024-01-25T15:04:33.229389+0000","last_peered":"2024-01-25T15:04:33.229389+0000","last_clean":"2024-01-25T15:04:33.229389+0000","last_became_active":"2024-01-25T15:04:26.546172+0000","last_became_peered":"2024-01-25T15:04:26.546172+0000","last_unstale":"2024-01-25T15:04:33.229389+0000","last_undegraded":"2024-01-25T15:04:33.229389+0000","last_fullsized":"2024-01-25T15:04:33.229389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:17:49.229771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518237+0000","last_change":"2024-01-25T15:04:31.585484+0000","last_active":"2024-01-25T15:04:32.518237+0000","last_peered":"2024-01-25T15:04:32.518237+0000","last_clean":"2024-01-25T15:04:32.518237+0000","last_became_active":"2024-01-25T15:04:31.585107+0000","last_became_peered":"2024-01-25T15:04:31.585107+0000","last_unstale":"2024-01-25T15:04:32.518237+0000","last_undegraded":"2024-01-25T15:04:32.518237+0000","last_fullsized":"2024-01-25T15:04:32.518237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:52:39.722794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229300+0000","last_change":"2024-01-25T15:04:27.539659+0000","last_active":"2024-01-25T15:04:33.229300+0000","last_peered":"2024-01-25T15:04:33.229300+0000","last_clean":"2024-01-25T15:04:33.229300+0000","last_became_active":"2024-01-25T15:04:27.539382+0000","last_became_peered":"2024-01-25T15:04:27.539382+0000","last_unstale":"2024-01-25T15:04:33.229300+0000","last_undegraded":"2024-01-25T15:04:33.229300+0000","last_fullsized":"2024-01-25T15:04:33.229300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:47:59.032295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519043+0000","last_change":"2024-01-25T15:04:26.550083+0000","last_active":"2024-01-25T15:04:32.519043+0000","last_peered":"2024-01-25T15:04:32.519043+0000","last_clean":"2024-01-25T15:04:32.519043+0000","last_became_active":"2024-01-25T15:04:26.549812+0000","last_became_peered":"2024-01-25T15:04:26.549812+0000","last_unstale":"2024-01-25T15:04:32.519043+0000","last_undegraded":"2024-01-25T15:04:32.519043+0000","last_fullsized":"2024-01-25T15:04:32.519043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:15:44.944688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518046+0000","last_change":"2024-01-25T15:04:31.802519+0000","last_active":"2024-01-25T15:04:32.518046+0000","last_peered":"2024-01-25T15:04:32.518046+0000","last_clean":"2024-01-25T15:04:32.518046+0000","last_became_active":"2024-01-25T15:04:31.802179+0000","last_became_peered":"2024-01-25T15:04:31.802179+0000","last_unstale":"2024-01-25T15:04:32.518046+0000","last_undegraded":"2024-01-25T15:04:32.518046+0000","last_fullsized":"2024-01-25T15:04:32.518046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:07:22.928800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.028016+0000","last_change":"2024-01-25T15:04:31.803027+0000","last_active":"2024-01-25T15:04:33.028016+0000","last_peered":"2024-01-25T15:04:33.028016+0000","last_clean":"2024-01-25T15:04:33.028016+0000","last_became_active":"2024-01-25T15:04:31.802543+0000","last_became_peered":"2024-01-25T15:04:31.802543+0000","last_unstale":"2024-01-25T15:04:33.028016+0000","last_undegraded":"2024-01-25T15:04:33.028016+0000","last_fullsized":"2024-01-25T15:04:33.028016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:53:59.218943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.187926+0000","last_change":"2024-01-25T15:04:27.537760+0000","last_active":"2024-01-25T15:04:33.187926+0000","last_peered":"2024-01-25T15:04:33.187926+0000","last_clean":"2024-01-25T15:04:33.187926+0000","last_became_active":"2024-01-25T15:04:27.537411+0000","last_became_peered":"2024-01-25T15:04:27.537411+0000","last_unstale":"2024-01-25T15:04:33.187926+0000","last_undegraded":"2024-01-25T15:04:33.187926+0000","last_fullsized":"2024-01-25T15:04:33.187926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:24:46.429617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227807+0000","last_change":"2024-01-25T15:04:26.553364+0000","last_active":"2024-01-25T15:04:33.227807+0000","last_peered":"2024-01-25T15:04:33.227807+0000","last_clean":"2024-01-25T15:04:33.227807+0000","last_became_active":"2024-01-25T15:04:26.553023+0000","last_became_peered":"2024-01-25T15:04:26.553023+0000","last_unstale":"2024-01-25T15:04:33.227807+0000","last_undegraded":"2024-01-25T15:04:33.227807+0000","last_fullsized":"2024-01-25T15:04:33.227807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:09:05.578946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518883+0000","last_change":"2024-01-25T15:04:31.588551+0000","last_active":"2024-01-25T15:04:32.518883+0000","last_peered":"2024-01-25T15:04:32.518883+0000","last_clean":"2024-01-25T15:04:32.518883+0000","last_became_active":"2024-01-25T15:04:31.588144+0000","last_became_peered":"2024-01-25T15:04:31.588144+0000","last_unstale":"2024-01-25T15:04:32.518883+0000","last_undegraded":"2024-01-25T15:04:32.518883+0000","last_fullsized":"2024-01-25T15:04:32.518883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:47:52.136422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517990+0000","last_change":"2024-01-25T15:04:27.537715+0000","last_active":"2024-01-25T15:04:32.517990+0000","last_peered":"2024-01-25T15:04:32.517990+0000","last_clean":"2024-01-25T15:04:32.517990+0000","last_became_active":"2024-01-25T15:04:27.537433+0000","last_became_peered":"2024-01-25T15:04:27.537433+0000","last_unstale":"2024-01-25T15:04:32.517990+0000","last_undegraded":"2024-01-25T15:04:32.517990+0000","last_fullsized":"2024-01-25T15:04:32.517990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:48.199996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518112+0000","last_change":"2024-01-25T15:04:26.543354+0000","last_active":"2024-01-25T15:04:32.518112+0000","last_peered":"2024-01-25T15:04:32.518112+0000","last_clean":"2024-01-25T15:04:32.518112+0000","last_became_active":"2024-01-25T15:04:26.543047+0000","last_became_peered":"2024-01-25T15:04:26.543047+0000","last_unstale":"2024-01-25T15:04:32.518112+0000","last_undegraded":"2024-01-25T15:04:32.518112+0000","last_fullsized":"2024-01-25T15:04:32.518112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:30:22.770050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518843+0000","last_change":"2024-01-25T15:04:26.541507+0000","last_active":"2024-01-25T15:04:32.518843+0000","last_peered":"2024-01-25T15:04:32.518843+0000","last_clean":"2024-01-25T15:04:32.518843+0000","last_became_active":"2024-01-25T15:04:26.540128+0000","last_became_peered":"2024-01-25T15:04:26.540128+0000","last_unstale":"2024-01-25T15:04:32.518843+0000","last_undegraded":"2024-01-25T15:04:32.518843+0000","last_fullsized":"2024-01-25T15:04:32.518843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:09:05.578946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027825+0000","last_change":"2024-01-25T15:04:27.525314+0000","last_active":"2024-01-25T15:04:33.027825+0000","last_peered":"2024-01-25T15:04:33.027825+0000","last_clean":"2024-01-25T15:04:33.027825+0000","last_became_active":"2024-01-25T15:04:27.525018+0000","last_became_peered":"2024-01-25T15:04:27.525018+0000","last_unstale":"2024-01-25T15:04:33.027825+0000","last_undegraded":"2024-01-25T15:04:33.027825+0000","last_fullsized":"2024-01-25T15:04:33.027825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:19:41.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519186+0000","last_change":"2024-01-25T15:04:31.591768+0000","last_active":"2024-01-25T15:04:32.519186+0000","last_peered":"2024-01-25T15:04:32.519186+0000","last_clean":"2024-01-25T15:04:32.519186+0000","last_became_active":"2024-01-25T15:04:31.591336+0000","last_became_peered":"2024-01-25T15:04:31.591336+0000","last_unstale":"2024-01-25T15:04:32.519186+0000","last_undegraded":"2024-01-25T15:04:32.519186+0000","last_fullsized":"2024-01-25T15:04:32.519186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:40:22.136826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518266+0000","last_change":"2024-01-25T15:04:26.550151+0000","last_active":"2024-01-25T15:04:32.518266+0000","last_peered":"2024-01-25T15:04:32.518266+0000","last_clean":"2024-01-25T15:04:32.518266+0000","last_became_active":"2024-01-25T15:04:26.549856+0000","last_became_peered":"2024-01-25T15:04:26.549856+0000","last_unstale":"2024-01-25T15:04:32.518266+0000","last_undegraded":"2024-01-25T15:04:32.518266+0000","last_fullsized":"2024-01-25T15:04:32.518266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:00:16.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228279+0000","last_change":"2024-01-25T15:04:27.526178+0000","last_active":"2024-01-25T15:04:33.228279+0000","last_peered":"2024-01-25T15:04:33.228279+0000","last_clean":"2024-01-25T15:04:33.228279+0000","last_became_active":"2024-01-25T15:04:27.525798+0000","last_became_peered":"2024-01-25T15:04:27.525798+0000","last_unstale":"2024-01-25T15:04:33.228279+0000","last_undegraded":"2024-01-25T15:04:33.228279+0000","last_fullsized":"2024-01-25T15:04:33.228279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:17:50.234531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518933+0000","last_change":"2024-01-25T15:04:31.584854+0000","last_active":"2024-01-25T15:04:32.518933+0000","last_peered":"2024-01-25T15:04:32.518933+0000","last_clean":"2024-01-25T15:04:32.518933+0000","last_became_active":"2024-01-25T15:04:31.584482+0000","last_became_peered":"2024-01-25T15:04:31.584482+0000","last_unstale":"2024-01-25T15:04:32.518933+0000","last_undegraded":"2024-01-25T15:04:32.518933+0000","last_fullsized":"2024-01-25T15:04:32.518933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:52:29.681769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519137+0000","last_change":"2024-01-25T15:04:27.536761+0000","last_active":"2024-01-25T15:04:32.519137+0000","last_peered":"2024-01-25T15:04:32.519137+0000","last_clean":"2024-01-25T15:04:32.519137+0000","last_became_active":"2024-01-25T15:04:27.536382+0000","last_became_peered":"2024-01-25T15:04:27.536382+0000","last_unstale":"2024-01-25T15:04:32.519137+0000","last_undegraded":"2024-01-25T15:04:32.519137+0000","last_fullsized":"2024-01-25T15:04:32.519137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:24:46.429617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519085+0000","last_change":"2024-01-25T15:04:27.529750+0000","last_active":"2024-01-25T15:04:32.519085+0000","last_peered":"2024-01-25T15:04:32.519085+0000","last_clean":"2024-01-25T15:04:32.519085+0000","last_became_active":"2024-01-25T15:04:27.529437+0000","last_became_peered":"2024-01-25T15:04:27.529437+0000","last_unstale":"2024-01-25T15:04:32.519085+0000","last_undegraded":"2024-01-25T15:04:32.519085+0000","last_fullsized":"2024-01-25T15:04:32.519085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:15:45.949448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228955+0000","last_change":"2024-01-25T15:04:27.538760+0000","last_active":"2024-01-25T15:04:33.228955+0000","last_peered":"2024-01-25T15:04:33.228955+0000","last_clean":"2024-01-25T15:04:33.228955+0000","last_became_active":"2024-01-25T15:04:27.537353+0000","last_became_peered":"2024-01-25T15:04:27.537353+0000","last_unstale":"2024-01-25T15:04:33.228955+0000","last_undegraded":"2024-01-25T15:04:33.228955+0000","last_fullsized":"2024-01-25T15:04:33.228955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:58:29.244789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027745+0000","last_change":"2024-01-25T15:04:27.534768+0000","last_active":"2024-01-25T15:04:33.027745+0000","last_peered":"2024-01-25T15:04:33.027745+0000","last_clean":"2024-01-25T15:04:33.027745+0000","last_became_active":"2024-01-25T15:04:27.534414+0000","last_became_peered":"2024-01-25T15:04:27.534414+0000","last_unstale":"2024-01-25T15:04:33.027745+0000","last_undegraded":"2024-01-25T15:04:33.027745+0000","last_fullsized":"2024-01-25T15:04:33.027745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:59:41.393305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518613+0000","last_change":"2024-01-25T15:04:27.532970+0000","last_active":"2024-01-25T15:04:32.518613+0000","last_peered":"2024-01-25T15:04:32.518613+0000","last_clean":"2024-01-25T15:04:32.518613+0000","last_became_active":"2024-01-25T15:04:27.532645+0000","last_became_peered":"2024-01-25T15:04:27.532645+0000","last_unstale":"2024-01-25T15:04:32.518613+0000","last_undegraded":"2024-01-25T15:04:32.518613+0000","last_fullsized":"2024-01-25T15:04:32.518613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:13:43.582651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188513+0000","last_change":"2024-01-25T15:04:27.538503+0000","last_active":"2024-01-25T15:04:33.188513+0000","last_peered":"2024-01-25T15:04:33.188513+0000","last_clean":"2024-01-25T15:04:33.188513+0000","last_became_active":"2024-01-25T15:04:27.538210+0000","last_became_peered":"2024-01-25T15:04:27.538210+0000","last_unstale":"2024-01-25T15:04:33.188513+0000","last_undegraded":"2024-01-25T15:04:33.188513+0000","last_fullsized":"2024-01-25T15:04:33.188513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:59:41.393305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519315+0000","last_change":"2024-01-25T15:04:27.540013+0000","last_active":"2024-01-25T15:04:32.519315+0000","last_peered":"2024-01-25T15:04:32.519315+0000","last_clean":"2024-01-25T15:04:32.519315+0000","last_became_active":"2024-01-25T15:04:27.539736+0000","last_became_peered":"2024-01-25T15:04:27.539736+0000","last_unstale":"2024-01-25T15:04:32.519315+0000","last_undegraded":"2024-01-25T15:04:32.519315+0000","last_fullsized":"2024-01-25T15:04:32.519315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:45:08.060821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518509+0000","last_change":"2024-01-25T15:04:27.536541+0000","last_active":"2024-01-25T15:04:32.518509+0000","last_peered":"2024-01-25T15:04:32.518509+0000","last_clean":"2024-01-25T15:04:32.518509+0000","last_became_active":"2024-01-25T15:04:27.534323+0000","last_became_peered":"2024-01-25T15:04:27.534323+0000","last_unstale":"2024-01-25T15:04:32.518509+0000","last_undegraded":"2024-01-25T15:04:32.518509+0000","last_fullsized":"2024-01-25T15:04:32.518509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:29:19.932806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227705+0000","last_change":"2024-01-25T15:04:27.534565+0000","last_active":"2024-01-25T15:04:33.227705+0000","last_peered":"2024-01-25T15:04:33.227705+0000","last_clean":"2024-01-25T15:04:33.227705+0000","last_became_active":"2024-01-25T15:04:27.534263+0000","last_became_peered":"2024-01-25T15:04:27.534263+0000","last_unstale":"2024-01-25T15:04:33.227705+0000","last_undegraded":"2024-01-25T15:04:33.227705+0000","last_fullsized":"2024-01-25T15:04:33.227705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:30.257021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517959+0000","last_change":"2024-01-25T15:04:27.532801+0000","last_active":"2024-01-25T15:04:32.517959+0000","last_peered":"2024-01-25T15:04:32.517959+0000","last_clean":"2024-01-25T15:04:32.517959+0000","last_became_active":"2024-01-25T15:04:27.532521+0000","last_became_peered":"2024-01-25T15:04:27.532521+0000","last_unstale":"2024-01-25T15:04:32.517959+0000","last_undegraded":"2024-01-25T15:04:32.517959+0000","last_fullsized":"2024-01-25T15:04:32.517959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:59:41.393305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229237+0000","last_change":"2024-01-25T15:04:27.531785+0000","last_active":"2024-01-25T15:04:33.229237+0000","last_peered":"2024-01-25T15:04:33.229237+0000","last_clean":"2024-01-25T15:04:33.229237+0000","last_became_active":"2024-01-25T15:04:27.531502+0000","last_became_peered":"2024-01-25T15:04:27.531502+0000","last_unstale":"2024-01-25T15:04:33.229237+0000","last_undegraded":"2024-01-25T15:04:33.229237+0000","last_fullsized":"2024-01-25T15:04:33.229237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:07:18.621735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027629+0000","last_change":"2024-01-25T15:04:27.538527+0000","last_active":"2024-01-25T15:04:33.027629+0000","last_peered":"2024-01-25T15:04:33.027629+0000","last_clean":"2024-01-25T15:04:33.027629+0000","last_became_active":"2024-01-25T15:04:27.538169+0000","last_became_peered":"2024-01-25T15:04:27.538169+0000","last_unstale":"2024-01-25T15:04:33.027629+0000","last_undegraded":"2024-01-25T15:04:33.027629+0000","last_fullsized":"2024-01-25T15:04:33.027629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:48.199996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519087+0000","last_change":"2024-01-25T15:04:27.528595+0000","last_active":"2024-01-25T15:04:32.519087+0000","last_peered":"2024-01-25T15:04:32.519087+0000","last_clean":"2024-01-25T15:04:32.519087+0000","last_became_active":"2024-01-25T15:04:27.528222+0000","last_became_peered":"2024-01-25T15:04:27.528222+0000","last_unstale":"2024-01-25T15:04:32.519087+0000","last_undegraded":"2024-01-25T15:04:32.519087+0000","last_fullsized":"2024-01-25T15:04:32.519087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:59:41.393305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228858+0000","last_change":"2024-01-25T15:04:27.539219+0000","last_active":"2024-01-25T15:04:33.228858+0000","last_peered":"2024-01-25T15:04:33.228858+0000","last_clean":"2024-01-25T15:04:33.228858+0000","last_became_active":"2024-01-25T15:04:27.538920+0000","last_became_peered":"2024-01-25T15:04:27.538920+0000","last_unstale":"2024-01-25T15:04:33.228858+0000","last_undegraded":"2024-01-25T15:04:33.228858+0000","last_fullsized":"2024-01-25T15:04:33.228858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:58:03.932974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519156+0000","last_change":"2024-01-25T15:04:27.531810+0000","last_active":"2024-01-25T15:04:32.519156+0000","last_peered":"2024-01-25T15:04:32.519156+0000","last_clean":"2024-01-25T15:04:32.519156+0000","last_became_active":"2024-01-25T15:04:27.531489+0000","last_became_peered":"2024-01-25T15:04:27.531489+0000","last_unstale":"2024-01-25T15:04:32.519156+0000","last_undegraded":"2024-01-25T15:04:32.519156+0000","last_fullsized":"2024-01-25T15:04:32.519156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:04:57.737913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228241+0000","last_change":"2024-01-25T15:04:27.532610+0000","last_active":"2024-01-25T15:04:33.228241+0000","last_peered":"2024-01-25T15:04:33.228241+0000","last_clean":"2024-01-25T15:04:33.228241+0000","last_became_active":"2024-01-25T15:04:27.532332+0000","last_became_peered":"2024-01-25T15:04:27.532332+0000","last_unstale":"2024-01-25T15:04:33.228241+0000","last_undegraded":"2024-01-25T15:04:33.228241+0000","last_fullsized":"2024-01-25T15:04:33.228241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:00.614350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227608+0000","last_change":"2024-01-25T15:04:27.535483+0000","last_active":"2024-01-25T15:04:33.227608+0000","last_peered":"2024-01-25T15:04:33.227608+0000","last_clean":"2024-01-25T15:04:33.227608+0000","last_became_active":"2024-01-25T15:04:27.534992+0000","last_became_peered":"2024-01-25T15:04:27.534992+0000","last_unstale":"2024-01-25T15:04:33.227608+0000","last_undegraded":"2024-01-25T15:04:33.227608+0000","last_fullsized":"2024-01-25T15:04:33.227608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:19:41.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188004+0000","last_change":"2024-01-25T15:04:27.528466+0000","last_active":"2024-01-25T15:04:33.188004+0000","last_peered":"2024-01-25T15:04:33.188004+0000","last_clean":"2024-01-25T15:04:33.188004+0000","last_became_active":"2024-01-25T15:04:27.528170+0000","last_became_peered":"2024-01-25T15:04:27.528170+0000","last_unstale":"2024-01-25T15:04:33.188004+0000","last_undegraded":"2024-01-25T15:04:33.188004+0000","last_fullsized":"2024-01-25T15:04:33.188004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:48.199996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027681+0000","last_change":"2024-01-25T15:04:27.527057+0000","last_active":"2024-01-25T15:04:33.027681+0000","last_peered":"2024-01-25T15:04:33.027681+0000","last_clean":"2024-01-25T15:04:33.027681+0000","last_became_active":"2024-01-25T15:04:27.526733+0000","last_became_peered":"2024-01-25T15:04:27.526733+0000","last_unstale":"2024-01-25T15:04:33.027681+0000","last_undegraded":"2024-01-25T15:04:33.027681+0000","last_fullsized":"2024-01-25T15:04:33.027681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:38:10.985262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518080+0000","last_change":"2024-01-25T15:04:27.533940+0000","last_active":"2024-01-25T15:04:32.518080+0000","last_peered":"2024-01-25T15:04:32.518080+0000","last_clean":"2024-01-25T15:04:32.518080+0000","last_became_active":"2024-01-25T15:04:27.533453+0000","last_became_peered":"2024-01-25T15:04:27.533453+0000","last_unstale":"2024-01-25T15:04:32.518080+0000","last_undegraded":"2024-01-25T15:04:32.518080+0000","last_fullsized":"2024-01-25T15:04:32.518080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:30.257021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228629+0000","last_change":"2024-01-25T15:04:27.529157+0000","last_active":"2024-01-25T15:04:33.228629+0000","last_peered":"2024-01-25T15:04:33.228629+0000","last_clean":"2024-01-25T15:04:33.228629+0000","last_became_active":"2024-01-25T15:04:27.528880+0000","last_became_peered":"2024-01-25T15:04:27.528880+0000","last_unstale":"2024-01-25T15:04:33.228629+0000","last_undegraded":"2024-01-25T15:04:33.228629+0000","last_fullsized":"2024-01-25T15:04:33.228629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:08:53.048328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518689+0000","last_change":"2024-01-25T15:04:27.528325+0000","last_active":"2024-01-25T15:04:32.518689+0000","last_peered":"2024-01-25T15:04:32.518689+0000","last_clean":"2024-01-25T15:04:32.518689+0000","last_became_active":"2024-01-25T15:04:27.527673+0000","last_became_peered":"2024-01-25T15:04:27.527673+0000","last_unstale":"2024-01-25T15:04:32.518689+0000","last_undegraded":"2024-01-25T15:04:32.518689+0000","last_fullsized":"2024-01-25T15:04:32.518689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:19:41.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519157+0000","last_change":"2024-01-25T15:04:27.530713+0000","last_active":"2024-01-25T15:04:32.519157+0000","last_peered":"2024-01-25T15:04:32.519157+0000","last_clean":"2024-01-25T15:04:32.519157+0000","last_became_active":"2024-01-25T15:04:27.530468+0000","last_became_peered":"2024-01-25T15:04:27.530468+0000","last_unstale":"2024-01-25T15:04:32.519157+0000","last_undegraded":"2024-01-25T15:04:32.519157+0000","last_fullsized":"2024-01-25T15:04:32.519157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:30.257021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229579+0000","last_change":"2024-01-25T15:04:27.542678+0000","last_active":"2024-01-25T15:04:33.229579+0000","last_peered":"2024-01-25T15:04:33.229579+0000","last_clean":"2024-01-25T15:04:33.229579+0000","last_became_active":"2024-01-25T15:04:27.542362+0000","last_became_peered":"2024-01-25T15:04:27.542362+0000","last_unstale":"2024-01-25T15:04:33.229579+0000","last_undegraded":"2024-01-25T15:04:33.229579+0000","last_fullsized":"2024-01-25T15:04:33.229579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:20:59.655525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517884+0000","last_change":"2024-01-25T15:04:27.540118+0000","last_active":"2024-01-25T15:04:32.517884+0000","last_peered":"2024-01-25T15:04:32.517884+0000","last_clean":"2024-01-25T15:04:32.517884+0000","last_became_active":"2024-01-25T15:04:27.539793+0000","last_became_peered":"2024-01-25T15:04:27.539793+0000","last_unstale":"2024-01-25T15:04:32.517884+0000","last_undegraded":"2024-01-25T15:04:32.517884+0000","last_fullsized":"2024-01-25T15:04:32.517884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:30:17.007992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227778+0000","last_change":"2024-01-25T15:04:27.540459+0000","last_active":"2024-01-25T15:04:33.227778+0000","last_peered":"2024-01-25T15:04:33.227778+0000","last_clean":"2024-01-25T15:04:33.227778+0000","last_became_active":"2024-01-25T15:04:27.540170+0000","last_became_peered":"2024-01-25T15:04:27.540170+0000","last_unstale":"2024-01-25T15:04:33.227778+0000","last_undegraded":"2024-01-25T15:04:33.227778+0000","last_fullsized":"2024-01-25T15:04:33.227778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:29:19.932806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228818+0000","last_change":"2024-01-25T15:04:27.533910+0000","last_active":"2024-01-25T15:04:33.228818+0000","last_peered":"2024-01-25T15:04:33.228818+0000","last_clean":"2024-01-25T15:04:33.228818+0000","last_became_active":"2024-01-25T15:04:27.533483+0000","last_became_peered":"2024-01-25T15:04:27.533483+0000","last_unstale":"2024-01-25T15:04:33.228818+0000","last_undegraded":"2024-01-25T15:04:33.228818+0000","last_fullsized":"2024-01-25T15:04:33.228818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:55:02.405369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228766+0000","last_change":"2024-01-25T15:04:27.539149+0000","last_active":"2024-01-25T15:04:33.228766+0000","last_peered":"2024-01-25T15:04:33.228766+0000","last_clean":"2024-01-25T15:04:33.228766+0000","last_became_active":"2024-01-25T15:04:27.538850+0000","last_became_peered":"2024-01-25T15:04:27.538850+0000","last_unstale":"2024-01-25T15:04:33.228766+0000","last_undegraded":"2024-01-25T15:04:33.228766+0000","last_fullsized":"2024-01-25T15:04:33.228766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:58:29.244789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227771+0000","last_change":"2024-01-25T15:04:27.534907+0000","last_active":"2024-01-25T15:04:33.227771+0000","last_peered":"2024-01-25T15:04:33.227771+0000","last_clean":"2024-01-25T15:04:33.227771+0000","last_became_active":"2024-01-25T15:04:27.534407+0000","last_became_peered":"2024-01-25T15:04:27.534407+0000","last_unstale":"2024-01-25T15:04:33.227771+0000","last_undegraded":"2024-01-25T15:04:33.227771+0000","last_fullsized":"2024-01-25T15:04:33.227771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:45:08.060821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027683+0000","last_change":"2024-01-25T15:04:27.529037+0000","last_active":"2024-01-25T15:04:33.027683+0000","last_peered":"2024-01-25T15:04:33.027683+0000","last_clean":"2024-01-25T15:04:33.027683+0000","last_became_active":"2024-01-25T15:04:27.528713+0000","last_became_peered":"2024-01-25T15:04:27.528713+0000","last_unstale":"2024-01-25T15:04:33.027683+0000","last_undegraded":"2024-01-25T15:04:33.027683+0000","last_fullsized":"2024-01-25T15:04:33.027683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:24:46.429617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188418+0000","last_change":"2024-01-25T15:04:27.531477+0000","last_active":"2024-01-25T15:04:33.188418+0000","last_peered":"2024-01-25T15:04:33.188418+0000","last_clean":"2024-01-25T15:04:33.188418+0000","last_became_active":"2024-01-25T15:04:27.531188+0000","last_became_peered":"2024-01-25T15:04:27.531188+0000","last_unstale":"2024-01-25T15:04:33.188418+0000","last_undegraded":"2024-01-25T15:04:33.188418+0000","last_fullsized":"2024-01-25T15:04:33.188418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:30.257021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229461+0000","last_change":"2024-01-25T15:04:27.541633+0000","last_active":"2024-01-25T15:04:33.229461+0000","last_peered":"2024-01-25T15:04:33.229461+0000","last_clean":"2024-01-25T15:04:33.229461+0000","last_became_active":"2024-01-25T15:04:27.539292+0000","last_became_peered":"2024-01-25T15:04:27.539292+0000","last_unstale":"2024-01-25T15:04:33.229461+0000","last_undegraded":"2024-01-25T15:04:33.229461+0000","last_fullsized":"2024-01-25T15:04:33.229461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:48:49.762254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4498,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.214}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":860160,"data_stored":690798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:04:44.597 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-25T15:04:44.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.732+0000 7f669cfe5640 1 Processor -- start 2024-01-25T15:04:44.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.733+0000 7f669cfe5640 1 -- start start 2024-01-25T15:04:44.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.733+0000 7f669cfe5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f669814eb20 0x7f66980c1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.733+0000 7f669cfe5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f66980c37b0 0x7f669806d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.733+0000 7f669cfe5640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66980c2a80 con 0x7f66980c2140 2024-01-25T15:04:44.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.733+0000 7f669cfe5640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669814ef00 con 0x7f669814eb20 2024-01-25T15:04:44.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.733+0000 7f669cfe5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6698155720 con 0x7f66980c37b0 2024-01-25T15:04:44.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.733+0000 7f6696d9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f66980c2140 0x7f66981513f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54616/0 (socket says 172.21.15.29:54616) 2024-01-25T15:04:44.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.733+0000 7f6696d9d640 1 -- 172.21.15.29:0/2799506106 learned_addr learned my addr 172.21.15.29:0/2799506106 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:44.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f668ffff640 1 --2- 172.21.15.29:0/2799506106 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f66980c37b0 0x7f669806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f669659c640 1 --2- 172.21.15.29:0/2799506106 >> v2:172.21.15.52:3300/0 conn(0x7f669814eb20 0x7f66980c1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f6695d9b640 1 -- 172.21.15.29:0/2799506106 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1877144112 0 0) 0x7f66980c2a80 con 0x7f66980c2140 2024-01-25T15:04:44.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f6695d9b640 1 -- 172.21.15.29:0/2799506106 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6684003520 con 0x7f66980c2140 2024-01-25T15:04:44.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f6695d9b640 1 -- 172.21.15.29:0/2799506106 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 406290828 0 0) 0x7f6684003520 con 0x7f66980c2140 2024-01-25T15:04:44.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f6695d9b640 1 -- 172.21.15.29:0/2799506106 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f66980c37b0 msgr2=0x7f669806d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:44.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f6695d9b640 1 --2- 172.21.15.29:0/2799506106 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f66980c37b0 0x7f669806d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f6695d9b640 1 -- 172.21.15.29:0/2799506106 >> v2:172.21.15.52:3300/0 conn(0x7f669814eb20 msgr2=0x7f66980c1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:44.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f6695d9b640 1 --2- 172.21.15.29:0/2799506106 >> v2:172.21.15.52:3300/0 conn(0x7f669814eb20 0x7f66980c1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f6695d9b640 1 -- 172.21.15.29:0/2799506106 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66980c2cd0 con 0x7f66980c2140 2024-01-25T15:04:44.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f6695d9b640 1 -- 172.21.15.29:0/2799506106 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f66900019f0 con 0x7f66980c2140 2024-01-25T15:04:44.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f6695d9b640 1 -- 172.21.15.29:0/2799506106 >> v1:172.21.15.29:6789/0 conn(0x7f66980c2140 legacy=0x7f66981513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f6695d9b640 1 --2- 172.21.15.29:0/2799506106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6684003970 0x7f6684003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f6695d9b640 1 --2- 172.21.15.29:0/2799506106 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66840047c0 0x7f6684004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f6695d9b640 1 --2- 172.21.15.29:0/2799506106 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f66980c37b0 0x7f6684005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f6695d9b640 1 -- 172.21.15.29:0/2799506106 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6698155720 con 0x7f66840047c0 2024-01-25T15:04:44.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f6695d9b640 1 -- 172.21.15.29:0/2799506106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668400db90 con 0x7f6684003970 2024-01-25T15:04:44.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f6695d9b640 1 -- 172.21.15.29:0/2799506106 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668400dcd0 con 0x7f66980c37b0 2024-01-25T15:04:44.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f668ffff640 1 --2- 172.21.15.29:0/2799506106 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66840047c0 0x7f6684004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f669659c640 1 --2- 172.21.15.29:0/2799506106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6684003970 0x7f6684003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f6696d9d640 1 --2- 172.21.15.29:0/2799506106 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f66980c37b0 0x7f6684005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f668ffff640 1 -- 172.21.15.29:0/2799506106 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f66980c37b0 msgr2=0x7f6684005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:44.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f668ffff640 1 --2- 172.21.15.29:0/2799506106 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f66980c37b0 0x7f6684005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f668ffff640 1 -- 172.21.15.29:0/2799506106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6684003970 msgr2=0x7f6684003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:44.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f668ffff640 1 --2- 172.21.15.29:0/2799506106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6684003970 0x7f6684003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.734+0000 7f668ffff640 1 -- 172.21.15.29:0/2799506106 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6684003520 con 0x7f66840047c0 2024-01-25T15:04:44.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.735+0000 7f668ffff640 1 --2- 172.21.15.29:0/2799506106 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66840047c0 0x7f6684004c40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6680009ac0 tx=0x7f66840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d607be305493378d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:44.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.735+0000 7f6695d9b640 1 -- 172.21.15.29:0/2799506106 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668002c6b0 con 0x7f66840047c0 2024-01-25T15:04:44.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.735+0000 7f6695d9b640 1 -- 172.21.15.29:0/2799506106 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668002c810 con 0x7f66840047c0 2024-01-25T15:04:44.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.735+0000 7f6695d9b640 1 -- 172.21.15.29:0/2799506106 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668002cba0 con 0x7f66840047c0 2024-01-25T15:04:44.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.736+0000 7f669cfe5640 1 -- 172.21.15.29:0/2799506106 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66840047c0 msgr2=0x7f6684004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.736+0000 7f669cfe5640 1 --2- 172.21.15.29:0/2799506106 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66840047c0 0x7f6684004c40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6680009ac0 tx=0x7f66840057f0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.736+0000 7f6696d9d640 1 -- 172.21.15.29:0/2799506106 reap_dead start 2024-01-25T15:04:44.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.736+0000 7f669cfe5640 1 -- 172.21.15.29:0/2799506106 shutdown_connections 2024-01-25T15:04:44.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.736+0000 7f669cfe5640 1 -- 172.21.15.29:0/2799506106 >> 172.21.15.29:0/2799506106 conn(0x7f66980a8be0 msgr2=0x7f669806a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:44.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.736+0000 7f669cfe5640 1 -- 172.21.15.29:0/2799506106 shutdown_connections 2024-01-25T15:04:44.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.736+0000 7f669cfe5640 1 -- 172.21.15.29:0/2799506106 wait complete. 2024-01-25T15:04:44.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.737+0000 7f669cfe5640 1 Processor -- start 2024-01-25T15:04:44.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.737+0000 7f669cfe5640 1 -- start start 2024-01-25T15:04:44.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.738+0000 7f669cfe5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66840047c0 0x7f6698141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.738+0000 7f669cfe5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66981ecdb0 0x7f6698153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.738+0000 7f669cfe5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6698141f90 0x7f66981e9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.738+0000 7f669cfe5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66981eddc0 con 0x7f66840047c0 2024-01-25T15:04:44.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.738+0000 7f669cfe5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66981e97c0 con 0x7f66981ecdb0 2024-01-25T15:04:44.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.738+0000 7f669cfe5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66980bdd40 con 0x7f6698141f90 2024-01-25T15:04:44.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.738+0000 7f669659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66840047c0 0x7f6698141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.738+0000 7f669659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66840047c0 0x7f6698141a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36268/0 (socket says 172.21.15.29:36268) 2024-01-25T15:04:44.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.738+0000 7f669659c640 1 -- 172.21.15.29:0/1931520458 learned_addr learned my addr 172.21.15.29:0/1931520458 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:44.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.738+0000 7f6696d9d640 1 --2- 172.21.15.29:0/1931520458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6698141f90 0x7f66981e9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.738+0000 7f668ffff640 1 --2- 172.21.15.29:0/1931520458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66981ecdb0 0x7f6698153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.738+0000 7f669659c640 1 -- 172.21.15.29:0/1931520458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6698141f90 msgr2=0x7f66981e9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.738+0000 7f669659c640 1 --2- 172.21.15.29:0/1931520458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6698141f90 0x7f66981e9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.738+0000 7f669659c640 1 -- 172.21.15.29:0/1931520458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66981ecdb0 msgr2=0x7f6698153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.738+0000 7f669659c640 1 --2- 172.21.15.29:0/1931520458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66981ecdb0 0x7f6698153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.738+0000 7f669659c640 1 -- 172.21.15.29:0/1931520458 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66981ed240 con 0x7f66840047c0 2024-01-25T15:04:44.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.738+0000 7f668ffff640 1 --2- 172.21.15.29:0/1931520458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66981ecdb0 0x7f6698153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:44.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.739+0000 7f669659c640 1 --2- 172.21.15.29:0/1931520458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66840047c0 0x7f6698141a50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6688011960 tx=0x7f6688011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:44.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.739+0000 7f668effd640 1 -- 172.21.15.29:0/1931520458 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668800faf0 con 0x7f66840047c0 2024-01-25T15:04:44.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.739+0000 7f668effd640 1 -- 172.21.15.29:0/1931520458 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668800fc50 con 0x7f66840047c0 2024-01-25T15:04:44.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.739+0000 7f669cfe5640 1 -- 172.21.15.29:0/1931520458 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66981ed520 con 0x7f66840047c0 2024-01-25T15:04:44.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.739+0000 7f668effd640 1 -- 172.21.15.29:0/1931520458 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6688014440 con 0x7f66840047c0 2024-01-25T15:04:44.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.739+0000 7f669cfe5640 1 -- 172.21.15.29:0/1931520458 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66981edae0 con 0x7f66840047c0 2024-01-25T15:04:44.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.740+0000 7f669cfe5640 1 -- 172.21.15.29:0/1931520458 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6698074080 con 0x7f66840047c0 2024-01-25T15:04:44.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.740+0000 7f668effd640 1 -- 172.21.15.29:0/1931520458 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f668801d400 con 0x7f66840047c0 2024-01-25T15:04:44.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.740+0000 7f668effd640 1 --2- 172.21.15.29:0/1931520458 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f667806aed0 0x7f667806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.740+0000 7f668effd640 1 -- 172.21.15.29:0/1931520458 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f668808a200 con 0x7f66840047c0 2024-01-25T15:04:44.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.741+0000 7f668ffff640 1 --2- 172.21.15.29:0/1931520458 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f667806aed0 0x7f667806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.741+0000 7f668ffff640 1 --2- 172.21.15.29:0/1931520458 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f667806aed0 0x7f667806d390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6680036000 tx=0x7f6680030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:44.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.745+0000 7f668effd640 1 -- 172.21.15.29:0/1931520458 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6688054dd0 con 0x7f66840047c0 2024-01-25T15:04:44.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.921+0000 7f669cfe5640 1 -- 172.21.15.29:0/1931520458 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f66981553b0 con 0x7f667806aed0 2024-01-25T15:04:44.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.930+0000 7f668effd640 1 -- 172.21.15.29:0/1931520458 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345257 (secure 0 0 0) 0x7f66800040c0 con 0x7f667806aed0 2024-01-25T15:04:44.935 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:44.937 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-25T15:04:44.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.933+0000 7f669cfe5640 1 -- 172.21.15.29:0/1931520458 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f667806aed0 msgr2=0x7f667806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.933+0000 7f669cfe5640 1 --2- 172.21.15.29:0/1931520458 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f667806aed0 0x7f667806d390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6680036000 tx=0x7f6680030000 comp rx=0 tx=0).stop 2024-01-25T15:04:44.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.933+0000 7f669cfe5640 1 -- 172.21.15.29:0/1931520458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66840047c0 msgr2=0x7f6698141a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.933+0000 7f669cfe5640 1 --2- 172.21.15.29:0/1931520458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66840047c0 0x7f6698141a50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6688011960 tx=0x7f6688011e20 comp rx=0 tx=0).stop 2024-01-25T15:04:44.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.933+0000 7f669cfe5640 1 -- 172.21.15.29:0/1931520458 shutdown_connections 2024-01-25T15:04:44.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.933+0000 7f669cfe5640 1 --2- 172.21.15.29:0/1931520458 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6698141f90 0x7f66981e9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.934+0000 7f669cfe5640 1 --2- 172.21.15.29:0/1931520458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66981ecdb0 0x7f6698153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.934+0000 7f669cfe5640 1 --2- 172.21.15.29:0/1931520458 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f667806aed0 0x7f667806d390 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.934+0000 7f669cfe5640 1 --2- 172.21.15.29:0/1931520458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66840047c0 0x7f6698141a50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.934+0000 7f669cfe5640 1 -- 172.21.15.29:0/1931520458 >> 172.21.15.29:0/1931520458 conn(0x7f66980a8be0 msgr2=0x7f669814df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:44.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.934+0000 7f669cfe5640 1 -- 172.21.15.29:0/1931520458 shutdown_connections 2024-01-25T15:04:44.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:44.934+0000 7f669cfe5640 1 -- 172.21.15.29:0/1931520458 wait complete. 2024-01-25T15:04:44.945 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-01-25T15:04:44.919494+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248496,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754726224,"statfs":{"total":773094113280,"available":772839653376,"internally_reserved":0,"allocated":3284992,"data_stored":1988350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003227"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027891+0000","last_change":"2024-01-25T15:04:26.549355+0000","last_active":"2024-01-25T15:04:33.027891+0000","last_peered":"2024-01-25T15:04:33.027891+0000","last_clean":"2024-01-25T15:04:33.027891+0000","last_became_active":"2024-01-25T15:04:26.549068+0000","last_became_peered":"2024-01-25T15:04:26.549068+0000","last_unstale":"2024-01-25T15:04:33.027891+0000","last_undegraded":"2024-01-25T15:04:33.027891+0000","last_fullsized":"2024-01-25T15:04:33.027891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:30:22.770050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518335+0000","last_change":"2024-01-25T15:04:27.536360+0000","last_active":"2024-01-25T15:04:32.518335+0000","last_peered":"2024-01-25T15:04:32.518335+0000","last_clean":"2024-01-25T15:04:32.518335+0000","last_became_active":"2024-01-25T15:04:27.534273+0000","last_became_peered":"2024-01-25T15:04:27.534273+0000","last_unstale":"2024-01-25T15:04:32.518335+0000","last_undegraded":"2024-01-25T15:04:32.518335+0000","last_fullsized":"2024-01-25T15:04:32.518335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:47:59.032295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517804+0000","last_change":"2024-01-25T15:04:31.803406+0000","last_active":"2024-01-25T15:04:32.517804+0000","last_peered":"2024-01-25T15:04:32.517804+0000","last_clean":"2024-01-25T15:04:32.517804+0000","last_became_active":"2024-01-25T15:04:31.803079+0000","last_became_peered":"2024-01-25T15:04:31.803079+0000","last_unstale":"2024-01-25T15:04:32.517804+0000","last_undegraded":"2024-01-25T15:04:32.517804+0000","last_fullsized":"2024-01-25T15:04:32.517804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:25:43.747285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518611+0000","last_change":"2024-01-25T15:04:26.545449+0000","last_active":"2024-01-25T15:04:32.518611+0000","last_peered":"2024-01-25T15:04:32.518611+0000","last_clean":"2024-01-25T15:04:32.518611+0000","last_became_active":"2024-01-25T15:04:26.545144+0000","last_became_peered":"2024-01-25T15:04:26.545144+0000","last_unstale":"2024-01-25T15:04:32.518611+0000","last_undegraded":"2024-01-25T15:04:32.518611+0000","last_fullsized":"2024-01-25T15:04:32.518611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:56:52.022913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027714+0000","last_change":"2024-01-25T15:04:27.523808+0000","last_active":"2024-01-25T15:04:33.027714+0000","last_peered":"2024-01-25T15:04:33.027714+0000","last_clean":"2024-01-25T15:04:33.027714+0000","last_became_active":"2024-01-25T15:04:27.523173+0000","last_became_peered":"2024-01-25T15:04:27.523173+0000","last_unstale":"2024-01-25T15:04:33.027714+0000","last_undegraded":"2024-01-25T15:04:33.027714+0000","last_fullsized":"2024-01-25T15:04:33.027714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:30.257021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227919+0000","last_change":"2024-01-25T15:04:31.589158+0000","last_active":"2024-01-25T15:04:33.227919+0000","last_peered":"2024-01-25T15:04:33.227919+0000","last_clean":"2024-01-25T15:04:33.227919+0000","last_became_active":"2024-01-25T15:04:31.588664+0000","last_became_peered":"2024-01-25T15:04:31.588664+0000","last_unstale":"2024-01-25T15:04:33.227919+0000","last_undegraded":"2024-01-25T15:04:33.227919+0000","last_fullsized":"2024-01-25T15:04:33.227919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:34.289728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228764+0000","last_change":"2024-01-25T15:04:26.548904+0000","last_active":"2024-01-25T15:04:33.228764+0000","last_peered":"2024-01-25T15:04:33.228764+0000","last_clean":"2024-01-25T15:04:33.228764+0000","last_became_active":"2024-01-25T15:04:26.548603+0000","last_became_peered":"2024-01-25T15:04:26.548603+0000","last_unstale":"2024-01-25T15:04:33.228764+0000","last_undegraded":"2024-01-25T15:04:33.228764+0000","last_fullsized":"2024-01-25T15:04:33.228764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:04:15.478889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227876+0000","last_change":"2024-01-25T15:04:27.524924+0000","last_active":"2024-01-25T15:04:33.227876+0000","last_peered":"2024-01-25T15:04:33.227876+0000","last_clean":"2024-01-25T15:04:33.227876+0000","last_became_active":"2024-01-25T15:04:27.524657+0000","last_became_peered":"2024-01-25T15:04:27.524657+0000","last_unstale":"2024-01-25T15:04:33.227876+0000","last_undegraded":"2024-01-25T15:04:33.227876+0000","last_fullsized":"2024-01-25T15:04:33.227876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:13:43.582651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228255+0000","last_change":"2024-01-25T15:04:31.589682+0000","last_active":"2024-01-25T15:04:33.228255+0000","last_peered":"2024-01-25T15:04:33.228255+0000","last_clean":"2024-01-25T15:04:33.228255+0000","last_became_active":"2024-01-25T15:04:31.589163+0000","last_became_peered":"2024-01-25T15:04:31.589163+0000","last_unstale":"2024-01-25T15:04:33.228255+0000","last_undegraded":"2024-01-25T15:04:33.228255+0000","last_fullsized":"2024-01-25T15:04:33.228255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:48:03.065003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228571+0000","last_change":"2024-01-25T15:04:26.550079+0000","last_active":"2024-01-25T15:04:33.228571+0000","last_peered":"2024-01-25T15:04:33.228571+0000","last_clean":"2024-01-25T15:04:33.228571+0000","last_became_active":"2024-01-25T15:04:26.549674+0000","last_became_peered":"2024-01-25T15:04:26.549674+0000","last_unstale":"2024-01-25T15:04:33.228571+0000","last_undegraded":"2024-01-25T15:04:33.228571+0000","last_fullsized":"2024-01-25T15:04:33.228571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:08:52.043568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228692+0000","last_change":"2024-01-25T15:04:27.523220+0000","last_active":"2024-01-25T15:04:33.228692+0000","last_peered":"2024-01-25T15:04:33.228692+0000","last_clean":"2024-01-25T15:04:33.228692+0000","last_became_active":"2024-01-25T15:04:27.522900+0000","last_became_peered":"2024-01-25T15:04:27.522900+0000","last_unstale":"2024-01-25T15:04:33.228692+0000","last_undegraded":"2024-01-25T15:04:33.228692+0000","last_fullsized":"2024-01-25T15:04:33.228692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:29:19.932806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228034+0000","last_change":"2024-01-25T15:04:31.582261+0000","last_active":"2024-01-25T15:04:33.228034+0000","last_peered":"2024-01-25T15:04:33.228034+0000","last_clean":"2024-01-25T15:04:33.228034+0000","last_became_active":"2024-01-25T15:04:31.581830+0000","last_became_peered":"2024-01-25T15:04:31.581830+0000","last_unstale":"2024-01-25T15:04:33.228034+0000","last_undegraded":"2024-01-25T15:04:33.228034+0000","last_fullsized":"2024-01-25T15:04:33.228034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:45:12.093528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518616+0000","last_change":"2024-01-25T15:04:27.528164+0000","last_active":"2024-01-25T15:04:32.518616+0000","last_peered":"2024-01-25T15:04:32.518616+0000","last_clean":"2024-01-25T15:04:32.518616+0000","last_became_active":"2024-01-25T15:04:27.527873+0000","last_became_peered":"2024-01-25T15:04:27.527873+0000","last_unstale":"2024-01-25T15:04:32.518616+0000","last_undegraded":"2024-01-25T15:04:32.518616+0000","last_fullsized":"2024-01-25T15:04:32.518616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:30:17.007992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229067+0000","last_change":"2024-01-25T15:04:26.552160+0000","last_active":"2024-01-25T15:04:33.229067+0000","last_peered":"2024-01-25T15:04:33.229067+0000","last_clean":"2024-01-25T15:04:33.229067+0000","last_became_active":"2024-01-25T15:04:26.551735+0000","last_became_peered":"2024-01-25T15:04:26.551735+0000","last_unstale":"2024-01-25T15:04:33.229067+0000","last_undegraded":"2024-01-25T15:04:33.229067+0000","last_fullsized":"2024-01-25T15:04:33.229067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:04:56.733153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229250+0000","last_change":"2024-01-25T15:04:31.589097+0000","last_active":"2024-01-25T15:04:33.229250+0000","last_peered":"2024-01-25T15:04:33.229250+0000","last_clean":"2024-01-25T15:04:33.229250+0000","last_became_active":"2024-01-25T15:04:31.588673+0000","last_became_peered":"2024-01-25T15:04:31.588673+0000","last_unstale":"2024-01-25T15:04:33.229250+0000","last_undegraded":"2024-01-25T15:04:33.229250+0000","last_fullsized":"2024-01-25T15:04:33.229250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:58:33.277497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518113+0000","last_change":"2024-01-25T15:04:27.537840+0000","last_active":"2024-01-25T15:04:32.518113+0000","last_peered":"2024-01-25T15:04:32.518113+0000","last_clean":"2024-01-25T15:04:32.518113+0000","last_became_active":"2024-01-25T15:04:27.537456+0000","last_became_peered":"2024-01-25T15:04:27.537456+0000","last_unstale":"2024-01-25T15:04:32.518113+0000","last_undegraded":"2024-01-25T15:04:32.518113+0000","last_fullsized":"2024-01-25T15:04:32.518113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:45:08.060821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188403+0000","last_change":"2024-01-25T15:04:26.548251+0000","last_active":"2024-01-25T15:04:33.188403+0000","last_peered":"2024-01-25T15:04:33.188403+0000","last_clean":"2024-01-25T15:04:33.188403+0000","last_became_active":"2024-01-25T15:04:26.547939+0000","last_became_peered":"2024-01-25T15:04:26.547939+0000","last_unstale":"2024-01-25T15:04:33.188403+0000","last_undegraded":"2024-01-25T15:04:33.188403+0000","last_fullsized":"2024-01-25T15:04:33.188403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:04:56.733153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228362+0000","last_change":"2024-01-25T15:04:31.590194+0000","last_active":"2024-01-25T15:04:33.228362+0000","last_peered":"2024-01-25T15:04:33.228362+0000","last_clean":"2024-01-25T15:04:33.228362+0000","last_became_active":"2024-01-25T15:04:31.589755+0000","last_became_peered":"2024-01-25T15:04:31.589755+0000","last_unstale":"2024-01-25T15:04:33.228362+0000","last_undegraded":"2024-01-25T15:04:33.228362+0000","last_fullsized":"2024-01-25T15:04:33.228362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:13:47.615358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518097+0000","last_change":"2024-01-25T15:04:27.529881+0000","last_active":"2024-01-25T15:04:32.518097+0000","last_peered":"2024-01-25T15:04:32.518097+0000","last_clean":"2024-01-25T15:04:32.518097+0000","last_became_active":"2024-01-25T15:04:27.529347+0000","last_became_peered":"2024-01-25T15:04:27.529347+0000","last_unstale":"2024-01-25T15:04:32.518097+0000","last_undegraded":"2024-01-25T15:04:32.518097+0000","last_fullsized":"2024-01-25T15:04:32.518097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:19:41.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188030+0000","last_change":"2024-01-25T15:04:26.549223+0000","last_active":"2024-01-25T15:04:33.188030+0000","last_peered":"2024-01-25T15:04:33.188030+0000","last_clean":"2024-01-25T15:04:33.188030+0000","last_became_active":"2024-01-25T15:04:26.548915+0000","last_became_peered":"2024-01-25T15:04:26.548915+0000","last_unstale":"2024-01-25T15:04:33.188030+0000","last_undegraded":"2024-01-25T15:04:33.188030+0000","last_fullsized":"2024-01-25T15:04:33.188030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:08:52.043568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188626+0000","last_change":"2024-01-25T15:04:31.801159+0000","last_active":"2024-01-25T15:04:33.188626+0000","last_peered":"2024-01-25T15:04:33.188626+0000","last_clean":"2024-01-25T15:04:33.188626+0000","last_became_active":"2024-01-25T15:04:31.800733+0000","last_became_peered":"2024-01-25T15:04:31.800733+0000","last_unstale":"2024-01-25T15:04:33.188626+0000","last_undegraded":"2024-01-25T15:04:33.188626+0000","last_fullsized":"2024-01-25T15:04:33.188626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:58:07.965682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229691+0000","last_change":"2024-01-25T15:04:27.529655+0000","last_active":"2024-01-25T15:04:33.229691+0000","last_peered":"2024-01-25T15:04:33.229691+0000","last_clean":"2024-01-25T15:04:33.229691+0000","last_became_active":"2024-01-25T15:04:27.529390+0000","last_became_peered":"2024-01-25T15:04:27.529390+0000","last_unstale":"2024-01-25T15:04:33.229691+0000","last_undegraded":"2024-01-25T15:04:33.229691+0000","last_fullsized":"2024-01-25T15:04:33.229691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:15:45.949448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227503+0000","last_change":"2024-01-25T15:04:26.548483+0000","last_active":"2024-01-25T15:04:33.227503+0000","last_peered":"2024-01-25T15:04:33.227503+0000","last_clean":"2024-01-25T15:04:33.227503+0000","last_became_active":"2024-01-25T15:04:26.548215+0000","last_became_peered":"2024-01-25T15:04:26.548215+0000","last_unstale":"2024-01-25T15:04:33.227503+0000","last_undegraded":"2024-01-25T15:04:33.227503+0000","last_fullsized":"2024-01-25T15:04:33.227503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:17:49.229771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228793+0000","last_change":"2024-01-25T15:04:31.588835+0000","last_active":"2024-01-25T15:04:33.228793+0000","last_peered":"2024-01-25T15:04:33.228793+0000","last_clean":"2024-01-25T15:04:33.228793+0000","last_became_active":"2024-01-25T15:04:31.588379+0000","last_became_peered":"2024-01-25T15:04:31.588379+0000","last_unstale":"2024-01-25T15:04:33.228793+0000","last_undegraded":"2024-01-25T15:04:33.228793+0000","last_fullsized":"2024-01-25T15:04:33.228793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:07:22.654442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.028081+0000","last_change":"2024-01-25T15:04:27.526537+0000","last_active":"2024-01-25T15:04:33.028081+0000","last_peered":"2024-01-25T15:04:33.028081+0000","last_clean":"2024-01-25T15:04:33.028081+0000","last_became_active":"2024-01-25T15:04:27.526228+0000","last_became_peered":"2024-01-25T15:04:27.526228+0000","last_unstale":"2024-01-25T15:04:33.028081+0000","last_undegraded":"2024-01-25T15:04:33.028081+0000","last_fullsized":"2024-01-25T15:04:33.028081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:30:17.007992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519264+0000","last_change":"2024-01-25T15:04:26.548972+0000","last_active":"2024-01-25T15:04:32.519264+0000","last_peered":"2024-01-25T15:04:32.519264+0000","last_clean":"2024-01-25T15:04:32.519264+0000","last_became_active":"2024-01-25T15:04:26.548698+0000","last_became_peered":"2024-01-25T15:04:26.548698+0000","last_unstale":"2024-01-25T15:04:32.519264+0000","last_undegraded":"2024-01-25T15:04:32.519264+0000","last_fullsized":"2024-01-25T15:04:32.519264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:04:56.733153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229547+0000","last_change":"2024-01-25T15:04:31.802696+0000","last_active":"2024-01-25T15:04:33.229547+0000","last_peered":"2024-01-25T15:04:33.229547+0000","last_clean":"2024-01-25T15:04:33.229547+0000","last_became_active":"2024-01-25T15:04:31.802303+0000","last_became_peered":"2024-01-25T15:04:31.802303+0000","last_unstale":"2024-01-25T15:04:33.229547+0000","last_undegraded":"2024-01-25T15:04:33.229547+0000","last_fullsized":"2024-01-25T15:04:33.229547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:47:52.136422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518826+0000","last_change":"2024-01-25T15:04:27.539946+0000","last_active":"2024-01-25T15:04:32.518826+0000","last_peered":"2024-01-25T15:04:32.518826+0000","last_clean":"2024-01-25T15:04:32.518826+0000","last_became_active":"2024-01-25T15:04:27.539623+0000","last_became_peered":"2024-01-25T15:04:27.539623+0000","last_unstale":"2024-01-25T15:04:32.518826+0000","last_undegraded":"2024-01-25T15:04:32.518826+0000","last_fullsized":"2024-01-25T15:04:32.518826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:07:18.621735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188491+0000","last_change":"2024-01-25T15:04:26.545936+0000","last_active":"2024-01-25T15:04:33.188491+0000","last_peered":"2024-01-25T15:04:33.188491+0000","last_clean":"2024-01-25T15:04:33.188491+0000","last_became_active":"2024-01-25T15:04:26.545607+0000","last_became_peered":"2024-01-25T15:04:26.545607+0000","last_unstale":"2024-01-25T15:04:33.188491+0000","last_undegraded":"2024-01-25T15:04:33.188491+0000","last_fullsized":"2024-01-25T15:04:33.188491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:15:44.944688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517706+0000","last_change":"2024-01-25T15:04:31.804100+0000","last_active":"2024-01-25T15:04:32.517706+0000","last_peered":"2024-01-25T15:04:32.517706+0000","last_clean":"2024-01-25T15:04:32.517706+0000","last_became_active":"2024-01-25T15:04:31.803678+0000","last_became_peered":"2024-01-25T15:04:31.803678+0000","last_unstale":"2024-01-25T15:04:32.517706+0000","last_undegraded":"2024-01-25T15:04:32.517706+0000","last_fullsized":"2024-01-25T15:04:32.517706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:41:20.297981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188527+0000","last_change":"2024-01-25T15:04:27.530931+0000","last_active":"2024-01-25T15:04:33.188527+0000","last_peered":"2024-01-25T15:04:33.188527+0000","last_clean":"2024-01-25T15:04:33.188527+0000","last_became_active":"2024-01-25T15:04:27.530621+0000","last_became_peered":"2024-01-25T15:04:27.530621+0000","last_unstale":"2024-01-25T15:04:33.188527+0000","last_undegraded":"2024-01-25T15:04:33.188527+0000","last_fullsized":"2024-01-25T15:04:33.188527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:19:41.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228955+0000","last_change":"2024-01-25T15:04:26.548270+0000","last_active":"2024-01-25T15:04:33.228955+0000","last_peered":"2024-01-25T15:04:33.228955+0000","last_clean":"2024-01-25T15:04:33.228955+0000","last_became_active":"2024-01-25T15:04:26.547977+0000","last_became_peered":"2024-01-25T15:04:26.547977+0000","last_unstale":"2024-01-25T15:04:33.228955+0000","last_undegraded":"2024-01-25T15:04:33.228955+0000","last_fullsized":"2024-01-25T15:04:33.228955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:40:17.099358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027687+0000","last_change":"2024-01-25T15:04:31.800974+0000","last_active":"2024-01-25T15:04:33.027687+0000","last_peered":"2024-01-25T15:04:33.027687+0000","last_clean":"2024-01-25T15:04:33.027687+0000","last_became_active":"2024-01-25T15:04:31.800562+0000","last_became_peered":"2024-01-25T15:04:31.800562+0000","last_unstale":"2024-01-25T15:04:33.027687+0000","last_undegraded":"2024-01-25T15:04:33.027687+0000","last_fullsized":"2024-01-25T15:04:33.027687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:55:06.438077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228790+0000","last_change":"2024-01-25T15:04:27.531901+0000","last_active":"2024-01-25T15:04:33.228790+0000","last_peered":"2024-01-25T15:04:33.228790+0000","last_clean":"2024-01-25T15:04:33.228790+0000","last_became_active":"2024-01-25T15:04:27.531519+0000","last_became_peered":"2024-01-25T15:04:27.531519+0000","last_unstale":"2024-01-25T15:04:33.228790+0000","last_undegraded":"2024-01-25T15:04:33.228790+0000","last_fullsized":"2024-01-25T15:04:33.228790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:47:48.103715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188610+0000","last_change":"2024-01-25T15:04:26.544391+0000","last_active":"2024-01-25T15:04:33.188610+0000","last_peered":"2024-01-25T15:04:33.188610+0000","last_clean":"2024-01-25T15:04:33.188610+0000","last_became_active":"2024-01-25T15:04:26.544092+0000","last_became_peered":"2024-01-25T15:04:26.544092+0000","last_unstale":"2024-01-25T15:04:33.188610+0000","last_undegraded":"2024-01-25T15:04:33.188610+0000","last_fullsized":"2024-01-25T15:04:33.188610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:17:49.229771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188192+0000","last_change":"2024-01-25T15:04:31.588590+0000","last_active":"2024-01-25T15:04:33.188192+0000","last_peered":"2024-01-25T15:04:33.188192+0000","last_clean":"2024-01-25T15:04:33.188192+0000","last_became_active":"2024-01-25T15:04:31.588221+0000","last_became_peered":"2024-01-25T15:04:31.588221+0000","last_unstale":"2024-01-25T15:04:33.188192+0000","last_undegraded":"2024-01-25T15:04:33.188192+0000","last_fullsized":"2024-01-25T15:04:33.188192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:04.647058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229204+0000","last_change":"2024-01-25T15:04:27.535794+0000","last_active":"2024-01-25T15:04:33.229204+0000","last_peered":"2024-01-25T15:04:33.229204+0000","last_clean":"2024-01-25T15:04:33.229204+0000","last_became_active":"2024-01-25T15:04:27.535528+0000","last_became_peered":"2024-01-25T15:04:27.535528+0000","last_unstale":"2024-01-25T15:04:33.229204+0000","last_undegraded":"2024-01-25T15:04:33.229204+0000","last_fullsized":"2024-01-25T15:04:33.229204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:04:57.737913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229149+0000","last_change":"2024-01-25T15:04:26.543493+0000","last_active":"2024-01-25T15:04:33.229149+0000","last_peered":"2024-01-25T15:04:33.229149+0000","last_clean":"2024-01-25T15:04:33.229149+0000","last_became_active":"2024-01-25T15:04:26.543214+0000","last_became_peered":"2024-01-25T15:04:26.543214+0000","last_unstale":"2024-01-25T15:04:33.229149+0000","last_undegraded":"2024-01-25T15:04:33.229149+0000","last_fullsized":"2024-01-25T15:04:33.229149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:56:52.022913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188481+0000","last_change":"2024-01-25T15:04:31.589300+0000","last_active":"2024-01-25T15:04:33.188481+0000","last_peered":"2024-01-25T15:04:33.188481+0000","last_clean":"2024-01-25T15:04:33.188481+0000","last_became_active":"2024-01-25T15:04:31.588325+0000","last_became_peered":"2024-01-25T15:04:31.588325+0000","last_unstale":"2024-01-25T15:04:33.188481+0000","last_undegraded":"2024-01-25T15:04:33.188481+0000","last_fullsized":"2024-01-25T15:04:33.188481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:55:06.438077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.187995+0000","last_change":"2024-01-25T15:04:27.530775+0000","last_active":"2024-01-25T15:04:33.187995+0000","last_peered":"2024-01-25T15:04:33.187995+0000","last_clean":"2024-01-25T15:04:33.187995+0000","last_became_active":"2024-01-25T15:04:27.530457+0000","last_became_peered":"2024-01-25T15:04:27.530457+0000","last_unstale":"2024-01-25T15:04:33.187995+0000","last_undegraded":"2024-01-25T15:04:33.187995+0000","last_fullsized":"2024-01-25T15:04:33.187995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:30:17.007992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519122+0000","last_change":"2024-01-25T15:04:26.542850+0000","last_active":"2024-01-25T15:04:32.519122+0000","last_peered":"2024-01-25T15:04:32.519122+0000","last_clean":"2024-01-25T15:04:32.519122+0000","last_became_active":"2024-01-25T15:04:26.542553+0000","last_became_peered":"2024-01-25T15:04:26.542553+0000","last_unstale":"2024-01-25T15:04:32.519122+0000","last_undegraded":"2024-01-25T15:04:32.519122+0000","last_fullsized":"2024-01-25T15:04:32.519122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:00:16.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188633+0000","last_change":"2024-01-25T15:04:31.587087+0000","last_active":"2024-01-25T15:04:33.188633+0000","last_peered":"2024-01-25T15:04:33.188633+0000","last_clean":"2024-01-25T15:04:33.188633+0000","last_became_active":"2024-01-25T15:04:31.586473+0000","last_became_peered":"2024-01-25T15:04:31.586473+0000","last_unstale":"2024-01-25T15:04:33.188633+0000","last_undegraded":"2024-01-25T15:04:33.188633+0000","last_fullsized":"2024-01-25T15:04:33.188633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:48:53.794961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027426+0000","last_change":"2024-01-25T15:04:27.523437+0000","last_active":"2024-01-25T15:04:33.027426+0000","last_peered":"2024-01-25T15:04:33.027426+0000","last_clean":"2024-01-25T15:04:33.027426+0000","last_became_active":"2024-01-25T15:04:27.523120+0000","last_became_peered":"2024-01-25T15:04:27.523120+0000","last_unstale":"2024-01-25T15:04:33.027426+0000","last_undegraded":"2024-01-25T15:04:33.027426+0000","last_fullsized":"2024-01-25T15:04:33.027426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:55:39.574847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227614+0000","last_change":"2024-01-25T15:04:26.548357+0000","last_active":"2024-01-25T15:04:33.227614+0000","last_peered":"2024-01-25T15:04:33.227614+0000","last_clean":"2024-01-25T15:04:33.227614+0000","last_became_active":"2024-01-25T15:04:26.548083+0000","last_became_peered":"2024-01-25T15:04:26.548083+0000","last_unstale":"2024-01-25T15:04:33.227614+0000","last_undegraded":"2024-01-25T15:04:33.227614+0000","last_fullsized":"2024-01-25T15:04:33.227614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:15:44.944688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.028012+0000","last_change":"2024-01-25T15:04:31.802800+0000","last_active":"2024-01-25T15:04:33.028012+0000","last_peered":"2024-01-25T15:04:33.028012+0000","last_clean":"2024-01-25T15:04:33.028012+0000","last_became_active":"2024-01-25T15:04:31.802424+0000","last_became_peered":"2024-01-25T15:04:31.802424+0000","last_unstale":"2024-01-25T15:04:33.028012+0000","last_undegraded":"2024-01-25T15:04:33.028012+0000","last_fullsized":"2024-01-25T15:04:33.028012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:21:03.688233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517912+0000","last_change":"2024-01-25T15:04:27.540477+0000","last_active":"2024-01-25T15:04:32.517912+0000","last_peered":"2024-01-25T15:04:32.517912+0000","last_clean":"2024-01-25T15:04:32.517912+0000","last_became_active":"2024-01-25T15:04:27.539902+0000","last_became_peered":"2024-01-25T15:04:27.539902+0000","last_unstale":"2024-01-25T15:04:32.517912+0000","last_undegraded":"2024-01-25T15:04:32.517912+0000","last_fullsized":"2024-01-25T15:04:32.517912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:58:29.244789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228206+0000","last_change":"2024-01-25T15:04:26.552279+0000","last_active":"2024-01-25T15:04:33.228206+0000","last_peered":"2024-01-25T15:04:33.228206+0000","last_clean":"2024-01-25T15:04:33.228206+0000","last_became_active":"2024-01-25T15:04:26.552022+0000","last_became_peered":"2024-01-25T15:04:26.552022+0000","last_unstale":"2024-01-25T15:04:33.228206+0000","last_undegraded":"2024-01-25T15:04:33.228206+0000","last_fullsized":"2024-01-25T15:04:33.228206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:30:22.770050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227688+0000","last_change":"2024-01-25T15:04:16.181635+0000","last_active":"2024-01-25T15:04:33.227688+0000","last_peered":"2024-01-25T15:04:33.227688+0000","last_clean":"2024-01-25T15:04:33.227688+0000","last_became_active":"2024-01-25T15:04:16.179890+0000","last_became_peered":"2024-01-25T15:04:16.179890+0000","last_unstale":"2024-01-25T15:04:33.227688+0000","last_undegraded":"2024-01-25T15:04:33.227688+0000","last_fullsized":"2024-01-25T15:04:33.227688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_clean_scrub_stamp":"2024-01-25T15:04:14.956188+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:49:00.618327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518629+0000","last_change":"2024-01-25T15:04:31.805290+0000","last_active":"2024-01-25T15:04:32.518629+0000","last_peered":"2024-01-25T15:04:32.518629+0000","last_clean":"2024-01-25T15:04:32.518629+0000","last_became_active":"2024-01-25T15:04:31.804864+0000","last_became_peered":"2024-01-25T15:04:31.804864+0000","last_unstale":"2024-01-25T15:04:32.518629+0000","last_undegraded":"2024-01-25T15:04:32.518629+0000","last_fullsized":"2024-01-25T15:04:32.518629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:04.647058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228586+0000","last_change":"2024-01-25T15:04:27.541813+0000","last_active":"2024-01-25T15:04:33.228586+0000","last_peered":"2024-01-25T15:04:33.228586+0000","last_clean":"2024-01-25T15:04:33.228586+0000","last_became_active":"2024-01-25T15:04:27.541486+0000","last_became_peered":"2024-01-25T15:04:27.541486+0000","last_unstale":"2024-01-25T15:04:33.228586+0000","last_undegraded":"2024-01-25T15:04:33.228586+0000","last_fullsized":"2024-01-25T15:04:33.228586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:55:02.405369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519311+0000","last_change":"2024-01-25T15:04:26.552363+0000","last_active":"2024-01-25T15:04:32.519311+0000","last_peered":"2024-01-25T15:04:32.519311+0000","last_clean":"2024-01-25T15:04:32.519311+0000","last_became_active":"2024-01-25T15:04:26.552012+0000","last_became_peered":"2024-01-25T15:04:26.552012+0000","last_unstale":"2024-01-25T15:04:32.519311+0000","last_undegraded":"2024-01-25T15:04:32.519311+0000","last_fullsized":"2024-01-25T15:04:32.519311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:30:22.770050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518534+0000","last_change":"2024-01-25T15:04:31.803682+0000","last_active":"2024-01-25T15:04:32.518534+0000","last_peered":"2024-01-25T15:04:32.518534+0000","last_clean":"2024-01-25T15:04:32.518534+0000","last_became_active":"2024-01-25T15:04:31.803296+0000","last_became_peered":"2024-01-25T15:04:31.803296+0000","last_unstale":"2024-01-25T15:04:32.518534+0000","last_undegraded":"2024-01-25T15:04:32.518534+0000","last_fullsized":"2024-01-25T15:04:32.518534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:58:33.277497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227972+0000","last_change":"2024-01-25T15:04:27.536077+0000","last_active":"2024-01-25T15:04:33.227972+0000","last_peered":"2024-01-25T15:04:33.227972+0000","last_clean":"2024-01-25T15:04:33.227972+0000","last_became_active":"2024-01-25T15:04:27.535816+0000","last_became_peered":"2024-01-25T15:04:27.535816+0000","last_unstale":"2024-01-25T15:04:33.227972+0000","last_undegraded":"2024-01-25T15:04:33.227972+0000","last_fullsized":"2024-01-25T15:04:33.227972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:58:03.932974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188722+0000","last_change":"2024-01-25T15:04:26.540088+0000","last_active":"2024-01-25T15:04:33.188722+0000","last_peered":"2024-01-25T15:04:33.188722+0000","last_clean":"2024-01-25T15:04:33.188722+0000","last_became_active":"2024-01-25T15:04:26.539758+0000","last_became_peered":"2024-01-25T15:04:26.539758+0000","last_unstale":"2024-01-25T15:04:33.188722+0000","last_undegraded":"2024-01-25T15:04:33.188722+0000","last_fullsized":"2024-01-25T15:04:33.188722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:09:05.578946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027869+0000","last_change":"2024-01-25T15:04:31.588679+0000","last_active":"2024-01-25T15:04:33.027869+0000","last_peered":"2024-01-25T15:04:33.027869+0000","last_clean":"2024-01-25T15:04:33.027869+0000","last_became_active":"2024-01-25T15:04:31.588266+0000","last_became_peered":"2024-01-25T15:04:31.588266+0000","last_unstale":"2024-01-25T15:04:33.027869+0000","last_undegraded":"2024-01-25T15:04:33.027869+0000","last_fullsized":"2024-01-25T15:04:33.027869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:48:53.794961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229583+0000","last_change":"2024-01-25T15:04:27.539641+0000","last_active":"2024-01-25T15:04:33.229583+0000","last_peered":"2024-01-25T15:04:33.229583+0000","last_clean":"2024-01-25T15:04:33.229583+0000","last_became_active":"2024-01-25T15:04:27.539345+0000","last_became_peered":"2024-01-25T15:04:27.539345+0000","last_unstale":"2024-01-25T15:04:33.229583+0000","last_undegraded":"2024-01-25T15:04:33.229583+0000","last_fullsized":"2024-01-25T15:04:33.229583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:53:55.186236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519214+0000","last_change":"2024-01-25T15:04:26.534562+0000","last_active":"2024-01-25T15:04:32.519214+0000","last_peered":"2024-01-25T15:04:32.519214+0000","last_clean":"2024-01-25T15:04:32.519214+0000","last_became_active":"2024-01-25T15:04:26.534281+0000","last_became_peered":"2024-01-25T15:04:26.534281+0000","last_unstale":"2024-01-25T15:04:32.519214+0000","last_undegraded":"2024-01-25T15:04:32.519214+0000","last_fullsized":"2024-01-25T15:04:32.519214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:05:27.178453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227545+0000","last_change":"2024-01-25T15:04:31.802670+0000","last_active":"2024-01-25T15:04:33.227545+0000","last_peered":"2024-01-25T15:04:33.227545+0000","last_clean":"2024-01-25T15:04:33.227545+0000","last_became_active":"2024-01-25T15:04:31.802294+0000","last_became_peered":"2024-01-25T15:04:31.802294+0000","last_unstale":"2024-01-25T15:04:33.227545+0000","last_undegraded":"2024-01-25T15:04:33.227545+0000","last_fullsized":"2024-01-25T15:04:33.227545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:53:59.218943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228093+0000","last_change":"2024-01-25T15:04:27.539159+0000","last_active":"2024-01-25T15:04:33.228093+0000","last_peered":"2024-01-25T15:04:33.228093+0000","last_clean":"2024-01-25T15:04:33.228093+0000","last_became_active":"2024-01-25T15:04:27.538865+0000","last_became_peered":"2024-01-25T15:04:27.538865+0000","last_unstale":"2024-01-25T15:04:33.228093+0000","last_undegraded":"2024-01-25T15:04:33.228093+0000","last_fullsized":"2024-01-25T15:04:33.228093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:47:48.103715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228169+0000","last_change":"2024-01-25T15:04:26.545573+0000","last_active":"2024-01-25T15:04:33.228169+0000","last_peered":"2024-01-25T15:04:33.228169+0000","last_clean":"2024-01-25T15:04:33.228169+0000","last_became_active":"2024-01-25T15:04:26.545279+0000","last_became_peered":"2024-01-25T15:04:26.545279+0000","last_unstale":"2024-01-25T15:04:33.228169+0000","last_undegraded":"2024-01-25T15:04:33.228169+0000","last_fullsized":"2024-01-25T15:04:33.228169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:45:28.838538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229521+0000","last_change":"2024-01-25T15:04:31.590311+0000","last_active":"2024-01-25T15:04:33.229521+0000","last_peered":"2024-01-25T15:04:33.229521+0000","last_clean":"2024-01-25T15:04:33.229521+0000","last_became_active":"2024-01-25T15:04:31.589798+0000","last_became_peered":"2024-01-25T15:04:31.589798+0000","last_unstale":"2024-01-25T15:04:33.229521+0000","last_undegraded":"2024-01-25T15:04:33.229521+0000","last_fullsized":"2024-01-25T15:04:33.229521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:04.647058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227885+0000","last_change":"2024-01-25T15:04:27.539911+0000","last_active":"2024-01-25T15:04:33.227885+0000","last_peered":"2024-01-25T15:04:33.227885+0000","last_clean":"2024-01-25T15:04:33.227885+0000","last_became_active":"2024-01-25T15:04:27.539414+0000","last_became_peered":"2024-01-25T15:04:27.539414+0000","last_unstale":"2024-01-25T15:04:33.227885+0000","last_undegraded":"2024-01-25T15:04:33.227885+0000","last_fullsized":"2024-01-25T15:04:33.227885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:07:18.621735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518745+0000","last_change":"2024-01-25T15:04:26.538656+0000","last_active":"2024-01-25T15:04:32.518745+0000","last_peered":"2024-01-25T15:04:32.518745+0000","last_clean":"2024-01-25T15:04:32.518745+0000","last_became_active":"2024-01-25T15:04:26.538352+0000","last_became_peered":"2024-01-25T15:04:26.538352+0000","last_unstale":"2024-01-25T15:04:32.518745+0000","last_undegraded":"2024-01-25T15:04:32.518745+0000","last_fullsized":"2024-01-25T15:04:32.518745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:56:52.022913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027848+0000","last_change":"2024-01-25T15:04:31.581015+0000","last_active":"2024-01-25T15:04:33.027848+0000","last_peered":"2024-01-25T15:04:33.027848+0000","last_clean":"2024-01-25T15:04:33.027848+0000","last_became_active":"2024-01-25T15:04:31.580253+0000","last_became_peered":"2024-01-25T15:04:31.580253+0000","last_unstale":"2024-01-25T15:04:33.027848+0000","last_undegraded":"2024-01-25T15:04:33.027848+0000","last_fullsized":"2024-01-25T15:04:33.027848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:58:07.965682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518484+0000","last_change":"2024-01-25T15:04:27.536648+0000","last_active":"2024-01-25T15:04:32.518484+0000","last_peered":"2024-01-25T15:04:32.518484+0000","last_clean":"2024-01-25T15:04:32.518484+0000","last_became_active":"2024-01-25T15:04:27.536010+0000","last_became_peered":"2024-01-25T15:04:27.536010+0000","last_unstale":"2024-01-25T15:04:32.518484+0000","last_undegraded":"2024-01-25T15:04:32.518484+0000","last_fullsized":"2024-01-25T15:04:32.518484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:48.199996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518565+0000","last_change":"2024-01-25T15:04:26.540469+0000","last_active":"2024-01-25T15:04:32.518565+0000","last_peered":"2024-01-25T15:04:32.518565+0000","last_clean":"2024-01-25T15:04:32.518565+0000","last_became_active":"2024-01-25T15:04:26.540180+0000","last_became_peered":"2024-01-25T15:04:26.540180+0000","last_unstale":"2024-01-25T15:04:32.518565+0000","last_undegraded":"2024-01-25T15:04:32.518565+0000","last_fullsized":"2024-01-25T15:04:32.518565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:56:52.022913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518587+0000","last_change":"2024-01-25T15:04:31.804865+0000","last_active":"2024-01-25T15:04:32.518587+0000","last_peered":"2024-01-25T15:04:32.518587+0000","last_clean":"2024-01-25T15:04:32.518587+0000","last_became_active":"2024-01-25T15:04:31.804470+0000","last_became_peered":"2024-01-25T15:04:31.804470+0000","last_unstale":"2024-01-25T15:04:32.518587+0000","last_undegraded":"2024-01-25T15:04:32.518587+0000","last_fullsized":"2024-01-25T15:04:32.518587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:11:49.452494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228951+0000","last_change":"2024-01-25T15:04:27.541056+0000","last_active":"2024-01-25T15:04:33.228951+0000","last_peered":"2024-01-25T15:04:33.228951+0000","last_clean":"2024-01-25T15:04:33.228951+0000","last_became_active":"2024-01-25T15:04:27.539554+0000","last_became_peered":"2024-01-25T15:04:27.539554+0000","last_unstale":"2024-01-25T15:04:33.228951+0000","last_undegraded":"2024-01-25T15:04:33.228951+0000","last_fullsized":"2024-01-25T15:04:33.228951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:00.614350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229053+0000","last_change":"2024-01-25T15:04:26.551429+0000","last_active":"2024-01-25T15:04:33.229053+0000","last_peered":"2024-01-25T15:04:33.229053+0000","last_clean":"2024-01-25T15:04:33.229053+0000","last_became_active":"2024-01-25T15:04:26.551181+0000","last_became_peered":"2024-01-25T15:04:26.551181+0000","last_unstale":"2024-01-25T15:04:33.229053+0000","last_undegraded":"2024-01-25T15:04:33.229053+0000","last_fullsized":"2024-01-25T15:04:33.229053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:00:16.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518432+0000","last_change":"2024-01-25T15:04:31.800938+0000","last_active":"2024-01-25T15:04:32.518432+0000","last_peered":"2024-01-25T15:04:32.518432+0000","last_clean":"2024-01-25T15:04:32.518432+0000","last_became_active":"2024-01-25T15:04:31.800545+0000","last_became_peered":"2024-01-25T15:04:31.800545+0000","last_unstale":"2024-01-25T15:04:32.518432+0000","last_undegraded":"2024-01-25T15:04:32.518432+0000","last_fullsized":"2024-01-25T15:04:32.518432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:26:14.960523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027624+0000","last_change":"2024-01-25T15:04:27.534211+0000","last_active":"2024-01-25T15:04:33.027624+0000","last_peered":"2024-01-25T15:04:33.027624+0000","last_clean":"2024-01-25T15:04:33.027624+0000","last_became_active":"2024-01-25T15:04:27.533793+0000","last_became_peered":"2024-01-25T15:04:27.533793+0000","last_unstale":"2024-01-25T15:04:33.027624+0000","last_undegraded":"2024-01-25T15:04:33.027624+0000","last_fullsized":"2024-01-25T15:04:33.027624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:55:36.165047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027906+0000","last_change":"2024-01-25T15:04:26.547052+0000","last_active":"2024-01-25T15:04:33.027906+0000","last_peered":"2024-01-25T15:04:33.027906+0000","last_clean":"2024-01-25T15:04:33.027906+0000","last_became_active":"2024-01-25T15:04:26.546739+0000","last_became_peered":"2024-01-25T15:04:26.546739+0000","last_unstale":"2024-01-25T15:04:33.027906+0000","last_undegraded":"2024-01-25T15:04:33.027906+0000","last_fullsized":"2024-01-25T15:04:33.027906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:05:27.178453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228631+0000","last_change":"2024-01-25T15:04:31.801553+0000","last_active":"2024-01-25T15:04:33.228631+0000","last_peered":"2024-01-25T15:04:33.228631+0000","last_clean":"2024-01-25T15:04:33.228631+0000","last_became_active":"2024-01-25T15:04:31.801117+0000","last_became_peered":"2024-01-25T15:04:31.801117+0000","last_unstale":"2024-01-25T15:04:33.228631+0000","last_undegraded":"2024-01-25T15:04:33.228631+0000","last_fullsized":"2024-01-25T15:04:33.228631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:41:20.297981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228502+0000","last_change":"2024-01-25T15:04:27.542771+0000","last_active":"2024-01-25T15:04:33.228502+0000","last_peered":"2024-01-25T15:04:33.228502+0000","last_clean":"2024-01-25T15:04:33.228502+0000","last_became_active":"2024-01-25T15:04:27.542443+0000","last_became_peered":"2024-01-25T15:04:27.542443+0000","last_unstale":"2024-01-25T15:04:33.228502+0000","last_undegraded":"2024-01-25T15:04:33.228502+0000","last_fullsized":"2024-01-25T15:04:33.228502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:13:43.582651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:36.881976+0000","last_change":"2024-01-25T15:04:26.543626+0000","last_active":"2024-01-25T15:04:36.881976+0000","last_peered":"2024-01-25T15:04:36.881976+0000","last_clean":"2024-01-25T15:04:36.881976+0000","last_became_active":"2024-01-25T15:04:26.543134+0000","last_became_peered":"2024-01-25T15:04:26.543134+0000","last_unstale":"2024-01-25T15:04:36.881976+0000","last_undegraded":"2024-01-25T15:04:36.881976+0000","last_fullsized":"2024-01-25T15:04:36.881976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:17:49.229771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188193+0000","last_change":"2024-01-25T15:04:31.590781+0000","last_active":"2024-01-25T15:04:33.188193+0000","last_peered":"2024-01-25T15:04:33.188193+0000","last_clean":"2024-01-25T15:04:33.188193+0000","last_became_active":"2024-01-25T15:04:31.589830+0000","last_became_peered":"2024-01-25T15:04:31.589830+0000","last_unstale":"2024-01-25T15:04:33.188193+0000","last_undegraded":"2024-01-25T15:04:33.188193+0000","last_fullsized":"2024-01-25T15:04:33.188193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:47:52.136422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228853+0000","last_change":"2024-01-25T15:04:27.530991+0000","last_active":"2024-01-25T15:04:33.228853+0000","last_peered":"2024-01-25T15:04:33.228853+0000","last_clean":"2024-01-25T15:04:33.228853+0000","last_became_active":"2024-01-25T15:04:27.530694+0000","last_became_peered":"2024-01-25T15:04:27.530694+0000","last_unstale":"2024-01-25T15:04:33.228853+0000","last_undegraded":"2024-01-25T15:04:33.228853+0000","last_fullsized":"2024-01-25T15:04:33.228853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:04:16.483649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188688+0000","last_change":"2024-01-25T15:04:26.552321+0000","last_active":"2024-01-25T15:04:33.188688+0000","last_peered":"2024-01-25T15:04:33.188688+0000","last_clean":"2024-01-25T15:04:33.188688+0000","last_became_active":"2024-01-25T15:04:26.552007+0000","last_became_peered":"2024-01-25T15:04:26.552007+0000","last_unstale":"2024-01-25T15:04:33.188688+0000","last_undegraded":"2024-01-25T15:04:33.188688+0000","last_fullsized":"2024-01-25T15:04:33.188688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:56:52.022913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228472+0000","last_change":"2024-01-25T15:04:31.589216+0000","last_active":"2024-01-25T15:04:33.228472+0000","last_peered":"2024-01-25T15:04:33.228472+0000","last_clean":"2024-01-25T15:04:33.228472+0000","last_became_active":"2024-01-25T15:04:31.588411+0000","last_became_peered":"2024-01-25T15:04:31.588411+0000","last_unstale":"2024-01-25T15:04:33.228472+0000","last_undegraded":"2024-01-25T15:04:33.228472+0000","last_fullsized":"2024-01-25T15:04:33.228472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:29:23.965513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027809+0000","last_change":"2024-01-25T15:04:27.524082+0000","last_active":"2024-01-25T15:04:33.027809+0000","last_peered":"2024-01-25T15:04:33.027809+0000","last_clean":"2024-01-25T15:04:33.027809+0000","last_became_active":"2024-01-25T15:04:27.523538+0000","last_became_peered":"2024-01-25T15:04:27.523538+0000","last_unstale":"2024-01-25T15:04:33.027809+0000","last_undegraded":"2024-01-25T15:04:33.027809+0000","last_fullsized":"2024-01-25T15:04:33.027809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:45:08.060821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229389+0000","last_change":"2024-01-25T15:04:26.546430+0000","last_active":"2024-01-25T15:04:33.229389+0000","last_peered":"2024-01-25T15:04:33.229389+0000","last_clean":"2024-01-25T15:04:33.229389+0000","last_became_active":"2024-01-25T15:04:26.546172+0000","last_became_peered":"2024-01-25T15:04:26.546172+0000","last_unstale":"2024-01-25T15:04:33.229389+0000","last_undegraded":"2024-01-25T15:04:33.229389+0000","last_fullsized":"2024-01-25T15:04:33.229389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:17:49.229771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518237+0000","last_change":"2024-01-25T15:04:31.585484+0000","last_active":"2024-01-25T15:04:32.518237+0000","last_peered":"2024-01-25T15:04:32.518237+0000","last_clean":"2024-01-25T15:04:32.518237+0000","last_became_active":"2024-01-25T15:04:31.585107+0000","last_became_peered":"2024-01-25T15:04:31.585107+0000","last_unstale":"2024-01-25T15:04:32.518237+0000","last_undegraded":"2024-01-25T15:04:32.518237+0000","last_fullsized":"2024-01-25T15:04:32.518237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:52:39.722794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229300+0000","last_change":"2024-01-25T15:04:27.539659+0000","last_active":"2024-01-25T15:04:33.229300+0000","last_peered":"2024-01-25T15:04:33.229300+0000","last_clean":"2024-01-25T15:04:33.229300+0000","last_became_active":"2024-01-25T15:04:27.539382+0000","last_became_peered":"2024-01-25T15:04:27.539382+0000","last_unstale":"2024-01-25T15:04:33.229300+0000","last_undegraded":"2024-01-25T15:04:33.229300+0000","last_fullsized":"2024-01-25T15:04:33.229300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:47:59.032295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519043+0000","last_change":"2024-01-25T15:04:26.550083+0000","last_active":"2024-01-25T15:04:32.519043+0000","last_peered":"2024-01-25T15:04:32.519043+0000","last_clean":"2024-01-25T15:04:32.519043+0000","last_became_active":"2024-01-25T15:04:26.549812+0000","last_became_peered":"2024-01-25T15:04:26.549812+0000","last_unstale":"2024-01-25T15:04:32.519043+0000","last_undegraded":"2024-01-25T15:04:32.519043+0000","last_fullsized":"2024-01-25T15:04:32.519043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:15:44.944688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518046+0000","last_change":"2024-01-25T15:04:31.802519+0000","last_active":"2024-01-25T15:04:32.518046+0000","last_peered":"2024-01-25T15:04:32.518046+0000","last_clean":"2024-01-25T15:04:32.518046+0000","last_became_active":"2024-01-25T15:04:31.802179+0000","last_became_peered":"2024-01-25T15:04:31.802179+0000","last_unstale":"2024-01-25T15:04:32.518046+0000","last_undegraded":"2024-01-25T15:04:32.518046+0000","last_fullsized":"2024-01-25T15:04:32.518046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:07:22.928800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.028016+0000","last_change":"2024-01-25T15:04:31.803027+0000","last_active":"2024-01-25T15:04:33.028016+0000","last_peered":"2024-01-25T15:04:33.028016+0000","last_clean":"2024-01-25T15:04:33.028016+0000","last_became_active":"2024-01-25T15:04:31.802543+0000","last_became_peered":"2024-01-25T15:04:31.802543+0000","last_unstale":"2024-01-25T15:04:33.028016+0000","last_undegraded":"2024-01-25T15:04:33.028016+0000","last_fullsized":"2024-01-25T15:04:33.028016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:53:59.218943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.187926+0000","last_change":"2024-01-25T15:04:27.537760+0000","last_active":"2024-01-25T15:04:33.187926+0000","last_peered":"2024-01-25T15:04:33.187926+0000","last_clean":"2024-01-25T15:04:33.187926+0000","last_became_active":"2024-01-25T15:04:27.537411+0000","last_became_peered":"2024-01-25T15:04:27.537411+0000","last_unstale":"2024-01-25T15:04:33.187926+0000","last_undegraded":"2024-01-25T15:04:33.187926+0000","last_fullsized":"2024-01-25T15:04:33.187926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:24:46.429617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227807+0000","last_change":"2024-01-25T15:04:26.553364+0000","last_active":"2024-01-25T15:04:33.227807+0000","last_peered":"2024-01-25T15:04:33.227807+0000","last_clean":"2024-01-25T15:04:33.227807+0000","last_became_active":"2024-01-25T15:04:26.553023+0000","last_became_peered":"2024-01-25T15:04:26.553023+0000","last_unstale":"2024-01-25T15:04:33.227807+0000","last_undegraded":"2024-01-25T15:04:33.227807+0000","last_fullsized":"2024-01-25T15:04:33.227807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:09:05.578946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518883+0000","last_change":"2024-01-25T15:04:31.588551+0000","last_active":"2024-01-25T15:04:32.518883+0000","last_peered":"2024-01-25T15:04:32.518883+0000","last_clean":"2024-01-25T15:04:32.518883+0000","last_became_active":"2024-01-25T15:04:31.588144+0000","last_became_peered":"2024-01-25T15:04:31.588144+0000","last_unstale":"2024-01-25T15:04:32.518883+0000","last_undegraded":"2024-01-25T15:04:32.518883+0000","last_fullsized":"2024-01-25T15:04:32.518883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:47:52.136422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517990+0000","last_change":"2024-01-25T15:04:27.537715+0000","last_active":"2024-01-25T15:04:32.517990+0000","last_peered":"2024-01-25T15:04:32.517990+0000","last_clean":"2024-01-25T15:04:32.517990+0000","last_became_active":"2024-01-25T15:04:27.537433+0000","last_became_peered":"2024-01-25T15:04:27.537433+0000","last_unstale":"2024-01-25T15:04:32.517990+0000","last_undegraded":"2024-01-25T15:04:32.517990+0000","last_fullsized":"2024-01-25T15:04:32.517990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:48.199996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518112+0000","last_change":"2024-01-25T15:04:26.543354+0000","last_active":"2024-01-25T15:04:32.518112+0000","last_peered":"2024-01-25T15:04:32.518112+0000","last_clean":"2024-01-25T15:04:32.518112+0000","last_became_active":"2024-01-25T15:04:26.543047+0000","last_became_peered":"2024-01-25T15:04:26.543047+0000","last_unstale":"2024-01-25T15:04:32.518112+0000","last_undegraded":"2024-01-25T15:04:32.518112+0000","last_fullsized":"2024-01-25T15:04:32.518112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:30:22.770050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518843+0000","last_change":"2024-01-25T15:04:26.541507+0000","last_active":"2024-01-25T15:04:32.518843+0000","last_peered":"2024-01-25T15:04:32.518843+0000","last_clean":"2024-01-25T15:04:32.518843+0000","last_became_active":"2024-01-25T15:04:26.540128+0000","last_became_peered":"2024-01-25T15:04:26.540128+0000","last_unstale":"2024-01-25T15:04:32.518843+0000","last_undegraded":"2024-01-25T15:04:32.518843+0000","last_fullsized":"2024-01-25T15:04:32.518843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:09:05.578946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027825+0000","last_change":"2024-01-25T15:04:27.525314+0000","last_active":"2024-01-25T15:04:33.027825+0000","last_peered":"2024-01-25T15:04:33.027825+0000","last_clean":"2024-01-25T15:04:33.027825+0000","last_became_active":"2024-01-25T15:04:27.525018+0000","last_became_peered":"2024-01-25T15:04:27.525018+0000","last_unstale":"2024-01-25T15:04:33.027825+0000","last_undegraded":"2024-01-25T15:04:33.027825+0000","last_fullsized":"2024-01-25T15:04:33.027825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:19:41.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519186+0000","last_change":"2024-01-25T15:04:31.591768+0000","last_active":"2024-01-25T15:04:32.519186+0000","last_peered":"2024-01-25T15:04:32.519186+0000","last_clean":"2024-01-25T15:04:32.519186+0000","last_became_active":"2024-01-25T15:04:31.591336+0000","last_became_peered":"2024-01-25T15:04:31.591336+0000","last_unstale":"2024-01-25T15:04:32.519186+0000","last_undegraded":"2024-01-25T15:04:32.519186+0000","last_fullsized":"2024-01-25T15:04:32.519186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:40:22.136826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518266+0000","last_change":"2024-01-25T15:04:26.550151+0000","last_active":"2024-01-25T15:04:32.518266+0000","last_peered":"2024-01-25T15:04:32.518266+0000","last_clean":"2024-01-25T15:04:32.518266+0000","last_became_active":"2024-01-25T15:04:26.549856+0000","last_became_peered":"2024-01-25T15:04:26.549856+0000","last_unstale":"2024-01-25T15:04:32.518266+0000","last_undegraded":"2024-01-25T15:04:32.518266+0000","last_fullsized":"2024-01-25T15:04:32.518266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:00:16.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228279+0000","last_change":"2024-01-25T15:04:27.526178+0000","last_active":"2024-01-25T15:04:33.228279+0000","last_peered":"2024-01-25T15:04:33.228279+0000","last_clean":"2024-01-25T15:04:33.228279+0000","last_became_active":"2024-01-25T15:04:27.525798+0000","last_became_peered":"2024-01-25T15:04:27.525798+0000","last_unstale":"2024-01-25T15:04:33.228279+0000","last_undegraded":"2024-01-25T15:04:33.228279+0000","last_fullsized":"2024-01-25T15:04:33.228279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:17:50.234531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518933+0000","last_change":"2024-01-25T15:04:31.584854+0000","last_active":"2024-01-25T15:04:32.518933+0000","last_peered":"2024-01-25T15:04:32.518933+0000","last_clean":"2024-01-25T15:04:32.518933+0000","last_became_active":"2024-01-25T15:04:31.584482+0000","last_became_peered":"2024-01-25T15:04:31.584482+0000","last_unstale":"2024-01-25T15:04:32.518933+0000","last_undegraded":"2024-01-25T15:04:32.518933+0000","last_fullsized":"2024-01-25T15:04:32.518933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:52:29.681769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519137+0000","last_change":"2024-01-25T15:04:27.536761+0000","last_active":"2024-01-25T15:04:32.519137+0000","last_peered":"2024-01-25T15:04:32.519137+0000","last_clean":"2024-01-25T15:04:32.519137+0000","last_became_active":"2024-01-25T15:04:27.536382+0000","last_became_peered":"2024-01-25T15:04:27.536382+0000","last_unstale":"2024-01-25T15:04:32.519137+0000","last_undegraded":"2024-01-25T15:04:32.519137+0000","last_fullsized":"2024-01-25T15:04:32.519137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:24:46.429617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519085+0000","last_change":"2024-01-25T15:04:27.529750+0000","last_active":"2024-01-25T15:04:32.519085+0000","last_peered":"2024-01-25T15:04:32.519085+0000","last_clean":"2024-01-25T15:04:32.519085+0000","last_became_active":"2024-01-25T15:04:27.529437+0000","last_became_peered":"2024-01-25T15:04:27.529437+0000","last_unstale":"2024-01-25T15:04:32.519085+0000","last_undegraded":"2024-01-25T15:04:32.519085+0000","last_fullsized":"2024-01-25T15:04:32.519085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:15:45.949448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228955+0000","last_change":"2024-01-25T15:04:27.538760+0000","last_active":"2024-01-25T15:04:33.228955+0000","last_peered":"2024-01-25T15:04:33.228955+0000","last_clean":"2024-01-25T15:04:33.228955+0000","last_became_active":"2024-01-25T15:04:27.537353+0000","last_became_peered":"2024-01-25T15:04:27.537353+0000","last_unstale":"2024-01-25T15:04:33.228955+0000","last_undegraded":"2024-01-25T15:04:33.228955+0000","last_fullsized":"2024-01-25T15:04:33.228955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:58:29.244789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027745+0000","last_change":"2024-01-25T15:04:27.534768+0000","last_active":"2024-01-25T15:04:33.027745+0000","last_peered":"2024-01-25T15:04:33.027745+0000","last_clean":"2024-01-25T15:04:33.027745+0000","last_became_active":"2024-01-25T15:04:27.534414+0000","last_became_peered":"2024-01-25T15:04:27.534414+0000","last_unstale":"2024-01-25T15:04:33.027745+0000","last_undegraded":"2024-01-25T15:04:33.027745+0000","last_fullsized":"2024-01-25T15:04:33.027745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:59:41.393305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518613+0000","last_change":"2024-01-25T15:04:27.532970+0000","last_active":"2024-01-25T15:04:32.518613+0000","last_peered":"2024-01-25T15:04:32.518613+0000","last_clean":"2024-01-25T15:04:32.518613+0000","last_became_active":"2024-01-25T15:04:27.532645+0000","last_became_peered":"2024-01-25T15:04:27.532645+0000","last_unstale":"2024-01-25T15:04:32.518613+0000","last_undegraded":"2024-01-25T15:04:32.518613+0000","last_fullsized":"2024-01-25T15:04:32.518613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:13:43.582651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188513+0000","last_change":"2024-01-25T15:04:27.538503+0000","last_active":"2024-01-25T15:04:33.188513+0000","last_peered":"2024-01-25T15:04:33.188513+0000","last_clean":"2024-01-25T15:04:33.188513+0000","last_became_active":"2024-01-25T15:04:27.538210+0000","last_became_peered":"2024-01-25T15:04:27.538210+0000","last_unstale":"2024-01-25T15:04:33.188513+0000","last_undegraded":"2024-01-25T15:04:33.188513+0000","last_fullsized":"2024-01-25T15:04:33.188513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:59:41.393305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519315+0000","last_change":"2024-01-25T15:04:27.540013+0000","last_active":"2024-01-25T15:04:32.519315+0000","last_peered":"2024-01-25T15:04:32.519315+0000","last_clean":"2024-01-25T15:04:32.519315+0000","last_became_active":"2024-01-25T15:04:27.539736+0000","last_became_peered":"2024-01-25T15:04:27.539736+0000","last_unstale":"2024-01-25T15:04:32.519315+0000","last_undegraded":"2024-01-25T15:04:32.519315+0000","last_fullsized":"2024-01-25T15:04:32.519315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:45:08.060821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518509+0000","last_change":"2024-01-25T15:04:27.536541+0000","last_active":"2024-01-25T15:04:32.518509+0000","last_peered":"2024-01-25T15:04:32.518509+0000","last_clean":"2024-01-25T15:04:32.518509+0000","last_became_active":"2024-01-25T15:04:27.534323+0000","last_became_peered":"2024-01-25T15:04:27.534323+0000","last_unstale":"2024-01-25T15:04:32.518509+0000","last_undegraded":"2024-01-25T15:04:32.518509+0000","last_fullsized":"2024-01-25T15:04:32.518509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:29:19.932806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227705+0000","last_change":"2024-01-25T15:04:27.534565+0000","last_active":"2024-01-25T15:04:33.227705+0000","last_peered":"2024-01-25T15:04:33.227705+0000","last_clean":"2024-01-25T15:04:33.227705+0000","last_became_active":"2024-01-25T15:04:27.534263+0000","last_became_peered":"2024-01-25T15:04:27.534263+0000","last_unstale":"2024-01-25T15:04:33.227705+0000","last_undegraded":"2024-01-25T15:04:33.227705+0000","last_fullsized":"2024-01-25T15:04:33.227705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:30.257021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517959+0000","last_change":"2024-01-25T15:04:27.532801+0000","last_active":"2024-01-25T15:04:32.517959+0000","last_peered":"2024-01-25T15:04:32.517959+0000","last_clean":"2024-01-25T15:04:32.517959+0000","last_became_active":"2024-01-25T15:04:27.532521+0000","last_became_peered":"2024-01-25T15:04:27.532521+0000","last_unstale":"2024-01-25T15:04:32.517959+0000","last_undegraded":"2024-01-25T15:04:32.517959+0000","last_fullsized":"2024-01-25T15:04:32.517959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:59:41.393305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229237+0000","last_change":"2024-01-25T15:04:27.531785+0000","last_active":"2024-01-25T15:04:33.229237+0000","last_peered":"2024-01-25T15:04:33.229237+0000","last_clean":"2024-01-25T15:04:33.229237+0000","last_became_active":"2024-01-25T15:04:27.531502+0000","last_became_peered":"2024-01-25T15:04:27.531502+0000","last_unstale":"2024-01-25T15:04:33.229237+0000","last_undegraded":"2024-01-25T15:04:33.229237+0000","last_fullsized":"2024-01-25T15:04:33.229237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:07:18.621735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027629+0000","last_change":"2024-01-25T15:04:27.538527+0000","last_active":"2024-01-25T15:04:33.027629+0000","last_peered":"2024-01-25T15:04:33.027629+0000","last_clean":"2024-01-25T15:04:33.027629+0000","last_became_active":"2024-01-25T15:04:27.538169+0000","last_became_peered":"2024-01-25T15:04:27.538169+0000","last_unstale":"2024-01-25T15:04:33.027629+0000","last_undegraded":"2024-01-25T15:04:33.027629+0000","last_fullsized":"2024-01-25T15:04:33.027629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:48.199996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519087+0000","last_change":"2024-01-25T15:04:27.528595+0000","last_active":"2024-01-25T15:04:32.519087+0000","last_peered":"2024-01-25T15:04:32.519087+0000","last_clean":"2024-01-25T15:04:32.519087+0000","last_became_active":"2024-01-25T15:04:27.528222+0000","last_became_peered":"2024-01-25T15:04:27.528222+0000","last_unstale":"2024-01-25T15:04:32.519087+0000","last_undegraded":"2024-01-25T15:04:32.519087+0000","last_fullsized":"2024-01-25T15:04:32.519087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:59:41.393305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228858+0000","last_change":"2024-01-25T15:04:27.539219+0000","last_active":"2024-01-25T15:04:33.228858+0000","last_peered":"2024-01-25T15:04:33.228858+0000","last_clean":"2024-01-25T15:04:33.228858+0000","last_became_active":"2024-01-25T15:04:27.538920+0000","last_became_peered":"2024-01-25T15:04:27.538920+0000","last_unstale":"2024-01-25T15:04:33.228858+0000","last_undegraded":"2024-01-25T15:04:33.228858+0000","last_fullsized":"2024-01-25T15:04:33.228858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:58:03.932974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519156+0000","last_change":"2024-01-25T15:04:27.531810+0000","last_active":"2024-01-25T15:04:32.519156+0000","last_peered":"2024-01-25T15:04:32.519156+0000","last_clean":"2024-01-25T15:04:32.519156+0000","last_became_active":"2024-01-25T15:04:27.531489+0000","last_became_peered":"2024-01-25T15:04:27.531489+0000","last_unstale":"2024-01-25T15:04:32.519156+0000","last_undegraded":"2024-01-25T15:04:32.519156+0000","last_fullsized":"2024-01-25T15:04:32.519156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:04:57.737913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228241+0000","last_change":"2024-01-25T15:04:27.532610+0000","last_active":"2024-01-25T15:04:33.228241+0000","last_peered":"2024-01-25T15:04:33.228241+0000","last_clean":"2024-01-25T15:04:33.228241+0000","last_became_active":"2024-01-25T15:04:27.532332+0000","last_became_peered":"2024-01-25T15:04:27.532332+0000","last_unstale":"2024-01-25T15:04:33.228241+0000","last_undegraded":"2024-01-25T15:04:33.228241+0000","last_fullsized":"2024-01-25T15:04:33.228241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:00.614350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227608+0000","last_change":"2024-01-25T15:04:27.535483+0000","last_active":"2024-01-25T15:04:33.227608+0000","last_peered":"2024-01-25T15:04:33.227608+0000","last_clean":"2024-01-25T15:04:33.227608+0000","last_became_active":"2024-01-25T15:04:27.534992+0000","last_became_peered":"2024-01-25T15:04:27.534992+0000","last_unstale":"2024-01-25T15:04:33.227608+0000","last_undegraded":"2024-01-25T15:04:33.227608+0000","last_fullsized":"2024-01-25T15:04:33.227608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:19:41.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188004+0000","last_change":"2024-01-25T15:04:27.528466+0000","last_active":"2024-01-25T15:04:33.188004+0000","last_peered":"2024-01-25T15:04:33.188004+0000","last_clean":"2024-01-25T15:04:33.188004+0000","last_became_active":"2024-01-25T15:04:27.528170+0000","last_became_peered":"2024-01-25T15:04:27.528170+0000","last_unstale":"2024-01-25T15:04:33.188004+0000","last_undegraded":"2024-01-25T15:04:33.188004+0000","last_fullsized":"2024-01-25T15:04:33.188004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:48.199996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027681+0000","last_change":"2024-01-25T15:04:27.527057+0000","last_active":"2024-01-25T15:04:33.027681+0000","last_peered":"2024-01-25T15:04:33.027681+0000","last_clean":"2024-01-25T15:04:33.027681+0000","last_became_active":"2024-01-25T15:04:27.526733+0000","last_became_peered":"2024-01-25T15:04:27.526733+0000","last_unstale":"2024-01-25T15:04:33.027681+0000","last_undegraded":"2024-01-25T15:04:33.027681+0000","last_fullsized":"2024-01-25T15:04:33.027681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:38:10.985262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518080+0000","last_change":"2024-01-25T15:04:27.533940+0000","last_active":"2024-01-25T15:04:32.518080+0000","last_peered":"2024-01-25T15:04:32.518080+0000","last_clean":"2024-01-25T15:04:32.518080+0000","last_became_active":"2024-01-25T15:04:27.533453+0000","last_became_peered":"2024-01-25T15:04:27.533453+0000","last_unstale":"2024-01-25T15:04:32.518080+0000","last_undegraded":"2024-01-25T15:04:32.518080+0000","last_fullsized":"2024-01-25T15:04:32.518080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:30.257021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228629+0000","last_change":"2024-01-25T15:04:27.529157+0000","last_active":"2024-01-25T15:04:33.228629+0000","last_peered":"2024-01-25T15:04:33.228629+0000","last_clean":"2024-01-25T15:04:33.228629+0000","last_became_active":"2024-01-25T15:04:27.528880+0000","last_became_peered":"2024-01-25T15:04:27.528880+0000","last_unstale":"2024-01-25T15:04:33.228629+0000","last_undegraded":"2024-01-25T15:04:33.228629+0000","last_fullsized":"2024-01-25T15:04:33.228629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:08:53.048328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518689+0000","last_change":"2024-01-25T15:04:27.528325+0000","last_active":"2024-01-25T15:04:32.518689+0000","last_peered":"2024-01-25T15:04:32.518689+0000","last_clean":"2024-01-25T15:04:32.518689+0000","last_became_active":"2024-01-25T15:04:27.527673+0000","last_became_peered":"2024-01-25T15:04:27.527673+0000","last_unstale":"2024-01-25T15:04:32.518689+0000","last_undegraded":"2024-01-25T15:04:32.518689+0000","last_fullsized":"2024-01-25T15:04:32.518689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:19:41.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519157+0000","last_change":"2024-01-25T15:04:27.530713+0000","last_active":"2024-01-25T15:04:32.519157+0000","last_peered":"2024-01-25T15:04:32.519157+0000","last_clean":"2024-01-25T15:04:32.519157+0000","last_became_active":"2024-01-25T15:04:27.530468+0000","last_became_peered":"2024-01-25T15:04:27.530468+0000","last_unstale":"2024-01-25T15:04:32.519157+0000","last_undegraded":"2024-01-25T15:04:32.519157+0000","last_fullsized":"2024-01-25T15:04:32.519157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:30.257021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229579+0000","last_change":"2024-01-25T15:04:27.542678+0000","last_active":"2024-01-25T15:04:33.229579+0000","last_peered":"2024-01-25T15:04:33.229579+0000","last_clean":"2024-01-25T15:04:33.229579+0000","last_became_active":"2024-01-25T15:04:27.542362+0000","last_became_peered":"2024-01-25T15:04:27.542362+0000","last_unstale":"2024-01-25T15:04:33.229579+0000","last_undegraded":"2024-01-25T15:04:33.229579+0000","last_fullsized":"2024-01-25T15:04:33.229579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:20:59.655525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517884+0000","last_change":"2024-01-25T15:04:27.540118+0000","last_active":"2024-01-25T15:04:32.517884+0000","last_peered":"2024-01-25T15:04:32.517884+0000","last_clean":"2024-01-25T15:04:32.517884+0000","last_became_active":"2024-01-25T15:04:27.539793+0000","last_became_peered":"2024-01-25T15:04:27.539793+0000","last_unstale":"2024-01-25T15:04:32.517884+0000","last_undegraded":"2024-01-25T15:04:32.517884+0000","last_fullsized":"2024-01-25T15:04:32.517884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:30:17.007992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227778+0000","last_change":"2024-01-25T15:04:27.540459+0000","last_active":"2024-01-25T15:04:33.227778+0000","last_peered":"2024-01-25T15:04:33.227778+0000","last_clean":"2024-01-25T15:04:33.227778+0000","last_became_active":"2024-01-25T15:04:27.540170+0000","last_became_peered":"2024-01-25T15:04:27.540170+0000","last_unstale":"2024-01-25T15:04:33.227778+0000","last_undegraded":"2024-01-25T15:04:33.227778+0000","last_fullsized":"2024-01-25T15:04:33.227778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:29:19.932806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228818+0000","last_change":"2024-01-25T15:04:27.533910+0000","last_active":"2024-01-25T15:04:33.228818+0000","last_peered":"2024-01-25T15:04:33.228818+0000","last_clean":"2024-01-25T15:04:33.228818+0000","last_became_active":"2024-01-25T15:04:27.533483+0000","last_became_peered":"2024-01-25T15:04:27.533483+0000","last_unstale":"2024-01-25T15:04:33.228818+0000","last_undegraded":"2024-01-25T15:04:33.228818+0000","last_fullsized":"2024-01-25T15:04:33.228818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:55:02.405369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228766+0000","last_change":"2024-01-25T15:04:27.539149+0000","last_active":"2024-01-25T15:04:33.228766+0000","last_peered":"2024-01-25T15:04:33.228766+0000","last_clean":"2024-01-25T15:04:33.228766+0000","last_became_active":"2024-01-25T15:04:27.538850+0000","last_became_peered":"2024-01-25T15:04:27.538850+0000","last_unstale":"2024-01-25T15:04:33.228766+0000","last_undegraded":"2024-01-25T15:04:33.228766+0000","last_fullsized":"2024-01-25T15:04:33.228766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:58:29.244789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227771+0000","last_change":"2024-01-25T15:04:27.534907+0000","last_active":"2024-01-25T15:04:33.227771+0000","last_peered":"2024-01-25T15:04:33.227771+0000","last_clean":"2024-01-25T15:04:33.227771+0000","last_became_active":"2024-01-25T15:04:27.534407+0000","last_became_peered":"2024-01-25T15:04:27.534407+0000","last_unstale":"2024-01-25T15:04:33.227771+0000","last_undegraded":"2024-01-25T15:04:33.227771+0000","last_fullsized":"2024-01-25T15:04:33.227771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:45:08.060821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027683+0000","last_change":"2024-01-25T15:04:27.529037+0000","last_active":"2024-01-25T15:04:33.027683+0000","last_peered":"2024-01-25T15:04:33.027683+0000","last_clean":"2024-01-25T15:04:33.027683+0000","last_became_active":"2024-01-25T15:04:27.528713+0000","last_became_peered":"2024-01-25T15:04:27.528713+0000","last_unstale":"2024-01-25T15:04:33.027683+0000","last_undegraded":"2024-01-25T15:04:33.027683+0000","last_fullsized":"2024-01-25T15:04:33.027683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:24:46.429617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188418+0000","last_change":"2024-01-25T15:04:27.531477+0000","last_active":"2024-01-25T15:04:33.188418+0000","last_peered":"2024-01-25T15:04:33.188418+0000","last_clean":"2024-01-25T15:04:33.188418+0000","last_became_active":"2024-01-25T15:04:27.531188+0000","last_became_peered":"2024-01-25T15:04:27.531188+0000","last_unstale":"2024-01-25T15:04:33.188418+0000","last_undegraded":"2024-01-25T15:04:33.188418+0000","last_fullsized":"2024-01-25T15:04:33.188418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:30.257021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229461+0000","last_change":"2024-01-25T15:04:27.541633+0000","last_active":"2024-01-25T15:04:33.229461+0000","last_peered":"2024-01-25T15:04:33.229461+0000","last_clean":"2024-01-25T15:04:33.229461+0000","last_became_active":"2024-01-25T15:04:27.539292+0000","last_became_peered":"2024-01-25T15:04:27.539292+0000","last_unstale":"2024-01-25T15:04:33.229461+0000","last_undegraded":"2024-01-25T15:04:33.229461+0000","last_fullsized":"2024-01-25T15:04:33.229461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:48:49.762254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":860160,"data_stored":690798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:04:44.950 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-25T15:04:44.951 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-25T15:04:44.951 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-25T15:04:44.951 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-25T15:04:44.951 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-25T15:04:45.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.086+0000 7fa412a97640 1 Processor -- start 2024-01-25T15:04:45.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.086+0000 7fa412a97640 1 -- start start 2024-01-25T15:04:45.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.087+0000 7fa412a97640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa40c1520b0 0x7fa40c155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:45.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.087+0000 7fa412a97640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40c0c66c0 con 0x7fa40c0c4f00 2024-01-25T15:04:45.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.087+0000 7fa412a97640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40c06cfc0 con 0x7fa40c0c55e0 2024-01-25T15:04:45.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.087+0000 7fa412a97640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa40c152490 con 0x7fa40c1520b0 2024-01-25T15:04:45.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.087+0000 7fa410833640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa40c1520b0 0x7fa40c155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:45.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.087+0000 7fa411034640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa40c0c4f00 0x7fa40c0c5b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54632/0 (socket says 172.21.15.29:54632) 2024-01-25T15:04:45.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.087+0000 7fa411034640 1 -- 172.21.15.29:0/317286882 learned_addr learned my addr 172.21.15.29:0/317286882 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:45.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.087+0000 7fa410833640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa40c1520b0 0x7fa40c155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36278/0 (socket says 172.21.15.29:36278) 2024-01-25T15:04:45.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.087+0000 7fa410833640 1 -- 172.21.15.29:0/317286882 >> v1:172.21.15.52:6789/0 conn(0x7fa40c0c55e0 legacy=0x7fa40c0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.087+0000 7fa410833640 1 -- 172.21.15.29:0/317286882 >> v1:172.21.15.29:6789/0 conn(0x7fa40c0c4f00 legacy=0x7fa40c0c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.087+0000 7fa410833640 1 -- 172.21.15.29:0/317286882 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40c0c8830 con 0x7fa40c1520b0 2024-01-25T15:04:45.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.087+0000 7fa40b7fe640 1 -- 172.21.15.29:0/317286882 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1471751465 0 0) 0x7fa40c0c66c0 con 0x7fa40c0c4f00 2024-01-25T15:04:45.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.088+0000 7fa410833640 1 --2- 172.21.15.29:0/317286882 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa40c1520b0 0x7fa40c155570 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa404009d90 tx=0x7fa40402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaeb40afca1f8ca server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:45.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.088+0000 7fa40b7fe640 1 -- 172.21.15.29:0/317286882 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40402cc60 con 0x7fa40c1520b0 2024-01-25T15:04:45.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.088+0000 7fa40b7fe640 1 -- 172.21.15.29:0/317286882 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40402cdc0 con 0x7fa40c1520b0 2024-01-25T15:04:45.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.088+0000 7fa40b7fe640 1 -- 172.21.15.29:0/317286882 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa404034660 con 0x7fa40c1520b0 2024-01-25T15:04:45.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.089+0000 7fa412a97640 1 -- 172.21.15.29:0/317286882 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa40c1520b0 msgr2=0x7fa40c155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.089+0000 7fa412a97640 1 --2- 172.21.15.29:0/317286882 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa40c1520b0 0x7fa40c155570 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa404009d90 tx=0x7fa40402beb0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.089+0000 7fa412a97640 1 -- 172.21.15.29:0/317286882 shutdown_connections 2024-01-25T15:04:45.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.089+0000 7fa412a97640 1 --2- 172.21.15.29:0/317286882 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa40c1520b0 0x7fa40c155570 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.089+0000 7fa412a97640 1 -- 172.21.15.29:0/317286882 >> 172.21.15.29:0/317286882 conn(0x7fa40c0ca220 msgr2=0x7fa40c0ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:45.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.089+0000 7fa412a97640 1 -- 172.21.15.29:0/317286882 shutdown_connections 2024-01-25T15:04:45.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.089+0000 7fa412a97640 1 -- 172.21.15.29:0/317286882 wait complete. 2024-01-25T15:04:45.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.090+0000 7fa412a97640 1 Processor -- start 2024-01-25T15:04:45.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.090+0000 7fa412a97640 1 -- start start 2024-01-25T15:04:45.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.091+0000 7fa412a97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa40c0c4f00 0x7fa40c0c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:45.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.091+0000 7fa412a97640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa40c1520b0 0x7fa40c155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:45.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.091+0000 7fa412a97640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa40c0af260 0x7fa40c1ea340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:45.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.091+0000 7fa412a97640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c1e9b60 con 0x7fa40c0c4f00 2024-01-25T15:04:45.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.091+0000 7fa412a97640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c157880 con 0x7fa40c0af260 2024-01-25T15:04:45.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.091+0000 7fa412a97640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c157b60 con 0x7fa40c1520b0 2024-01-25T15:04:45.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.091+0000 7fa410833640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa40c0c4f00 0x7fa40c0c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:45.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.091+0000 7fa410833640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa40c0c4f00 0x7fa40c0c40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36284/0 (socket says 172.21.15.29:36284) 2024-01-25T15:04:45.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.091+0000 7fa410833640 1 -- 172.21.15.29:0/361283114 learned_addr learned my addr 172.21.15.29:0/361283114 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:45.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.091+0000 7fa411034640 1 --2- 172.21.15.29:0/361283114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa40c0af260 0x7fa40c1ea340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:45.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.091+0000 7fa40bfff640 1 --2- 172.21.15.29:0/361283114 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa40c1520b0 0x7fa40c155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:45.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.091+0000 7fa410833640 1 -- 172.21.15.29:0/361283114 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa40c1520b0 msgr2=0x7fa40c155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.091+0000 7fa410833640 1 --2- 172.21.15.29:0/361283114 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa40c1520b0 0x7fa40c155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.091+0000 7fa410833640 1 -- 172.21.15.29:0/361283114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa40c0af260 msgr2=0x7fa40c1ea340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.091+0000 7fa410833640 1 --2- 172.21.15.29:0/361283114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa40c0af260 0x7fa40c1ea340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.091+0000 7fa410833640 1 -- 172.21.15.29:0/361283114 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa404009a70 con 0x7fa40c0c4f00 2024-01-25T15:04:45.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.091+0000 7fa410833640 1 --2- 172.21.15.29:0/361283114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa40c0c4f00 0x7fa40c0c40c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa404037040 tx=0x7fa404004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:45.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.092+0000 7fa4097fa640 1 -- 172.21.15.29:0/361283114 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa404040650 con 0x7fa40c0c4f00 2024-01-25T15:04:45.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.092+0000 7fa4097fa640 1 -- 172.21.15.29:0/361283114 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4040407b0 con 0x7fa40c0c4f00 2024-01-25T15:04:45.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.092+0000 7fa412a97640 1 -- 172.21.15.29:0/361283114 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40c157e40 con 0x7fa40c0c4f00 2024-01-25T15:04:45.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.092+0000 7fa4097fa640 1 -- 172.21.15.29:0/361283114 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa404040b60 con 0x7fa40c0c4f00 2024-01-25T15:04:45.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.092+0000 7fa412a97640 1 -- 172.21.15.29:0/361283114 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40c1e9e20 con 0x7fa40c0c4f00 2024-01-25T15:04:45.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.093+0000 7fa412a97640 1 -- 172.21.15.29:0/361283114 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa40c155970 con 0x7fa40c0c4f00 2024-01-25T15:04:45.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.093+0000 7fa4097fa640 1 -- 172.21.15.29:0/361283114 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fa404040cc0 con 0x7fa40c0c4f00 2024-01-25T15:04:45.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.093+0000 7fa4097fa640 1 --2- 172.21.15.29:0/361283114 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa3f806aed0 0x7fa3f806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:45.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.093+0000 7fa4097fa640 1 -- 172.21.15.29:0/361283114 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa4040ac6f0 con 0x7fa40c0c4f00 2024-01-25T15:04:45.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.094+0000 7fa40bfff640 1 --2- 172.21.15.29:0/361283114 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa3f806aed0 0x7fa3f806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:45.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.094+0000 7fa40bfff640 1 --2- 172.21.15.29:0/361283114 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa3f806aed0 0x7fa3f806d390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa40c1573d0 tx=0x7fa400009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:45.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.097+0000 7fa4097fa640 1 -- 172.21.15.29:0/361283114 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fa404077410 con 0x7fa40c0c4f00 2024-01-25T15:04:45.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.323+0000 7fa412a97640 1 -- 172.21.15.29:0/361283114 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa40c1549a0 con 0x7fa40c0c4f00 2024-01-25T15:04:45.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.326+0000 7fa4097fa640 1 -- 172.21.15.29:0/361283114 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170777 (secure 0 0 0) 0x7fa40407aa30 con 0x7fa40c0c4f00 2024-01-25T15:04:45.328 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:45.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.328+0000 7fa412a97640 1 -- 172.21.15.29:0/361283114 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa3f806aed0 msgr2=0x7fa3f806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.328+0000 7fa412a97640 1 --2- 172.21.15.29:0/361283114 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa3f806aed0 0x7fa3f806d390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa40c1573d0 tx=0x7fa400009040 comp rx=0 tx=0).stop 2024-01-25T15:04:45.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.328+0000 7fa412a97640 1 -- 172.21.15.29:0/361283114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa40c0c4f00 msgr2=0x7fa40c0c40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.328+0000 7fa412a97640 1 --2- 172.21.15.29:0/361283114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa40c0c4f00 0x7fa40c0c40c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa404037040 tx=0x7fa404004a40 comp rx=0 tx=0).stop 2024-01-25T15:04:45.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.328+0000 7fa412a97640 1 -- 172.21.15.29:0/361283114 shutdown_connections 2024-01-25T15:04:45.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.328+0000 7fa412a97640 1 --2- 172.21.15.29:0/361283114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa40c0af260 0x7fa40c1ea340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.328+0000 7fa412a97640 1 --2- 172.21.15.29:0/361283114 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa40c1520b0 0x7fa40c155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.328+0000 7fa412a97640 1 --2- 172.21.15.29:0/361283114 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa3f806aed0 0x7fa3f806d390 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.328+0000 7fa412a97640 1 --2- 172.21.15.29:0/361283114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa40c0c4f00 0x7fa40c0c40c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.328+0000 7fa412a97640 1 -- 172.21.15.29:0/361283114 >> 172.21.15.29:0/361283114 conn(0x7fa40c0ca220 msgr2=0x7fa40c153650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:45.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.328+0000 7fa412a97640 1 -- 172.21.15.29:0/361283114 shutdown_connections 2024-01-25T15:04:45.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.328+0000 7fa412a97640 1 -- 172.21.15.29:0/361283114 wait complete. 2024-01-25T15:04:45.340 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2152312734},{"type":"v1","addr":"172.21.15.52:6833","nonce":2152312734}]},"active_addr":"172.21.15.52:6833/2152312734","active_change":"2024-01-25T15:04:06.905730+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":3469485614}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":668888754}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":2897422549}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":526105984}]}]} 2024-01-25T15:04:45.344 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-25T15:04:45.344 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-25T15:04:45.345 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.445+0000 7f0317173640 1 Processor -- start 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.445+0000 7f0317173640 1 -- start start 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.446+0000 7f0317173640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f03100c4980 0x7f0310160140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.446+0000 7f0317173640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03100c5b40 con 0x7f0310151e90 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.446+0000 7f0317173640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03100c9d90 con 0x7f03100c7f00 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.446+0000 7f0317173640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0310154c50 con 0x7f03100c4980 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.446+0000 7f0315710640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f03100c4980 0x7f0310160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.446+0000 7f0314f0f640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0310151e90 0x7f031006b220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54636/0 (socket says 172.21.15.29:54636) 2024-01-25T15:04:45.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.446+0000 7f0314f0f640 1 -- 172.21.15.29:0/2763493396 learned_addr learned my addr 172.21.15.29:0/2763493396 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:45.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.446+0000 7f0315710640 1 -- 172.21.15.29:0/2763493396 >> v1:172.21.15.52:6789/0 conn(0x7f03100c7f00 legacy=0x7f03100c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.446+0000 7f0315710640 1 -- 172.21.15.29:0/2763493396 >> v1:172.21.15.29:6789/0 conn(0x7f0310151e90 legacy=0x7f031006b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.446+0000 7f0315710640 1 -- 172.21.15.29:0/2763493396 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03100c5210 con 0x7f03100c4980 2024-01-25T15:04:45.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.446+0000 7f030f7fe640 1 -- 172.21.15.29:0/2763493396 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1863311403 0 0) 0x7f03100c5b40 con 0x7f0310151e90 2024-01-25T15:04:45.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.447+0000 7f0315710640 1 --2- 172.21.15.29:0/2763493396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03100c4980 0x7f0310160140 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0308009d90 tx=0x7f030802bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93eb43262595d6d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.447+0000 7f030f7fe640 1 -- 172.21.15.29:0/2763493396 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030802cd80 con 0x7f03100c4980 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.447+0000 7f030f7fe640 1 -- 172.21.15.29:0/2763493396 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0308034440 con 0x7f03100c4980 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.447+0000 7f030f7fe640 1 -- 172.21.15.29:0/2763493396 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03080347d0 con 0x7f03100c4980 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.447+0000 7f0317173640 1 -- 172.21.15.29:0/2763493396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03100c4980 msgr2=0x7f0310160140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.447+0000 7f0317173640 1 --2- 172.21.15.29:0/2763493396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03100c4980 0x7f0310160140 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0308009d90 tx=0x7f030802bfd0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.448+0000 7f0317173640 1 -- 172.21.15.29:0/2763493396 shutdown_connections 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.448+0000 7f0317173640 1 --2- 172.21.15.29:0/2763493396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03100c4980 0x7f0310160140 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.448+0000 7f0317173640 1 -- 172.21.15.29:0/2763493396 >> 172.21.15.29:0/2763493396 conn(0x7f03100ca000 msgr2=0x7f03100ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.448+0000 7f0317173640 1 -- 172.21.15.29:0/2763493396 shutdown_connections 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.448+0000 7f0317173640 1 -- 172.21.15.29:0/2763493396 wait complete. 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.449+0000 7f0317173640 1 Processor -- start 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.449+0000 7f0317173640 1 -- start start 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.449+0000 7f0317173640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03100c4980 0x7f03100c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.449+0000 7f0317173640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03100c7f00 0x7f03100c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.449+0000 7f0317173640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0310151e90 0x7f0310155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.450+0000 7f0317173640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03101584b0 con 0x7f03100c4980 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.450+0000 7f0317173640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03100c40a0 con 0x7f03100c7f00 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.450+0000 7f0317173640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03100afaa0 con 0x7f0310151e90 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.450+0000 7f0314f0f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03100c4980 0x7f03100c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.450+0000 7f0314f0f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03100c4980 0x7f03100c3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36304/0 (socket says 172.21.15.29:36304) 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.450+0000 7f0314f0f640 1 -- 172.21.15.29:0/3294984490 learned_addr learned my addr 172.21.15.29:0/3294984490 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.450+0000 7f030ffff640 1 --2- 172.21.15.29:0/3294984490 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03100c7f00 0x7f03100c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.450+0000 7f0315710640 1 --2- 172.21.15.29:0/3294984490 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0310151e90 0x7f0310155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.450+0000 7f0314f0f640 1 -- 172.21.15.29:0/3294984490 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0310151e90 msgr2=0x7f0310155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.450+0000 7f0314f0f640 1 --2- 172.21.15.29:0/3294984490 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0310151e90 0x7f0310155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.450+0000 7f0314f0f640 1 -- 172.21.15.29:0/3294984490 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03100c7f00 msgr2=0x7f03100c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.450+0000 7f0314f0f640 1 --2- 172.21.15.29:0/3294984490 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03100c7f00 0x7f03100c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.450+0000 7f0314f0f640 1 -- 172.21.15.29:0/3294984490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0308009a70 con 0x7f03100c4980 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.450+0000 7f0315710640 1 --2- 172.21.15.29:0/3294984490 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0310151e90 0x7f0310155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.450+0000 7f0314f0f640 1 --2- 172.21.15.29:0/3294984490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03100c4980 0x7f03100c3a30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f030400c3f0 tx=0x7f030400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.450+0000 7f030d7fa640 1 -- 172.21.15.29:0/3294984490 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03040074e0 con 0x7f03100c4980 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.450+0000 7f030d7fa640 1 -- 172.21.15.29:0/3294984490 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0304007640 con 0x7f03100c4980 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.450+0000 7f0317173640 1 -- 172.21.15.29:0/3294984490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03100af4e0 con 0x7f03100c4980 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.450+0000 7f030d7fa640 1 -- 172.21.15.29:0/3294984490 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0304004a00 con 0x7f03100c4980 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.450+0000 7f0317173640 1 -- 172.21.15.29:0/3294984490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03100c6780 con 0x7f03100c4980 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.451+0000 7f0317173640 1 -- 172.21.15.29:0/3294984490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0310074080 con 0x7f03100c4980 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.452+0000 7f030d7fa640 1 -- 172.21.15.29:0/3294984490 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0304004b60 con 0x7f03100c4980 2024-01-25T15:04:45.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.452+0000 7f030d7fa640 1 --2- 172.21.15.29:0/3294984490 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f02f406af00 0x7f02f406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:45.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.452+0000 7f030d7fa640 1 -- 172.21.15.29:0/3294984490 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f03040895a0 con 0x7f03100c4980 2024-01-25T15:04:45.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.452+0000 7f030ffff640 1 --2- 172.21.15.29:0/3294984490 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f02f406af00 0x7f02f406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:45.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.453+0000 7f030ffff640 1 --2- 172.21.15.29:0/3294984490 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f02f406af00 0x7f02f406d3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f03100af170 tx=0x7f02fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:45.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.457+0000 7f030d7fa640 1 -- 172.21.15.29:0/3294984490 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f0304054210 con 0x7f03100c4980 2024-01-25T15:04:45.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.636+0000 7f0317173640 1 -- 172.21.15.29:0/3294984490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f031006bc30 con 0x7f03100c4980 2024-01-25T15:04:45.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.637+0000 7f030d7fa640 1 -- 172.21.15.29:0/3294984490 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18311 (secure 0 0 0) 0x7f0304057830 con 0x7f03100c4980 2024-01-25T15:04:45.638 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:45.638 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:31.978871+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:04:45.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.639+0000 7f0317173640 1 -- 172.21.15.29:0/3294984490 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f02f406af00 msgr2=0x7f02f406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.639+0000 7f0317173640 1 --2- 172.21.15.29:0/3294984490 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f02f406af00 0x7f02f406d3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f03100af170 tx=0x7f02fc009040 comp rx=0 tx=0).stop 2024-01-25T15:04:45.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.639+0000 7f0317173640 1 -- 172.21.15.29:0/3294984490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03100c4980 msgr2=0x7f03100c3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.639+0000 7f0317173640 1 --2- 172.21.15.29:0/3294984490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03100c4980 0x7f03100c3a30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f030400c3f0 tx=0x7f030400c8b0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.639+0000 7f0317173640 1 -- 172.21.15.29:0/3294984490 shutdown_connections 2024-01-25T15:04:45.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.639+0000 7f0317173640 1 --2- 172.21.15.29:0/3294984490 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0310151e90 0x7f0310155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.639+0000 7f0317173640 1 --2- 172.21.15.29:0/3294984490 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03100c7f00 0x7f03100c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.639+0000 7f0317173640 1 --2- 172.21.15.29:0/3294984490 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f02f406af00 0x7f02f406d3c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.639+0000 7f0317173640 1 --2- 172.21.15.29:0/3294984490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03100c4980 0x7f03100c3a30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.639+0000 7f0317173640 1 -- 172.21.15.29:0/3294984490 >> 172.21.15.29:0/3294984490 conn(0x7f03100ca000 msgr2=0x7f031006b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:45.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.639+0000 7f0317173640 1 -- 172.21.15.29:0/3294984490 shutdown_connections 2024-01-25T15:04:45.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.639+0000 7f0317173640 1 -- 172.21.15.29:0/3294984490 wait complete. 2024-01-25T15:04:45.651 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-25T15:04:45.651 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:04:45.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.752+0000 7f8be3351640 1 Processor -- start 2024-01-25T15:04:45.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.752+0000 7f8be3351640 1 -- start start 2024-01-25T15:04:45.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.753+0000 7f8be3351640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8bdc1520b0 0x7f8bdc155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.753+0000 7f8be3351640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bdc0c4f00 0x7f8bdc0c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.753+0000 7f8be3351640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bdc0c66c0 con 0x7f8bdc0c55e0 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.753+0000 7f8be3351640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bdc06cfc0 con 0x7f8bdc1520b0 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.753+0000 7f8be3351640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc152490 con 0x7f8bdc0c4f00 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.753+0000 7f8be18ee640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bdc0c4f00 0x7f8bdc0c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.753+0000 7f8be10ed640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8bdc1520b0 0x7f8bdc155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.754+0000 7f8be18ee640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bdc0c4f00 0x7f8bdc0c5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:40398/0 (socket says 172.21.15.29:40398) 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.754+0000 7f8be18ee640 1 -- 172.21.15.29:0/62733021 learned_addr learned my addr 172.21.15.29:0/62733021 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.754+0000 7f8be18ee640 1 -- 172.21.15.29:0/62733021 >> v2:172.21.15.52:3300/0 conn(0x7f8bdc1520b0 msgr2=0x7f8bdc155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.754+0000 7f8be18ee640 1 --2- 172.21.15.29:0/62733021 >> v2:172.21.15.52:3300/0 conn(0x7f8bdc1520b0 0x7f8bdc155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.754+0000 7f8be18ee640 1 -- 172.21.15.29:0/62733021 >> v1:172.21.15.52:6789/0 conn(0x7f8bdc0c55e0 legacy=0x7f8bdc0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.754+0000 7f8be18ee640 1 -- 172.21.15.29:0/62733021 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bdc0c8830 con 0x7f8bdc0c4f00 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.754+0000 7f8be10ed640 1 --2- 172.21.15.29:0/62733021 >> v2:172.21.15.52:3300/0 conn(0x7f8bdc1520b0 0x7f8bdc155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.755+0000 7f8be18ee640 1 --2- 172.21.15.29:0/62733021 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bdc0c4f00 0x7f8bdc0c5b30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4009870 tx=0x7f8bd402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d76110c3eda69212 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.755+0000 7f8bdbfff640 1 -- 172.21.15.29:0/62733021 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4031640 con 0x7f8bdc0c4f00 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.755+0000 7f8bdbfff640 1 -- 172.21.15.29:0/62733021 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd40317a0 con 0x7f8bdc0c4f00 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.755+0000 7f8bdbfff640 1 -- 172.21.15.29:0/62733021 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4031b30 con 0x7f8bdc0c4f00 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.755+0000 7f8be3351640 1 -- 172.21.15.29:0/62733021 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bdc0c4f00 msgr2=0x7f8bdc0c5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.755+0000 7f8be3351640 1 --2- 172.21.15.29:0/62733021 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bdc0c4f00 0x7f8bdc0c5b30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4009870 tx=0x7f8bd402b8f0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.755+0000 7f8be3351640 1 -- 172.21.15.29:0/62733021 shutdown_connections 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.755+0000 7f8be3351640 1 --2- 172.21.15.29:0/62733021 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bdc0c4f00 0x7f8bdc0c5b30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.755+0000 7f8be3351640 1 --2- 172.21.15.29:0/62733021 >> v2:172.21.15.52:3300/0 conn(0x7f8bdc1520b0 0x7f8bdc155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.755+0000 7f8be3351640 1 -- 172.21.15.29:0/62733021 >> 172.21.15.29:0/62733021 conn(0x7f8bdc0ca220 msgr2=0x7f8bdc0ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:45.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.756+0000 7f8be3351640 1 -- 172.21.15.29:0/62733021 shutdown_connections 2024-01-25T15:04:45.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.756+0000 7f8be3351640 1 -- 172.21.15.29:0/62733021 wait complete. 2024-01-25T15:04:45.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.757+0000 7f8be3351640 1 Processor -- start 2024-01-25T15:04:45.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.757+0000 7f8be3351640 1 -- start start 2024-01-25T15:04:45.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.757+0000 7f8be3351640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bdc0c4f00 0x7f8bdc14a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:45.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.757+0000 7f8be3351640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bdc1520b0 0x7f8bdc0c3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:45.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.757+0000 7f8be3351640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bdc1eab50 0x7f8bdc0c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:45.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.757+0000 7f8be3351640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc0ad7f0 con 0x7f8bdc1eab50 2024-01-25T15:04:45.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.757+0000 7f8be3351640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc0ad510 con 0x7f8bdc1520b0 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.757+0000 7f8be3351640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc0c3c10 con 0x7f8bdc0c4f00 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.757+0000 7f8be18ee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bdc1eab50 0x7f8bdc0c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.757+0000 7f8be18ee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bdc1eab50 0x7f8bdc0c36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44380/0 (socket says 172.21.15.29:44380) 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.757+0000 7f8be18ee640 1 -- 172.21.15.29:0/4219842365 learned_addr learned my addr 172.21.15.29:0/4219842365 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.757+0000 7f8be10ed640 1 --2- 172.21.15.29:0/4219842365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bdc0c4f00 0x7f8bdc14a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.758+0000 7f8be08ec640 1 --2- 172.21.15.29:0/4219842365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bdc1520b0 0x7f8bdc0c3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.758+0000 7f8be18ee640 1 -- 172.21.15.29:0/4219842365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bdc0c4f00 msgr2=0x7f8bdc14a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.758+0000 7f8be18ee640 1 --2- 172.21.15.29:0/4219842365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bdc0c4f00 0x7f8bdc14a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.758+0000 7f8be18ee640 1 -- 172.21.15.29:0/4219842365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bdc1520b0 msgr2=0x7f8bdc0c3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.758+0000 7f8be18ee640 1 --2- 172.21.15.29:0/4219842365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bdc1520b0 0x7f8bdc0c3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.758+0000 7f8be18ee640 1 -- 172.21.15.29:0/4219842365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bcc009a70 con 0x7f8bdc1eab50 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.758+0000 7f8be18ee640 1 --2- 172.21.15.29:0/4219842365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bdc1eab50 0x7f8bdc0c36d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4009870 tx=0x7f8bd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.758+0000 7f8bd9ffb640 1 -- 172.21.15.29:0/4219842365 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd403a930 con 0x7f8bdc1eab50 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.758+0000 7f8bd9ffb640 1 -- 172.21.15.29:0/4219842365 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd403aab0 con 0x7f8bdc1eab50 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.758+0000 7f8bd9ffb640 1 -- 172.21.15.29:0/4219842365 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd403ae60 con 0x7f8bdc1eab50 2024-01-25T15:04:45.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.758+0000 7f8be3351640 1 -- 172.21.15.29:0/4219842365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd40094d0 con 0x7f8bdc1eab50 2024-01-25T15:04:45.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.758+0000 7f8be3351640 1 -- 172.21.15.29:0/4219842365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bdc0acec0 con 0x7f8bdc1eab50 2024-01-25T15:04:45.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.759+0000 7f8be3351640 1 -- 172.21.15.29:0/4219842365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bdc0a9c70 con 0x7f8bdc1eab50 2024-01-25T15:04:45.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.760+0000 7f8bd9ffb640 1 -- 172.21.15.29:0/4219842365 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8bd402f050 con 0x7f8bdc1eab50 2024-01-25T15:04:45.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.760+0000 7f8bd9ffb640 1 --2- 172.21.15.29:0/4219842365 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8bc806aed0 0x7f8bc806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:45.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.760+0000 7f8bd9ffb640 1 -- 172.21.15.29:0/4219842365 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8bd40ab5d0 con 0x7f8bdc1eab50 2024-01-25T15:04:45.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.760+0000 7f8be10ed640 1 --2- 172.21.15.29:0/4219842365 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8bc806aed0 0x7f8bc806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:45.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.761+0000 7f8be10ed640 1 --2- 172.21.15.29:0/4219842365 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8bc806aed0 0x7f8bc806d390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc0114e0 tx=0x7f8bcc00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:45.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.764+0000 7f8bd9ffb640 1 -- 172.21.15.29:0/4219842365 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8bdc0a9c70 con 0x7f8bdc1eab50 2024-01-25T15:04:45.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.945+0000 7f8be3351640 1 -- 172.21.15.29:0/4219842365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8bdc0a9c70 con 0x7f8bdc1eab50 2024-01-25T15:04:45.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.946+0000 7f8bd9ffb640 1 -- 172.21.15.29:0/4219842365 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18311 (secure 0 0 0) 0x7f8bdc0a9c70 con 0x7f8bdc1eab50 2024-01-25T15:04:45.947 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:45.947 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:31.978871+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.948+0000 7f8be3351640 1 -- 172.21.15.29:0/4219842365 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8bc806aed0 msgr2=0x7f8bc806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.948+0000 7f8be3351640 1 --2- 172.21.15.29:0/4219842365 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8bc806aed0 0x7f8bc806d390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc0114e0 tx=0x7f8bcc00b040 comp rx=0 tx=0).stop 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.948+0000 7f8be3351640 1 -- 172.21.15.29:0/4219842365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bdc1eab50 msgr2=0x7f8bdc0c36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.948+0000 7f8be3351640 1 --2- 172.21.15.29:0/4219842365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bdc1eab50 0x7f8bdc0c36d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4009870 tx=0x7f8bd40046c0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.948+0000 7f8be3351640 1 -- 172.21.15.29:0/4219842365 shutdown_connections 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.948+0000 7f8be3351640 1 --2- 172.21.15.29:0/4219842365 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8bc806aed0 0x7f8bc806d390 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.948+0000 7f8be3351640 1 --2- 172.21.15.29:0/4219842365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bdc1eab50 0x7f8bdc0c36d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.948+0000 7f8be3351640 1 --2- 172.21.15.29:0/4219842365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bdc1520b0 0x7f8bdc0c3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.948+0000 7f8be3351640 1 --2- 172.21.15.29:0/4219842365 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bdc0c4f00 0x7f8bdc14a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.948+0000 7f8be3351640 1 -- 172.21.15.29:0/4219842365 >> 172.21.15.29:0/4219842365 conn(0x7f8bdc0ca220 msgr2=0x7f8bdc06c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:45.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.948+0000 7f8be3351640 1 -- 172.21.15.29:0/4219842365 shutdown_connections 2024-01-25T15:04:45.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:45.948+0000 7f8be3351640 1 -- 172.21.15.29:0/4219842365 wait complete. 2024-01-25T15:04:45.960 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-25T15:04:45.960 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-25T15:04:45.961 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-25T15:04:45.961 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-25T15:04:45.961 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-01-25T15:04:45.962 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-01-25T15:04:45.962 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-01-25T15:04:45.962 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-01-25T15:04:46.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.134+0000 7fb72e08c640 1 Processor -- start 2024-01-25T15:04:46.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.135+0000 7f1d88456640 1 Processor -- start 2024-01-25T15:04:46.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.135+0000 7f8a9bacf640 1 Processor -- start 2024-01-25T15:04:46.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.135+0000 7f833cd6c640 1 Processor -- start 2024-01-25T15:04:46.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.135+0000 7f833cd6c640 1 -- start start 2024-01-25T15:04:46.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.135+0000 7f8a9bacf640 1 -- start start 2024-01-25T15:04:46.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.135+0000 7fb72e08c640 1 -- start start 2024-01-25T15:04:46.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.136+0000 7fb72e08c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb7200e8210 0x7fb7200ea600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.136+0000 7fb72e08c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7200e28f0 con 0x7fb72004b330 2024-01-25T15:04:46.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.136+0000 7fb72e08c640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72000b7c0 con 0x7fb7200dc080 2024-01-25T15:04:46.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.136+0000 7fb72e08c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb72004ad50 con 0x7fb7200e8210 2024-01-25T15:04:46.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.136+0000 7fb72d88b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb7200e8210 0x7fb7200ea600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.136+0000 7fb72d88b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb7200e8210 0x7fb7200ea600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44388/0 (socket says 172.21.15.29:44388) 2024-01-25T15:04:46.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.136+0000 7fb72d88b640 1 -- 172.21.15.29:0/3595098968 learned_addr learned my addr 172.21.15.29:0/3595098968 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:46.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.135+0000 7f913d6e5640 1 Processor -- start 2024-01-25T15:04:46.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.135+0000 7f1d88456640 1 -- start start 2024-01-25T15:04:46.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.136+0000 7f833cd6c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f83380c4c90 0x7f83380c0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f833cd6c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f83380c4290 0x7f8338155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f833cd6c640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83380c3e00 con 0x7f833806dcb0 2024-01-25T15:04:46.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f833cd6c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83380c5230 con 0x7f83380c4c90 2024-01-25T15:04:46.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f833cd6c640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83380c5510 con 0x7f83380c4290 2024-01-25T15:04:46.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7ff3eea75640 1 Processor -- start 2024-01-25T15:04:46.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7ff3eea75640 1 -- start start 2024-01-25T15:04:46.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.136+0000 7f06dd203640 1 Processor -- start 2024-01-25T15:04:46.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.135+0000 7f59e32d3640 1 Processor -- start 2024-01-25T15:04:46.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.135+0000 7f59e32d3640 1 -- start start 2024-01-25T15:04:46.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.136+0000 7f59e32d3640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59dc06c530 0x7f59dc159520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.136+0000 7f59e32d3640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc06c9c0 con 0x7f59dc152a80 2024-01-25T15:04:46.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f59e32d3640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc070e20 con 0x7f59dc0723d0 2024-01-25T15:04:46.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f59e32d3640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc071c30 con 0x7f59dc06c530 2024-01-25T15:04:46.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f1d88456640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1d80156190 0x7f1d8006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f1d88456640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1d80071890 0x7f1d800704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f1d88456640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d8006d830 0x7f1d80070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f1d88456640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d80156570 con 0x7f1d80071890 2024-01-25T15:04:46.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f1d88456640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d80158e80 con 0x7f1d80156190 2024-01-25T15:04:46.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f1d88456640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d80159160 con 0x7f1d8006d830 2024-01-25T15:04:46.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f59e086e640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f59dc0723d0 0x7f59dc06be20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:49678/0 (socket says 172.21.15.29:49678) 2024-01-25T15:04:46.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f59e086e640 1 -- 172.21.15.29:0/1742924634 learned_addr learned my addr 172.21.15.29:0/1742924634 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:46.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f59e1870640 1 --2- 172.21.15.29:0/1742924634 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59dc06c530 0x7f59dc159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.136+0000 7f913d6e5640 1 -- start start 2024-01-25T15:04:46.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f913d6e5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9138156190 0x7f913806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f06dd203640 1 -- start start 2024-01-25T15:04:46.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f1d861f2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1d80156190 0x7f1d8006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f1d861f2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1d80156190 0x7f1d8006d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:33392/0 (socket says 172.21.15.29:33392) 2024-01-25T15:04:46.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f1d861f2640 1 -- 172.21.15.29:0/2131573591 learned_addr learned my addr 172.21.15.29:0/2131573591 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:46.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f1d869f3640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d8006d830 0x7f1d80070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f913d6e5640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9138158e80 con 0x7f913806d830 2024-01-25T15:04:46.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f1d859f1640 1 --2- 172.21.15.29:0/2131573591 >> v2:172.21.15.29:3300/0 conn(0x7f1d80071890 0x7f1d800704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7fb71bfff640 1 -- 172.21.15.29:0/3595098968 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324252613 0 0) 0x7fb72000b7c0 con 0x7fb7200dc080 2024-01-25T15:04:46.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f59e1870640 1 -- 172.21.15.29:0/1742924634 >> v1:172.21.15.52:6789/0 conn(0x7f59dc0723d0 legacy=0x7f59dc06be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f59e1870640 1 -- 172.21.15.29:0/1742924634 >> v1:172.21.15.29:6789/0 conn(0x7f59dc152a80 legacy=0x7f59dc0c1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f59e1870640 1 -- 172.21.15.29:0/1742924634 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc070230 con 0x7f59dc06c530 2024-01-25T15:04:46.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f913d6e5640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9138159160 con 0x7f9138071890 2024-01-25T15:04:46.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f913d6e5640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9138156570 con 0x7f9138156190 2024-01-25T15:04:46.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7fb71bfff640 1 -- 172.21.15.29:0/3595098968 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb714003520 con 0x7fb7200dc080 2024-01-25T15:04:46.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7fb72d88b640 1 -- 172.21.15.29:0/3595098968 >> v1:172.21.15.52:6789/0 conn(0x7fb7200dc080 legacy=0x7fb7200070e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.137+0000 7f83377fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f833806dcb0 0x7f8338159490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:49666/0 (socket says 172.21.15.29:49666) 2024-01-25T15:04:46.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f83377fe640 1 -- 172.21.15.29:0/2766634485 learned_addr learned my addr 172.21.15.29:0/2766634485 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:46.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f8336ffd640 1 --2- 172.21.15.29:0/2766634485 >> v2:172.21.15.29:3300/0 conn(0x7f83380c4c90 0x7f83380c0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f8337fff640 1 --2- 172.21.15.29:0/2766634485 >> v2:172.21.15.52:3300/0 conn(0x7f83380c4290 0x7f8338155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7fb71bfff640 1 -- 172.21.15.29:0/3595098968 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134388579 0 0) 0x7fb7200e28f0 con 0x7fb72004b330 2024-01-25T15:04:46.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7fb72d88b640 1 -- 172.21.15.29:0/3595098968 >> v1:172.21.15.29:6789/0 conn(0x7fb72004b330 legacy=0x7fb72003ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7fb72d88b640 1 -- 172.21.15.29:0/3595098968 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72000bd10 con 0x7fb7200e8210 2024-01-25T15:04:46.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f8a9bacf640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a8c0d6fd0 0x7f8a8c04c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f8a9bacf640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a8c0d4a40 con 0x7f8a8c0d4660 2024-01-25T15:04:46.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f8a9bacf640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a8c04b510 con 0x7f8a8c049e00 2024-01-25T15:04:46.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f8a9bacf640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c007c10 con 0x7f8a8c0d6fd0 2024-01-25T15:04:46.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f83367fc640 1 -- 172.21.15.29:0/2766634485 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746097935 0 0) 0x7f83380c3e00 con 0x7f833806dcb0 2024-01-25T15:04:46.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f83367fc640 1 -- 172.21.15.29:0/2766634485 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8320003520 con 0x7f833806dcb0 2024-01-25T15:04:46.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f1d869f3640 1 -- 172.21.15.29:0/2131573591 >> v2:172.21.15.52:3300/0 conn(0x7f1d80156190 msgr2=0x7f1d8006d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f1d869f3640 1 --2- 172.21.15.29:0/2131573591 >> v2:172.21.15.52:3300/0 conn(0x7f1d80156190 0x7f1d8006d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f1d869f3640 1 -- 172.21.15.29:0/2131573591 >> v2:172.21.15.29:3300/0 conn(0x7f1d80071890 msgr2=0x7f1d800704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f1d869f3640 1 --2- 172.21.15.29:0/2131573591 >> v2:172.21.15.29:3300/0 conn(0x7f1d80071890 0x7f1d800704d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f1d869f3640 1 -- 172.21.15.29:0/2131573591 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d80159440 con 0x7f1d8006d830 2024-01-25T15:04:46.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7ff3eea75640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3e814ddf0 0x7ff3e8151110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7ff3eea75640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff3e80c1920 0x7ff3e80c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f06dd203640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f06d00d7b60 0x7f06d0007200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f06dd203640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06d004e0f0 0x7f06d004efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f06dd203640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d000fd60 con 0x7f06d0007740 2024-01-25T15:04:46.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f06dd203640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d00db180 con 0x7f06d00d7b60 2024-01-25T15:04:46.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f06dd203640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d000f8e0 con 0x7f06d004e0f0 2024-01-25T15:04:46.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7ff3eea75640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e8151650 con 0x7ff3e806c090 2024-01-25T15:04:46.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7ff3eea75640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e80705a0 con 0x7ff3e80c1920 2024-01-25T15:04:46.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f06d7fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f06d00d7b60 0x7f06d0007200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7ff3eea75640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e8070880 con 0x7ff3e814ddf0 2024-01-25T15:04:46.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f06d77fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f06d0007740 0x7f06d004e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:49704/0 (socket says 172.21.15.29:49704) 2024-01-25T15:04:46.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f8a9906a640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8a8c049e00 0x7f8a8c04ba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:49698/0 (socket says 172.21.15.29:49698) 2024-01-25T15:04:46.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f8a9906a640 1 -- 172.21.15.29:0/756066534 learned_addr learned my addr 172.21.15.29:0/756066534 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:46.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f59e1870640 1 --2- 172.21.15.29:0/1742924634 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59dc06c530 0x7f59dc159520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f59d80097d0 tx=0x7f59d802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=468291b0324c7bcc server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f9136ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9138156190 0x7f913806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f06d77fe640 1 -- 172.21.15.29:0/1150493923 learned_addr learned my addr 172.21.15.29:0/1150493923 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:46.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f06dca02640 1 --2- 172.21.15.29:0/1150493923 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06d004e0f0 0x7f06d004efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f91377fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f913806d830 0x7f9138070be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58912/0 (socket says 172.21.15.29:58912) 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f91377fe640 1 -- 172.21.15.29:0/1000527187 learned_addr learned my addr 172.21.15.29:0/1000527187 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f83367fc640 1 -- 172.21.15.29:0/2766634485 <== mon.1 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3551959400 0 0) 0x7f8320003520 con 0x7f833806dcb0 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f83367fc640 1 -- 172.21.15.29:0/2766634485 >> v2:172.21.15.52:3300/0 conn(0x7f83380c4290 msgr2=0x7f8338155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f83367fc640 1 --2- 172.21.15.29:0/2766634485 >> v2:172.21.15.52:3300/0 conn(0x7f83380c4290 0x7f8338155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.138+0000 7f83367fc640 1 -- 172.21.15.29:0/2766634485 >> v2:172.21.15.29:3300/0 conn(0x7f83380c4c90 msgr2=0x7f83380c0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f83367fc640 1 --2- 172.21.15.29:0/2766634485 >> v2:172.21.15.29:3300/0 conn(0x7f83380c4c90 0x7f83380c0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f83367fc640 1 -- 172.21.15.29:0/2766634485 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83380c57f0 con 0x7f833806dcb0 2024-01-25T15:04:46.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f83367fc640 1 -- 172.21.15.29:0/2766634485 <== mon.1 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f83300019f0 con 0x7f833806dcb0 2024-01-25T15:04:46.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f8337fff640 1 --2- 172.21.15.29:0/2766634485 >> v2:172.21.15.52:3300/0 conn(0x7f83380c4290 0x7f8338155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:46.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f8a9a06c640 1 --2- 172.21.15.29:0/756066534 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a8c0d6fd0 0x7f8a8c04c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7ff3ed012640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff3e806c090 0x7ff3e806c500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:49714/0 (socket says 172.21.15.29:49714) 2024-01-25T15:04:46.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7ff3e7fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff3e80c1920 0x7ff3e80c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7ff3ed012640 1 -- 172.21.15.29:0/3947446478 learned_addr learned my addr 172.21.15.29:0/3947446478 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:46.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f8a98869640 1 -- 172.21.15.29:0/756066534 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147983240 0 0) 0x7f8a8c04b510 con 0x7f8a8c049e00 2024-01-25T15:04:46.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f06d7fff640 1 -- 172.21.15.29:0/1150493923 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06d004e0f0 msgr2=0x7f06d004efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f06d7fff640 1 --2- 172.21.15.29:0/1150493923 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06d004e0f0 0x7f06d004efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f06d7fff640 1 -- 172.21.15.29:0/1150493923 >> v1:172.21.15.52:6789/0 conn(0x7f06d0007740 legacy=0x7f06d004e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f06d7fff640 1 -- 172.21.15.29:0/1150493923 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d00da500 con 0x7f06d00d7b60 2024-01-25T15:04:46.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7ff3ec811640 1 --2- 172.21.15.29:0/3947446478 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3e814ddf0 0x7ff3e8151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f8a98869640 1 -- 172.21.15.29:0/756066534 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a80003520 con 0x7f8a8c049e00 2024-01-25T15:04:46.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f59d3fff640 1 -- 172.21.15.29:0/1742924634 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d80316f0 con 0x7f59dc06c530 2024-01-25T15:04:46.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f1d869f3640 1 --2- 172.21.15.29:0/2131573591 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d8006d830 0x7f1d80070a10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1d800c6db0 tx=0x7f1d7002b7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa0bee6d4276eae server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f9135ffb640 1 -- 172.21.15.29:0/1000527187 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1768945703 0 0) 0x7f9138159160 con 0x7f9138071890 2024-01-25T15:04:46.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f9135ffb640 1 -- 172.21.15.29:0/1000527187 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9120003520 con 0x7f9138071890 2024-01-25T15:04:46.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f83367fc640 1 -- 172.21.15.29:0/2766634485 >> v1:172.21.15.52:6789/0 conn(0x7f833806dcb0 legacy=0x7f8338159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f83367fc640 1 --2- 172.21.15.29:0/2766634485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83200039c0 0x7f8320003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f83367fc640 1 --2- 172.21.15.29:0/2766634485 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83200047c0 0x7f8320004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f83367fc640 1 --2- 172.21.15.29:0/2766634485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8320005180 0x7f832000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f83367fc640 1 -- 172.21.15.29:0/2766634485 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83380c5230 con 0x7f83200039c0 2024-01-25T15:04:46.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f83367fc640 1 -- 172.21.15.29:0/2766634485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83380c5510 con 0x7f8320005180 2024-01-25T15:04:46.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f83367fc640 1 -- 172.21.15.29:0/2766634485 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832000c020 con 0x7f83200047c0 2024-01-25T15:04:46.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7ff3e77fe640 1 -- 172.21.15.29:0/3947446478 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249305984 0 0) 0x7ff3e8151650 con 0x7ff3e806c090 2024-01-25T15:04:46.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f83377fe640 1 --2- 172.21.15.29:0/2766634485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83200039c0 0x7f8320003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f8336ffd640 1 --2- 172.21.15.29:0/2766634485 >> v2:172.21.15.29:3300/0 conn(0x7f83380c4c90 0x7f83380c0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:46.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7ff3e77fe640 1 -- 172.21.15.29:0/3947446478 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3d8003520 con 0x7ff3e806c090 2024-01-25T15:04:46.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f8a98869640 1 -- 172.21.15.29:0/756066534 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097310814 0 0) 0x7f8a8c0d4a40 con 0x7f8a8c0d4660 2024-01-25T15:04:46.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f8a98869640 1 -- 172.21.15.29:0/756066534 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a8c04b510 con 0x7f8a8c0d4660 2024-01-25T15:04:46.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f59d3fff640 1 -- 172.21.15.29:0/1742924634 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d8031850 con 0x7f59dc06c530 2024-01-25T15:04:46.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.139+0000 7f59d3fff640 1 -- 172.21.15.29:0/1742924634 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d8031be0 con 0x7f59dc06c530 2024-01-25T15:04:46.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f8a98869640 1 -- 172.21.15.29:0/756066534 <== mon.1 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1496568657 0 0) 0x7f8a80003520 con 0x7f8a8c049e00 2024-01-25T15:04:46.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f8a98869640 1 -- 172.21.15.29:0/756066534 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a8c0d6fd0 msgr2=0x7f8a8c04c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f8a98869640 1 --2- 172.21.15.29:0/756066534 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a8c0d6fd0 0x7f8a8c04c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f9135ffb640 1 -- 172.21.15.29:0/1000527187 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 180125122 0 0) 0x7f9138158e80 con 0x7f913806d830 2024-01-25T15:04:46.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f9135ffb640 1 -- 172.21.15.29:0/1000527187 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9138159160 con 0x7f913806d830 2024-01-25T15:04:46.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f9135ffb640 1 -- 172.21.15.29:0/1000527187 <== mon.1 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3808654172 0 0) 0x7f9120003520 con 0x7f9138071890 2024-01-25T15:04:46.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f9135ffb640 1 -- 172.21.15.29:0/1000527187 >> v2:172.21.15.52:3300/0 conn(0x7f9138156190 msgr2=0x7f913806d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f9135ffb640 1 --2- 172.21.15.29:0/1000527187 >> v2:172.21.15.52:3300/0 conn(0x7f9138156190 0x7f913806d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f9135ffb640 1 -- 172.21.15.29:0/1000527187 >> v1:172.21.15.29:6789/0 conn(0x7f913806d830 legacy=0x7f9138070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f9135ffb640 1 -- 172.21.15.29:0/1000527187 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9138159440 con 0x7f9138071890 2024-01-25T15:04:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f8a98869640 1 -- 172.21.15.29:0/756066534 >> v1:172.21.15.29:6789/0 conn(0x7f8a8c0d4660 legacy=0x7f8a8c0471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f8a98869640 1 -- 172.21.15.29:0/756066534 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c0d75b0 con 0x7f8a8c049e00 2024-01-25T15:04:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f8a98869640 1 -- 172.21.15.29:0/756066534 <== mon.1 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f8a94062320 con 0x7f8a8c049e00 2024-01-25T15:04:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f1d851f0640 1 -- 172.21.15.29:0/2131573591 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d70031520 con 0x7f1d8006d830 2024-01-25T15:04:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7fb72d88b640 1 --2- 172.21.15.29:0/3595098968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7200e8210 0x7fb7200ea600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb71c009870 tx=0x7fb71c02b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f1e26608cb6fc server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f8a98869640 1 -- 172.21.15.29:0/756066534 >> v1:172.21.15.52:6789/0 conn(0x7f8a8c049e00 legacy=0x7f8a8c04ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f8336ffd640 1 --2- 172.21.15.29:0/2766634485 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83200047c0 0x7f8320004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f8a98869640 1 --2- 172.21.15.29:0/756066534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a80003b00 0x7f8a80003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7ff3e7fff640 1 -- 172.21.15.29:0/3947446478 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3e814ddf0 msgr2=0x7ff3e8151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7ff3e7fff640 1 --2- 172.21.15.29:0/3947446478 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3e814ddf0 0x7ff3e8151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7ff3e7fff640 1 -- 172.21.15.29:0/3947446478 >> v1:172.21.15.52:6789/0 conn(0x7ff3e806c090 legacy=0x7ff3e806c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7ff3e7fff640 1 -- 172.21.15.29:0/3947446478 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e8070b60 con 0x7ff3e80c1920 2024-01-25T15:04:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f1d851f0640 1 -- 172.21.15.29:0/2131573591 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d70031680 con 0x7f1d8006d830 2024-01-25T15:04:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f8a98869640 1 --2- 172.21.15.29:0/756066534 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a800047c0 0x7f8a80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f1d851f0640 1 -- 172.21.15.29:0/2131573591 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d70031a10 con 0x7f1d8006d830 2024-01-25T15:04:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f06d7fff640 1 --2- 172.21.15.29:0/1150493923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06d00d7b60 0x7f06d0007200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f06c40097a0 tx=0x7f06c402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f6a5be901c834d2 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f8a98869640 1 --2- 172.21.15.29:0/756066534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a80005180 0x7f8a8000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f8a9906a640 1 --2- 172.21.15.29:0/756066534 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a800047c0 0x7f8a80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f06d6ffd640 1 -- 172.21.15.29:0/1150493923 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c402d040 con 0x7f06d00d7b60 2024-01-25T15:04:46.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f8a98869640 1 -- 172.21.15.29:0/756066534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8000bec0 con 0x7f8a80003b00 2024-01-25T15:04:46.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f8337fff640 1 --2- 172.21.15.29:0/2766634485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8320005180 0x7f832000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f8a98869640 1 -- 172.21.15.29:0/756066534 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8000c000 con 0x7f8a80005180 2024-01-25T15:04:46.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f8a98869640 1 -- 172.21.15.29:0/756066534 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8000c1c0 con 0x7f8a800047c0 2024-01-25T15:04:46.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f8a9a06c640 1 --2- 172.21.15.29:0/756066534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a80005180 0x7f8a8000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f06d6ffd640 1 -- 172.21.15.29:0/1150493923 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c4031810 con 0x7f06d00d7b60 2024-01-25T15:04:46.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f06d6ffd640 1 -- 172.21.15.29:0/1150493923 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c4031ba0 con 0x7f06d00d7b60 2024-01-25T15:04:46.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7fb71bfff640 1 -- 172.21.15.29:0/3595098968 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c031890 con 0x7fb7200e8210 2024-01-25T15:04:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f59e32d3640 1 -- 172.21.15.29:0/1742924634 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59dc06c530 msgr2=0x7f59dc159520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f59e32d3640 1 --2- 172.21.15.29:0/1742924634 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59dc06c530 0x7f59dc159520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f59d80097d0 tx=0x7f59d802b790 comp rx=0 tx=0).stop 2024-01-25T15:04:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f9135ffb640 1 -- 172.21.15.29:0/1000527187 <== mon.1 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f912c001670 con 0x7f9138071890 2024-01-25T15:04:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f9135ffb640 1 -- 172.21.15.29:0/1000527187 >> v1:172.21.15.52:6789/0 conn(0x7f9138071890 legacy=0x7f91380704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f9135ffb640 1 --2- 172.21.15.29:0/1000527187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9120003b70 0x7f9120003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f9135ffb640 1 --2- 172.21.15.29:0/1000527187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91200047c0 0x7f9120004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f9135ffb640 1 --2- 172.21.15.29:0/1000527187 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91200052f0 0x7f912000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f9135ffb640 1 -- 172.21.15.29:0/1000527187 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9138156570 con 0x7f9120003b70 2024-01-25T15:04:46.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f9135ffb640 1 -- 172.21.15.29:0/1000527187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912000c240 con 0x7f91200047c0 2024-01-25T15:04:46.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f9135ffb640 1 -- 172.21.15.29:0/1000527187 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912000c400 con 0x7f91200052f0 2024-01-25T15:04:46.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.140+0000 7f91367fc640 1 --2- 172.21.15.29:0/1000527187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91200047c0 0x7f9120004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f91377fe640 1 --2- 172.21.15.29:0/1000527187 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91200052f0 0x7f912000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f8a9986b640 1 --2- 172.21.15.29:0/756066534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a80003b00 0x7f8a80003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7fb71bfff640 1 -- 172.21.15.29:0/3595098968 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71c0319f0 con 0x7fb7200e8210 2024-01-25T15:04:46.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f9136ffd640 1 --2- 172.21.15.29:0/1000527187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9120003b70 0x7f9120003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f83377fe640 1 -- 172.21.15.29:0/2766634485 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83200047c0 msgr2=0x7f8320004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f83377fe640 1 --2- 172.21.15.29:0/2766634485 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83200047c0 0x7f8320004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f83377fe640 1 -- 172.21.15.29:0/2766634485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8320005180 msgr2=0x7f832000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f83377fe640 1 --2- 172.21.15.29:0/2766634485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8320005180 0x7f832000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f83377fe640 1 -- 172.21.15.29:0/2766634485 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8320003520 con 0x7f83200039c0 2024-01-25T15:04:46.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f8337fff640 1 -- 172.21.15.29:0/2766634485 reap_dead start 2024-01-25T15:04:46.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f59e32d3640 1 -- 172.21.15.29:0/1742924634 shutdown_connections 2024-01-25T15:04:46.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f59e32d3640 1 --2- 172.21.15.29:0/1742924634 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59dc06c530 0x7f59dc159520 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f59e32d3640 1 -- 172.21.15.29:0/1742924634 >> 172.21.15.29:0/1742924634 conn(0x7f59dc0c2a10 msgr2=0x7f59dc0c2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f1d88456640 1 -- 172.21.15.29:0/2131573591 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d8006d830 msgr2=0x7f1d80070a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f1d88456640 1 --2- 172.21.15.29:0/2131573591 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d8006d830 0x7f1d80070a10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1d800c6db0 tx=0x7f1d7002b7c0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7ff3e7fff640 1 --2- 172.21.15.29:0/3947446478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3e80c1920 0x7ff3e80c1d80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00c950 tx=0x7ff3dc02dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85ab460d488e365 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f91367fc640 1 -- 172.21.15.29:0/1000527187 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91200052f0 msgr2=0x7f912000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f91367fc640 1 --2- 172.21.15.29:0/1000527187 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91200052f0 0x7f912000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f91367fc640 1 -- 172.21.15.29:0/1000527187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9120003b70 msgr2=0x7f9120003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f91367fc640 1 --2- 172.21.15.29:0/1000527187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9120003b70 0x7f9120003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f91367fc640 1 -- 172.21.15.29:0/1000527187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9120003520 con 0x7f91200047c0 2024-01-25T15:04:46.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f1d88456640 1 -- 172.21.15.29:0/2131573591 shutdown_connections 2024-01-25T15:04:46.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f1d88456640 1 --2- 172.21.15.29:0/2131573591 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d8006d830 0x7f1d80070a10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f1d88456640 1 --2- 172.21.15.29:0/2131573591 >> v2:172.21.15.29:3300/0 conn(0x7f1d80071890 0x7f1d800704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f1d88456640 1 --2- 172.21.15.29:0/2131573591 >> v2:172.21.15.52:3300/0 conn(0x7f1d80156190 0x7f1d8006d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f1d88456640 1 -- 172.21.15.29:0/2131573591 >> 172.21.15.29:0/2131573591 conn(0x7f1d800c2a10 msgr2=0x7f1d800c2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7ff3e77fe640 1 -- 172.21.15.29:0/3947446478 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc02e6c0 con 0x7ff3e80c1920 2024-01-25T15:04:46.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7fb71bfff640 1 -- 172.21.15.29:0/3595098968 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c031d80 con 0x7fb7200e8210 2024-01-25T15:04:46.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7ff3e77fe640 1 -- 172.21.15.29:0/3947446478 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc02e820 con 0x7ff3e80c1920 2024-01-25T15:04:46.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7ff3e77fe640 1 -- 172.21.15.29:0/3947446478 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc02ebf0 con 0x7ff3e80c1920 2024-01-25T15:04:46.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7fb72e08c640 1 -- 172.21.15.29:0/3595098968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7200e8210 msgr2=0x7fb7200ea600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7fb72e08c640 1 --2- 172.21.15.29:0/3595098968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7200e8210 0x7fb7200ea600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb71c009870 tx=0x7fb71c02b930 comp rx=0 tx=0).stop 2024-01-25T15:04:46.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f8a9986b640 1 -- 172.21.15.29:0/756066534 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a800047c0 msgr2=0x7f8a80004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f8a9986b640 1 --2- 172.21.15.29:0/756066534 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a800047c0 0x7f8a80004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f8a9986b640 1 -- 172.21.15.29:0/756066534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a80005180 msgr2=0x7f8a8000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f8a9986b640 1 --2- 172.21.15.29:0/756066534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a80005180 0x7f8a8000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.141+0000 7f8a9986b640 1 -- 172.21.15.29:0/756066534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a80003520 con 0x7f8a80003b00 2024-01-25T15:04:46.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7f06dd203640 1 -- 172.21.15.29:0/1150493923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06d00d7b60 msgr2=0x7f06d0007200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7f06dd203640 1 --2- 172.21.15.29:0/1150493923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06d00d7b60 0x7f06d0007200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f06c40097a0 tx=0x7f06c402b8b0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7fb72e08c640 1 -- 172.21.15.29:0/3595098968 shutdown_connections 2024-01-25T15:04:46.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7fb72e08c640 1 --2- 172.21.15.29:0/3595098968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7200e8210 0x7fb7200ea600 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7fb72e08c640 1 -- 172.21.15.29:0/3595098968 >> 172.21.15.29:0/3595098968 conn(0x7fb720006330 msgr2=0x7fb720006740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7f59e32d3640 1 -- 172.21.15.29:0/1742924634 shutdown_connections 2024-01-25T15:04:46.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7f59e32d3640 1 -- 172.21.15.29:0/1742924634 wait complete. 2024-01-25T15:04:46.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7f06dd203640 1 -- 172.21.15.29:0/1150493923 shutdown_connections 2024-01-25T15:04:46.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7f06dd203640 1 --2- 172.21.15.29:0/1150493923 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06d004e0f0 0x7f06d004efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7f06dd203640 1 --2- 172.21.15.29:0/1150493923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06d00d7b60 0x7f06d0007200 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7f06dd203640 1 -- 172.21.15.29:0/1150493923 >> 172.21.15.29:0/1150493923 conn(0x7f06d004c5e0 msgr2=0x7f06d004c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7f91377fe640 1 -- 172.21.15.29:0/1000527187 reap_dead start 2024-01-25T15:04:46.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7f06dd203640 1 -- 172.21.15.29:0/1150493923 shutdown_connections 2024-01-25T15:04:46.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7f1d88456640 1 -- 172.21.15.29:0/2131573591 shutdown_connections 2024-01-25T15:04:46.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7f1d88456640 1 -- 172.21.15.29:0/2131573591 wait complete. 2024-01-25T15:04:46.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7f06dd203640 1 -- 172.21.15.29:0/1150493923 wait complete. 2024-01-25T15:04:46.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7fb72e08c640 1 -- 172.21.15.29:0/3595098968 shutdown_connections 2024-01-25T15:04:46.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7f83377fe640 1 --2- 172.21.15.29:0/2766634485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83200039c0 0x7f8320003de0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f833000a7b0 tx=0x7f83200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9baae4097252207 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7ff3eea75640 1 -- 172.21.15.29:0/3947446478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3e80c1920 msgr2=0x7ff3e80c1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7ff3eea75640 1 --2- 172.21.15.29:0/3947446478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3e80c1920 0x7ff3e80c1d80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00c950 tx=0x7ff3dc02dd20 comp rx=0 tx=0).stop 2024-01-25T15:04:46.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7f91367fc640 1 --2- 172.21.15.29:0/1000527187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91200047c0 0x7f9120004c40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f912c007e80 tx=0x7f91200057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dad8d12635ca589 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.142+0000 7fb72e08c640 1 -- 172.21.15.29:0/3595098968 wait complete. 2024-01-25T15:04:46.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.143+0000 7f83367fc640 1 -- 172.21.15.29:0/2766634485 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8330034630 con 0x7f83200039c0 2024-01-25T15:04:46.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.143+0000 7f83367fc640 1 -- 172.21.15.29:0/2766634485 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833002f070 con 0x7f83200039c0 2024-01-25T15:04:46.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.143+0000 7f83367fc640 1 -- 172.21.15.29:0/2766634485 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83300349f0 con 0x7f83200039c0 2024-01-25T15:04:46.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.143+0000 7ff3eea75640 1 -- 172.21.15.29:0/3947446478 shutdown_connections 2024-01-25T15:04:46.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.143+0000 7ff3eea75640 1 --2- 172.21.15.29:0/3947446478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3e80c1920 0x7ff3e80c1d80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.143+0000 7f9135ffb640 1 -- 172.21.15.29:0/1000527187 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c02c870 con 0x7f91200047c0 2024-01-25T15:04:46.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.143+0000 7f9135ffb640 1 -- 172.21.15.29:0/1000527187 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912c02c9f0 con 0x7f91200047c0 2024-01-25T15:04:46.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.143+0000 7f9135ffb640 1 -- 172.21.15.29:0/1000527187 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c02ce20 con 0x7f91200047c0 2024-01-25T15:04:46.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.143+0000 7ff3eea75640 1 --2- 172.21.15.29:0/3947446478 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3e814ddf0 0x7ff3e8151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.143+0000 7ff3eea75640 1 -- 172.21.15.29:0/3947446478 >> 172.21.15.29:0/3947446478 conn(0x7ff3e80c2a10 msgr2=0x7ff3e80c2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.143+0000 7ff3eea75640 1 -- 172.21.15.29:0/3947446478 shutdown_connections 2024-01-25T15:04:46.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.144+0000 7f1d88456640 1 Processor -- start 2024-01-25T15:04:46.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.144+0000 7f833cd6c640 1 -- 172.21.15.29:0/2766634485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83200039c0 msgr2=0x7f8320003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.144+0000 7f833cd6c640 1 --2- 172.21.15.29:0/2766634485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83200039c0 0x7f8320003de0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f833000a7b0 tx=0x7f83200057f0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.144+0000 7f1d88456640 1 -- start start 2024-01-25T15:04:46.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.144+0000 7ff3eea75640 1 -- 172.21.15.29:0/3947446478 wait complete. 2024-01-25T15:04:46.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.144+0000 7f833cd6c640 1 -- 172.21.15.29:0/2766634485 shutdown_connections 2024-01-25T15:04:46.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.144+0000 7f833cd6c640 1 --2- 172.21.15.29:0/2766634485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83200039c0 0x7f8320003de0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.144+0000 7f913d6e5640 1 -- 172.21.15.29:0/1000527187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91200047c0 msgr2=0x7f9120004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.144+0000 7f06dd203640 1 Processor -- start 2024-01-25T15:04:46.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.144+0000 7f913d6e5640 1 --2- 172.21.15.29:0/1000527187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91200047c0 0x7f9120004c40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f912c007e80 tx=0x7f91200057f0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.144+0000 7f913d6e5640 1 -- 172.21.15.29:0/1000527187 shutdown_connections 2024-01-25T15:04:46.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.144+0000 7f913d6e5640 1 --2- 172.21.15.29:0/1000527187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91200047c0 0x7f9120004c40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.144+0000 7f833cd6c640 1 -- 172.21.15.29:0/2766634485 >> 172.21.15.29:0/2766634485 conn(0x7f83380c5b90 msgr2=0x7f83380c5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.144+0000 7f913d6e5640 1 -- 172.21.15.29:0/1000527187 >> 172.21.15.29:0/1000527187 conn(0x7f91380c2a10 msgr2=0x7f91380c2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.144+0000 7f06dd203640 1 -- start start 2024-01-25T15:04:46.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.144+0000 7f833cd6c640 1 -- 172.21.15.29:0/2766634485 shutdown_connections 2024-01-25T15:04:46.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.144+0000 7f833cd6c640 1 -- 172.21.15.29:0/2766634485 wait complete. 2024-01-25T15:04:46.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.144+0000 7f913d6e5640 1 -- 172.21.15.29:0/1000527187 shutdown_connections 2024-01-25T15:04:46.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.144+0000 7f913d6e5640 1 -- 172.21.15.29:0/1000527187 wait complete. 2024-01-25T15:04:46.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.145+0000 7fb72e08c640 1 Processor -- start 2024-01-25T15:04:46.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.145+0000 7fb72e08c640 1 -- start start 2024-01-25T15:04:46.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.145+0000 7f1d88456640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d8006d830 0x7f1d801f2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.145+0000 7f1d88456640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d80071890 0x7f1d801e3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.145+0000 7f1d859f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d80071890 0x7f1d801e3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.145+0000 7f06dd203640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06d0007740 0x7f06d01719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f1d859f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d80071890 0x7f1d801e3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44452/0 (socket says 172.21.15.29:44452) 2024-01-25T15:04:46.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f06dd203640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06d004e0f0 0x7f06d0170ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f06dd203640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06d00d7b60 0x7f06d00d8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f06dd203640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d00492a0 con 0x7f06d004e0f0 2024-01-25T15:04:46.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f06dd203640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d0171530 con 0x7f06d00d7b60 2024-01-25T15:04:46.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f06dd203640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d00d8490 con 0x7f06d0007740 2024-01-25T15:04:46.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f1d861f2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d8006d830 0x7f1d801f2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7fb72e08c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72004b330 0x7fb7200dc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7fb72e08c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb7200dc080 0x7fb7200d8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7fb72d08a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72004b330 0x7fb7200dc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7fb72d08a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72004b330 0x7fb7200dc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:33444/0 (socket says 172.21.15.29:33444) 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7ff3eea75640 1 Processor -- start 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7ff3eea75640 1 -- start start 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f06d77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06d004e0f0 0x7f06d0170ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f06d77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06d004e0f0 0x7f06d0170ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44464/0 (socket says 172.21.15.29:44464) 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f06d77fe640 1 -- 172.21.15.29:0/1323359809 learned_addr learned my addr 172.21.15.29:0/1323359809 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f06dca02640 1 --2- 172.21.15.29:0/1323359809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06d00d7b60 0x7f06d00d8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.144+0000 7f59e32d3640 1 Processor -- start 2024-01-25T15:04:46.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.144+0000 7f59e32d3640 1 -- start start 2024-01-25T15:04:46.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.145+0000 7f59e32d3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59dc06c530 0x7f59dc15c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7fb72e08c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7200e8210 0x7fb72002ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.145+0000 7f59e32d3640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59dc0723d0 0x7f59dc14bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.145+0000 7f59e32d3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59dc152a80 0x7f59dc14c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.145+0000 7f59e32d3640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc155850 con 0x7f59dc06c530 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.145+0000 7f59e32d3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc1537e0 con 0x7f59dc152a80 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.145+0000 7f59e32d3640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc153d60 con 0x7f59dc0723d0 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.145+0000 7f59e1870640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59dc152a80 0x7f59dc14c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.145+0000 7f59e1870640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59dc152a80 0x7f59dc14c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:33438/0 (socket says 172.21.15.29:33438) 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.145+0000 7f59e1870640 1 -- 172.21.15.29:0/2269365921 learned_addr learned my addr 172.21.15.29:0/2269365921 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.145+0000 7f59e106f640 1 --2- 172.21.15.29:0/2269365921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59dc06c530 0x7f59dc15c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f59e1870640 1 -- 172.21.15.29:0/2269365921 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59dc0723d0 msgr2=0x7f59dc14bec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f59e1870640 1 --2- 172.21.15.29:0/2269365921 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59dc0723d0 0x7f59dc14bec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f59e1870640 1 -- 172.21.15.29:0/2269365921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59dc06c530 msgr2=0x7f59dc15c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f59e1870640 1 --2- 172.21.15.29:0/2269365921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59dc06c530 0x7f59dc15c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f59e1870640 1 -- 172.21.15.29:0/2269365921 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d8009400 con 0x7f59dc152a80 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f59e106f640 1 --2- 172.21.15.29:0/2269365921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59dc06c530 0x7f59dc15c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7fb72d08a640 1 -- 172.21.15.29:0/1609397679 learned_addr learned my addr 172.21.15.29:0/1609397679 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7fb72e08c640 1 -- 172.21.15.29:0/1609397679 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7200dcd20 con 0x7fb7200e8210 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7fb72e08c640 1 -- 172.21.15.29:0/1609397679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7200df390 con 0x7fb72004b330 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7fb72e08c640 1 -- 172.21.15.29:0/1609397679 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7200dcf60 con 0x7fb7200dc080 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f8a9986b640 1 --2- 172.21.15.29:0/756066534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a80003b00 0x7f8a80003f00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8a900018c0 tx=0x7f8a800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c355828d38893c9c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f59e1870640 1 --2- 172.21.15.29:0/2269365921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59dc152a80 0x7f59dc14c400 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f59d802b7d0 tx=0x7f59d80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7f06d7fff640 1 --2- 172.21.15.29:0/1323359809 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06d0007740 0x7f06d01719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7fb72d88b640 1 --2- 172.21.15.29:0/1609397679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7200e8210 0x7fb72002ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7fb72c889640 1 --2- 172.21.15.29:0/1609397679 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb7200dc080 0x7fb7200d8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7fb72d08a640 1 -- 172.21.15.29:0/1609397679 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb7200dc080 msgr2=0x7fb7200d8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7fb72d08a640 1 --2- 172.21.15.29:0/1609397679 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb7200dc080 0x7fb7200d8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7fb72d08a640 1 -- 172.21.15.29:0/1609397679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7200e8210 msgr2=0x7fb72002ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7fb72d08a640 1 --2- 172.21.15.29:0/1609397679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7200e8210 0x7fb72002ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7fb72d08a640 1 -- 172.21.15.29:0/1609397679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71c0094d0 con 0x7fb72004b330 2024-01-25T15:04:46.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7fb72d08a640 1 --2- 172.21.15.29:0/1609397679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72004b330 0x7fb7200dc7e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb72400c490 tx=0x7fb72400c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7f913d6e5640 1 Processor -- start 2024-01-25T15:04:46.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7f913d6e5640 1 -- start start 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f1d88456640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d80156190 0x7f1d800c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f1d88456640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d800aa280 con 0x7f1d80071890 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f1d88456640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d801f2d60 con 0x7f1d80156190 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f1d88456640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d800ab370 con 0x7f1d8006d830 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7f1d861f2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d8006d830 0x7f1d801f2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:40468/0 (socket says 172.21.15.29:40468) 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7f1d861f2640 1 -- 172.21.15.29:0/1071096850 learned_addr learned my addr 172.21.15.29:0/1071096850 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7f8a98869640 1 -- 172.21.15.29:0/756066534 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a900052d0 con 0x7f8a80003b00 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7f8a98869640 1 -- 172.21.15.29:0/756066534 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a90005450 con 0x7f8a80003b00 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f8a9bacf640 1 -- 172.21.15.29:0/756066534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a80003b00 msgr2=0x7f8a80003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f8a9bacf640 1 --2- 172.21.15.29:0/756066534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a80003b00 0x7f8a80003f00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8a900018c0 tx=0x7f8a800057f0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f8a9a06c640 1 -- 172.21.15.29:0/756066534 reap_dead start 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f833cd6c640 1 Processor -- start 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.146+0000 7f833cd6c640 1 -- start start 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7f833cd6c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83200039c0 0x7f8338143990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f833cd6c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8338144670 0x7f833814f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f83377fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83200039c0 0x7f8338143990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f83377fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83200039c0 0x7f8338143990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:40486/0 (socket says 172.21.15.29:40486) 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f83377fe640 1 -- 172.21.15.29:0/2362736658 learned_addr learned my addr 172.21.15.29:0/2362736658 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f833cd6c640 1 --2- 172.21.15.29:0/2362736658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f833814fc10 0x7f833815b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f833cd6c640 1 -- 172.21.15.29:0/2362736658 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833814f130 con 0x7f8338144670 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f833cd6c640 1 -- 172.21.15.29:0/2362736658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833814e520 con 0x7f833814fc10 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f833cd6c640 1 -- 172.21.15.29:0/2362736658 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833814e800 con 0x7f83200039c0 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7ff3eea75640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3e806c090 0x7ff3e80bbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7ff3eea75640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e80c1920 0x7ff3e80bc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7ff3eea75640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3e814ddf0 0x7ff3e81e8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7ff3eea75640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e80bc620 con 0x7ff3e806c090 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7ff3eea75640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e80be120 con 0x7ff3e80c1920 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7ff3eea75640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e80be670 con 0x7ff3e814ddf0 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7ff3ed012640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3e814ddf0 0x7ff3e81e8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7ff3ed012640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3e814ddf0 0x7ff3e81e8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:40496/0 (socket says 172.21.15.29:40496) 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7ff3ed012640 1 -- 172.21.15.29:0/1545874273 learned_addr learned my addr 172.21.15.29:0/1545874273 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7f06dca02640 1 -- 172.21.15.29:0/1323359809 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06d0007740 msgr2=0x7f06d01719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7f06dca02640 1 --2- 172.21.15.29:0/1323359809 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06d0007740 0x7f06d01719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7f06dca02640 1 -- 172.21.15.29:0/1323359809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06d004e0f0 msgr2=0x7f06d0170ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7f06dca02640 1 --2- 172.21.15.29:0/1323359809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06d004e0f0 0x7f06d0170ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7f06dca02640 1 -- 172.21.15.29:0/1323359809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c4009400 con 0x7f06d00d7b60 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7f06d7fff640 1 --2- 172.21.15.29:0/1323359809 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06d0007740 0x7f06d01719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7f06dca02640 1 --2- 172.21.15.29:0/1323359809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06d00d7b60 0x7f06d00d8920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f06d8067d70 tx=0x7f06d8068260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f06d4ff9640 1 -- 172.21.15.29:0/1323359809 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d8068990 con 0x7f06d00d7b60 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f06d4ff9640 1 -- 172.21.15.29:0/1323359809 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d8072050 con 0x7f06d00d7b60 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f06d4ff9640 1 -- 172.21.15.29:0/1323359809 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d80730a0 con 0x7f06d00d7b60 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f06dd203640 1 -- 172.21.15.29:0/1323359809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d004d440 con 0x7f06d00d7b60 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f06dd203640 1 -- 172.21.15.29:0/1323359809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d00d9b00 con 0x7f06d00d7b60 2024-01-25T15:04:46.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7f59d1ffb640 1 -- 172.21.15.29:0/2269365921 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d8060890 con 0x7f59dc152a80 2024-01-25T15:04:46.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7f59e32d3640 1 -- 172.21.15.29:0/2269365921 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59dc14c940 con 0x7f59dc152a80 2024-01-25T15:04:46.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7f59e32d3640 1 -- 172.21.15.29:0/2269365921 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59dc15b590 con 0x7f59dc152a80 2024-01-25T15:04:46.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.147+0000 7f59d1ffb640 1 -- 172.21.15.29:0/2269365921 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d8060a10 con 0x7f59dc152a80 2024-01-25T15:04:46.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f59d1ffb640 1 -- 172.21.15.29:0/2269365921 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d8060dc0 con 0x7f59dc152a80 2024-01-25T15:04:46.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f913d6e5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91200047c0 0x7f91381f1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f8a9bacf640 1 -- 172.21.15.29:0/756066534 shutdown_connections 2024-01-25T15:04:46.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f8a9bacf640 1 -- 172.21.15.29:0/756066534 >> 172.21.15.29:0/756066534 conn(0x7f8a8c0492e0 msgr2=0x7f8a8c0496f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f913d6e5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91380c4da0 0x7f913815b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7f9136ffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91200047c0 0x7f91381f1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f83377fe640 1 -- 172.21.15.29:0/2362736658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f833814fc10 msgr2=0x7f833815b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f83377fe640 1 --2- 172.21.15.29:0/2362736658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f833814fc10 0x7f833815b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f83377fe640 1 -- 172.21.15.29:0/2362736658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8338144670 msgr2=0x7f833814f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f83377fe640 1 --2- 172.21.15.29:0/2362736658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8338144670 0x7f833814f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.148+0000 7f83377fe640 1 -- 172.21.15.29:0/2362736658 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833814eae0 con 0x7f83200039c0 2024-01-25T15:04:46.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7fb719ffb640 1 -- 172.21.15.29:0/1609397679 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7240052d0 con 0x7fb72004b330 2024-01-25T15:04:46.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7fb72e08c640 1 -- 172.21.15.29:0/1609397679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7200e7cd0 con 0x7fb72004b330 2024-01-25T15:04:46.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.150+0000 7fb72e08c640 1 -- 172.21.15.29:0/1609397679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7200e7fb0 con 0x7fb72004b330 2024-01-25T15:04:46.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7f1d861f2640 1 -- 172.21.15.29:0/1071096850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d80156190 msgr2=0x7f1d800c4dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-25T15:04:46.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7f1d861f2640 1 --2- 172.21.15.29:0/1071096850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d80156190 0x7f1d800c4dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7f1d861f2640 1 -- 172.21.15.29:0/1071096850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d80071890 msgr2=0x7f1d801e3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7f1d861f2640 1 --2- 172.21.15.29:0/1071096850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d80071890 0x7f1d801e3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7f1d861f2640 1 -- 172.21.15.29:0/1071096850 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d70009400 con 0x7f1d8006d830 2024-01-25T15:04:46.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7f1d861f2640 1 --2- 172.21.15.29:0/1071096850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d8006d830 0x7f1d801f2820 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00efc0 tx=0x7f1d7c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.150+0000 7f8a9bacf640 1 -- 172.21.15.29:0/756066534 shutdown_connections 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7f83377fe640 1 --2- 172.21.15.29:0/2362736658 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83200039c0 0x7f8338143990 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f833000a7b0 tx=0x7f8330001cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.150+0000 7f831ffff640 1 -- 172.21.15.29:0/2362736658 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8330001a10 con 0x7f83200039c0 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7ff3e7fff640 1 --2- 172.21.15.29:0/1545874273 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e80c1920 0x7ff3e80bc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7ff3ec811640 1 --2- 172.21.15.29:0/1545874273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3e806c090 0x7ff3e80bbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7ff3ed012640 1 -- 172.21.15.29:0/1545874273 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e80c1920 msgr2=0x7ff3e80bc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7ff3ed012640 1 --2- 172.21.15.29:0/1545874273 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e80c1920 0x7ff3e80bc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7ff3ed012640 1 -- 172.21.15.29:0/1545874273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3e806c090 msgr2=0x7ff3e80bbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7ff3ed012640 1 --2- 172.21.15.29:0/1545874273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3e806c090 0x7ff3e80bbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7ff3ed012640 1 -- 172.21.15.29:0/1545874273 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3dc00c630 con 0x7ff3e814ddf0 2024-01-25T15:04:46.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.150+0000 7f59d1ffb640 1 -- 172.21.15.29:0/2269365921 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f59d803b040 con 0x7f59dc152a80 2024-01-25T15:04:46.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.150+0000 7ff3ed012640 1 --2- 172.21.15.29:0/1545874273 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3e814ddf0 0x7ff3e81e8c00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0002150 tx=0x7ff3e000ce70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7f9136ffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91200047c0 0x7f91381f1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:40512/0 (socket says 172.21.15.29:40512) 2024-01-25T15:04:46.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.150+0000 7f06dd203640 1 -- 172.21.15.29:0/1323359809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f06d00dada0 con 0x7f06d00d7b60 2024-01-25T15:04:46.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.150+0000 7f59e32d3640 1 -- 172.21.15.29:0/2269365921 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f59bc001030 con 0x7f59dc152a80 2024-01-25T15:04:46.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7f91367fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91380c4da0 0x7f913815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7f91367fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91380c4da0 0x7f913815b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44492/0 (socket says 172.21.15.29:44492) 2024-01-25T15:04:46.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7f913d6e5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9138152d20 0x7f91381eb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7f913d6e5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9138152870 con 0x7f91380c4da0 2024-01-25T15:04:46.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7f913d6e5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9138150870 con 0x7f9138152d20 2024-01-25T15:04:46.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.151+0000 7f59d1ffb640 1 --2- 172.21.15.29:0/2269365921 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f59c006afd0 0x7f59c006d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.149+0000 7f913d6e5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9138150b10 con 0x7f91200047c0 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.150+0000 7f9136ffd640 1 -- 172.21.15.29:0/2595852488 learned_addr learned my addr 172.21.15.29:0/2595852488 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.150+0000 7f9136ffd640 1 -- 172.21.15.29:0/2595852488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9138152d20 msgr2=0x7f91381eb3c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.150+0000 7f9136ffd640 1 --2- 172.21.15.29:0/2595852488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9138152d20 0x7f91381eb3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.150+0000 7f9136ffd640 1 -- 172.21.15.29:0/2595852488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91380c4da0 msgr2=0x7f913815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.150+0000 7f9136ffd640 1 --2- 172.21.15.29:0/2595852488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91380c4da0 0x7f913815b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.150+0000 7f9136ffd640 1 -- 172.21.15.29:0/2595852488 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9138150df0 con 0x7f91200047c0 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.150+0000 7ff3e57fa640 1 -- 172.21.15.29:0/1545874273 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0004d60 con 0x7ff3e814ddf0 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.150+0000 7ff3e57fa640 1 -- 172.21.15.29:0/1545874273 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e000a910 con 0x7ff3e814ddf0 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.150+0000 7ff3e57fa640 1 -- 172.21.15.29:0/1545874273 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e000acc0 con 0x7ff3e814ddf0 2024-01-25T15:04:46.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.151+0000 7fb7137fe640 1 -- 172.21.15.29:0/1609397679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb708001030 con 0x7fb72004b330 2024-01-25T15:04:46.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.151+0000 7f9136ffd640 1 --2- 172.21.15.29:0/2595852488 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91200047c0 0x7f91381f1520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f912800f620 tx=0x7f912800fae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.150+0000 7f833cd6c640 1 -- 172.21.15.29:0/2362736658 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833814edc0 con 0x7f83200039c0 2024-01-25T15:04:46.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.150+0000 7f833cd6c640 1 -- 172.21.15.29:0/2362736658 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833814dec0 con 0x7f83200039c0 2024-01-25T15:04:46.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.151+0000 7f833cd6c640 1 -- 172.21.15.29:0/2362736658 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f83380c46e0 con 0x7f83200039c0 2024-01-25T15:04:46.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.151+0000 7ff3eea75640 1 -- 172.21.15.29:0/1545874273 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e80be390 con 0x7ff3e814ddf0 2024-01-25T15:04:46.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.151+0000 7ff3eea75640 1 -- 172.21.15.29:0/1545874273 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e80c0360 con 0x7ff3e814ddf0 2024-01-25T15:04:46.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.151+0000 7f831ffff640 1 -- 172.21.15.29:0/2362736658 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8330004b60 con 0x7f83200039c0 2024-01-25T15:04:46.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.151+0000 7f911f7fe640 1 -- 172.21.15.29:0/2595852488 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9128014870 con 0x7f91200047c0 2024-01-25T15:04:46.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.151+0000 7f911f7fe640 1 -- 172.21.15.29:0/2595852488 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91280149d0 con 0x7f91200047c0 2024-01-25T15:04:46.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.151+0000 7f1d76ffd640 1 -- 172.21.15.29:0/1071096850 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c009b60 con 0x7f1d8006d830 2024-01-25T15:04:46.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.151+0000 7f1d76ffd640 1 -- 172.21.15.29:0/1071096850 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7c00f040 con 0x7f1d8006d830 2024-01-25T15:04:46.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.151+0000 7f1d76ffd640 1 -- 172.21.15.29:0/1071096850 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c0092e0 con 0x7f1d8006d830 2024-01-25T15:04:46.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.150+0000 7f8a9bacf640 1 -- 172.21.15.29:0/756066534 wait complete. 2024-01-25T15:04:46.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.151+0000 7f8a9bacf640 1 Processor -- start 2024-01-25T15:04:46.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.152+0000 7f911f7fe640 1 -- 172.21.15.29:0/2595852488 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9128014d60 con 0x7f91200047c0 2024-01-25T15:04:46.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.152+0000 7f913d6e5640 1 -- 172.21.15.29:0/2595852488 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91381510d0 con 0x7f91200047c0 2024-01-25T15:04:46.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.152+0000 7f913d6e5640 1 -- 172.21.15.29:0/2595852488 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913815bcb0 con 0x7f91200047c0 2024-01-25T15:04:46.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.152+0000 7fb719ffb640 1 -- 172.21.15.29:0/1609397679 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb724005430 con 0x7fb72004b330 2024-01-25T15:04:46.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.152+0000 7ff3eea75640 1 -- 172.21.15.29:0/1545874273 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff3e8070230 con 0x7ff3e814ddf0 2024-01-25T15:04:46.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.151+0000 7f06d4ff9640 1 -- 172.21.15.29:0/1323359809 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f06d8073220 con 0x7f06d00d7b60 2024-01-25T15:04:46.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.152+0000 7f06d4ff9640 1 --2- 172.21.15.29:0/1323359809 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f06bc06aed0 0x7f06bc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.152+0000 7f06d4ff9640 1 -- 172.21.15.29:0/1323359809 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f06d8102fc0 con 0x7f06d00d7b60 2024-01-25T15:04:46.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.152+0000 7f06d4ff9640 1 --2- 172.21.15.29:0/1323359809 >> [v2:172.21.15.52:6824/2160170066,v1:172.21.15.52:6825/2160170066] conn(0x7f06bc074510 0x7f06bc076950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.152+0000 7f06d7fff640 1 --2- 172.21.15.29:0/1323359809 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f06bc06aed0 0x7f06bc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.152+0000 7f06d4ff9640 1 -- 172.21.15.29:0/1323359809 --> [v2:172.21.15.52:6824/2160170066,v1:172.21.15.52:6825/2160170066] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06bc077020 con 0x7f06bc074510 2024-01-25T15:04:46.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.152+0000 7f06d4ff9640 1 -- 172.21.15.29:0/1323359809 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06d81055e0 con 0x7f06d00d7b60 2024-01-25T15:04:46.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.152+0000 7f91367fc640 1 --2- 172.21.15.29:0/2595852488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91380c4da0 0x7f913815b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-01-25T15:04:46.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.152+0000 7f1d88456640 1 -- 172.21.15.29:0/1071096850 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d801e3bb0 con 0x7f1d8006d830 2024-01-25T15:04:46.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.153+0000 7f1d88456640 1 -- 172.21.15.29:0/1071096850 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d800ab5a0 con 0x7f1d8006d830 2024-01-25T15:04:46.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.153+0000 7f59d1ffb640 1 -- 172.21.15.29:0/2269365921 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f59d80cd7c0 con 0x7f59dc152a80 2024-01-25T15:04:46.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.153+0000 7f59d1ffb640 1 --2- 172.21.15.29:0/2269365921 >> [v2:172.21.15.52:6809/3231115782,v1:172.21.15.52:6811/3231115782] conn(0x7f59c0074590 0x7f59c00769d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.152+0000 7f8a9bacf640 1 -- start start 2024-01-25T15:04:46.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.153+0000 7f59d1ffb640 1 -- 172.21.15.29:0/2269365921 --> [v2:172.21.15.52:6809/3231115782,v1:172.21.15.52:6811/3231115782] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59c00770a0 con 0x7f59c0074590 2024-01-25T15:04:46.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.153+0000 7f8a9bacf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a8c0cf510 0x7f8a8c180850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.153+0000 7f8a9bacf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a8c0089b0 0x7f8a8c0cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.153+0000 7f59d1ffb640 1 -- 172.21.15.29:0/2269365921 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59d80985e0 con 0x7f59dc152a80 2024-01-25T15:04:46.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.152+0000 7f831ffff640 1 -- 172.21.15.29:0/2362736658 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8330034640 con 0x7f83200039c0 2024-01-25T15:04:46.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.153+0000 7f8a9906a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a8c0089b0 0x7f8a8c0cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.153+0000 7f8a9906a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a8c0089b0 0x7f8a8c0cf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44498/0 (socket says 172.21.15.29:44498) 2024-01-25T15:04:46.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.153+0000 7f8a9906a640 1 -- 172.21.15.29:0/3152288731 learned_addr learned my addr 172.21.15.29:0/3152288731 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:46.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.153+0000 7f8a9bacf640 1 --2- 172.21.15.29:0/3152288731 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a8c041d20 0x7f8a8c0421a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.153+0000 7f831ffff640 1 -- 172.21.15.29:0/2362736658 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8330031030 con 0x7f83200039c0 2024-01-25T15:04:46.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.153+0000 7f8a9bacf640 1 -- 172.21.15.29:0/3152288731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c17d780 con 0x7f8a8c0089b0 2024-01-25T15:04:46.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.153+0000 7f8a9bacf640 1 -- 172.21.15.29:0/3152288731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c007860 con 0x7f8a8c0cf510 2024-01-25T15:04:46.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.153+0000 7f8a9bacf640 1 -- 172.21.15.29:0/3152288731 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c007b40 con 0x7f8a8c041d20 2024-01-25T15:04:46.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.153+0000 7fb719ffb640 1 -- 172.21.15.29:0/1609397679 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb724012910 con 0x7fb72004b330 2024-01-25T15:04:46.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.154+0000 7fb719ffb640 1 -- 172.21.15.29:0/1609397679 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fb724012b30 con 0x7fb72004b330 2024-01-25T15:04:46.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.154+0000 7f831ffff640 1 --2- 172.21.15.29:0/2362736658 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f832406afd0 0x7f832406d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.154+0000 7f06d77fe640 1 --2- 172.21.15.29:0/1323359809 >> [v2:172.21.15.52:6824/2160170066,v1:172.21.15.52:6825/2160170066] conn(0x7f06bc074510 0x7f06bc076950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.154+0000 7f831ffff640 1 -- 172.21.15.29:0/2362736658 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f83300abae0 con 0x7f83200039c0 2024-01-25T15:04:46.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.154+0000 7f59e106f640 1 --2- 172.21.15.29:0/2269365921 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f59c006afd0 0x7f59c006d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.154+0000 7f8336ffd640 1 --2- 172.21.15.29:0/2362736658 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f832406afd0 0x7f832406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.154+0000 7fb719ffb640 1 --2- 172.21.15.29:0/1609397679 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb70c06afd0 0x7fb70c06d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.154+0000 7ff3e57fa640 1 -- 172.21.15.29:0/1545874273 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ff3e0011560 con 0x7ff3e814ddf0 2024-01-25T15:04:46.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.154+0000 7f8a9906a640 1 -- 172.21.15.29:0/3152288731 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a8c041d20 msgr2=0x7f8a8c0421a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-25T15:04:46.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.154+0000 7fb719ffb640 1 -- 172.21.15.29:0/1609397679 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb724089590 con 0x7fb72004b330 2024-01-25T15:04:46.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.154+0000 7f831ffff640 1 --2- 172.21.15.29:0/2362736658 >> [v2:172.21.15.52:6800/2238001841,v1:172.21.15.52:6801/2238001841] conn(0x7f8324074610 0x7f8324076a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.154+0000 7f8a9906a640 1 --2- 172.21.15.29:0/3152288731 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8a8c041d20 0x7f8a8c0421a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.154+0000 7f8a9906a640 1 -- 172.21.15.29:0/3152288731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a8c0cf510 msgr2=0x7f8a8c180850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-25T15:04:46.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7f831ffff640 1 -- 172.21.15.29:0/2362736658 --> [v2:172.21.15.52:6800/2238001841,v1:172.21.15.52:6801/2238001841] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8324077120 con 0x7f8324074610 2024-01-25T15:04:46.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7f59e086e640 1 --2- 172.21.15.29:0/2269365921 >> [v2:172.21.15.52:6809/3231115782,v1:172.21.15.52:6811/3231115782] conn(0x7f59c0074590 0x7f59c00769d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.154+0000 7f8a9906a640 1 --2- 172.21.15.29:0/3152288731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a8c0cf510 0x7f8a8c180850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7fb719ffb640 1 --2- 172.21.15.29:0/1609397679 >> [v2:172.21.15.29:6817/1239098486,v1:172.21.15.29:6819/1239098486] conn(0x7fb70c0744a0 0x7fb70c0768e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7fb72c889640 1 --2- 172.21.15.29:0/1609397679 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb70c06afd0 0x7fb70c06d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7f831ffff640 1 -- 172.21.15.29:0/2362736658 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83300abe90 con 0x7f83200039c0 2024-01-25T15:04:46.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.154+0000 7f06d7fff640 1 --2- 172.21.15.29:0/1323359809 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f06bc06aed0 0x7f06bc06d390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f06c4036000 tx=0x7f06c403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.154+0000 7f8a9906a640 1 -- 172.21.15.29:0/3152288731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c007e20 con 0x7f8a8c0089b0 2024-01-25T15:04:46.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7f8336ffd640 1 --2- 172.21.15.29:0/2362736658 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f832406afd0 0x7f832406d490 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f832c006d40 tx=0x7f832c006cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7f8337fff640 1 --2- 172.21.15.29:0/2362736658 >> [v2:172.21.15.52:6800/2238001841,v1:172.21.15.52:6801/2238001841] conn(0x7f8324074610 0x7f8324076a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7ff3e57fa640 1 --2- 172.21.15.29:0/1545874273 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff3cc06af20 0x7ff3cc06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7f1d88456640 1 -- 172.21.15.29:0/1071096850 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1d80159a00 con 0x7f1d8006d830 2024-01-25T15:04:46.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7ff3e57fa640 1 -- 172.21.15.29:0/1545874273 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff3e008d6c0 con 0x7ff3e814ddf0 2024-01-25T15:04:46.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7fb72d88b640 1 --2- 172.21.15.29:0/1609397679 >> [v2:172.21.15.29:6817/1239098486,v1:172.21.15.29:6819/1239098486] conn(0x7fb70c0744a0 0x7fb70c0768e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.154+0000 7f911f7fe640 1 -- 172.21.15.29:0/2595852488 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f912800d490 con 0x7f91200047c0 2024-01-25T15:04:46.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7ff3e57fa640 1 --2- 172.21.15.29:0/1545874273 >> [v2:172.21.15.52:6808/2258341795,v1:172.21.15.52:6810/2258341795] conn(0x7ff3cc074560 0x7ff3cc0769a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7f911f7fe640 1 --2- 172.21.15.29:0/2595852488 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f912406afd0 0x7f912406d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7f911f7fe640 1 -- 172.21.15.29:0/2595852488 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f912808a250 con 0x7f91200047c0 2024-01-25T15:04:46.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7f913d6e5640 1 --2- 172.21.15.29:0/2595852488 >> [v2:172.21.15.29:6808/1186362515,v1:172.21.15.29:6809/1186362515] conn(0x7f9138153120 0x7f913814e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7f913d6e5640 1 -- 172.21.15.29:0/2595852488 --> [v2:172.21.15.29:6808/1186362515,v1:172.21.15.29:6809/1186362515] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91380ac120 con 0x7f9138153120 2024-01-25T15:04:46.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7f59e086e640 1 --2- 172.21.15.29:0/2269365921 >> [v2:172.21.15.52:6809/3231115782,v1:172.21.15.52:6811/3231115782] conn(0x7f59c0074590 0x7f59c00769d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7ff3e57fa640 1 -- 172.21.15.29:0/1545874273 --> [v2:172.21.15.52:6808/2258341795,v1:172.21.15.52:6810/2258341795] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff3cc077070 con 0x7ff3cc074560 2024-01-25T15:04:46.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7ff3e57fa640 1 -- 172.21.15.29:0/1545874273 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3e008fdd0 con 0x7ff3e814ddf0 2024-01-25T15:04:46.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7f59e106f640 1 --2- 172.21.15.29:0/2269365921 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f59c006afd0 0x7f59c006d490 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f59cc001bc0 tx=0x7f59cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7f91367fc640 1 --2- 172.21.15.29:0/2595852488 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f912406afd0 0x7f912406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7f8a9906a640 1 --2- 172.21.15.29:0/3152288731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a8c0089b0 0x7f8a8c0cf8f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8a94064090 tx=0x7f8a94068a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.155+0000 7f1d76ffd640 1 -- 172.21.15.29:0/1071096850 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f1d7c014480 con 0x7f1d8006d830 2024-01-25T15:04:46.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.156+0000 7ff3ec811640 1 --2- 172.21.15.29:0/1545874273 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff3cc06af20 0x7ff3cc06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.156+0000 7fb72d88b640 1 --2- 172.21.15.29:0/1609397679 >> [v2:172.21.15.29:6817/1239098486,v1:172.21.15.29:6819/1239098486] conn(0x7fb70c0744a0 0x7fb70c0768e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.156+0000 7f06d77fe640 1 --2- 172.21.15.29:0/1323359809 >> [v2:172.21.15.52:6824/2160170066,v1:172.21.15.52:6825/2160170066] conn(0x7f06bc074510 0x7f06bc076950 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.156+0000 7f91377fe640 1 --2- 172.21.15.29:0/2595852488 >> [v2:172.21.15.29:6808/1186362515,v1:172.21.15.29:6809/1186362515] conn(0x7f9138153120 0x7f913814e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.156+0000 7ff3e7fff640 1 --2- 172.21.15.29:0/1545874273 >> [v2:172.21.15.52:6808/2258341795,v1:172.21.15.52:6810/2258341795] conn(0x7ff3cc074560 0x7ff3cc0769a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.156+0000 7fb719ffb640 1 -- 172.21.15.29:0/1609397679 --> [v2:172.21.15.29:6817/1239098486,v1:172.21.15.29:6819/1239098486] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb70c076fb0 con 0x7fb70c0744a0 2024-01-25T15:04:46.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.156+0000 7f8a8a7fc640 1 -- 172.21.15.29:0/3152288731 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9408f070 con 0x7f8a8c0089b0 2024-01-25T15:04:46.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.156+0000 7f8a8a7fc640 1 -- 172.21.15.29:0/3152288731 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9406bb00 con 0x7f8a8c0089b0 2024-01-25T15:04:46.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.156+0000 7f8a8a7fc640 1 -- 172.21.15.29:0/3152288731 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9406be90 con 0x7f8a8c0089b0 2024-01-25T15:04:46.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.156+0000 7fb719ffb640 1 -- 172.21.15.29:0/1609397679 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb72408bae0 con 0x7fb72004b330 2024-01-25T15:04:46.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.156+0000 7f1d76ffd640 1 --2- 172.21.15.29:0/1071096850 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1d6406afa0 0x7f1d6406d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.156+0000 7f91377fe640 1 --2- 172.21.15.29:0/2595852488 >> [v2:172.21.15.29:6808/1186362515,v1:172.21.15.29:6809/1186362515] conn(0x7f9138153120 0x7f913814e7a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.156+0000 7f1d76ffd640 1 -- 172.21.15.29:0/1071096850 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1d7c08a020 con 0x7f1d8006d830 2024-01-25T15:04:46.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.156+0000 7f8a9bacf640 1 -- 172.21.15.29:0/3152288731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a8c008100 con 0x7f8a8c0089b0 2024-01-25T15:04:46.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.156+0000 7f1d76ffd640 1 --2- 172.21.15.29:0/1071096850 >> [v2:172.21.15.29:6800/2245852782,v1:172.21.15.29:6801/2245852782] conn(0x7f1d640745e0 0x7f1d64076a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.156+0000 7f1d76ffd640 1 -- 172.21.15.29:0/1071096850 --> [v2:172.21.15.29:6800/2245852782,v1:172.21.15.29:6801/2245852782] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1d640770f0 con 0x7f1d640745e0 2024-01-25T15:04:46.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.156+0000 7f1d76ffd640 1 -- 172.21.15.29:0/1071096850 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d7c08c5e0 con 0x7f1d8006d830 2024-01-25T15:04:46.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.156+0000 7f8337fff640 1 --2- 172.21.15.29:0/2362736658 >> [v2:172.21.15.52:6800/2238001841,v1:172.21.15.52:6801/2238001841] conn(0x7f8324074610 0x7f8324076a50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.156+0000 7fb72c889640 1 --2- 172.21.15.29:0/1609397679 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb70c06afd0 0x7fb70c06d490 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb72804f800 tx=0x7fb728068440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.157+0000 7f1d859f1640 1 --2- 172.21.15.29:0/1071096850 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1d6406afa0 0x7f1d6406d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.157+0000 7ff3e7fff640 1 --2- 172.21.15.29:0/1545874273 >> [v2:172.21.15.52:6808/2258341795,v1:172.21.15.52:6810/2258341795] conn(0x7ff3cc074560 0x7ff3cc0769a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.157+0000 7fb719ffb640 1 -- 172.21.15.29:0/1609397679 <== osd.0 v2:172.21.15.29:6817/1239098486 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb70c076fb0 con 0x7fb70c0744a0 2024-01-25T15:04:46.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.157+0000 7f59d1ffb640 1 -- 172.21.15.29:0/2269365921 <== osd.7 v2:172.21.15.52:6809/3231115782 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f59c00770a0 con 0x7f59c0074590 2024-01-25T15:04:46.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.157+0000 7f1d869f3640 1 --2- 172.21.15.29:0/1071096850 >> [v2:172.21.15.29:6800/2245852782,v1:172.21.15.29:6801/2245852782] conn(0x7f1d640745e0 0x7f1d64076a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.157+0000 7f06d4ff9640 1 -- 172.21.15.29:0/1323359809 <== osd.6 v2:172.21.15.52:6824/2160170066 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f06bc077020 con 0x7f06bc074510 2024-01-25T15:04:46.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.157+0000 7f1d859f1640 1 --2- 172.21.15.29:0/1071096850 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1d6406afa0 0x7f1d6406d460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1d80157220 tx=0x7f1d78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.157+0000 7f831ffff640 1 -- 172.21.15.29:0/2362736658 <== osd.4 v2:172.21.15.52:6800/2238001841 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8324077120 con 0x7f8324074610 2024-01-25T15:04:46.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.157+0000 7f911f7fe640 1 -- 172.21.15.29:0/2595852488 <== osd.1 v2:172.21.15.29:6808/1186362515 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f91380ac120 con 0x7f9138153120 2024-01-25T15:04:46.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.158+0000 7f91367fc640 1 --2- 172.21.15.29:0/2595852488 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f912406afd0 0x7f912406d490 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f912c036000 tx=0x7f912c009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.159+0000 7f8a9bacf640 1 -- 172.21.15.29:0/3152288731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8c042890 con 0x7f8a8c0089b0 2024-01-25T15:04:46.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.158+0000 7ff3e57fa640 1 -- 172.21.15.29:0/1545874273 <== osd.5 v2:172.21.15.52:6808/2258341795 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff3cc077070 con 0x7ff3cc074560 2024-01-25T15:04:46.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.159+0000 7ff3ec811640 1 --2- 172.21.15.29:0/1545874273 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff3cc06af20 0x7ff3cc06d3e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009b40 tx=0x7ff3d4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.161+0000 7f1d869f3640 1 --2- 172.21.15.29:0/1071096850 >> [v2:172.21.15.29:6800/2245852782,v1:172.21.15.29:6801/2245852782] conn(0x7f1d640745e0 0x7f1d64076a20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.161+0000 7f8a8a7fc640 1 -- 172.21.15.29:0/3152288731 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8a940730a0 con 0x7f8a8c0089b0 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.161+0000 7f8a9bacf640 1 -- 172.21.15.29:0/3152288731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8a8c0d7e50 con 0x7f8a8c0089b0 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.161+0000 7f8a8a7fc640 1 --2- 172.21.15.29:0/3152288731 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8a7806aed0 0x7f8a7806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.161+0000 7f8a8a7fc640 1 -- 172.21.15.29:0/3152288731 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8a94102b70 con 0x7f8a8c0089b0 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.161+0000 7f8a8a7fc640 1 --2- 172.21.15.29:0/3152288731 >> [v2:172.21.15.29:6816/2866381288,v1:172.21.15.29:6818/2866381288] conn(0x7f8a78074320 0x7f8a78076760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.161+0000 7f8a8a7fc640 1 -- 172.21.15.29:0/3152288731 --> [v2:172.21.15.29:6816/2866381288,v1:172.21.15.29:6818/2866381288] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8a78076e30 con 0x7f8a78074320 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.162+0000 7f8a8a7fc640 1 -- 172.21.15.29:0/3152288731 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a9410d070 con 0x7f8a8c0089b0 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.162+0000 7f8a9a06c640 1 --2- 172.21.15.29:0/3152288731 >> [v2:172.21.15.29:6816/2866381288,v1:172.21.15.29:6818/2866381288] conn(0x7f8a78074320 0x7f8a78076760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.162+0000 7f8a9986b640 1 --2- 172.21.15.29:0/3152288731 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8a7806aed0 0x7f8a7806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.163+0000 7f8a9a06c640 1 --2- 172.21.15.29:0/3152288731 >> [v2:172.21.15.29:6816/2866381288,v1:172.21.15.29:6818/2866381288] conn(0x7f8a78074320 0x7f8a78076760 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.165+0000 7f1d76ffd640 1 -- 172.21.15.29:0/1071096850 <== osd.2 v2:172.21.15.29:6800/2245852782 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1d640770f0 con 0x7f1d640745e0 2024-01-25T15:04:46.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.164+0000 7f8a8a7fc640 1 -- 172.21.15.29:0/3152288731 <== osd.3 v2:172.21.15.29:6816/2866381288 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8a78076e30 con 0x7f8a78074320 2024-01-25T15:04:46.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.184+0000 7f8a9986b640 1 --2- 172.21.15.29:0/3152288731 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8a7806aed0 0x7f8a7806d390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8a90038000 tx=0x7f8a90034000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.191+0000 7fb7137fe640 1 -- 172.21.15.29:0/1609397679 --> [v2:172.21.15.29:6817/1239098486,v1:172.21.15.29:6819/1239098486] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb708002d30 con 0x7fb70c0744a0 2024-01-25T15:04:46.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.191+0000 7f913d6e5640 1 -- 172.21.15.29:0/2595852488 --> [v2:172.21.15.29:6808/1186362515,v1:172.21.15.29:6809/1186362515] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9138152a40 con 0x7f9138153120 2024-01-25T15:04:46.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.190+0000 7ff3eea75640 1 -- 172.21.15.29:0/1545874273 --> [v2:172.21.15.52:6808/2258341795,v1:172.21.15.52:6810/2258341795] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff3e8071120 con 0x7ff3cc074560 2024-01-25T15:04:46.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.191+0000 7fb719ffb640 1 -- 172.21.15.29:0/1609397679 <== osd.0 v2:172.21.15.29:6817/1239098486 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb708002d30 con 0x7fb70c0744a0 2024-01-25T15:04:46.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.191+0000 7ff3e57fa640 1 -- 172.21.15.29:0/1545874273 <== osd.5 v2:172.21.15.52:6808/2258341795 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff3dc00c4a0 con 0x7ff3cc074560 2024-01-25T15:04:46.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.191+0000 7f911f7fe640 1 -- 172.21.15.29:0/2595852488 <== osd.1 v2:172.21.15.29:6808/1186362515 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9138152a40 con 0x7f9138153120 2024-01-25T15:04:46.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.191+0000 7f833cd6c640 1 -- 172.21.15.29:0/2362736658 --> [v2:172.21.15.52:6800/2238001841,v1:172.21.15.52:6801/2238001841] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f83380c46e0 con 0x7f8324074610 2024-01-25T15:04:46.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.192+0000 7f913d6e5640 1 -- 172.21.15.29:0/2595852488 >> [v2:172.21.15.29:6808/1186362515,v1:172.21.15.29:6809/1186362515] conn(0x7f9138153120 msgr2=0x7f913814e7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.192+0000 7f913d6e5640 1 --2- 172.21.15.29:0/2595852488 >> [v2:172.21.15.29:6808/1186362515,v1:172.21.15.29:6809/1186362515] conn(0x7f9138153120 0x7f913814e7a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.192+0000 7fb7137fe640 1 -- 172.21.15.29:0/1609397679 >> [v2:172.21.15.29:6817/1239098486,v1:172.21.15.29:6819/1239098486] conn(0x7fb70c0744a0 msgr2=0x7fb70c0768e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.192+0000 7fb7137fe640 1 --2- 172.21.15.29:0/1609397679 >> [v2:172.21.15.29:6817/1239098486,v1:172.21.15.29:6819/1239098486] conn(0x7fb70c0744a0 0x7fb70c0768e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.192+0000 7f913d6e5640 1 -- 172.21.15.29:0/2595852488 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f912406afd0 msgr2=0x7f912406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.192+0000 7f913d6e5640 1 --2- 172.21.15.29:0/2595852488 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f912406afd0 0x7f912406d490 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f912c036000 tx=0x7f912c009030 comp rx=0 tx=0).stop 2024-01-25T15:04:46.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.192+0000 7f913d6e5640 1 -- 172.21.15.29:0/2595852488 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91200047c0 msgr2=0x7f91381f1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.192+0000 7f913d6e5640 1 --2- 172.21.15.29:0/2595852488 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91200047c0 0x7f91381f1520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f912800f620 tx=0x7f912800fae0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.192+0000 7f91377fe640 1 -- 172.21.15.29:0/2595852488 reap_dead start 2024-01-25T15:04:46.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.192+0000 7ff3eea75640 1 -- 172.21.15.29:0/1545874273 >> [v2:172.21.15.52:6808/2258341795,v1:172.21.15.52:6810/2258341795] conn(0x7ff3cc074560 msgr2=0x7ff3cc0769a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.192+0000 7ff3eea75640 1 --2- 172.21.15.29:0/1545874273 >> [v2:172.21.15.52:6808/2258341795,v1:172.21.15.52:6810/2258341795] conn(0x7ff3cc074560 0x7ff3cc0769a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.192+0000 7f06dd203640 1 -- 172.21.15.29:0/1323359809 --> [v2:172.21.15.52:6824/2160170066,v1:172.21.15.52:6825/2160170066] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f06d00daac0 con 0x7f06bc074510 2024-01-25T15:04:46.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.192+0000 7fb7137fe640 1 -- 172.21.15.29:0/1609397679 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb70c06afd0 msgr2=0x7fb70c06d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.192+0000 7ff3eea75640 1 -- 172.21.15.29:0/1545874273 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff3cc06af20 msgr2=0x7ff3cc06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.192+0000 7ff3eea75640 1 --2- 172.21.15.29:0/1545874273 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff3cc06af20 0x7ff3cc06d3e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009b40 tx=0x7ff3d4009190 comp rx=0 tx=0).stop 2024-01-25T15:04:46.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.192+0000 7ff3eea75640 1 -- 172.21.15.29:0/1545874273 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3e814ddf0 msgr2=0x7ff3e81e8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.192+0000 7ff3eea75640 1 --2- 172.21.15.29:0/1545874273 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3e814ddf0 0x7ff3e81e8c00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0002150 tx=0x7ff3e000ce70 comp rx=0 tx=0).stop 2024-01-25T15:04:46.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.192+0000 7fb7137fe640 1 --2- 172.21.15.29:0/1609397679 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb70c06afd0 0x7fb70c06d490 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb72804f800 tx=0x7fb728068440 comp rx=0 tx=0).stop 2024-01-25T15:04:46.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.192+0000 7ff3ed012640 1 -- 172.21.15.29:0/1545874273 reap_dead start 2024-01-25T15:04:46.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.193+0000 7fb7137fe640 1 -- 172.21.15.29:0/1609397679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72004b330 msgr2=0x7fb7200dc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.193+0000 7fb7137fe640 1 --2- 172.21.15.29:0/1609397679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72004b330 0x7fb7200dc7e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb72400c490 tx=0x7fb72400c950 comp rx=0 tx=0).stop 2024-01-25T15:04:46.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.193+0000 7fb72d88b640 1 -- 172.21.15.29:0/1609397679 reap_dead start 2024-01-25T15:04:46.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.193+0000 7f831ffff640 1 -- 172.21.15.29:0/2362736658 <== osd.4 v2:172.21.15.52:6800/2238001841 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8328004040 con 0x7f8324074610 2024-01-25T15:04:46.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.193+0000 7ff3eea75640 1 -- 172.21.15.29:0/1545874273 shutdown_connections 2024-01-25T15:04:46.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.193+0000 7fb7137fe640 1 -- 172.21.15.29:0/1609397679 shutdown_connections 2024-01-25T15:04:46.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.193+0000 7ff3eea75640 1 -- 172.21.15.29:0/1545874273 >> 172.21.15.29:0/1545874273 conn(0x7ff3e80c2a10 msgr2=0x7ff3e80c2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.193+0000 7fb7137fe640 1 -- 172.21.15.29:0/1609397679 >> 172.21.15.29:0/1609397679 conn(0x7fb720006330 msgr2=0x7fb72002cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.193+0000 7f913d6e5640 1 -- 172.21.15.29:0/2595852488 shutdown_connections 2024-01-25T15:04:46.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.193+0000 7f913d6e5640 1 -- 172.21.15.29:0/2595852488 >> 172.21.15.29:0/2595852488 conn(0x7f91380c2a10 msgr2=0x7f91380c07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.193+0000 7f06d4ff9640 1 -- 172.21.15.29:0/1323359809 <== osd.6 v2:172.21.15.52:6824/2160170066 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f06bc077020 con 0x7f06bc074510 2024-01-25T15:04:46.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.193+0000 7fb7137fe640 1 -- 172.21.15.29:0/1609397679 shutdown_connections 2024-01-25T15:04:46.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.193+0000 7fb7137fe640 1 -- 172.21.15.29:0/1609397679 wait complete. 2024-01-25T15:04:46.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.193+0000 7f833cd6c640 1 -- 172.21.15.29:0/2362736658 >> [v2:172.21.15.52:6800/2238001841,v1:172.21.15.52:6801/2238001841] conn(0x7f8324074610 msgr2=0x7f8324076a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.193+0000 7f913d6e5640 1 -- 172.21.15.29:0/2595852488 shutdown_connections 2024-01-25T15:04:46.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.193+0000 7f913d6e5640 1 -- 172.21.15.29:0/2595852488 wait complete. 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.193+0000 7f833cd6c640 1 --2- 172.21.15.29:0/2362736658 >> [v2:172.21.15.52:6800/2238001841,v1:172.21.15.52:6801/2238001841] conn(0x7f8324074610 0x7f8324076a50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.193+0000 7f833cd6c640 1 -- 172.21.15.29:0/2362736658 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f832406afd0 msgr2=0x7f832406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.193+0000 7f833cd6c640 1 --2- 172.21.15.29:0/2362736658 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f832406afd0 0x7f832406d490 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f832c006d40 tx=0x7f832c006cb0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.193+0000 7f833cd6c640 1 -- 172.21.15.29:0/2362736658 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83200039c0 msgr2=0x7f8338143990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.193+0000 7f833cd6c640 1 --2- 172.21.15.29:0/2362736658 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f83200039c0 0x7f8338143990 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f833000a7b0 tx=0x7f8330001cb0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.193+0000 7f8337fff640 1 -- 172.21.15.29:0/2362736658 reap_dead start 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.194+0000 7f06dd203640 1 -- 172.21.15.29:0/1323359809 >> [v2:172.21.15.52:6824/2160170066,v1:172.21.15.52:6825/2160170066] conn(0x7f06bc074510 msgr2=0x7f06bc076950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.194+0000 7f06dd203640 1 --2- 172.21.15.29:0/1323359809 >> [v2:172.21.15.52:6824/2160170066,v1:172.21.15.52:6825/2160170066] conn(0x7f06bc074510 0x7f06bc076950 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.194+0000 7f833cd6c640 1 -- 172.21.15.29:0/2362736658 shutdown_connections 2024-01-25T15:04:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.194+0000 7f833cd6c640 1 -- 172.21.15.29:0/2362736658 >> 172.21.15.29:0/2362736658 conn(0x7f83380c5b90 msgr2=0x7f8338153b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.194+0000 7f06dd203640 1 -- 172.21.15.29:0/1323359809 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f06bc06aed0 msgr2=0x7f06bc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.194+0000 7f06dd203640 1 --2- 172.21.15.29:0/1323359809 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f06bc06aed0 0x7f06bc06d390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f06c4036000 tx=0x7f06c403c040 comp rx=0 tx=0).stop 2024-01-25T15:04:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.194+0000 7f06dd203640 1 -- 172.21.15.29:0/1323359809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06d00d7b60 msgr2=0x7f06d00d8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.194+0000 7f06dd203640 1 --2- 172.21.15.29:0/1323359809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06d00d7b60 0x7f06d00d8920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f06d8067d70 tx=0x7f06d8068260 comp rx=0 tx=0).stop 2024-01-25T15:04:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.194+0000 7f06dca02640 1 -- 172.21.15.29:0/1323359809 reap_dead start 2024-01-25T15:04:46.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.194+0000 7f833cd6c640 1 -- 172.21.15.29:0/2362736658 shutdown_connections 2024-01-25T15:04:46.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.194+0000 7ff3eea75640 1 -- 172.21.15.29:0/1545874273 shutdown_connections 2024-01-25T15:04:46.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.194+0000 7ff3eea75640 1 -- 172.21.15.29:0/1545874273 wait complete. 2024-01-25T15:04:46.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.194+0000 7f06dd203640 1 -- 172.21.15.29:0/1323359809 shutdown_connections 2024-01-25T15:04:46.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.194+0000 7f06dd203640 1 -- 172.21.15.29:0/1323359809 >> 172.21.15.29:0/1323359809 conn(0x7f06d004c5e0 msgr2=0x7f06d0005920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.194+0000 7f833cd6c640 1 -- 172.21.15.29:0/2362736658 wait complete. 2024-01-25T15:04:46.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.194+0000 7f06dd203640 1 -- 172.21.15.29:0/1323359809 shutdown_connections 2024-01-25T15:04:46.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.194+0000 7f06dd203640 1 -- 172.21.15.29:0/1323359809 wait complete. 2024-01-25T15:04:46.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.199+0000 7f8a9bacf640 1 -- 172.21.15.29:0/3152288731 --> [v2:172.21.15.29:6816/2866381288,v1:172.21.15.29:6818/2866381288] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8a8c04a9e0 con 0x7f8a78074320 2024-01-25T15:04:46.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.199+0000 7f1d88456640 1 -- 172.21.15.29:0/1071096850 --> [v2:172.21.15.29:6800/2245852782,v1:172.21.15.29:6801/2245852782] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1d800737f0 con 0x7f1d640745e0 2024-01-25T15:04:46.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.199+0000 7f8a8a7fc640 1 -- 172.21.15.29:0/3152288731 <== osd.3 v2:172.21.15.29:6816/2866381288 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8a8c04a9e0 con 0x7f8a78074320 2024-01-25T15:04:46.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.199+0000 7f1d76ffd640 1 -- 172.21.15.29:0/1071096850 <== osd.2 v2:172.21.15.29:6800/2245852782 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1d800737f0 con 0x7f1d640745e0 2024-01-25T15:04:46.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.200+0000 7f1d74ff9640 1 -- 172.21.15.29:0/1071096850 >> [v2:172.21.15.29:6800/2245852782,v1:172.21.15.29:6801/2245852782] conn(0x7f1d640745e0 msgr2=0x7f1d64076a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.200+0000 7f1d74ff9640 1 --2- 172.21.15.29:0/1071096850 >> [v2:172.21.15.29:6800/2245852782,v1:172.21.15.29:6801/2245852782] conn(0x7f1d640745e0 0x7f1d64076a20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.201+0000 7f8a77fff640 1 -- 172.21.15.29:0/3152288731 >> [v2:172.21.15.29:6816/2866381288,v1:172.21.15.29:6818/2866381288] conn(0x7f8a78074320 msgr2=0x7f8a78076760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.201+0000 7f8a77fff640 1 --2- 172.21.15.29:0/3152288731 >> [v2:172.21.15.29:6816/2866381288,v1:172.21.15.29:6818/2866381288] conn(0x7f8a78074320 0x7f8a78076760 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.201+0000 7f1d74ff9640 1 -- 172.21.15.29:0/1071096850 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1d6406afa0 msgr2=0x7f1d6406d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.201+0000 7f8a77fff640 1 -- 172.21.15.29:0/3152288731 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8a7806aed0 msgr2=0x7f8a7806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.201+0000 7f8a77fff640 1 --2- 172.21.15.29:0/3152288731 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8a7806aed0 0x7f8a7806d390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8a90038000 tx=0x7f8a90034000 comp rx=0 tx=0).stop 2024-01-25T15:04:46.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.201+0000 7f8a77fff640 1 -- 172.21.15.29:0/3152288731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a8c0089b0 msgr2=0x7f8a8c0cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.201+0000 7f8a77fff640 1 --2- 172.21.15.29:0/3152288731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a8c0089b0 0x7f8a8c0cf8f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8a94064090 tx=0x7f8a94068a10 comp rx=0 tx=0).stop 2024-01-25T15:04:46.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.201+0000 7f8a9a06c640 1 -- 172.21.15.29:0/3152288731 reap_dead start 2024-01-25T15:04:46.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.201+0000 7f8a77fff640 1 -- 172.21.15.29:0/3152288731 shutdown_connections 2024-01-25T15:04:46.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.201+0000 7f8a77fff640 1 -- 172.21.15.29:0/3152288731 >> 172.21.15.29:0/3152288731 conn(0x7f8a8c0492e0 msgr2=0x7f8a8c0d1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.201+0000 7f8a77fff640 1 -- 172.21.15.29:0/3152288731 shutdown_connections 2024-01-25T15:04:46.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.201+0000 7f8a77fff640 1 -- 172.21.15.29:0/3152288731 wait complete. 2024-01-25T15:04:46.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.201+0000 7f1d74ff9640 1 --2- 172.21.15.29:0/1071096850 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1d6406afa0 0x7f1d6406d460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1d80157220 tx=0x7f1d78008040 comp rx=0 tx=0).stop 2024-01-25T15:04:46.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.201+0000 7f1d74ff9640 1 -- 172.21.15.29:0/1071096850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d8006d830 msgr2=0x7f1d801f2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.202+0000 7f1d74ff9640 1 --2- 172.21.15.29:0/1071096850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1d8006d830 0x7f1d801f2820 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00efc0 tx=0x7f1d7c00c490 comp rx=0 tx=0).stop 2024-01-25T15:04:46.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.202+0000 7f1d869f3640 1 -- 172.21.15.29:0/1071096850 reap_dead start 2024-01-25T15:04:46.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.202+0000 7f1d74ff9640 1 -- 172.21.15.29:0/1071096850 shutdown_connections 2024-01-25T15:04:46.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.202+0000 7f1d74ff9640 1 -- 172.21.15.29:0/1071096850 >> 172.21.15.29:0/1071096850 conn(0x7f1d800c2a10 msgr2=0x7f1d8006be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.204+0000 7f1d74ff9640 1 -- 172.21.15.29:0/1071096850 shutdown_connections 2024-01-25T15:04:46.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.204+0000 7f1d74ff9640 1 -- 172.21.15.29:0/1071096850 wait complete. 2024-01-25T15:04:46.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.210+0000 7f59e32d3640 1 -- 172.21.15.29:0/2269365921 --> [v2:172.21.15.52:6809/3231115782,v1:172.21.15.52:6811/3231115782] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f59bc002d30 con 0x7f59c0074590 2024-01-25T15:04:46.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.211+0000 7f59d1ffb640 1 -- 172.21.15.29:0/2269365921 <== osd.7 v2:172.21.15.52:6809/3231115782 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f59bc002d30 con 0x7f59c0074590 2024-01-25T15:04:46.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.212+0000 7f59c77fe640 1 -- 172.21.15.29:0/2269365921 >> [v2:172.21.15.52:6809/3231115782,v1:172.21.15.52:6811/3231115782] conn(0x7f59c0074590 msgr2=0x7f59c00769d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.212+0000 7f59c77fe640 1 --2- 172.21.15.29:0/2269365921 >> [v2:172.21.15.52:6809/3231115782,v1:172.21.15.52:6811/3231115782] conn(0x7f59c0074590 0x7f59c00769d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.212+0000 7f59c77fe640 1 -- 172.21.15.29:0/2269365921 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f59c006afd0 msgr2=0x7f59c006d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.212+0000 7f59c77fe640 1 --2- 172.21.15.29:0/2269365921 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f59c006afd0 0x7f59c006d490 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f59cc001bc0 tx=0x7f59cc009040 comp rx=0 tx=0).stop 2024-01-25T15:04:46.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.212+0000 7f59c77fe640 1 -- 172.21.15.29:0/2269365921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59dc152a80 msgr2=0x7f59dc14c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.212+0000 7f59c77fe640 1 --2- 172.21.15.29:0/2269365921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59dc152a80 0x7f59dc14c400 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f59d802b7d0 tx=0x7f59d80046c0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.213+0000 7f59e1870640 1 -- 172.21.15.29:0/2269365921 reap_dead start 2024-01-25T15:04:46.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.213+0000 7f59c77fe640 1 -- 172.21.15.29:0/2269365921 shutdown_connections 2024-01-25T15:04:46.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.213+0000 7f59c77fe640 1 -- 172.21.15.29:0/2269365921 >> 172.21.15.29:0/2269365921 conn(0x7f59dc0c2a10 msgr2=0x7f59dc1590b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.213+0000 7f59c77fe640 1 -- 172.21.15.29:0/2269365921 shutdown_connections 2024-01-25T15:04:46.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.213+0000 7f59c77fe640 1 -- 172.21.15.29:0/2269365921 wait complete. 2024-01-25T15:04:46.262 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-01-25T15:04:46.262 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-25T15:04:46.263 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-01-25T15:04:46.263 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-25T15:04:46.264 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-01-25T15:04:46.264 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-25T15:04:46.265 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-01-25T15:04:46.265 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-25T15:04:46.266 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-01-25T15:04:46.266 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-25T15:04:46.267 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-01-25T15:04:46.267 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-25T15:04:46.268 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-01-25T15:04:46.268 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-25T15:04:46.269 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-01-25T15:04:46.269 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-25T15:04:46.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.472+0000 7f8cd90ad640 1 Processor -- start 2024-01-25T15:04:46.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.473+0000 7f8cd90ad640 1 -- start start 2024-01-25T15:04:46.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.473+0000 7fceeae23640 1 Processor -- start 2024-01-25T15:04:46.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.473+0000 7fceeae23640 1 -- start start 2024-01-25T15:04:46.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.473+0000 7f129be0e640 1 Processor -- start 2024-01-25T15:04:46.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.474+0000 7f129be0e640 1 -- start start 2024-01-25T15:04:46.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.474+0000 7f8cd90ad640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8ccc0089e0 0x7f8ccc0d8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.474+0000 7f8cd90ad640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ccc008dc0 0x7f8ccc0daeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.474+0000 7f8cd90ad640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8ccc0d43e0 0x7f8ccc0d4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.474+0000 7f8cd90ad640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ccc048310 con 0x7f8ccc0089e0 2024-01-25T15:04:46.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.474+0000 7f8cd90ad640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ccc0daa20 con 0x7f8ccc0d43e0 2024-01-25T15:04:46.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.474+0000 7f8cd90ad640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0475e0 con 0x7f8ccc008dc0 2024-01-25T15:04:46.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.474+0000 7f3c00e90640 1 Processor -- start 2024-01-25T15:04:46.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.474+0000 7fceeae23640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcee414f4b0 0x7fcee406a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.474+0000 7fceeae23640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcee406ac00 0x7fcee4163470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.474+0000 7f8cd3fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8ccc0089e0 0x7f8ccc0d8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.474+0000 7f8cd3fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8ccc0089e0 0x7f8ccc0d8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44504/0 (socket says 172.21.15.29:44504) 2024-01-25T15:04:46.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.474+0000 7f8cd3fff640 1 -- 172.21.15.29:0/1066088529 learned_addr learned my addr 172.21.15.29:0/1066088529 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.475+0000 7fceeae23640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee40c22f0 con 0x7fcee4159570 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.475+0000 7fceeae23640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee4159ac0 con 0x7fcee406ac00 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.475+0000 7fceeae23640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee40c19c0 con 0x7fcee414f4b0 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.475+0000 7fcee8bbf640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcee414f4b0 0x7fcee406a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.475+0000 7fcee3fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcee4159570 0x7fcee4159fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:49726/0 (socket says 172.21.15.29:49726) 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.475+0000 7fcee8bbf640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcee414f4b0 0x7fcee406a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:33474/0 (socket says 172.21.15.29:33474) 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.475+0000 7fcee3fff640 1 -- 172.21.15.29:0/2723582670 learned_addr learned my addr 172.21.15.29:0/2723582670 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.475+0000 7f129be0e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f12940c1b90 0x7f1294071d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.475+0000 7f129be0e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1294070230 0x7f12940706c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.475+0000 7f129be0e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1294158af0 con 0x7f1294155d20 2024-01-25T15:04:46.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.475+0000 7f129be0e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1294158db0 con 0x7f12940c1b90 2024-01-25T15:04:46.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.475+0000 7f129be0e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1294159090 con 0x7f1294070230 2024-01-25T15:04:46.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.475+0000 7f12993a9640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1294155d20 0x7f1294156180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:49724/0 (socket says 172.21.15.29:49724) 2024-01-25T15:04:46.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.475+0000 7f12993a9640 1 -- 172.21.15.29:0/637843071 learned_addr learned my addr 172.21.15.29:0/637843071 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:46.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.475+0000 7f129a3ab640 1 --2- 172.21.15.29:0/637843071 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1294070230 0x7f12940706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.474+0000 7f3c00e90640 1 -- start start 2024-01-25T15:04:46.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.475+0000 7fcbb0860640 1 Processor -- start 2024-01-25T15:04:46.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.475+0000 7fcbb0860640 1 -- start start 2024-01-25T15:04:46.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.475+0000 7f3c00e90640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3bfc070670 0x7f3bfc070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.476+0000 7f3c00e90640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3bfc0c0e20 0x7f3bfc0726d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.476+0000 7f3c00e90640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bfc152fd0 con 0x7f3bfc06d9f0 2024-01-25T15:04:46.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.476+0000 7f3c00e90640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bfc159520 con 0x7f3bfc070670 2024-01-25T15:04:46.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.476+0000 7f3c00e90640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc06d560 con 0x7f3bfc0c0e20 2024-01-25T15:04:46.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.475+0000 7f1298ba8640 1 -- 172.21.15.29:0/637843071 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566488299 0 0) 0x7f1294158af0 con 0x7f1294155d20 2024-01-25T15:04:46.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.475+0000 7f1298ba8640 1 -- 172.21.15.29:0/637843071 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1280003520 con 0x7f1294155d20 2024-01-25T15:04:46.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.476+0000 7f129a3ab640 1 -- 172.21.15.29:0/637843071 >> v2:172.21.15.29:3300/0 conn(0x7f12940c1b90 msgr2=0x7f1294071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.476+0000 7f129a3ab640 1 --2- 172.21.15.29:0/637843071 >> v2:172.21.15.29:3300/0 conn(0x7f12940c1b90 0x7f1294071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.476+0000 7f129a3ab640 1 -- 172.21.15.29:0/637843071 >> v1:172.21.15.52:6789/0 conn(0x7f1294155d20 legacy=0x7f1294156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.476+0000 7f129a3ab640 1 -- 172.21.15.29:0/637843071 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1294159370 con 0x7f1294070230 2024-01-25T15:04:46.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.476+0000 7f3bf9d9b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3bfc0c0e20 0x7f3bfc0726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.476+0000 7f3bf9d9b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3bfc0c0e20 0x7f3bfc0726d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:40544/0 (socket says 172.21.15.29:40544) 2024-01-25T15:04:46.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.476+0000 7f3bf9d9b640 1 -- 172.21.15.29:0/3786501551 learned_addr learned my addr 172.21.15.29:0/3786501551 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:46.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.475+0000 7fcee93c0640 1 --2- 172.21.15.29:0/2723582670 >> v2:172.21.15.29:3300/0 conn(0x7fcee406ac00 0x7fcee4163470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.476+0000 7fcee8bbf640 1 -- 172.21.15.29:0/2723582670 >> v2:172.21.15.29:3300/0 conn(0x7fcee406ac00 msgr2=0x7fcee4163470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.476+0000 7fcee8bbf640 1 --2- 172.21.15.29:0/2723582670 >> v2:172.21.15.29:3300/0 conn(0x7fcee406ac00 0x7fcee4163470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.476+0000 7fcee8bbf640 1 -- 172.21.15.29:0/2723582670 >> v1:172.21.15.52:6789/0 conn(0x7fcee4159570 legacy=0x7fcee4159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.476+0000 7fcee8bbf640 1 -- 172.21.15.29:0/2723582670 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee40c1ca0 con 0x7fcee414f4b0 2024-01-25T15:04:46.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7fcbb0860640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcba404b110 0x7fcba40d38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7fcbb0860640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba40d9f40 con 0x7fcba40d3e10 2024-01-25T15:04:46.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7fcbb0860640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba40da220 con 0x7fcba400bd50 2024-01-25T15:04:46.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7fcbb0860640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba40da500 con 0x7fcba404b110 2024-01-25T15:04:46.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7f3bfa59c640 1 --2- 172.21.15.29:0/3786501551 >> v2:172.21.15.52:3300/0 conn(0x7f3bfc070670 0x7f3bfc070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7fcbab7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcba400bd50 0x7fcba4046b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:49732/0 (socket says 172.21.15.29:49732) 2024-01-25T15:04:46.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7fcbab7fe640 1 -- 172.21.15.29:0/2167586872 learned_addr learned my addr 172.21.15.29:0/2167586872 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:46.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.476+0000 7f8cd3fff640 1 -- 172.21.15.29:0/1066088529 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ccc008dc0 msgr2=0x7f8ccc0daeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.476+0000 7f8cd3fff640 1 --2- 172.21.15.29:0/1066088529 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ccc008dc0 0x7f8ccc0daeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.476+0000 7f8cd3fff640 1 -- 172.21.15.29:0/1066088529 >> v2:172.21.15.52:3300/0 conn(0x7f8ccc0d43e0 msgr2=0x7f8ccc0d4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.476+0000 7f8cd3fff640 1 --2- 172.21.15.29:0/1066088529 >> v2:172.21.15.52:3300/0 conn(0x7f8ccc0d43e0 0x7f8ccc0d4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.476+0000 7f8cd3fff640 1 -- 172.21.15.29:0/1066088529 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc0478c0 con 0x7f8ccc0089e0 2024-01-25T15:04:46.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7fcbaaffd640 1 --2- 172.21.15.29:0/2167586872 >> v2:172.21.15.29:3300/0 conn(0x7fcba404b110 0x7fcba40d38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.475+0000 7f85e6e6d640 1 Processor -- start 2024-01-25T15:04:46.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.476+0000 7f85e6e6d640 1 -- start start 2024-01-25T15:04:46.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7fcbaa7fc640 1 -- 172.21.15.29:0/2167586872 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766971682 0 0) 0x7fcba40da220 con 0x7fcba400bd50 2024-01-25T15:04:46.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7f85e6e6d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f85e00c5660 0x7f85e006d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7f85e6e6d640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e00c2e50 con 0x7f85e00c2a00 2024-01-25T15:04:46.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7f85e6e6d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e0153c20 con 0x7f85e00c2620 2024-01-25T15:04:46.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7f85e6e6d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e0153fc0 con 0x7f85e00c5660 2024-01-25T15:04:46.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7f85e666c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f85e00c2a00 0x7f85e014d970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58954/0 (socket says 172.21.15.29:58954) 2024-01-25T15:04:46.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7f85e666c640 1 -- 172.21.15.29:0/946020874 learned_addr learned my addr 172.21.15.29:0/946020874 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:46.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7f85e4e69640 1 -- 172.21.15.29:0/946020874 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043190727 0 0) 0x7f85e0153c20 con 0x7f85e00c2620 2024-01-25T15:04:46.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7f85e4e69640 1 -- 172.21.15.29:0/946020874 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85cc003520 con 0x7f85e00c2620 2024-01-25T15:04:46.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7fcbaa7fc640 1 -- 172.21.15.29:0/2167586872 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb9c003520 con 0x7fcba400bd50 2024-01-25T15:04:46.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7f8cd3fff640 1 --2- 172.21.15.29:0/1066088529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ccc0089e0 0x7f8ccc0d8510 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4050350 tx=0x7f8cd40aa640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ac8c220598ae58 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f8cd2ffd640 1 -- 172.21.15.29:0/1066088529 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd40af7d0 con 0x7f8ccc0089e0 2024-01-25T15:04:46.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f85e4e69640 1 -- 172.21.15.29:0/946020874 <== mon.1 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 672083095 0 0) 0x7f85cc003520 con 0x7f85e00c2620 2024-01-25T15:04:46.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f85e4e69640 1 -- 172.21.15.29:0/946020874 >> v2:172.21.15.29:3300/0 conn(0x7f85e00c5660 msgr2=0x7f85e006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f85e4e69640 1 --2- 172.21.15.29:0/946020874 >> v2:172.21.15.29:3300/0 conn(0x7f85e00c5660 0x7f85e006d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f85e4e69640 1 -- 172.21.15.29:0/946020874 >> v1:172.21.15.29:6789/0 conn(0x7f85e00c2a00 legacy=0x7f85e014d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7f3bf9d9b640 1 -- 172.21.15.29:0/3786501551 >> v2:172.21.15.52:3300/0 conn(0x7f3bfc070670 msgr2=0x7f3bfc070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7f3bf9d9b640 1 --2- 172.21.15.29:0/3786501551 >> v2:172.21.15.52:3300/0 conn(0x7f3bfc070670 0x7f3bfc070a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7f3bf9d9b640 1 -- 172.21.15.29:0/3786501551 >> v1:172.21.15.29:6789/0 conn(0x7f3bfc06d9f0 legacy=0x7f3bfc06de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7f3bf9d9b640 1 -- 172.21.15.29:0/3786501551 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc072c10 con 0x7f3bfc0c0e20 2024-01-25T15:04:46.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7fcee8bbf640 1 --2- 172.21.15.29:0/2723582670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcee414f4b0 0x7fcee406a6c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcee40c4840 tx=0x7fced802b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d82b2e7615453e55 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7fcee37fe640 1 -- 172.21.15.29:0/2723582670 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced80317c0 con 0x7fcee414f4b0 2024-01-25T15:04:46.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7fcee37fe640 1 -- 172.21.15.29:0/2723582670 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced8031920 con 0x7fcee414f4b0 2024-01-25T15:04:46.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7fcee37fe640 1 -- 172.21.15.29:0/2723582670 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced80317c0 con 0x7fcee414f4b0 2024-01-25T15:04:46.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7fcbaa7fc640 1 -- 172.21.15.29:0/2167586872 <== mon.1 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2527358895 0 0) 0x7fcb9c003520 con 0x7fcba400bd50 2024-01-25T15:04:46.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f7123ce0640 1 Processor -- start 2024-01-25T15:04:46.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7fcbaa7fc640 1 -- 172.21.15.29:0/2167586872 >> v2:172.21.15.29:3300/0 conn(0x7fcba404b110 msgr2=0x7fcba40d38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7fcbaa7fc640 1 --2- 172.21.15.29:0/2167586872 >> v2:172.21.15.29:3300/0 conn(0x7fcba404b110 0x7fcba40d38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7fcbaa7fc640 1 -- 172.21.15.29:0/2167586872 >> v1:172.21.15.29:6789/0 conn(0x7fcba40d3e10 legacy=0x7fcba4006ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.477+0000 7f129a3ab640 1 --2- 172.21.15.29:0/637843071 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1294070230 0x7f12940706c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f128c009d90 tx=0x7f128c02be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=758e691e5af6bf25 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f1298ba8640 1 -- 172.21.15.29:0/637843071 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c02cbe0 con 0x7f1294070230 2024-01-25T15:04:46.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f1298ba8640 1 -- 172.21.15.29:0/637843071 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c02cd40 con 0x7f1294070230 2024-01-25T15:04:46.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f1298ba8640 1 -- 172.21.15.29:0/637843071 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c034660 con 0x7f1294070230 2024-01-25T15:04:46.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7fcbaa7fc640 1 -- 172.21.15.29:0/2167586872 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba40da7e0 con 0x7fcba400bd50 2024-01-25T15:04:46.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7fcbaa7fc640 1 -- 172.21.15.29:0/2167586872 <== mon.1 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7fcbac04f2a0 con 0x7fcba400bd50 2024-01-25T15:04:46.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f3bf9d9b640 1 --2- 172.21.15.29:0/3786501551 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3bfc0c0e20 0x7f3bfc0726d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0009870 tx=0x7f3bf002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a34d9d7d6c0931d4 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f8cd2ffd640 1 -- 172.21.15.29:0/1066088529 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd40ad050 con 0x7f8ccc0089e0 2024-01-25T15:04:46.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f85e4e69640 1 -- 172.21.15.29:0/946020874 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e00a5090 con 0x7f85e00c2620 2024-01-25T15:04:46.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f85e4e69640 1 -- 172.21.15.29:0/946020874 <== mon.1 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f85d8001920 con 0x7f85e00c2620 2024-01-25T15:04:46.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f85e4e69640 1 -- 172.21.15.29:0/946020874 >> v1:172.21.15.52:6789/0 conn(0x7f85e00c2620 legacy=0x7f85e01543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f85e4e69640 1 --2- 172.21.15.29:0/946020874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85cc003a10 0x7f85cc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f7123ce0640 1 -- start start 2024-01-25T15:04:46.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7fcbaa7fc640 1 -- 172.21.15.29:0/2167586872 >> v1:172.21.15.52:6789/0 conn(0x7fcba400bd50 legacy=0x7fcba4046b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f85e4e69640 1 --2- 172.21.15.29:0/946020874 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85cc0047c0 0x7f85cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f3bf959a640 1 -- 172.21.15.29:0/3786501551 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf00317c0 con 0x7f3bfc0c0e20 2024-01-25T15:04:46.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7fcbaa7fc640 1 --2- 172.21.15.29:0/2167586872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcb9c003970 0x7fcb9c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f3bf959a640 1 -- 172.21.15.29:0/3786501551 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf0031920 con 0x7f3bfc0c0e20 2024-01-25T15:04:46.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7fcbaa7fc640 1 --2- 172.21.15.29:0/2167586872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb9c0042d0 0x7fcb9c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7fcbaa7fc640 1 --2- 172.21.15.29:0/2167586872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb9c004fa0 0x7fcb9c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f8cd2ffd640 1 -- 172.21.15.29:0/1066088529 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd40afbf0 con 0x7f8ccc0089e0 2024-01-25T15:04:46.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7fcbaa7fc640 1 -- 172.21.15.29:0/2167586872 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba40da500 con 0x7fcb9c004fa0 2024-01-25T15:04:46.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7fcbabfff640 1 --2- 172.21.15.29:0/2167586872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb9c004fa0 0x7fcb9c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7fcbaa7fc640 1 -- 172.21.15.29:0/2167586872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c00bef0 con 0x7fcb9c0042d0 2024-01-25T15:04:46.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f8cd90ad640 1 -- 172.21.15.29:0/1066088529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ccc0089e0 msgr2=0x7f8ccc0d8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f8cd90ad640 1 --2- 172.21.15.29:0/1066088529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ccc0089e0 0x7f8ccc0d8510 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4050350 tx=0x7f8cd40aa640 comp rx=0 tx=0).stop 2024-01-25T15:04:46.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7fcbaa7fc640 1 -- 172.21.15.29:0/2167586872 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c00c0b0 con 0x7fcb9c003970 2024-01-25T15:04:46.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f7123ce0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f711c156270 0x7f711c072740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f7123ce0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f711c06cd80 0x7f711c0c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f8cd90ad640 1 -- 172.21.15.29:0/1066088529 shutdown_connections 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f8cd90ad640 1 --2- 172.21.15.29:0/1066088529 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ccc008dc0 0x7f8ccc0daeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f8cd90ad640 1 --2- 172.21.15.29:0/1066088529 >> v2:172.21.15.52:3300/0 conn(0x7f8ccc0d43e0 0x7f8ccc0d4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f8cd90ad640 1 --2- 172.21.15.29:0/1066088529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ccc0089e0 0x7f8ccc0d8510 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f8cd90ad640 1 -- 172.21.15.29:0/1066088529 >> 172.21.15.29:0/1066088529 conn(0x7f8ccc007c50 msgr2=0x7f8ccc008060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7f7123ce0640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711c06bfc0 con 0x7f711c159530 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f85e4e69640 1 --2- 172.21.15.29:0/946020874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85cc0052a0 0x7f85cc00ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f85e4e69640 1 -- 172.21.15.29:0/946020874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e0153fc0 con 0x7f85cc003a10 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f85e566a640 1 --2- 172.21.15.29:0/946020874 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85cc0047c0 0x7f85cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f85e4e69640 1 -- 172.21.15.29:0/946020874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc007bc0 con 0x7f85cc0052a0 2024-01-25T15:04:46.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f85e4e69640 1 -- 172.21.15.29:0/946020874 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc007d80 con 0x7f85cc0047c0 2024-01-25T15:04:46.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7f7123ce0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711c159aa0 con 0x7f711c156270 2024-01-25T15:04:46.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7f7123ce0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c06c2a0 con 0x7f711c06cd80 2024-01-25T15:04:46.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.478+0000 7f85e666c640 1 --2- 172.21.15.29:0/946020874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85cc0052a0 0x7f85cc00ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f129be0e640 1 -- 172.21.15.29:0/637843071 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1294070230 msgr2=0x7f12940706c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f129be0e640 1 --2- 172.21.15.29:0/637843071 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1294070230 0x7f12940706c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f128c009d90 tx=0x7f128c02be30 comp rx=0 tx=0).stop 2024-01-25T15:04:46.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f129be0e640 1 -- 172.21.15.29:0/637843071 shutdown_connections 2024-01-25T15:04:46.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f129be0e640 1 --2- 172.21.15.29:0/637843071 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1294070230 0x7f12940706c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f129be0e640 1 --2- 172.21.15.29:0/637843071 >> v2:172.21.15.29:3300/0 conn(0x7f12940c1b90 0x7f1294071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f129be0e640 1 -- 172.21.15.29:0/637843071 >> 172.21.15.29:0/637843071 conn(0x7f12940c2a10 msgr2=0x7f12940c2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f85e666c640 1 -- 172.21.15.29:0/946020874 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85cc0047c0 msgr2=0x7f85cc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f85e666c640 1 --2- 172.21.15.29:0/946020874 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85cc0047c0 0x7f85cc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f85e666c640 1 -- 172.21.15.29:0/946020874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85cc003a10 msgr2=0x7f85cc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7fcbaaffd640 1 --2- 172.21.15.29:0/2167586872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb9c0042d0 0x7fcb9c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7f129be0e640 1 -- 172.21.15.29:0/637843071 shutdown_connections 2024-01-25T15:04:46.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f85e666c640 1 --2- 172.21.15.29:0/946020874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85cc003a10 0x7f85cc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7f85e666c640 1 -- 172.21.15.29:0/946020874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc003520 con 0x7f85cc0052a0 2024-01-25T15:04:46.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7f85e666c640 1 -- 172.21.15.29:0/946020874 reap_dead start 2024-01-25T15:04:46.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7f712227d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f711c06cd80 0x7f711c0c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7fceeae23640 1 -- 172.21.15.29:0/2723582670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcee414f4b0 msgr2=0x7fcee406a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.479+0000 7fceeae23640 1 --2- 172.21.15.29:0/2723582670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcee414f4b0 0x7fcee406a6c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcee40c4840 tx=0x7fced802b860 comp rx=0 tx=0).stop 2024-01-25T15:04:46.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7f8cd90ad640 1 -- 172.21.15.29:0/1066088529 shutdown_connections 2024-01-25T15:04:46.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7f129be0e640 1 -- 172.21.15.29:0/637843071 wait complete. 2024-01-25T15:04:46.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7f8cd90ad640 1 -- 172.21.15.29:0/1066088529 wait complete. 2024-01-25T15:04:46.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7fceeae23640 1 -- 172.21.15.29:0/2723582670 shutdown_connections 2024-01-25T15:04:46.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7fceeae23640 1 --2- 172.21.15.29:0/2723582670 >> v2:172.21.15.29:3300/0 conn(0x7fcee406ac00 0x7fcee4163470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7fceeae23640 1 --2- 172.21.15.29:0/2723582670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcee414f4b0 0x7fcee406a6c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7fceeae23640 1 -- 172.21.15.29:0/2723582670 >> 172.21.15.29:0/2723582670 conn(0x7fcee40c39b0 msgr2=0x7fcee40c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7f85e666c640 1 --2- 172.21.15.29:0/946020874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85cc0052a0 0x7f85cc00ff90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0018a0 tx=0x7f85cc0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc1b4aab971d0bfc server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7f3bf959a640 1 -- 172.21.15.29:0/3786501551 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0031cb0 con 0x7f3bfc0c0e20 2024-01-25T15:04:46.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7fcbab7fe640 1 --2- 172.21.15.29:0/2167586872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcb9c003970 0x7fcb9c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7fceeae23640 1 -- 172.21.15.29:0/2723582670 shutdown_connections 2024-01-25T15:04:46.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7fceeae23640 1 -- 172.21.15.29:0/2723582670 wait complete. 2024-01-25T15:04:46.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7f85e4e69640 1 -- 172.21.15.29:0/946020874 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc004aa0 con 0x7f85cc0052a0 2024-01-25T15:04:46.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7f3c00e90640 1 -- 172.21.15.29:0/3786501551 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3bfc0c0e20 msgr2=0x7f3bfc0726d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7f3c00e90640 1 --2- 172.21.15.29:0/3786501551 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3bfc0c0e20 0x7f3bfc0726d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0009870 tx=0x7f3bf002b860 comp rx=0 tx=0).stop 2024-01-25T15:04:46.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.481+0000 7f3c00e90640 1 -- 172.21.15.29:0/3786501551 shutdown_connections 2024-01-25T15:04:46.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7f85e4e69640 1 -- 172.21.15.29:0/946020874 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc004c00 con 0x7f85cc0052a0 2024-01-25T15:04:46.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.481+0000 7f85e4e69640 1 -- 172.21.15.29:0/946020874 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc007070 con 0x7f85cc0052a0 2024-01-25T15:04:46.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7fcbabfff640 1 -- 172.21.15.29:0/2167586872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcb9c003970 msgr2=0x7fcb9c003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7fcbabfff640 1 --2- 172.21.15.29:0/2167586872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcb9c003970 0x7fcb9c003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7fcbabfff640 1 -- 172.21.15.29:0/2167586872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb9c0042d0 msgr2=0x7fcb9c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7fcbabfff640 1 --2- 172.21.15.29:0/2167586872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb9c0042d0 0x7fcb9c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7fcbabfff640 1 -- 172.21.15.29:0/2167586872 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c003520 con 0x7fcb9c004fa0 2024-01-25T15:04:46.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.481+0000 7f3c00e90640 1 --2- 172.21.15.29:0/3786501551 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3bfc0c0e20 0x7f3bfc0726d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.481+0000 7f3c00e90640 1 --2- 172.21.15.29:0/3786501551 >> v2:172.21.15.52:3300/0 conn(0x7f3bfc070670 0x7f3bfc070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.481+0000 7f3c00e90640 1 -- 172.21.15.29:0/3786501551 >> 172.21.15.29:0/3786501551 conn(0x7f3bfc06a6c0 msgr2=0x7f3bfc06aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.481+0000 7f85e6e6d640 1 -- 172.21.15.29:0/946020874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85cc0052a0 msgr2=0x7f85cc00ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.481+0000 7f85e6e6d640 1 --2- 172.21.15.29:0/946020874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85cc0052a0 0x7f85cc00ff90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0018a0 tx=0x7f85cc0057f0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.481+0000 7f85e6e6d640 1 -- 172.21.15.29:0/946020874 shutdown_connections 2024-01-25T15:04:46.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.481+0000 7f85e6e6d640 1 --2- 172.21.15.29:0/946020874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85cc0052a0 0x7f85cc00ff90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.481+0000 7f85e6e6d640 1 -- 172.21.15.29:0/946020874 >> 172.21.15.29:0/946020874 conn(0x7f85e00c5b90 msgr2=0x7f85e00c5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7f712227d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f711c06cd80 0x7f711c0c0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:40556/0 (socket says 172.21.15.29:40556) 2024-01-25T15:04:46.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7f712227d640 1 -- 172.21.15.29:0/678428756 learned_addr learned my addr 172.21.15.29:0/678428756 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:46.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.480+0000 7f712227d640 1 -- 172.21.15.29:0/678428756 >> v2:172.21.15.29:3300/0 conn(0x7f711c156270 msgr2=0x7f711c072740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-25T15:04:46.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.481+0000 7f7121a7c640 1 --2- 172.21.15.29:0/678428756 >> v2:172.21.15.29:3300/0 conn(0x7f711c156270 0x7f711c072740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.481+0000 7f712227d640 1 --2- 172.21.15.29:0/678428756 >> v2:172.21.15.29:3300/0 conn(0x7f711c156270 0x7f711c072740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.481+0000 7f712227d640 1 -- 172.21.15.29:0/678428756 >> v1:172.21.15.52:6789/0 conn(0x7f711c159530 legacy=0x7f711c0c3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.481+0000 7f712227d640 1 -- 172.21.15.29:0/678428756 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c06c580 con 0x7f711c06cd80 2024-01-25T15:04:46.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.481+0000 7f3c00e90640 1 -- 172.21.15.29:0/3786501551 shutdown_connections 2024-01-25T15:04:46.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.481+0000 7f8cd90ad640 1 Processor -- start 2024-01-25T15:04:46.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.481+0000 7f129be0e640 1 Processor -- start 2024-01-25T15:04:46.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.482+0000 7fcbabfff640 1 --2- 172.21.15.29:0/2167586872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb9c004fa0 0x7fcb9c00b980 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcba402b220 tx=0x7fcb9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec040f12cce69713 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.482+0000 7fceeae23640 1 Processor -- start 2024-01-25T15:04:46.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.482+0000 7fcbabfff640 1 -- 172.21.15.29:0/2167586872 reap_dead start 2024-01-25T15:04:46.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.482+0000 7f8cd90ad640 1 -- start start 2024-01-25T15:04:46.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.482+0000 7fcbaa7fc640 1 -- 172.21.15.29:0/2167586872 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb980052d0 con 0x7fcb9c004fa0 2024-01-25T15:04:46.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.482+0000 7fc66f59e640 1 Processor -- start 2024-01-25T15:04:46.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.482+0000 7fcbaa7fc640 1 -- 172.21.15.29:0/2167586872 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9802e050 con 0x7fcb9c004fa0 2024-01-25T15:04:46.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.482+0000 7f7121a7c640 1 --2- 172.21.15.29:0/678428756 >> v2:172.21.15.29:3300/0 conn(0x7f711c156270 0x7f711c072740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:46.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.482+0000 7fc66f59e640 1 -- start start 2024-01-25T15:04:46.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f8cd90ad640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ccc0089e0 0x7f8ccc04ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f8cd90ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ccc008dc0 0x7f8ccc175280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f8cd90ad640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ccc0d43e0 0x7f8ccc046020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f8cd90ad640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc04b600 con 0x7f8ccc0089e0 2024-01-25T15:04:46.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f8cd90ad640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc046a10 con 0x7f8ccc008dc0 2024-01-25T15:04:46.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f8cd90ad640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc045660 con 0x7f8ccc0d43e0 2024-01-25T15:04:46.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7fcbaa7fc640 1 -- 172.21.15.29:0/2167586872 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb980035f0 con 0x7fcb9c004fa0 2024-01-25T15:04:46.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.482+0000 7f129be0e640 1 -- start start 2024-01-25T15:04:46.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f129be0e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1294070230 0x7f12940c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f129be0e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f12940c1b90 0x7f1294153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f129be0e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1294155d20 0x7f1294150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f129be0e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1294150920 con 0x7f1294155d20 2024-01-25T15:04:46.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f129be0e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1294153210 con 0x7f1294070230 2024-01-25T15:04:46.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f129be0e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12940c5520 con 0x7f12940c1b90 2024-01-25T15:04:46.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f12993a9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f12940c1b90 0x7f1294153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f8cd88ac640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ccc0d43e0 0x7f8ccc046020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f8cd88ac640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ccc0d43e0 0x7f8ccc046020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:40568/0 (socket says 172.21.15.29:40568) 2024-01-25T15:04:46.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f8cd88ac640 1 -- 172.21.15.29:0/3480222399 learned_addr learned my addr 172.21.15.29:0/3480222399 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:46.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f85e6e6d640 1 -- 172.21.15.29:0/946020874 shutdown_connections 2024-01-25T15:04:46.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f129a3ab640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1294155d20 0x7f1294150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f129a3ab640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1294155d20 0x7f1294150d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44586/0 (socket says 172.21.15.29:44586) 2024-01-25T15:04:46.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f129a3ab640 1 -- 172.21.15.29:0/895971269 learned_addr learned my addr 172.21.15.29:0/895971269 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:46.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f1299baa640 1 --2- 172.21.15.29:0/895971269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1294070230 0x7f12940c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.482+0000 7fceeae23640 1 -- start start 2024-01-25T15:04:46.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7fceeae23640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcee406ac00 0x7fcee4155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7fceeae23640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcee414f4b0 0x7fcee41522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f85e6e6d640 1 -- 172.21.15.29:0/946020874 wait complete. 2024-01-25T15:04:46.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f712227d640 1 --2- 172.21.15.29:0/678428756 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f711c06cd80 0x7f711c0c0c70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7118009870 tx=0x7f711802b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0819f14f9e2cf60 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.481+0000 7f3c00e90640 1 -- 172.21.15.29:0/3786501551 wait complete. 2024-01-25T15:04:46.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7fceeae23640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcee4159570 0x7fcee414bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7fcee8bbf640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcee406ac00 0x7fcee4155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7fcee8bbf640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcee406ac00 0x7fcee4155e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:40578/0 (socket says 172.21.15.29:40578) 2024-01-25T15:04:46.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f3c00e90640 1 Processor -- start 2024-01-25T15:04:46.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f8cd88ac640 1 -- 172.21.15.29:0/3480222399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ccc008dc0 msgr2=0x7f8ccc175280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f8cd88ac640 1 --2- 172.21.15.29:0/3480222399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ccc008dc0 0x7f8ccc175280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7f8cd88ac640 1 -- 172.21.15.29:0/3480222399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ccc0089e0 msgr2=0x7f8ccc04ba90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-25T15:04:46.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7fcee3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcee414f4b0 0x7fcee41522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7fcee3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcee414f4b0 0x7fcee41522b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:33544/0 (socket says 172.21.15.29:33544) 2024-01-25T15:04:46.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7f129a3ab640 1 -- 172.21.15.29:0/895971269 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f12940c1b90 msgr2=0x7f1294153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7f129a3ab640 1 --2- 172.21.15.29:0/895971269 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f12940c1b90 0x7f1294153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7f129a3ab640 1 -- 172.21.15.29:0/895971269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1294070230 msgr2=0x7f12940c4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7fc66f59e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc670156150 0x7fc67015cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7fc66f59e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc6700c55b0 0x7fc67015c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7fc66f59e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6700c79d0 con 0x7fc67006d1b0 2024-01-25T15:04:46.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7fc66f59e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc670156530 con 0x7fc6700c55b0 2024-01-25T15:04:46.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.483+0000 7fc66f59e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc67006d640 con 0x7fc670156150 2024-01-25T15:04:46.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7f8cd88ac640 1 --2- 172.21.15.29:0/3480222399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ccc0089e0 0x7f8ccc04ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7f129a3ab640 1 --2- 172.21.15.29:0/895971269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1294070230 0x7f12940c4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7f129a3ab640 1 -- 172.21.15.29:0/895971269 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c009a70 con 0x7f1294155d20 2024-01-25T15:04:46.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fceeae23640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee41502d0 con 0x7fcee4159570 2024-01-25T15:04:46.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fceeae23640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee41ee120 con 0x7fcee414f4b0 2024-01-25T15:04:46.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fceeae23640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee414f930 con 0x7fcee406ac00 2024-01-25T15:04:46.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fcee8bbf640 1 -- 172.21.15.29:0/1242319969 learned_addr learned my addr 172.21.15.29:0/1242319969 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:46.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7f1299baa640 1 --2- 172.21.15.29:0/895971269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1294070230 0x7f12940c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:46.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fc66e59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc670156150 0x7fc67015cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fc66e59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc670156150 0x7fc67015cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:33548/0 (socket says 172.21.15.29:33548) 2024-01-25T15:04:46.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fc66e59c640 1 -- 172.21.15.29:0/3031605653 learned_addr learned my addr 172.21.15.29:0/3031605653 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:46.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fcbb0860640 1 -- 172.21.15.29:0/2167586872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb9c004fa0 msgr2=0x7fcb9c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fcbb0860640 1 --2- 172.21.15.29:0/2167586872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb9c004fa0 0x7fcb9c00b980 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcba402b220 tx=0x7fcb9c0057f0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7f7120a7a640 1 -- 172.21.15.29:0/678428756 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71180317e0 con 0x7f711c06cd80 2024-01-25T15:04:46.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7f8cd88ac640 1 -- 172.21.15.29:0/3480222399 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd404f940 con 0x7f8ccc0d43e0 2024-01-25T15:04:46.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fcbb0860640 1 -- 172.21.15.29:0/2167586872 shutdown_connections 2024-01-25T15:04:46.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fcbb0860640 1 --2- 172.21.15.29:0/2167586872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb9c004fa0 0x7fcb9c00b980 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fcbb0860640 1 -- 172.21.15.29:0/2167586872 >> 172.21.15.29:0/2167586872 conn(0x7fcba4048250 msgr2=0x7fcba4048660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7f7120a7a640 1 -- 172.21.15.29:0/678428756 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7118031940 con 0x7f711c06cd80 2024-01-25T15:04:46.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7f7120a7a640 1 -- 172.21.15.29:0/678428756 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7118031d10 con 0x7f711c06cd80 2024-01-25T15:04:46.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fcee93c0640 1 --2- 172.21.15.29:0/1242319969 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcee4159570 0x7fcee414bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7f8cd88ac640 1 --2- 172.21.15.29:0/3480222399 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ccc0d43e0 0x7f8ccc046020 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000b410 tx=0x7f8cc000b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fc66ed9d640 1 --2- 172.21.15.29:0/3031605653 >> v2:172.21.15.29:3300/0 conn(0x7fc6700c55b0 0x7fc67015c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fc66e59c640 1 -- 172.21.15.29:0/3031605653 >> v2:172.21.15.29:3300/0 conn(0x7fc6700c55b0 msgr2=0x7fc67015c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fc66e59c640 1 --2- 172.21.15.29:0/3031605653 >> v2:172.21.15.29:3300/0 conn(0x7fc6700c55b0 0x7fc67015c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fc66e59c640 1 -- 172.21.15.29:0/3031605653 >> v1:172.21.15.52:6789/0 conn(0x7fc67006d1b0 legacy=0x7fc6700c2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fcbb0860640 1 -- 172.21.15.29:0/2167586872 shutdown_connections 2024-01-25T15:04:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fc66e59c640 1 -- 172.21.15.29:0/3031605653 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6700c4ad0 con 0x7fc670156150 2024-01-25T15:04:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fcbb0860640 1 -- 172.21.15.29:0/2167586872 wait complete. 2024-01-25T15:04:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fcee3fff640 1 -- 172.21.15.29:0/1242319969 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcee406ac00 msgr2=0x7fcee4155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fcee3fff640 1 --2- 172.21.15.29:0/1242319969 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcee406ac00 0x7fcee4155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fcee3fff640 1 -- 172.21.15.29:0/1242319969 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcee4159570 msgr2=0x7fcee414bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fcee3fff640 1 --2- 172.21.15.29:0/1242319969 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcee4159570 0x7fcee414bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fcee3fff640 1 -- 172.21.15.29:0/1242319969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced8009400 con 0x7fcee414f4b0 2024-01-25T15:04:46.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7f8cd0ff9640 1 -- 172.21.15.29:0/3480222399 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0011830 con 0x7f8ccc0d43e0 2024-01-25T15:04:46.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fcee93c0640 1 --2- 172.21.15.29:0/1242319969 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcee4159570 0x7fcee414bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:46.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7fcee8bbf640 1 --2- 172.21.15.29:0/1242319969 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcee406ac00 0x7fcee4155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:46.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.485+0000 7f8cd0ff9640 1 -- 172.21.15.29:0/3480222399 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc00119b0 con 0x7f8ccc0d43e0 2024-01-25T15:04:46.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.485+0000 7f8cd0ff9640 1 -- 172.21.15.29:0/3480222399 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0011d60 con 0x7f8ccc0d43e0 2024-01-25T15:04:46.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.485+0000 7f8cd90ad640 1 -- 172.21.15.29:0/3480222399 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ccc0443d0 con 0x7f8ccc0d43e0 2024-01-25T15:04:46.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.485+0000 7f85e6e6d640 1 Processor -- start 2024-01-25T15:04:46.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.485+0000 7f8cd90ad640 1 -- 172.21.15.29:0/3480222399 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ccc0d2060 con 0x7f8ccc0d43e0 2024-01-25T15:04:46.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.484+0000 7f3c00e90640 1 -- start start 2024-01-25T15:04:46.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.485+0000 7fcee3fff640 1 --2- 172.21.15.29:0/1242319969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcee414f4b0 0x7fcee41522b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fced000c410 tx=0x7fced0001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.485+0000 7f85e6e6d640 1 -- start start 2024-01-25T15:04:46.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.485+0000 7fc66ed9d640 1 --2- 172.21.15.29:0/3031605653 >> v2:172.21.15.29:3300/0 conn(0x7fc6700c55b0 0x7fc67015c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:46.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.485+0000 7f3c00e90640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bfc06d9f0 0x7f3bfc1ee3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.485+0000 7f7123ce0640 1 -- 172.21.15.29:0/678428756 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f711c06cd80 msgr2=0x7f711c0c0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.485+0000 7f7123ce0640 1 --2- 172.21.15.29:0/678428756 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f711c06cd80 0x7f711c0c0c70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7118009870 tx=0x7f711802b880 comp rx=0 tx=0).stop 2024-01-25T15:04:46.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f7123ce0640 1 -- 172.21.15.29:0/678428756 shutdown_connections 2024-01-25T15:04:46.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.485+0000 7fcee17fa640 1 -- 172.21.15.29:0/1242319969 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced0005ce0 con 0x7fcee414f4b0 2024-01-25T15:04:46.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.485+0000 7fcee17fa640 1 -- 172.21.15.29:0/1242319969 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced0005e40 con 0x7fcee414f4b0 2024-01-25T15:04:46.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f7123ce0640 1 --2- 172.21.15.29:0/678428756 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f711c06cd80 0x7f711c0c0c70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f7123ce0640 1 --2- 172.21.15.29:0/678428756 >> v2:172.21.15.29:3300/0 conn(0x7f711c156270 0x7f711c072740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f7123ce0640 1 -- 172.21.15.29:0/678428756 >> 172.21.15.29:0/678428756 conn(0x7f711c0a78d0 msgr2=0x7f711c0a7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.485+0000 7f3c00e90640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3bfc070670 0x7f3bfc152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.485+0000 7f3c00e90640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bfc0c0e20 0x7f3bfc0c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f85e6e6d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85cc0052a0 0x7f85e00babb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f85e6e6d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85e01e8ea0 0x7f85e014bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f85e6e6d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85e01e9320 0x7f85e014c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f85e6e6d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e00bbd70 con 0x7f85e01e8ea0 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f85e6e6d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e014c920 con 0x7f85e01e9320 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f85e6e6d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e00a7230 con 0x7f85cc0052a0 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.485+0000 7f3c00e90640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc1e5f80 con 0x7f3bfc0c0e20 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.485+0000 7f3c00e90640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc152a50 con 0x7f3bfc06d9f0 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.485+0000 7f3c00e90640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc154d70 con 0x7f3bfc070670 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.485+0000 7f3bfad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bfc0c0e20 0x7f3bfc0c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.485+0000 7f3bfad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bfc0c0e20 0x7f3bfc0c1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44612/0 (socket says 172.21.15.29:44612) 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.485+0000 7f3bfad9d640 1 -- 172.21.15.29:0/2937938397 learned_addr learned my addr 172.21.15.29:0/2937938397 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f3bfa59c640 1 --2- 172.21.15.29:0/2937938397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bfc06d9f0 0x7f3bfc1ee3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f3bf9d9b640 1 --2- 172.21.15.29:0/2937938397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3bfc070670 0x7f3bfc152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f3bfad9d640 1 -- 172.21.15.29:0/2937938397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3bfc070670 msgr2=0x7f3bfc152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f3bfad9d640 1 --2- 172.21.15.29:0/2937938397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3bfc070670 0x7f3bfc152510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f3bfad9d640 1 -- 172.21.15.29:0/2937938397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bfc06d9f0 msgr2=0x7f3bfc1ee3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f3bfad9d640 1 --2- 172.21.15.29:0/2937938397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bfc06d9f0 0x7f3bfc1ee3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f3bfad9d640 1 -- 172.21.15.29:0/2937938397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf00094d0 con 0x7f3bfc0c0e20 2024-01-25T15:04:46.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f3bfa59c640 1 --2- 172.21.15.29:0/2937938397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bfc06d9f0 0x7f3bfc1ee3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:46.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.485+0000 7f129a3ab640 1 --2- 172.21.15.29:0/895971269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1294155d20 0x7f1294150d40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f128c009eb0 tx=0x7f128c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7fc66e59c640 1 --2- 172.21.15.29:0/3031605653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc670156150 0x7fc67015cbb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc670071990 tx=0x7fc66402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b764694564fb86e server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7fcbb0860640 1 Processor -- start 2024-01-25T15:04:46.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f85e5e6b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85cc0052a0 0x7f85e00babb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f85e5e6b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85cc0052a0 0x7f85e00babb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:40590/0 (socket says 172.21.15.29:40590) 2024-01-25T15:04:46.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f85e5e6b640 1 -- 172.21.15.29:0/3176402648 learned_addr learned my addr 172.21.15.29:0/3176402648 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:46.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f3bfad9d640 1 --2- 172.21.15.29:0/2937938397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bfc0c0e20 0x7f3bfc0c1be0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400c780 tx=0x7f3bf400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7fcee17fa640 1 -- 172.21.15.29:0/1242319969 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced00072d0 con 0x7fcee414f4b0 2024-01-25T15:04:46.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f128a7fc640 1 -- 172.21.15.29:0/895971269 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c03e610 con 0x7f1294155d20 2024-01-25T15:04:46.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f128a7fc640 1 -- 172.21.15.29:0/895971269 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c03e770 con 0x7f1294155d20 2024-01-25T15:04:46.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f128a7fc640 1 -- 172.21.15.29:0/895971269 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c03eb20 con 0x7f1294155d20 2024-01-25T15:04:46.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7f8cd90ad640 1 -- 172.21.15.29:0/3480222399 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ccc04b0c0 con 0x7f8ccc0d43e0 2024-01-25T15:04:46.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7f3beaffd640 1 -- 172.21.15.29:0/2937938397 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4003d80 con 0x7f3bfc0c0e20 2024-01-25T15:04:46.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f129be0e640 1 -- 172.21.15.29:0/895971269 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1294153cd0 con 0x7f1294155d20 2024-01-25T15:04:46.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7f7123ce0640 1 -- 172.21.15.29:0/678428756 shutdown_connections 2024-01-25T15:04:46.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7f129be0e640 1 -- 172.21.15.29:0/895971269 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1294150360 con 0x7f1294155d20 2024-01-25T15:04:46.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7fc66d59a640 1 -- 172.21.15.29:0/3031605653 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc664031870 con 0x7fc670156150 2024-01-25T15:04:46.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7fc66d59a640 1 -- 172.21.15.29:0/3031605653 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6640319d0 con 0x7fc670156150 2024-01-25T15:04:46.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7fc66d59a640 1 -- 172.21.15.29:0/3031605653 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc664031d60 con 0x7fc670156150 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7f3beaffd640 1 -- 172.21.15.29:0/2937938397 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf400ce90 con 0x7f3bfc0c0e20 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7f3beaffd640 1 -- 172.21.15.29:0/2937938397 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf40052b0 con 0x7f3bfc0c0e20 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7f3c00e90640 1 -- 172.21.15.29:0/2937938397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bfc155050 con 0x7f3bfc0c0e20 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7f3c00e90640 1 -- 172.21.15.29:0/2937938397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bfc155ad0 con 0x7f3bfc0c0e20 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7f85e666c640 1 --2- 172.21.15.29:0/3176402648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85e01e9320 0x7f85e014c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7f85e5e6b640 1 -- 172.21.15.29:0/3176402648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85e01e9320 msgr2=0x7f85e014c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7f85e5e6b640 1 --2- 172.21.15.29:0/3176402648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85e01e9320 0x7f85e014c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7f85e5e6b640 1 -- 172.21.15.29:0/3176402648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85e01e8ea0 msgr2=0x7f85e014bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7f85e566a640 1 --2- 172.21.15.29:0/3176402648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85e01e8ea0 0x7f85e014bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7f85e5e6b640 1 --2- 172.21.15.29:0/3176402648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85e01e8ea0 0x7f85e014bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7f85e5e6b640 1 -- 172.21.15.29:0/3176402648 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e00bbf70 con 0x7f85cc0052a0 2024-01-25T15:04:46.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7f85e566a640 1 --2- 172.21.15.29:0/3176402648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85e01e8ea0 0x7f85e014bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:46.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.486+0000 7fcbb0860640 1 -- start start 2024-01-25T15:04:46.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7fcbb0860640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb9c004fa0 0x7fcba40dc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7fcbb0860640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcba40dd200 0x7fcba40d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7fcbb0860640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcba402c170 0x7fcba402c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.488+0000 7f129be0e640 1 -- 172.21.15.29:0/895971269 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127c005290 con 0x7f1294155d20 2024-01-25T15:04:46.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7fcbb0860640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba41711b0 con 0x7fcb9c004fa0 2024-01-25T15:04:46.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7fcbb0860640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba40dd630 con 0x7fcba402c170 2024-01-25T15:04:46.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7fcbb0860640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba40dcc60 con 0x7fcba40dd200 2024-01-25T15:04:46.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7fceeae23640 1 -- 172.21.15.29:0/1242319969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee414fc10 con 0x7fcee414f4b0 2024-01-25T15:04:46.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.488+0000 7fceeae23640 1 -- 172.21.15.29:0/1242319969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee40a8cf0 con 0x7fcee414f4b0 2024-01-25T15:04:46.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.487+0000 7f7123ce0640 1 -- 172.21.15.29:0/678428756 wait complete. 2024-01-25T15:04:46.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.488+0000 7f3c00e90640 1 -- 172.21.15.29:0/2937938397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bfc155570 con 0x7f3bfc0c0e20 2024-01-25T15:04:46.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.488+0000 7fc66f59e640 1 -- 172.21.15.29:0/3031605653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc670156150 msgr2=0x7fc67015cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.488+0000 7fc66f59e640 1 --2- 172.21.15.29:0/3031605653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc670156150 0x7fc67015cbb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc670071990 tx=0x7fc66402b910 comp rx=0 tx=0).stop 2024-01-25T15:04:46.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.489+0000 7fcee17fa640 1 -- 172.21.15.29:0/1242319969 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fced0007430 con 0x7fcee414f4b0 2024-01-25T15:04:46.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.489+0000 7f7123ce0640 1 Processor -- start 2024-01-25T15:04:46.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.489+0000 7f8cd0ff9640 1 -- 172.21.15.29:0/3480222399 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8cc001a400 con 0x7f8ccc0d43e0 2024-01-25T15:04:46.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.489+0000 7fc66f59e640 1 -- 172.21.15.29:0/3031605653 shutdown_connections 2024-01-25T15:04:46.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.489+0000 7fc66f59e640 1 --2- 172.21.15.29:0/3031605653 >> v2:172.21.15.29:3300/0 conn(0x7fc6700c55b0 0x7fc67015c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.489+0000 7fc66f59e640 1 --2- 172.21.15.29:0/3031605653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc670156150 0x7fc67015cbb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.489+0000 7fc66f59e640 1 -- 172.21.15.29:0/3031605653 >> 172.21.15.29:0/3031605653 conn(0x7fc6700c7e70 msgr2=0x7fc6700c8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.489+0000 7f7123ce0640 1 -- start start 2024-01-25T15:04:46.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.489+0000 7fc66f59e640 1 -- 172.21.15.29:0/3031605653 shutdown_connections 2024-01-25T15:04:46.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.489+0000 7fcbabfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcba402c170 0x7fcba402c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.489+0000 7fcbaaffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcba40dd200 0x7fcba40d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.489+0000 7fcbab7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb9c004fa0 0x7fcba40dc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.489+0000 7fcbab7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb9c004fa0 0x7fcba40dc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44640/0 (socket says 172.21.15.29:44640) 2024-01-25T15:04:46.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.489+0000 7fcbab7fe640 1 -- 172.21.15.29:0/3251391165 learned_addr learned my addr 172.21.15.29:0/3251391165 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:46.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.489+0000 7fcee17fa640 1 --2- 172.21.15.29:0/1242319969 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcec806af50 0x7fcec806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.489+0000 7fcee17fa640 1 -- 172.21.15.29:0/1242319969 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fced008c370 con 0x7fcee414f4b0 2024-01-25T15:04:46.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.489+0000 7f85e5e6b640 1 --2- 172.21.15.29:0/3176402648 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85cc0052a0 0x7f85e00babb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f85d800cad0 tx=0x7f85d800cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7fceeae23640 1 -- 172.21.15.29:0/1242319969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee4150410 con 0x7fcee414f4b0 2024-01-25T15:04:46.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7f3beaffd640 1 -- 172.21.15.29:0/2937938397 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f3bf4005410 con 0x7f3bfc0c0e20 2024-01-25T15:04:46.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7fcbab7fe640 1 -- 172.21.15.29:0/3251391165 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcba40dd200 msgr2=0x7fcba40d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7fcbab7fe640 1 --2- 172.21.15.29:0/3251391165 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcba40dd200 0x7fcba40d0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7fcbab7fe640 1 -- 172.21.15.29:0/3251391165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcba402c170 msgr2=0x7fcba402c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7fcbab7fe640 1 --2- 172.21.15.29:0/3251391165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcba402c170 0x7fcba402c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7fcbab7fe640 1 -- 172.21.15.29:0/3251391165 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba40dd880 con 0x7fcb9c004fa0 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7fcbaaffd640 1 --2- 172.21.15.29:0/3251391165 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcba40dd200 0x7fcba40d0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7f7123ce0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f711c06cd80 0x7f711c151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7f7123ce0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f711c156270 0x7f711c150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7f7123ce0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f711c159530 0x7f711c0aa350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7f7123ce0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c0a8b10 con 0x7f711c159530 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7f7123ce0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c15a040 con 0x7f711c156270 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7f7123ce0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c0a8830 con 0x7f711c06cd80 2024-01-25T15:04:46.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7fcbab7fe640 1 --2- 172.21.15.29:0/3251391165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb9c004fa0 0x7fcba40dc720 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcbac064450 tx=0x7fcbac068950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7f8cd0ff9640 1 --2- 172.21.15.29:0/3480222399 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8cb806aed0 0x7f8cb806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7f8cd0ff9640 1 -- 172.21.15.29:0/3480222399 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8cc0089af0 con 0x7f8ccc0d43e0 2024-01-25T15:04:46.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7f3beaffd640 1 --2- 172.21.15.29:0/2937938397 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3bdc06af20 0x7f3bdc06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7f7121a7c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f711c06cd80 0x7f711c151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7f7121a7c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f711c06cd80 0x7f711c151a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:40608/0 (socket says 172.21.15.29:40608) 2024-01-25T15:04:46.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.491+0000 7f3beaffd640 1 -- 172.21.15.29:0/2937938397 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3bf40891f0 con 0x7f3bfc0c0e20 2024-01-25T15:04:46.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.491+0000 7f3bfa59c640 1 --2- 172.21.15.29:0/2937938397 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3bdc06af20 0x7f3bdc06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7f7121a7c640 1 -- 172.21.15.29:0/2641670426 learned_addr learned my addr 172.21.15.29:0/2641670426 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7f712127b640 1 --2- 172.21.15.29:0/2641670426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f711c156270 0x7f711c150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.491+0000 7f7121a7c640 1 -- 172.21.15.29:0/2641670426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f711c156270 msgr2=0x7f711c150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.491+0000 7f7121a7c640 1 --2- 172.21.15.29:0/2641670426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f711c156270 0x7f711c150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.491+0000 7f7121a7c640 1 -- 172.21.15.29:0/2641670426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f711c159530 msgr2=0x7f711c0aa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.491+0000 7f712227d640 1 --2- 172.21.15.29:0/2641670426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f711c159530 0x7f711c0aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.490+0000 7f128a7fc640 1 -- 172.21.15.29:0/895971269 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f128c03b050 con 0x7f1294155d20 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.491+0000 7f8cd3fff640 1 --2- 172.21.15.29:0/3480222399 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8cb806aed0 0x7f8cb806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.491+0000 7f7121a7c640 1 --2- 172.21.15.29:0/2641670426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f711c159530 0x7f711c0aa350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.491+0000 7f7121a7c640 1 -- 172.21.15.29:0/2641670426 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71180094d0 con 0x7f711c06cd80 2024-01-25T15:04:46.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.491+0000 7f712227d640 1 --2- 172.21.15.29:0/2641670426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f711c159530 0x7f711c0aa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:46.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.489+0000 7fc66f59e640 1 -- 172.21.15.29:0/3031605653 wait complete. 2024-01-25T15:04:46.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.491+0000 7fcee8bbf640 1 --2- 172.21.15.29:0/1242319969 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcec806af50 0x7fcec806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.491+0000 7f7121a7c640 1 --2- 172.21.15.29:0/2641670426 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f711c06cd80 0x7f711c151a40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f710c00c7f0 tx=0x7f710c00cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.491+0000 7fc66f59e640 1 Processor -- start 2024-01-25T15:04:46.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.491+0000 7f8cd3fff640 1 --2- 172.21.15.29:0/3480222399 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8cb806aed0 0x7f8cb806d390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00dd50 tx=0x7f8cd40ae000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.491+0000 7f128a7fc640 1 --2- 172.21.15.29:0/895971269 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f127806afa0 0x7f127806d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.491+0000 7f3bfa59c640 1 --2- 172.21.15.29:0/2937938397 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3bdc06af20 0x7f3bdc06d3e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00a9d0 tx=0x7f3bec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.491+0000 7fc66f59e640 1 -- start start 2024-01-25T15:04:46.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.492+0000 7f128a7fc640 1 -- 172.21.15.29:0/895971269 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f128c0ac500 con 0x7f1294155d20 2024-01-25T15:04:46.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.492+0000 7fcee8bbf640 1 --2- 172.21.15.29:0/1242319969 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcec806af50 0x7fcec806d410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fced8000c00 tx=0x7fced803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.492+0000 7f1299baa640 1 --2- 172.21.15.29:0/895971269 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f127806afa0 0x7f127806d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.492+0000 7f1299baa640 1 --2- 172.21.15.29:0/895971269 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f127806afa0 0x7f127806d460 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1284009890 tx=0x7f1284008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.492+0000 7fc66f59e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6700c55b0 0x7fc6701586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.492+0000 7fc66e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6700c55b0 0x7fc6701586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.492+0000 7fc66e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6700c55b0 0x7fc6701586f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44654/0 (socket says 172.21.15.29:44654) 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.492+0000 7fc66f59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc670156150 0x7fc670158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.493+0000 7fc66f59e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc670150b60 0x7fc670150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.493+0000 7fc66f59e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6701f7620 con 0x7fc6700c55b0 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.493+0000 7fc66f59e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6701f7b50 con 0x7fc670156150 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.493+0000 7fc66f59e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc670156da0 con 0x7fc670150b60 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.493+0000 7fc66e59c640 1 -- 172.21.15.29:0/244091464 learned_addr learned my addr 172.21.15.29:0/244091464 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.493+0000 7fc66ed9d640 1 --2- 172.21.15.29:0/244091464 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc670150b60 0x7fc670150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.493+0000 7fc66dd9b640 1 --2- 172.21.15.29:0/244091464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc670156150 0x7fc670158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.493+0000 7fc66e59c640 1 -- 172.21.15.29:0/244091464 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc670150b60 msgr2=0x7fc670150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.493+0000 7fc66e59c640 1 --2- 172.21.15.29:0/244091464 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc670150b60 0x7fc670150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.493+0000 7fc66e59c640 1 -- 172.21.15.29:0/244091464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc670156150 msgr2=0x7fc670158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.493+0000 7fc66e59c640 1 --2- 172.21.15.29:0/244091464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc670156150 0x7fc670158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.493+0000 7fc66e59c640 1 -- 172.21.15.29:0/244091464 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6640094d0 con 0x7fc6700c55b0 2024-01-25T15:04:46.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.493+0000 7fc66dd9b640 1 --2- 172.21.15.29:0/244091464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc670156150 0x7fc670158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:46.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.493+0000 7fc66ed9d640 1 --2- 172.21.15.29:0/244091464 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc670150b60 0x7fc670150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:46.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.493+0000 7fc66e59c640 1 --2- 172.21.15.29:0/244091464 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6700c55b0 0x7fc6701586f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc66402bf20 tx=0x7fc6640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.494+0000 7f128a7fc640 1 -- 172.21.15.29:0/895971269 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f128c077320 con 0x7f1294155d20 2024-01-25T15:04:46.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.498+0000 7f71127fc640 1 -- 172.21.15.29:0/2641670426 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c007a30 con 0x7f711c06cd80 2024-01-25T15:04:46.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.498+0000 7f71127fc640 1 -- 172.21.15.29:0/2641670426 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710c007b90 con 0x7f711c06cd80 2024-01-25T15:04:46.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.498+0000 7f71127fc640 1 -- 172.21.15.29:0/2641670426 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c00ce40 con 0x7f711c06cd80 2024-01-25T15:04:46.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.498+0000 7fcb97fff640 1 -- 172.21.15.29:0/3251391165 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac08f070 con 0x7fcb9c004fa0 2024-01-25T15:04:46.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.498+0000 7f85d67fc640 1 -- 172.21.15.29:0/3176402648 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d8003d80 con 0x7f85cc0052a0 2024-01-25T15:04:46.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.498+0000 7f85d67fc640 1 -- 172.21.15.29:0/3176402648 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d8005070 con 0x7f85cc0052a0 2024-01-25T15:04:46.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.499+0000 7f85e6e6d640 1 -- 172.21.15.29:0/3176402648 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e014eba0 con 0x7f85cc0052a0 2024-01-25T15:04:46.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.499+0000 7f7123ce0640 1 -- 172.21.15.29:0/2641670426 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711c1f75a0 con 0x7f711c06cd80 2024-01-25T15:04:46.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.499+0000 7fcb97fff640 1 -- 172.21.15.29:0/3251391165 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbac068c00 con 0x7fcb9c004fa0 2024-01-25T15:04:46.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.499+0000 7f7123ce0640 1 -- 172.21.15.29:0/2641670426 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711c0ab550 con 0x7f711c06cd80 2024-01-25T15:04:46.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.499+0000 7fcb97fff640 1 -- 172.21.15.29:0/3251391165 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac0730a0 con 0x7fcb9c004fa0 2024-01-25T15:04:46.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.499+0000 7f85e6e6d640 1 -- 172.21.15.29:0/3176402648 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e014f160 con 0x7f85cc0052a0 2024-01-25T15:04:46.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.499+0000 7f3beaffd640 1 -- 172.21.15.29:0/2937938397 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f3bfc155570 con 0x7f3bfc0c0e20 2024-01-25T15:04:46.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.499+0000 7f85d67fc640 1 -- 172.21.15.29:0/3176402648 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d8005420 con 0x7f85cc0052a0 2024-01-25T15:04:46.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.499+0000 7f8cd0ff9640 1 -- 172.21.15.29:0/3480222399 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8cc00546c0 con 0x7f8ccc0d43e0 2024-01-25T15:04:46.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.499+0000 7fcbb0860640 1 -- 172.21.15.29:0/3251391165 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba40ddb60 con 0x7fcb9c004fa0 2024-01-25T15:04:46.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.499+0000 7fcbb0860640 1 -- 172.21.15.29:0/3251391165 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba4170dd0 con 0x7fcb9c004fa0 2024-01-25T15:04:46.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.499+0000 7fc65effd640 1 -- 172.21.15.29:0/244091464 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66403adf0 con 0x7fc6700c55b0 2024-01-25T15:04:46.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.500+0000 7fc65effd640 1 -- 172.21.15.29:0/244091464 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6640443f0 con 0x7fc6700c55b0 2024-01-25T15:04:46.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.500+0000 7fc66f59e640 1 -- 172.21.15.29:0/244091464 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6701f7870 con 0x7fc6700c55b0 2024-01-25T15:04:46.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.500+0000 7fcee17fa640 1 -- 172.21.15.29:0/1242319969 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fcee4150410 con 0x7fcee414f4b0 2024-01-25T15:04:46.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.500+0000 7fc66f59e640 1 -- 172.21.15.29:0/244091464 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6701eddd0 con 0x7fc6700c55b0 2024-01-25T15:04:46.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.500+0000 7fc65effd640 1 -- 172.21.15.29:0/244091464 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6640447a0 con 0x7fc6700c55b0 2024-01-25T15:04:46.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.500+0000 7f85e6e6d640 1 -- 172.21.15.29:0/3176402648 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c8005290 con 0x7f85cc0052a0 2024-01-25T15:04:46.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.500+0000 7f7123ce0640 1 -- 172.21.15.29:0/2641670426 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711c074010 con 0x7f711c06cd80 2024-01-25T15:04:46.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.501+0000 7f71127fc640 1 -- 172.21.15.29:0/2641670426 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f710c01a450 con 0x7f711c06cd80 2024-01-25T15:04:46.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.502+0000 7f71127fc640 1 --2- 172.21.15.29:0/2641670426 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f710006afa0 0x7f710006d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.502+0000 7f71127fc640 1 -- 172.21.15.29:0/2641670426 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f710c089d90 con 0x7f711c06cd80 2024-01-25T15:04:46.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.502+0000 7fcbb0860640 1 -- 172.21.15.29:0/3251391165 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba4170f60 con 0x7fcb9c004fa0 2024-01-25T15:04:46.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.502+0000 7f712127b640 1 --2- 172.21.15.29:0/2641670426 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f710006afa0 0x7f710006d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.503+0000 7fc65effd640 1 -- 172.21.15.29:0/244091464 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fc664044900 con 0x7fc6700c55b0 2024-01-25T15:04:46.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.502+0000 7f85d67fc640 1 -- 172.21.15.29:0/3176402648 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f85d8005580 con 0x7f85cc0052a0 2024-01-25T15:04:46.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.503+0000 7f85d67fc640 1 --2- 172.21.15.29:0/3176402648 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f85c406aed0 0x7f85c406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.503+0000 7f85d67fc640 1 -- 172.21.15.29:0/3176402648 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f85d80898c0 con 0x7f85cc0052a0 2024-01-25T15:04:46.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.503+0000 7f85e566a640 1 --2- 172.21.15.29:0/3176402648 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f85c406aed0 0x7f85c406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.503+0000 7f712127b640 1 --2- 172.21.15.29:0/2641670426 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f710006afa0 0x7f710006d460 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f711c15cc70 tx=0x7f7114003d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.503+0000 7fcb97fff640 1 -- 172.21.15.29:0/3251391165 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fcbac073200 con 0x7fcb9c004fa0 2024-01-25T15:04:46.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.503+0000 7fc66f59e640 1 -- 172.21.15.29:0/244091464 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc654005290 con 0x7fc6700c55b0 2024-01-25T15:04:46.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.504+0000 7f85e566a640 1 --2- 172.21.15.29:0/3176402648 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f85c406aed0 0x7f85c406d390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f85e01539e0 tx=0x7f85d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.504+0000 7fcb97fff640 1 --2- 172.21.15.29:0/3251391165 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcb9006afd0 0x7fcb9006d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.504+0000 7fc65effd640 1 --2- 172.21.15.29:0/244091464 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc65006afd0 0x7fc65006d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:46.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.504+0000 7fc65effd640 1 -- 172.21.15.29:0/244091464 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc66402d040 con 0x7fc6700c55b0 2024-01-25T15:04:46.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.504+0000 7fcb97fff640 1 -- 172.21.15.29:0/3251391165 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcbac103ce0 con 0x7fcb9c004fa0 2024-01-25T15:04:46.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.504+0000 7fc66dd9b640 1 --2- 172.21.15.29:0/244091464 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc65006afd0 0x7fc65006d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.504+0000 7fcbaaffd640 1 --2- 172.21.15.29:0/3251391165 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcb9006afd0 0x7fcb9006d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:46.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.505+0000 7fc66dd9b640 1 --2- 172.21.15.29:0/244091464 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc65006afd0 0x7fc65006d490 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc6701ee0f0 tx=0x7fc668009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.505+0000 7fcbaaffd640 1 --2- 172.21.15.29:0/3251391165 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcb9006afd0 0x7fcb9006d490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcba40dd5e0 tx=0x7fcba0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:46.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.505+0000 7f71127fc640 1 -- 172.21.15.29:0/2641670426 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f710c054a90 con 0x7f711c06cd80 2024-01-25T15:04:46.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.509+0000 7f85d67fc640 1 -- 172.21.15.29:0/3176402648 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f85d8054490 con 0x7f85cc0052a0 2024-01-25T15:04:46.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.513+0000 7fcb97fff640 1 -- 172.21.15.29:0/3251391165 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fcbac0ce8a0 con 0x7fcb9c004fa0 2024-01-25T15:04:46.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.522+0000 7fc65effd640 1 -- 172.21.15.29:0/244091464 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fc664076d70 con 0x7fc6700c55b0 2024-01-25T15:04:46.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.906+0000 7f129be0e640 1 -- 172.21.15.29:0/895971269 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f127c005810 con 0x7f1294155d20 2024-01-25T15:04:46.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.906+0000 7f128a7fc640 1 -- 172.21.15.29:0/895971269 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f128c07a940 con 0x7f1294155d20 2024-01-25T15:04:46.907 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-01-25T15:04:46.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.910+0000 7f1277fff640 1 -- 172.21.15.29:0/895971269 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f127806afa0 msgr2=0x7f127806d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.910+0000 7f1277fff640 1 --2- 172.21.15.29:0/895971269 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f127806afa0 0x7f127806d460 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1284009890 tx=0x7f1284008040 comp rx=0 tx=0).stop 2024-01-25T15:04:46.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.910+0000 7f1277fff640 1 -- 172.21.15.29:0/895971269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1294155d20 msgr2=0x7f1294150d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.910+0000 7f1277fff640 1 --2- 172.21.15.29:0/895971269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1294155d20 0x7f1294150d40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f128c009eb0 tx=0x7f128c004a40 comp rx=0 tx=0).stop 2024-01-25T15:04:46.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.910+0000 7f1277fff640 1 -- 172.21.15.29:0/895971269 shutdown_connections 2024-01-25T15:04:46.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.910+0000 7f1277fff640 1 --2- 172.21.15.29:0/895971269 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f127806afa0 0x7f127806d460 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.910+0000 7f1277fff640 1 --2- 172.21.15.29:0/895971269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1294155d20 0x7f1294150d40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.911+0000 7f1277fff640 1 --2- 172.21.15.29:0/895971269 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f12940c1b90 0x7f1294153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.911+0000 7f1277fff640 1 --2- 172.21.15.29:0/895971269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1294070230 0x7f12940c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.911+0000 7f1277fff640 1 -- 172.21.15.29:0/895971269 >> 172.21.15.29:0/895971269 conn(0x7f12940c2a10 msgr2=0x7f129406c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.911+0000 7f1277fff640 1 -- 172.21.15.29:0/895971269 shutdown_connections 2024-01-25T15:04:46.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.911+0000 7f1277fff640 1 -- 172.21.15.29:0/895971269 wait complete. 2024-01-25T15:04:46.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.916+0000 7fceeae23640 1 -- 172.21.15.29:0/1242319969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcee4074010 con 0x7fcee414f4b0 2024-01-25T15:04:46.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.916+0000 7f3c00e90640 1 -- 172.21.15.29:0/2937938397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3bfc155d10 con 0x7f3bfc0c0e20 2024-01-25T15:04:46.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.917+0000 7f3beaffd640 1 -- 172.21.15.29:0/2937938397 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3bfc155d10 con 0x7f3bfc0c0e20 2024-01-25T15:04:46.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.917+0000 7fcee17fa640 1 -- 172.21.15.29:0/1242319969 <== mon.1 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcee4150410 con 0x7fcee414f4b0 2024-01-25T15:04:46.918 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-01-25T15:04:46.920 INFO:teuthology.orchestra.run.smithi029.stdout:55834574855 2024-01-25T15:04:46.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.920+0000 7fceeae23640 1 -- 172.21.15.29:0/1242319969 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcec806af50 msgr2=0x7fcec806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.920+0000 7fceeae23640 1 --2- 172.21.15.29:0/1242319969 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcec806af50 0x7fcec806d410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fced8000c00 tx=0x7fced803d040 comp rx=0 tx=0).stop 2024-01-25T15:04:46.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.920+0000 7fceeae23640 1 -- 172.21.15.29:0/1242319969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcee414f4b0 msgr2=0x7fcee41522b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.920+0000 7fceeae23640 1 --2- 172.21.15.29:0/1242319969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcee414f4b0 0x7fcee41522b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fced000c410 tx=0x7fced0001e70 comp rx=0 tx=0).stop 2024-01-25T15:04:46.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.921+0000 7f3be8ff9640 1 -- 172.21.15.29:0/2937938397 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3bdc06af20 msgr2=0x7f3bdc06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.921+0000 7f3be8ff9640 1 --2- 172.21.15.29:0/2937938397 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3bdc06af20 0x7f3bdc06d3e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00a9d0 tx=0x7f3bec008040 comp rx=0 tx=0).stop 2024-01-25T15:04:46.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.921+0000 7f3be8ff9640 1 -- 172.21.15.29:0/2937938397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bfc0c0e20 msgr2=0x7f3bfc0c1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.921+0000 7f3be8ff9640 1 --2- 172.21.15.29:0/2937938397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bfc0c0e20 0x7f3bfc0c1be0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400c780 tx=0x7f3bf400cc40 comp rx=0 tx=0).stop 2024-01-25T15:04:46.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.921+0000 7fceeae23640 1 -- 172.21.15.29:0/1242319969 shutdown_connections 2024-01-25T15:04:46.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.921+0000 7fceeae23640 1 --2- 172.21.15.29:0/1242319969 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcec806af50 0x7fcec806d410 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.921+0000 7fceeae23640 1 --2- 172.21.15.29:0/1242319969 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcee4159570 0x7fcee414bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.921+0000 7f3be8ff9640 1 -- 172.21.15.29:0/2937938397 shutdown_connections 2024-01-25T15:04:46.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.921+0000 7f3be8ff9640 1 --2- 172.21.15.29:0/2937938397 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3bdc06af20 0x7f3bdc06d3e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.921+0000 7fceeae23640 1 --2- 172.21.15.29:0/1242319969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcee414f4b0 0x7fcee41522b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.921+0000 7fceeae23640 1 --2- 172.21.15.29:0/1242319969 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcee406ac00 0x7fcee4155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.921+0000 7f3be8ff9640 1 --2- 172.21.15.29:0/2937938397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bfc0c0e20 0x7f3bfc0c1be0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.921+0000 7f3be8ff9640 1 --2- 172.21.15.29:0/2937938397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3bfc070670 0x7f3bfc152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.921+0000 7fceeae23640 1 -- 172.21.15.29:0/1242319969 >> 172.21.15.29:0/1242319969 conn(0x7fcee40c39b0 msgr2=0x7fcee415c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.921+0000 7f3be8ff9640 1 --2- 172.21.15.29:0/2937938397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bfc06d9f0 0x7f3bfc1ee3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.921+0000 7f3be8ff9640 1 -- 172.21.15.29:0/2937938397 >> 172.21.15.29:0/2937938397 conn(0x7f3bfc06a6c0 msgr2=0x7f3bfc157490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.922+0000 7f3be8ff9640 1 -- 172.21.15.29:0/2937938397 shutdown_connections 2024-01-25T15:04:46.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.922+0000 7f3be8ff9640 1 -- 172.21.15.29:0/2937938397 wait complete. 2024-01-25T15:04:46.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.922+0000 7fceeae23640 1 -- 172.21.15.29:0/1242319969 shutdown_connections 2024-01-25T15:04:46.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.922+0000 7fceeae23640 1 -- 172.21.15.29:0/1242319969 wait complete. 2024-01-25T15:04:46.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.924+0000 7f85e6e6d640 1 -- 172.21.15.29:0/3176402648 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f85c8005540 con 0x7f85cc0052a0 2024-01-25T15:04:46.927 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-01-25T15:04:46.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.925+0000 7f85d67fc640 1 -- 172.21.15.29:0/3176402648 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f85d8057ab0 con 0x7f85cc0052a0 2024-01-25T15:04:46.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.928+0000 7f85c3fff640 1 -- 172.21.15.29:0/3176402648 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f85c406aed0 msgr2=0x7f85c406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.928+0000 7f85c3fff640 1 --2- 172.21.15.29:0/3176402648 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f85c406aed0 0x7f85c406d390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f85e01539e0 tx=0x7f85d0008040 comp rx=0 tx=0).stop 2024-01-25T15:04:46.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.928+0000 7f85c3fff640 1 -- 172.21.15.29:0/3176402648 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85cc0052a0 msgr2=0x7f85e00babb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.928+0000 7f85c3fff640 1 --2- 172.21.15.29:0/3176402648 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85cc0052a0 0x7f85e00babb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f85d800cad0 tx=0x7f85d800cf90 comp rx=0 tx=0).stop 2024-01-25T15:04:46.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.928+0000 7f85c3fff640 1 -- 172.21.15.29:0/3176402648 shutdown_connections 2024-01-25T15:04:46.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.928+0000 7f85c3fff640 1 --2- 172.21.15.29:0/3176402648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85e01e9320 0x7f85e014c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.928+0000 7f85c3fff640 1 --2- 172.21.15.29:0/3176402648 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f85c406aed0 0x7f85c406d390 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.928+0000 7f85c3fff640 1 --2- 172.21.15.29:0/3176402648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85e01e8ea0 0x7f85e014bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.928+0000 7f85c3fff640 1 --2- 172.21.15.29:0/3176402648 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85cc0052a0 0x7f85e00babb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.928+0000 7f85c3fff640 1 -- 172.21.15.29:0/3176402648 >> 172.21.15.29:0/3176402648 conn(0x7f85e00c5b90 msgr2=0x7f85e014d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.929+0000 7f85c3fff640 1 -- 172.21.15.29:0/3176402648 shutdown_connections 2024-01-25T15:04:46.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.929+0000 7f85c3fff640 1 -- 172.21.15.29:0/3176402648 wait complete. 2024-01-25T15:04:46.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2024-01-25T15:04:46.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.931+0000 7f7123ce0640 1 -- 172.21.15.29:0/2641670426 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f711c0c1210 con 0x7f711c06cd80 2024-01-25T15:04:46.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.932+0000 7f71127fc640 1 -- 172.21.15.29:0/2641670426 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f710c01f090 con 0x7f711c06cd80 2024-01-25T15:04:46.935 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-01-25T15:04:46.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.935+0000 7f7123ce0640 1 -- 172.21.15.29:0/2641670426 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f710006afa0 msgr2=0x7f710006d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.935+0000 7f7123ce0640 1 --2- 172.21.15.29:0/2641670426 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f710006afa0 0x7f710006d460 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f711c15cc70 tx=0x7f7114003d90 comp rx=0 tx=0).stop 2024-01-25T15:04:46.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.935+0000 7f7123ce0640 1 -- 172.21.15.29:0/2641670426 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f711c06cd80 msgr2=0x7f711c151a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.935+0000 7f7123ce0640 1 --2- 172.21.15.29:0/2641670426 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f711c06cd80 0x7f711c151a40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f710c00c7f0 tx=0x7f710c00cbf0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.935+0000 7f7123ce0640 1 -- 172.21.15.29:0/2641670426 shutdown_connections 2024-01-25T15:04:46.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.935+0000 7f7123ce0640 1 --2- 172.21.15.29:0/2641670426 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f710006afa0 0x7f710006d460 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.935+0000 7f7123ce0640 1 --2- 172.21.15.29:0/2641670426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f711c159530 0x7f711c0aa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.935+0000 7f7123ce0640 1 --2- 172.21.15.29:0/2641670426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f711c156270 0x7f711c150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.935+0000 7f7123ce0640 1 --2- 172.21.15.29:0/2641670426 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f711c06cd80 0x7f711c151a40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.935+0000 7f7123ce0640 1 -- 172.21.15.29:0/2641670426 >> 172.21.15.29:0/2641670426 conn(0x7f711c0a78d0 msgr2=0x7f711c0a4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.935+0000 7fcbb0860640 1 -- 172.21.15.29:0/3251391165 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcba4048030 con 0x7fcb9c004fa0 2024-01-25T15:04:46.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.936+0000 7f7123ce0640 1 -- 172.21.15.29:0/2641670426 shutdown_connections 2024-01-25T15:04:46.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.936+0000 7f7123ce0640 1 -- 172.21.15.29:0/2641670426 wait complete. 2024-01-25T15:04:46.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.936+0000 7fcb97fff640 1 -- 172.21.15.29:0/3251391165 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcbac067bd0 con 0x7fcb9c004fa0 2024-01-25T15:04:46.937 INFO:teuthology.orchestra.run.smithi029.stdout:55834574855 2024-01-25T15:04:46.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.939+0000 7fc66f59e640 1 -- 172.21.15.29:0/244091464 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc654005100 con 0x7fc6700c55b0 2024-01-25T15:04:46.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.939+0000 7fcbb0860640 1 -- 172.21.15.29:0/3251391165 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcb9006afd0 msgr2=0x7fcb9006d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.939+0000 7fcbb0860640 1 --2- 172.21.15.29:0/3251391165 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcb9006afd0 0x7fcb9006d490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcba40dd5e0 tx=0x7fcba0008040 comp rx=0 tx=0).stop 2024-01-25T15:04:46.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.940+0000 7fcbb0860640 1 -- 172.21.15.29:0/3251391165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb9c004fa0 msgr2=0x7fcba40dc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.940+0000 7fcbb0860640 1 --2- 172.21.15.29:0/3251391165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb9c004fa0 0x7fcba40dc720 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcbac064450 tx=0x7fcbac068950 comp rx=0 tx=0).stop 2024-01-25T15:04:46.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.939+0000 7fc65effd640 1 -- 172.21.15.29:0/244091464 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc664035020 con 0x7fc6700c55b0 2024-01-25T15:04:46.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.940+0000 7fcbb0860640 1 -- 172.21.15.29:0/3251391165 shutdown_connections 2024-01-25T15:04:46.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.940+0000 7fcbb0860640 1 --2- 172.21.15.29:0/3251391165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcba402c170 0x7fcba402c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.940+0000 7fcbb0860640 1 --2- 172.21.15.29:0/3251391165 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcba40dd200 0x7fcba40d0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.940+0000 7fcbb0860640 1 --2- 172.21.15.29:0/3251391165 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcb9006afd0 0x7fcb9006d490 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.940+0000 7fcbb0860640 1 --2- 172.21.15.29:0/3251391165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb9c004fa0 0x7fcba40dc720 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.940+0000 7fcbb0860640 1 -- 172.21.15.29:0/3251391165 >> 172.21.15.29:0/3251391165 conn(0x7fcba4048250 msgr2=0x7fcba40d5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.942 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-01-25T15:04:46.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.940+0000 7fcbb0860640 1 -- 172.21.15.29:0/3251391165 shutdown_connections 2024-01-25T15:04:46.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.940+0000 7fcbb0860640 1 -- 172.21.15.29:0/3251391165 wait complete. 2024-01-25T15:04:46.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2024-01-25T15:04:46.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2024-01-25T15:04:46.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.942+0000 7fc66f59e640 1 -- 172.21.15.29:0/244091464 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc65006afd0 msgr2=0x7fc65006d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.942+0000 7fc66f59e640 1 --2- 172.21.15.29:0/244091464 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc65006afd0 0x7fc65006d490 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc6701ee0f0 tx=0x7fc668009040 comp rx=0 tx=0).stop 2024-01-25T15:04:46.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.942+0000 7fc66f59e640 1 -- 172.21.15.29:0/244091464 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6700c55b0 msgr2=0x7fc6701586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.942+0000 7fc66f59e640 1 --2- 172.21.15.29:0/244091464 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6700c55b0 0x7fc6701586f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc66402bf20 tx=0x7fc6640046c0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.942+0000 7fc66f59e640 1 -- 172.21.15.29:0/244091464 shutdown_connections 2024-01-25T15:04:46.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.942+0000 7fc66f59e640 1 --2- 172.21.15.29:0/244091464 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc670150b60 0x7fc670150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.942+0000 7fc66f59e640 1 --2- 172.21.15.29:0/244091464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc670156150 0x7fc670158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.942+0000 7fc66f59e640 1 --2- 172.21.15.29:0/244091464 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc65006afd0 0x7fc65006d490 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.942+0000 7fc66f59e640 1 --2- 172.21.15.29:0/244091464 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6700c55b0 0x7fc6701586f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.942+0000 7fc66f59e640 1 -- 172.21.15.29:0/244091464 >> 172.21.15.29:0/244091464 conn(0x7fc6700c7e70 msgr2=0x7fc6700abb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.942+0000 7fc66f59e640 1 -- 172.21.15.29:0/244091464 shutdown_connections 2024-01-25T15:04:46.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.942+0000 7fc66f59e640 1 -- 172.21.15.29:0/244091464 wait complete. 2024-01-25T15:04:46.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2024-01-25T15:04:46.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2024-01-25T15:04:46.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.956+0000 7f8cd90ad640 1 -- 172.21.15.29:0/3480222399 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8ccc04b770 con 0x7f8ccc0d43e0 2024-01-25T15:04:46.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.957+0000 7f8cd0ff9640 1 -- 172.21.15.29:0/3480222399 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8cc0015020 con 0x7f8ccc0d43e0 2024-01-25T15:04:46.957 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-01-25T15:04:46.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2024-01-25T15:04:46.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.959+0000 7f8cd90ad640 1 -- 172.21.15.29:0/3480222399 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8cb806aed0 msgr2=0x7f8cb806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.959+0000 7f8cd90ad640 1 --2- 172.21.15.29:0/3480222399 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8cb806aed0 0x7f8cb806d390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00dd50 tx=0x7f8cd40ae000 comp rx=0 tx=0).stop 2024-01-25T15:04:46.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.959+0000 7f8cd90ad640 1 -- 172.21.15.29:0/3480222399 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ccc0d43e0 msgr2=0x7f8ccc046020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.959+0000 7f8cd90ad640 1 --2- 172.21.15.29:0/3480222399 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ccc0d43e0 0x7f8ccc046020 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000b410 tx=0x7f8cc000b8d0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.959+0000 7f8cd90ad640 1 -- 172.21.15.29:0/3480222399 shutdown_connections 2024-01-25T15:04:46.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.959+0000 7f8cd90ad640 1 --2- 172.21.15.29:0/3480222399 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ccc0d43e0 0x7f8ccc046020 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.959+0000 7f8cd90ad640 1 --2- 172.21.15.29:0/3480222399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ccc008dc0 0x7f8ccc175280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.959+0000 7f8cd90ad640 1 --2- 172.21.15.29:0/3480222399 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8cb806aed0 0x7f8cb806d390 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.959+0000 7f8cd90ad640 1 --2- 172.21.15.29:0/3480222399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ccc0089e0 0x7f8ccc04ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.959+0000 7f8cd90ad640 1 -- 172.21.15.29:0/3480222399 >> 172.21.15.29:0/3480222399 conn(0x7f8ccc007c50 msgr2=0x7f8ccc0d0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.959+0000 7f8cd90ad640 1 -- 172.21.15.29:0/3480222399 shutdown_connections 2024-01-25T15:04:46.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:46.959+0000 7f8cd90ad640 1 -- 172.21.15.29:0/3480222399 wait complete. 2024-01-25T15:04:46.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2024-01-25T15:04:46.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-01-25T15:04:47.932 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-25T15:04:47.945 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-25T15:04:47.947 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-25T15:04:47.949 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-25T15:04:47.953 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-25T15:04:47.960 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-25T15:04:47.962 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-25T15:04:47.971 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-25T15:04:48.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.096+0000 7f7c549f4640 1 Processor -- start 2024-01-25T15:04:48.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.096+0000 7f7c549f4640 1 -- start start 2024-01-25T15:04:48.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.097+0000 7f7c549f4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7c5006dcb0 0x7f7c500c0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.097+0000 7f7c549f4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7c500c4c90 0x7f7c50159490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.097+0000 7f7c549f4640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c500c3e00 con 0x7f7c500c4290 2024-01-25T15:04:48.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.097+0000 7f7c549f4640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c501599d0 con 0x7f7c5006dcb0 2024-01-25T15:04:48.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.097+0000 7f7c549f4640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c500c5230 con 0x7f7c500c4c90 2024-01-25T15:04:48.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.098+0000 7f7c4f7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7c5006dcb0 0x7f7c500c0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.098+0000 7f7c4ffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7c500c4290 0x7f7c50155cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58956/0 (socket says 172.21.15.29:58956) 2024-01-25T15:04:48.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.098+0000 7f7c4ffff640 1 -- 172.21.15.29:0/546667038 learned_addr learned my addr 172.21.15.29:0/546667038 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:48.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.099+0000 7f7c4f7fe640 1 -- 172.21.15.29:0/546667038 >> v2:172.21.15.52:3300/0 conn(0x7f7c500c4c90 msgr2=0x7f7c50159490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-25T15:04:48.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.099+0000 7f7c4f7fe640 1 --2- 172.21.15.29:0/546667038 >> v2:172.21.15.52:3300/0 conn(0x7f7c500c4c90 0x7f7c50159490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.099+0000 7f7c4f7fe640 1 -- 172.21.15.29:0/546667038 >> v1:172.21.15.29:6789/0 conn(0x7f7c500c4290 legacy=0x7f7c50155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.099+0000 7f7c4f7fe640 1 -- 172.21.15.29:0/546667038 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c500c5510 con 0x7f7c5006dcb0 2024-01-25T15:04:48.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.101+0000 7f7c4f7fe640 1 --2- 172.21.15.29:0/546667038 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c5006dcb0 0x7f7c500c0b60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7c5006cb30 tx=0x7f7c4402b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b5db90b3ed05ea server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.101+0000 7f7c4e7fc640 1 -- 172.21.15.29:0/546667038 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4402bea0 con 0x7f7c5006dcb0 2024-01-25T15:04:48.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.101+0000 7f7c4e7fc640 1 -- 172.21.15.29:0/546667038 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4402e050 con 0x7f7c5006dcb0 2024-01-25T15:04:48.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.101+0000 7f7c4e7fc640 1 -- 172.21.15.29:0/546667038 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44030930 con 0x7f7c5006dcb0 2024-01-25T15:04:48.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.102+0000 7f7c549f4640 1 -- 172.21.15.29:0/546667038 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c5006dcb0 msgr2=0x7f7c500c0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.102+0000 7f7c549f4640 1 --2- 172.21.15.29:0/546667038 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c5006dcb0 0x7f7c500c0b60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7c5006cb30 tx=0x7f7c4402b6a0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.103+0000 7f7c549f4640 1 -- 172.21.15.29:0/546667038 shutdown_connections 2024-01-25T15:04:48.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.103+0000 7f7c549f4640 1 --2- 172.21.15.29:0/546667038 >> v2:172.21.15.52:3300/0 conn(0x7f7c500c4c90 0x7f7c50159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.103+0000 7f7c549f4640 1 --2- 172.21.15.29:0/546667038 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c5006dcb0 0x7f7c500c0b60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.103+0000 7f7c549f4640 1 -- 172.21.15.29:0/546667038 >> 172.21.15.29:0/546667038 conn(0x7f7c500c5b90 msgr2=0x7f7c500c5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:48.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.103+0000 7f7c549f4640 1 -- 172.21.15.29:0/546667038 shutdown_connections 2024-01-25T15:04:48.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.104+0000 7f7c549f4640 1 -- 172.21.15.29:0/546667038 wait complete. 2024-01-25T15:04:48.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.105+0000 7f7c549f4640 1 Processor -- start 2024-01-25T15:04:48.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.106+0000 7f7c549f4640 1 -- start start 2024-01-25T15:04:48.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.107+0000 7f7c549f4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c5006dcb0 0x7f7c501448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.107+0000 7f7c549f4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c500c4290 0x7f7c50144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.108+0000 7f7c549f4640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c500c4c90 0x7f7c50153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.108+0000 7f7c4effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c500c4290 0x7f7c50144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.108+0000 7f7c4effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c500c4290 0x7f7c50144de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:33606/0 (socket says 172.21.15.29:33606) 2024-01-25T15:04:48.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.108+0000 7f7c4effd640 1 -- 172.21.15.29:0/1343871973 learned_addr learned my addr 172.21.15.29:0/1343871973 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:48.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.108+0000 7f7c549f4640 1 -- 172.21.15.29:0/1343871973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c500a7020 con 0x7f7c5006dcb0 2024-01-25T15:04:48.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.108+0000 7f7c549f4640 1 -- 172.21.15.29:0/1343871973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c50156f00 con 0x7f7c500c4290 2024-01-25T15:04:48.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.108+0000 7f7c549f4640 1 -- 172.21.15.29:0/1343871973 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c500a6b90 con 0x7f7c500c4c90 2024-01-25T15:04:48.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.109+0000 7f7c4f7fe640 1 --2- 172.21.15.29:0/1343871973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c5006dcb0 0x7f7c501448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.109+0000 7f7c4effd640 1 -- 172.21.15.29:0/1343871973 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c500c4c90 msgr2=0x7f7c50153c50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-25T15:04:48.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.109+0000 7f7c4effd640 1 --2- 172.21.15.29:0/1343871973 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c500c4c90 0x7f7c50153c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.109+0000 7f7c4effd640 1 -- 172.21.15.29:0/1343871973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c5006dcb0 msgr2=0x7f7c501448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.109+0000 7f7c4effd640 1 --2- 172.21.15.29:0/1343871973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c5006dcb0 0x7f7c501448a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.109+0000 7f7c4effd640 1 -- 172.21.15.29:0/1343871973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c44009400 con 0x7f7c500c4290 2024-01-25T15:04:48.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.109+0000 7f7c4f7fe640 1 --2- 172.21.15.29:0/1343871973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c5006dcb0 0x7f7c501448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:48.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.110+0000 7f7c4effd640 1 --2- 172.21.15.29:0/1343871973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c500c4290 0x7f7c50144de0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800ba80 tx=0x7f7c4800bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.110+0000 7f7c37fff640 1 -- 172.21.15.29:0/1343871973 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4800cc90 con 0x7f7c500c4290 2024-01-25T15:04:48.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.110+0000 7f7c549f4640 1 -- 172.21.15.29:0/1343871973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c500a8300 con 0x7f7c500c4290 2024-01-25T15:04:48.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.110+0000 7f7c549f4640 1 -- 172.21.15.29:0/1343871973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c500a6260 con 0x7f7c500c4290 2024-01-25T15:04:48.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.111+0000 7f7c37fff640 1 -- 172.21.15.29:0/1343871973 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4800cdf0 con 0x7f7c500c4290 2024-01-25T15:04:48.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.111+0000 7f7c37fff640 1 -- 172.21.15.29:0/1343871973 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48014680 con 0x7f7c500c4290 2024-01-25T15:04:48.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.112+0000 7f7c549f4640 1 -- 172.21.15.29:0/1343871973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c50074010 con 0x7f7c500c4290 2024-01-25T15:04:48.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.114+0000 7f7c37fff640 1 -- 172.21.15.29:0/1343871973 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7c480147e0 con 0x7f7c500c4290 2024-01-25T15:04:48.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.115+0000 7f7c37fff640 1 --2- 172.21.15.29:0/1343871973 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7c3c06afa0 0x7f7c3c06d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.115+0000 7f7c37fff640 1 -- 172.21.15.29:0/1343871973 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7c48037e40 con 0x7f7c500c4290 2024-01-25T15:04:48.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.116+0000 7f7c4f7fe640 1 --2- 172.21.15.29:0/1343871973 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7c3c06afa0 0x7f7c3c06d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.117+0000 7f7c4f7fe640 1 --2- 172.21.15.29:0/1343871973 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7c3c06afa0 0x7f7c3c06d460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7c44034000 tx=0x7f7c44008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.119+0000 7f7c37fff640 1 -- 172.21.15.29:0/1343871973 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7c48054730 con 0x7f7c500c4290 2024-01-25T15:04:48.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.152+0000 7f1b33c6e640 1 Processor -- start 2024-01-25T15:04:48.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.153+0000 7f1b33c6e640 1 -- start start 2024-01-25T15:04:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.154+0000 7f1b33c6e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1b2c152590 0x7f1b2c152970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.154+0000 7f1b33c6e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2c0ad540 con 0x7f1b2c149190 2024-01-25T15:04:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.154+0000 7f1b33c6e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2c070d40 con 0x7f1b2c0ad0b0 2024-01-25T15:04:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.154+0000 7f1b33c6e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2c155c00 con 0x7f1b2c152590 2024-01-25T15:04:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.153+0000 7f0ee69c5640 1 Processor -- start 2024-01-25T15:04:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.154+0000 7f424c275640 1 Processor -- start 2024-01-25T15:04:48.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.153+0000 7f0ee69c5640 1 -- start start 2024-01-25T15:04:48.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.154+0000 7f424c275640 1 -- start start 2024-01-25T15:04:48.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.154+0000 7f0ee69c5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0ee006d600 0x7f0ee00a8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.154+0000 7f0ee69c5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ee00c2f80 0x7f0ee0154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.154+0000 7f0ee69c5640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee0155690 con 0x7f0ee014b2a0 2024-01-25T15:04:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.154+0000 7f0ee69c5640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee00c22c0 con 0x7f0ee006d600 2024-01-25T15:04:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.154+0000 7f0ee69c5640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee00c24a0 con 0x7f0ee00c2f80 2024-01-25T15:04:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.154+0000 7f0ee4f62640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ee00c2f80 0x7f0ee0154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.155+0000 7f0ee4f62640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ee00c2f80 0x7f0ee0154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:33626/0 (socket says 172.21.15.29:33626) 2024-01-25T15:04:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.155+0000 7f0ee4f62640 1 -- 172.21.15.29:0/3156510435 learned_addr learned my addr 172.21.15.29:0/3156510435 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.154+0000 7f0edf7fe640 1 --2- 172.21.15.29:0/3156510435 >> v2:172.21.15.29:3300/0 conn(0x7f0ee006d600 0x7f0ee00a8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.154+0000 7f0edffff640 1 --1- 172.21.15.29:0/3156510435 >> v1:172.21.15.29:6789/0 conn(0x7f0ee014b2a0 0x7f0ee006e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58978/0 (socket says 172.21.15.29:58978) 2024-01-25T15:04:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.155+0000 7f0edf7fe640 1 -- 172.21.15.29:0/3156510435 >> v2:172.21.15.52:3300/0 conn(0x7f0ee00c2f80 msgr2=0x7f0ee0154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.155+0000 7f0edf7fe640 1 --2- 172.21.15.29:0/3156510435 >> v2:172.21.15.52:3300/0 conn(0x7f0ee00c2f80 0x7f0ee0154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.155+0000 7f0edf7fe640 1 -- 172.21.15.29:0/3156510435 >> v1:172.21.15.29:6789/0 conn(0x7f0ee014b2a0 legacy=0x7f0ee006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.155+0000 7f0edf7fe640 1 -- 172.21.15.29:0/3156510435 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee00c2780 con 0x7f0ee006d600 2024-01-25T15:04:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.155+0000 7f0ee4f62640 1 --2- 172.21.15.29:0/3156510435 >> v2:172.21.15.52:3300/0 conn(0x7f0ee00c2f80 0x7f0ee0154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:48.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.155+0000 7f1b31a0a640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1b2c149190 0x7f1b2c070510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58966/0 (socket says 172.21.15.29:58966) 2024-01-25T15:04:48.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.155+0000 7fce57e51640 1 Processor -- start 2024-01-25T15:04:48.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.155+0000 7f1b31a0a640 1 -- 172.21.15.29:0/2244825648 learned_addr learned my addr 172.21.15.29:0/2244825648 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:48.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.155+0000 7f1b30a08640 1 -- 172.21.15.29:0/2244825648 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844814165 0 0) 0x7f1b1c001110 con 0x7f1b2c149190 2024-01-25T15:04:48.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.155+0000 7f1b30a08640 1 -- 172.21.15.29:0/2244825648 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b18003520 con 0x7f1b2c149190 2024-01-25T15:04:48.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.155+0000 7f1b3220b640 1 --2- 172.21.15.29:0/2244825648 >> v2:172.21.15.52:3300/0 conn(0x7f1b2c152590 0x7f1b2c152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7f1b30a08640 1 -- 172.21.15.29:0/2244825648 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2489325015 0 0) 0x7f1b18003520 con 0x7f1b2c149190 2024-01-25T15:04:48.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7f1b30a08640 1 -- 172.21.15.29:0/2244825648 >> v2:172.21.15.52:3300/0 conn(0x7f1b2c152590 msgr2=0x7f1b2c152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:48.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7f1b30a08640 1 --2- 172.21.15.29:0/2244825648 >> v2:172.21.15.52:3300/0 conn(0x7f1b2c152590 0x7f1b2c152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7f1b30a08640 1 -- 172.21.15.29:0/2244825648 >> v1:172.21.15.52:6789/0 conn(0x7f1b2c0ad0b0 legacy=0x7f1b2c0c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:48.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7f1b30a08640 1 -- 172.21.15.29:0/2244825648 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c155ee0 con 0x7f1b2c149190 2024-01-25T15:04:48.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7f1b30a08640 1 -- 172.21.15.29:0/2244825648 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f1b1c0017e0 con 0x7f1b2c149190 2024-01-25T15:04:48.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7f1b30a08640 1 -- 172.21.15.29:0/2244825648 >> v1:172.21.15.29:6789/0 conn(0x7f1b2c149190 legacy=0x7f1b2c070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7f1b30a08640 1 --2- 172.21.15.29:0/2244825648 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b18003a20 0x7f1b18003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7f1b30a08640 1 --2- 172.21.15.29:0/2244825648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b180047c0 0x7f1b18004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7f1b30a08640 1 --2- 172.21.15.29:0/2244825648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b18005380 0x7f1b1800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7f1b30a08640 1 -- 172.21.15.29:0/2244825648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c155c00 con 0x7f1b180047c0 2024-01-25T15:04:48.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7f1b30a08640 1 -- 172.21.15.29:0/2244825648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1800c2b0 con 0x7f1b18005380 2024-01-25T15:04:48.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7f1b30a08640 1 -- 172.21.15.29:0/2244825648 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1800c470 con 0x7f1b18003a20 2024-01-25T15:04:48.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.155+0000 7f424c275640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f42440c18d0 0x7f424414db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.155+0000 7f424c275640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f424406d560 con 0x7f42440676c0 2024-01-25T15:04:48.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.155+0000 7f424c275640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42440c1440 con 0x7f42440c2150 2024-01-25T15:04:48.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.155+0000 7f424c275640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4244151760 con 0x7f42440c18d0 2024-01-25T15:04:48.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7f424a812640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f42440c2150 0x7f42440c2a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:49764/0 (socket says 172.21.15.29:49764) 2024-01-25T15:04:48.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7f424a812640 1 -- 172.21.15.29:0/4251687461 learned_addr learned my addr 172.21.15.29:0/4251687461 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:48.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7f4249810640 1 --2- 172.21.15.29:0/4251687461 >> v2:172.21.15.29:3300/0 conn(0x7f42440c18d0 0x7f424414db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7f424900f640 1 -- 172.21.15.29:0/4251687461 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2663758175 0 0) 0x7f42440c1440 con 0x7f42440c2150 2024-01-25T15:04:48.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7f424900f640 1 -- 172.21.15.29:0/4251687461 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4230003520 con 0x7f42440c2150 2024-01-25T15:04:48.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7f1b31a0a640 1 --2- 172.21.15.29:0/2244825648 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b18003a20 0x7f1b18003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7fce57e51640 1 -- start start 2024-01-25T15:04:48.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.157+0000 7f0edf7fe640 1 --2- 172.21.15.29:0/3156510435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ee006d600 0x7f0ee00a8490 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00a93e0 tx=0x7f0ed002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4944261e8d35f211 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7fc14759e640 1 Processor -- start 2024-01-25T15:04:48.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7fc14759e640 1 -- start start 2024-01-25T15:04:48.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.156+0000 7f1b3220b640 1 --2- 172.21.15.29:0/2244825648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b18005380 0x7f1b1800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.157+0000 7f1b31a0a640 1 -- 172.21.15.29:0/2244825648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b18005380 msgr2=0x7f1b1800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:48.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.157+0000 7f1b31a0a640 1 --2- 172.21.15.29:0/2244825648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b18005380 0x7f1b1800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.157+0000 7f1b31a0a640 1 -- 172.21.15.29:0/2244825648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b180047c0 msgr2=0x7f1b18004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:48.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.157+0000 7f1b31a0a640 1 --2- 172.21.15.29:0/2244825648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b180047c0 0x7f1b18004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.157+0000 7f1b31a0a640 1 -- 172.21.15.29:0/2244825648 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c155ee0 con 0x7f1b18003a20 2024-01-25T15:04:48.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.157+0000 7f1b3220b640 1 -- 172.21.15.29:0/2244825648 reap_dead start 2024-01-25T15:04:48.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.157+0000 7f4249810640 1 -- 172.21.15.29:0/4251687461 >> v1:172.21.15.52:6789/0 conn(0x7f42440c2150 legacy=0x7f42440c2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.157+0000 7f4249810640 1 -- 172.21.15.29:0/4251687461 >> v1:172.21.15.29:6789/0 conn(0x7f42440676c0 legacy=0x7f4244070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:48.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.157+0000 7f4249810640 1 -- 172.21.15.29:0/4251687461 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4244071550 con 0x7f42440c18d0 2024-01-25T15:04:48.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.158+0000 7fce57e51640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce50154090 0x7fce500ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.158+0000 7fce57e51640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fce5006dbc0 0x7fce5006e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.158+0000 7fce57e51640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce50154fd0 con 0x7fce500abcf0 2024-01-25T15:04:48.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.158+0000 7fce57e51640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce50071da0 con 0x7fce5006dbc0 2024-01-25T15:04:48.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.158+0000 7fce57e51640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce500a9540 con 0x7fce50154090 2024-01-25T15:04:48.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.158+0000 7f0edeffd640 1 -- 172.21.15.29:0/3156510435 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed00317c0 con 0x7f0ee006d600 2024-01-25T15:04:48.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.158+0000 7f0edeffd640 1 -- 172.21.15.29:0/3156510435 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed0031920 con 0x7f0ee006d600 2024-01-25T15:04:48.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.158+0000 7f8ea9eca640 1 Processor -- start 2024-01-25T15:04:48.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.158+0000 7fc14759e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc14003eb80 0x7fc1400ea230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.158+0000 7fc14659c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc14003e7a0 0x7fc1400df320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:58996/0 (socket says 172.21.15.29:58996) 2024-01-25T15:04:48.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.158+0000 7fc14659c640 1 -- 172.21.15.29:0/3848807967 learned_addr learned my addr 172.21.15.29:0/3848807967 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:48.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.158+0000 7fc14759e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc140046960 con 0x7fc14003e7a0 2024-01-25T15:04:48.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.158+0000 7fce553ec640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fce500abcf0 0x7fce50154470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:49780/0 (socket says 172.21.15.29:49780) 2024-01-25T15:04:48.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.158+0000 7fce553ec640 1 -- 172.21.15.29:0/3820766873 learned_addr learned my addr 172.21.15.29:0/3820766873 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:48.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.158+0000 7fce563ee640 1 --2- 172.21.15.29:0/3820766873 >> v2:172.21.15.52:3300/0 conn(0x7fce5006dbc0 0x7fce5006e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.158+0000 7f1b31a0a640 1 --2- 172.21.15.29:0/2244825648 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b18003a20 0x7f1b18003e60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c007e90 tx=0x7f1b180057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31fd468b0e52490 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.158+0000 7fc14759e640 1 -- 172.21.15.29:0/3848807967 --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14003f010 con 0x7fc1400dfd90 2024-01-25T15:04:48.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.158+0000 7fc14759e640 1 -- 172.21.15.29:0/3848807967 --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1400474e0 con 0x7fc14003eb80 2024-01-25T15:04:48.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7fc146d9d640 1 --2- 172.21.15.29:0/3848807967 >> v2:172.21.15.52:3300/0 conn(0x7fc14003eb80 0x7fc1400ea230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.158+0000 7fce54beb640 1 -- 172.21.15.29:0/3820766873 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245276268 0 0) 0x7fce50154fd0 con 0x7fce500abcf0 2024-01-25T15:04:48.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7fce54beb640 1 -- 172.21.15.29:0/3820766873 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce3c003520 con 0x7fce500abcf0 2024-01-25T15:04:48.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7f1b30a08640 1 -- 172.21.15.29:0/2244825648 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c005ad0 con 0x7f1b18003a20 2024-01-25T15:04:48.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7f1b30a08640 1 -- 172.21.15.29:0/2244825648 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1c005c30 con 0x7f1b18003a20 2024-01-25T15:04:48.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7f0ee69c5640 1 -- 172.21.15.29:0/3156510435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ee006d600 msgr2=0x7f0ee00a8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7f1b30a08640 1 -- 172.21.15.29:0/2244825648 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c005ad0 con 0x7f1b18003a20 2024-01-25T15:04:48.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.158+0000 7f8ea9eca640 1 -- start start 2024-01-25T15:04:48.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7f4249810640 1 --2- 172.21.15.29:0/4251687461 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42440c18d0 0x7f424414db20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f42400097a0 tx=0x7f424002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72afc73699c23723 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7fce563ee640 1 -- 172.21.15.29:0/3820766873 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce50154090 msgr2=0x7fce500ab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:48.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7fce563ee640 1 --2- 172.21.15.29:0/3820766873 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce50154090 0x7fce500ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7f0ee69c5640 1 --2- 172.21.15.29:0/3156510435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ee006d600 0x7f0ee00a8490 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00a93e0 tx=0x7f0ed002b860 comp rx=0 tx=0).stop 2024-01-25T15:04:48.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7f0ee69c5640 1 -- 172.21.15.29:0/3156510435 shutdown_connections 2024-01-25T15:04:48.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7f0ee69c5640 1 --2- 172.21.15.29:0/3156510435 >> v2:172.21.15.52:3300/0 conn(0x7f0ee00c2f80 0x7f0ee0154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7f0ee69c5640 1 --2- 172.21.15.29:0/3156510435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ee006d600 0x7f0ee00a8490 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7f0ee69c5640 1 -- 172.21.15.29:0/3156510435 >> 172.21.15.29:0/3156510435 conn(0x7f0ee00c39b0 msgr2=0x7f0ee00c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:48.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7f0ee69c5640 1 -- 172.21.15.29:0/3156510435 shutdown_connections 2024-01-25T15:04:48.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7f0ee69c5640 1 -- 172.21.15.29:0/3156510435 wait complete. 2024-01-25T15:04:48.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7f424900f640 1 -- 172.21.15.29:0/4251687461 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424002e070 con 0x7f42440c18d0 2024-01-25T15:04:48.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7fce54beb640 1 -- 172.21.15.29:0/3820766873 <== mon.1 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4051755851 0 0) 0x7fce3c003520 con 0x7fce500abcf0 2024-01-25T15:04:48.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7f424900f640 1 -- 172.21.15.29:0/4251687461 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42400315a0 con 0x7f42440c18d0 2024-01-25T15:04:48.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7fce563ee640 1 -- 172.21.15.29:0/3820766873 >> v1:172.21.15.52:6789/0 conn(0x7fce500abcf0 legacy=0x7fce50154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7f8ea9eca640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8ea40c18d0 0x7f8ea414db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7fce563ee640 1 -- 172.21.15.29:0/3820766873 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce50072760 con 0x7fce5006dbc0 2024-01-25T15:04:48.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7f1b33c6e640 1 -- 172.21.15.29:0/2244825648 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b18003a20 msgr2=0x7f1b18003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7f1b33c6e640 1 --2- 172.21.15.29:0/2244825648 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b18003a20 0x7f1b18003e60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c007e90 tx=0x7f1b180057f0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7fc14559a640 1 -- 172.21.15.29:0/3848807967 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280060549 0 0) 0x7fc13c001110 con 0x7fc1400dfd90 2024-01-25T15:04:48.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7fc14559a640 1 -- 172.21.15.29:0/3848807967 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc130003520 con 0x7fc1400dfd90 2024-01-25T15:04:48.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.159+0000 7f8ea37fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8ea40676c0 0x7f8ea4070e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:49800/0 (socket says 172.21.15.29:49800) 2024-01-25T15:04:48.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7f8ea37fe640 1 -- 172.21.15.29:0/1094049336 learned_addr learned my addr 172.21.15.29:0/1094049336 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:48.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7f8ea2ffd640 1 --2- 172.21.15.29:0/1094049336 >> v2:172.21.15.52:3300/0 conn(0x7f8ea40c18d0 0x7f8ea414db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7f8ea9eca640 1 -- 172.21.15.29:0/1094049336 --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea406d560 con 0x7f8ea40c2150 2024-01-25T15:04:48.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7f8ea9eca640 1 -- 172.21.15.29:0/1094049336 --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea40c1440 con 0x7f8ea40676c0 2024-01-25T15:04:48.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7fc14559a640 1 -- 172.21.15.29:0/3848807967 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227634850 0 0) 0x7fc138001110 con 0x7fc14003e7a0 2024-01-25T15:04:48.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7f8ea9eca640 1 -- 172.21.15.29:0/1094049336 --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea4151760 con 0x7f8ea40c18d0 2024-01-25T15:04:48.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7fc14559a640 1 -- 172.21.15.29:0/3848807967 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc130003840 con 0x7fc14003e7a0 2024-01-25T15:04:48.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7fc14559a640 1 -- 172.21.15.29:0/3848807967 <== mon.1 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1785605899 0 0) 0x7fc130003520 con 0x7fc1400dfd90 2024-01-25T15:04:48.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7fc14559a640 1 -- 172.21.15.29:0/3848807967 >> v2:172.21.15.52:3300/0 conn(0x7fc14003eb80 msgr2=0x7fc1400ea230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:48.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7fc14559a640 1 --2- 172.21.15.29:0/3848807967 >> v2:172.21.15.52:3300/0 conn(0x7fc14003eb80 0x7fc1400ea230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7fc14559a640 1 -- 172.21.15.29:0/3848807967 >> v1:172.21.15.29:6789/0 conn(0x7fc14003e7a0 legacy=0x7fc1400df320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7fc14559a640 1 -- 172.21.15.29:0/3848807967 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1400477c0 con 0x7fc1400dfd90 2024-01-25T15:04:48.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7fc14559a640 1 -- 172.21.15.29:0/3848807967 <== mon.1 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7fc13c001760 con 0x7fc1400dfd90 2024-01-25T15:04:48.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7f424c275640 1 -- 172.21.15.29:0/4251687461 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42440c18d0 msgr2=0x7f424414db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7f424c275640 1 --2- 172.21.15.29:0/4251687461 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42440c18d0 0x7f424414db20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f42400097a0 tx=0x7f424002b840 comp rx=0 tx=0).stop 2024-01-25T15:04:48.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7fc14559a640 1 -- 172.21.15.29:0/3848807967 >> v1:172.21.15.52:6789/0 conn(0x7fc1400dfd90 legacy=0x7fc1400e2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7fc14559a640 1 --2- 172.21.15.29:0/3848807967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc130003cb0 0x7fc1300040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7fc14559a640 1 --2- 172.21.15.29:0/3848807967 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1300047c0 0x7fc130004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7f1b33c6e640 1 -- 172.21.15.29:0/2244825648 shutdown_connections 2024-01-25T15:04:48.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7f1b33c6e640 1 --2- 172.21.15.29:0/2244825648 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b18003a20 0x7f1b18003e60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7f1b33c6e640 1 -- 172.21.15.29:0/2244825648 >> 172.21.15.29:0/2244825648 conn(0x7f1b2c0c7f80 msgr2=0x7f1b2c0c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:48.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7f8ea27fc640 1 -- 172.21.15.29:0/1094049336 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886410381 0 0) 0x7f8ea40c1440 con 0x7f8ea40676c0 2024-01-25T15:04:48.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7f8ea27fc640 1 -- 172.21.15.29:0/1094049336 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e8c005730 con 0x7f8ea40676c0 2024-01-25T15:04:48.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7ff4ff59e640 1 Processor -- start 2024-01-25T15:04:48.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7fc14559a640 1 --2- 172.21.15.29:0/3848807967 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc130005320 0x7fc13000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7fc14559a640 1 -- 172.21.15.29:0/3848807967 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1400474e0 con 0x7fc130005320 2024-01-25T15:04:48.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7fc14559a640 1 -- 172.21.15.29:0/3848807967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13000c240 con 0x7fc130003cb0 2024-01-25T15:04:48.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7fc14559a640 1 -- 172.21.15.29:0/3848807967 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc13000c400 con 0x7fc1300047c0 2024-01-25T15:04:48.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.161+0000 7f1b33c6e640 1 -- 172.21.15.29:0/2244825648 shutdown_connections 2024-01-25T15:04:48.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7fc14659c640 1 --2- 172.21.15.29:0/3848807967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc130003cb0 0x7fc1300040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.160+0000 7fc145d9b640 1 --2- 172.21.15.29:0/3848807967 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1300047c0 0x7fc130004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.161+0000 7fc146d9d640 1 --2- 172.21.15.29:0/3848807967 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc130005320 0x7fc13000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.161+0000 7f424c275640 1 -- 172.21.15.29:0/4251687461 shutdown_connections 2024-01-25T15:04:48.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.161+0000 7f424c275640 1 --2- 172.21.15.29:0/4251687461 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42440c18d0 0x7f424414db20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.161+0000 7f424c275640 1 -- 172.21.15.29:0/4251687461 >> 172.21.15.29:0/4251687461 conn(0x7f424406a6c0 msgr2=0x7f424406aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:48.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.161+0000 7fce563ee640 1 --2- 172.21.15.29:0/3820766873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce5006dbc0 0x7fce5006e010 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fce48009d90 tx=0x7fce4802cd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6e4fbf1ab20c4d0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.161+0000 7fce54beb640 1 -- 172.21.15.29:0/3820766873 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c001670 con 0x7fce5006dbc0 2024-01-25T15:04:48.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.161+0000 7fce54beb640 1 -- 172.21.15.29:0/3820766873 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4802d890 con 0x7fce5006dbc0 2024-01-25T15:04:48.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.161+0000 7fce54beb640 1 -- 172.21.15.29:0/3820766873 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c001670 con 0x7fce5006dbc0 2024-01-25T15:04:48.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.161+0000 7f0ee69c5640 1 Processor -- start 2024-01-25T15:04:48.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.161+0000 7f8ea2ffd640 1 -- 172.21.15.29:0/1094049336 >> v1:172.21.15.52:6789/0 conn(0x7f8ea40676c0 legacy=0x7f8ea4070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.161+0000 7f8ea2ffd640 1 -- 172.21.15.29:0/1094049336 >> v1:172.21.15.29:6789/0 conn(0x7f8ea40c2150 legacy=0x7f8ea40c29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.161+0000 7f8ea2ffd640 1 -- 172.21.15.29:0/1094049336 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea4071550 con 0x7f8ea40c18d0 2024-01-25T15:04:48.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.161+0000 7ff4ff59e640 1 -- start start 2024-01-25T15:04:48.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.161+0000 7f0ee69c5640 1 -- start start 2024-01-25T15:04:48.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.161+0000 7f1b33c6e640 1 -- 172.21.15.29:0/2244825648 wait complete. 2024-01-25T15:04:48.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.161+0000 7fc14659c640 1 -- 172.21.15.29:0/3848807967 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1300047c0 msgr2=0x7fc130004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:48.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.162+0000 7ff4ff59e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5000c2aa0 0x7ff500071ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.162+0000 7ff4ff59e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff5000721e0 0x7ff50015bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.162+0000 7ff4ff59e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5000c2f20 con 0x7ff500155360 2024-01-25T15:04:48.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.162+0000 7ff4ff59e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5000c1630 con 0x7ff5000721e0 2024-01-25T15:04:48.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.162+0000 7ff4ff59e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5000c1810 con 0x7ff5000c2aa0 2024-01-25T15:04:48.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.162+0000 7f424c275640 1 -- 172.21.15.29:0/4251687461 shutdown_connections 2024-01-25T15:04:48.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.161+0000 7fc14659c640 1 --2- 172.21.15.29:0/3848807967 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1300047c0 0x7fc130004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.162+0000 7f424c275640 1 -- 172.21.15.29:0/4251687461 wait complete. 2024-01-25T15:04:48.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.162+0000 7ff4fe59c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff500155360 0x7ff5000c2390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:49816/0 (socket says 172.21.15.29:49816) 2024-01-25T15:04:48.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.162+0000 7ff4fe59c640 1 -- 172.21.15.29:0/428990924 learned_addr learned my addr 172.21.15.29:0/428990924 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:48.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.161+0000 7fc14659c640 1 -- 172.21.15.29:0/3848807967 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc130005320 msgr2=0x7fc13000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:48.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.162+0000 7f0ee69c5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ee006d600 0x7f0ee014e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.162+0000 7f8ea2ffd640 1 --2- 172.21.15.29:0/1094049336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea40c18d0 0x7f8ea414db20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c009d90 tx=0x7f8e9c02bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67a3c934454f7795 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.162+0000 7ff4fdd9b640 1 --2- 172.21.15.29:0/428990924 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5000c2aa0 0x7ff500071ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.162+0000 7ff4fed9d640 1 --2- 172.21.15.29:0/428990924 >> v2:172.21.15.52:3300/0 conn(0x7ff5000721e0 0x7ff50015bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.161+0000 7fc14659c640 1 --2- 172.21.15.29:0/3848807967 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc130005320 0x7fc13000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.161+0000 7fc14659c640 1 -- 172.21.15.29:0/3848807967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1400477c0 con 0x7fc130003cb0 2024-01-25T15:04:48.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.161+0000 7fc146d9d640 1 -- 172.21.15.29:0/3848807967 reap_dead start 2024-01-25T15:04:48.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.162+0000 7fc14659c640 1 --2- 172.21.15.29:0/3848807967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc130003cb0 0x7fc1300040b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc138001a00 tx=0x7fc1300057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de84e6bfd482683d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.162+0000 7fce57e51640 1 -- 172.21.15.29:0/3820766873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce5006dbc0 msgr2=0x7fce5006e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.162+0000 7fce57e51640 1 --2- 172.21.15.29:0/3820766873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce5006dbc0 0x7fce5006e010 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fce48009d90 tx=0x7fce4802cd60 comp rx=0 tx=0).stop 2024-01-25T15:04:48.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7f1b33c6e640 1 Processor -- start 2024-01-25T15:04:48.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7f8ea27fc640 1 -- 172.21.15.29:0/1094049336 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c02ccf0 con 0x7f8ea40c18d0 2024-01-25T15:04:48.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7f8ea27fc640 1 -- 172.21.15.29:0/1094049336 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9c02ce50 con 0x7f8ea40c18d0 2024-01-25T15:04:48.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7f0ee69c5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ee00c2f80 0x7f0ee01549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7f8ea27fc640 1 -- 172.21.15.29:0/1094049336 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c034660 con 0x7f8ea40c18d0 2024-01-25T15:04:48.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7f0ee69c5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ee014b2a0 0x7f0ee0144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7f0edffff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ee006d600 0x7f0ee014e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7f0edffff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ee006d600 0x7f0ee014e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:40678/0 (socket says 172.21.15.29:40678) 2024-01-25T15:04:48.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7f0edffff640 1 -- 172.21.15.29:0/344616016 learned_addr learned my addr 172.21.15.29:0/344616016 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:48.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7f0ee69c5640 1 -- 172.21.15.29:0/344616016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee01f2ca0 con 0x7f0ee00c2f80 2024-01-25T15:04:48.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7f0ee69c5640 1 -- 172.21.15.29:0/344616016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee0148dc0 con 0x7f0ee014b2a0 2024-01-25T15:04:48.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7f0ee69c5640 1 -- 172.21.15.29:0/344616016 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee00ac9b0 con 0x7f0ee006d600 2024-01-25T15:04:48.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7f0ee4f62640 1 --2- 172.21.15.29:0/344616016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ee014b2a0 0x7f0ee0144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7ff4fdd9b640 1 -- 172.21.15.29:0/428990924 >> v2:172.21.15.52:3300/0 conn(0x7ff5000721e0 msgr2=0x7ff50015bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:48.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7ff4fdd9b640 1 --2- 172.21.15.29:0/428990924 >> v2:172.21.15.52:3300/0 conn(0x7ff5000721e0 0x7ff50015bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7ff4fdd9b640 1 -- 172.21.15.29:0/428990924 >> v1:172.21.15.52:6789/0 conn(0x7ff500155360 legacy=0x7ff5000c2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7ff4fdd9b640 1 -- 172.21.15.29:0/428990924 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5000c1af0 con 0x7ff5000c2aa0 2024-01-25T15:04:48.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7fc14559a640 1 -- 172.21.15.29:0/3848807967 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138005ad0 con 0x7fc130003cb0 2024-01-25T15:04:48.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7fc14559a640 1 -- 172.21.15.29:0/3848807967 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc138005c30 con 0x7fc130003cb0 2024-01-25T15:04:48.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7fc14559a640 1 -- 172.21.15.29:0/3848807967 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138007070 con 0x7fc130003cb0 2024-01-25T15:04:48.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7f0edf7fe640 1 --2- 172.21.15.29:0/344616016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ee00c2f80 0x7f0ee01549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f8ea9eca640 1 -- 172.21.15.29:0/1094049336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea40c18d0 msgr2=0x7f8ea414db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7fc14759e640 1 -- 172.21.15.29:0/3848807967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc130003cb0 msgr2=0x7fc1300040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7fc14759e640 1 --2- 172.21.15.29:0/3848807967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc130003cb0 0x7fc1300040b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc138001a00 tx=0x7fc1300057f0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7fce57e51640 1 -- 172.21.15.29:0/3820766873 shutdown_connections 2024-01-25T15:04:48.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7fce57e51640 1 --2- 172.21.15.29:0/3820766873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce5006dbc0 0x7fce5006e010 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7fce57e51640 1 --2- 172.21.15.29:0/3820766873 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce50154090 0x7fce500ab6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7fce57e51640 1 -- 172.21.15.29:0/3820766873 >> 172.21.15.29:0/3820766873 conn(0x7fce500c2a10 msgr2=0x7fce500c2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:48.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f8ea9eca640 1 --2- 172.21.15.29:0/1094049336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea40c18d0 0x7f8ea414db20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c009d90 tx=0x7f8e9c02bf40 comp rx=0 tx=0).stop 2024-01-25T15:04:48.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f8ea9eca640 1 -- 172.21.15.29:0/1094049336 shutdown_connections 2024-01-25T15:04:48.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7fce57e51640 1 -- 172.21.15.29:0/3820766873 shutdown_connections 2024-01-25T15:04:48.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7fce57e51640 1 -- 172.21.15.29:0/3820766873 wait complete. 2024-01-25T15:04:48.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f8ea9eca640 1 --2- 172.21.15.29:0/1094049336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea40c18d0 0x7f8ea414db20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f8ea9eca640 1 -- 172.21.15.29:0/1094049336 >> 172.21.15.29:0/1094049336 conn(0x7f8ea406a6c0 msgr2=0x7f8ea406aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:48.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.163+0000 7f1b33c6e640 1 -- start start 2024-01-25T15:04:48.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f1b33c6e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b18003a20 0x7f1b2c149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f1b33c6e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b2c14c700 0x7f1b2c14bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f1b33c6e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b2c150150 0x7f1b2c1e94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f1b33c6e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c14f350 con 0x7f1b2c14c700 2024-01-25T15:04:48.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f1b33c6e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c1ea0e0 con 0x7f1b2c150150 2024-01-25T15:04:48.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f1b33c6e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c14a4c0 con 0x7f1b18003a20 2024-01-25T15:04:48.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7ff4fdd9b640 1 --2- 172.21.15.29:0/428990924 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5000c2aa0 0x7ff500071ca0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800be30 tx=0x7ff4f80092f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=364cbf82782fde38 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f8ea9eca640 1 -- 172.21.15.29:0/1094049336 shutdown_connections 2024-01-25T15:04:48.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f8ea9eca640 1 -- 172.21.15.29:0/1094049336 wait complete. 2024-01-25T15:04:48.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f424c275640 1 Processor -- start 2024-01-25T15:04:48.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f0edf7fe640 1 -- 172.21.15.29:0/344616016 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ee006d600 msgr2=0x7f0ee014e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f0edf7fe640 1 --2- 172.21.15.29:0/344616016 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ee006d600 0x7f0ee014e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f0edf7fe640 1 -- 172.21.15.29:0/344616016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ee014b2a0 msgr2=0x7f0ee0144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f1b31a0a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b18003a20 0x7f1b2c149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f1b31a0a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b18003a20 0x7f1b2c149f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:40680/0 (socket says 172.21.15.29:40680) 2024-01-25T15:04:48.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f1b31a0a640 1 -- 172.21.15.29:0/3687349057 learned_addr learned my addr 172.21.15.29:0/3687349057 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:48.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f0edf7fe640 1 --2- 172.21.15.29:0/344616016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ee014b2a0 0x7f0ee0144550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f0edf7fe640 1 -- 172.21.15.29:0/344616016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed0009400 con 0x7f0ee00c2f80 2024-01-25T15:04:48.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f1b3220b640 1 --2- 172.21.15.29:0/3687349057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b2c150150 0x7f1b2c1e94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f424c275640 1 -- start start 2024-01-25T15:04:48.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7f1b31209640 1 --2- 172.21.15.29:0/3687349057 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b2c14c700 0x7f1b2c14bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.164+0000 7ff4fd59a640 1 -- 172.21.15.29:0/428990924 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8009540 con 0x7ff5000c2aa0 2024-01-25T15:04:48.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.165+0000 7ff4fd59a640 1 -- 172.21.15.29:0/428990924 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f80096a0 con 0x7ff5000c2aa0 2024-01-25T15:04:48.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.165+0000 7f1b31a0a640 1 -- 172.21.15.29:0/3687349057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b2c150150 msgr2=0x7f1b2c1e94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.165+0000 7f1b31a0a640 1 --2- 172.21.15.29:0/3687349057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b2c150150 0x7f1b2c1e94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.165+0000 7f1b31a0a640 1 -- 172.21.15.29:0/3687349057 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b2c14c700 msgr2=0x7f1b2c14bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.165+0000 7f1b31a0a640 1 --2- 172.21.15.29:0/3687349057 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b2c14c700 0x7f1b2c14bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.165+0000 7f1b31a0a640 1 -- 172.21.15.29:0/3687349057 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c148030 con 0x7f1b18003a20 2024-01-25T15:04:48.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.165+0000 7f1b31209640 1 --2- 172.21.15.29:0/3687349057 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b2c14c700 0x7f1b2c14bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:48.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.165+0000 7f0edf7fe640 1 --2- 172.21.15.29:0/344616016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ee00c2f80 0x7f0ee01549f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0033000 tx=0x7f0ed00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.165+0000 7f0edcff9640 1 -- 172.21.15.29:0/344616016 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0003cc0 con 0x7f0ee00c2f80 2024-01-25T15:04:48.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.165+0000 7f0edcff9640 1 -- 172.21.15.29:0/344616016 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed0040070 con 0x7f0ee00c2f80 2024-01-25T15:04:48.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.165+0000 7f0edcff9640 1 -- 172.21.15.29:0/344616016 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed00476c0 con 0x7f0ee00c2f80 2024-01-25T15:04:48.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.165+0000 7fc14759e640 1 -- 172.21.15.29:0/3848807967 shutdown_connections 2024-01-25T15:04:48.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.165+0000 7fc14759e640 1 --2- 172.21.15.29:0/3848807967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc130003cb0 0x7fc1300040b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.165+0000 7fc14759e640 1 -- 172.21.15.29:0/3848807967 >> 172.21.15.29:0/3848807967 conn(0x7fc140048250 msgr2=0x7fc140048660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:48.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.165+0000 7f424c275640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42440676c0 0x7f42440ab070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.165+0000 7f0ee69c5640 1 -- 172.21.15.29:0/344616016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee00abd00 con 0x7f0ee00c2f80 2024-01-25T15:04:48.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7f424c275640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42440c18d0 0x7f4244147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7f424c275640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f42440c2150 0x7f424413af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7f424c275640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4244145e40 con 0x7f42440c18d0 2024-01-25T15:04:48.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7f424c275640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4244147150 con 0x7f42440676c0 2024-01-25T15:04:48.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7f424a011640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42440676c0 0x7f42440ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.165+0000 7ff4fd59a640 1 -- 172.21.15.29:0/428990924 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8009a50 con 0x7ff5000c2aa0 2024-01-25T15:04:48.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.165+0000 7ff4ff59e640 1 -- 172.21.15.29:0/428990924 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5000c2aa0 msgr2=0x7ff500071ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.165+0000 7ff4ff59e640 1 --2- 172.21.15.29:0/428990924 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5000c2aa0 0x7ff500071ca0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800be30 tx=0x7ff4f80092f0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7ff4ff59e640 1 -- 172.21.15.29:0/428990924 shutdown_connections 2024-01-25T15:04:48.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7ff4ff59e640 1 --2- 172.21.15.29:0/428990924 >> v2:172.21.15.52:3300/0 conn(0x7ff5000721e0 0x7ff50015bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7ff4ff59e640 1 --2- 172.21.15.29:0/428990924 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5000c2aa0 0x7ff500071ca0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7ff4ff59e640 1 -- 172.21.15.29:0/428990924 >> 172.21.15.29:0/428990924 conn(0x7ff5000a89e0 msgr2=0x7ff5000a8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:48.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7f0ee69c5640 1 -- 172.21.15.29:0/344616016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee01f26d0 con 0x7f0ee00c2f80 2024-01-25T15:04:48.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7fc14759e640 1 -- 172.21.15.29:0/3848807967 shutdown_connections 2024-01-25T15:04:48.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.165+0000 7f1b31a0a640 1 --2- 172.21.15.29:0/3687349057 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b18003a20 0x7f1b2c149f80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c034d80 tx=0x7f1b1c001b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7f424c275640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42440a9670 con 0x7f42440c2150 2024-01-25T15:04:48.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7fce57e51640 1 Processor -- start 2024-01-25T15:04:48.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7f8ea9eca640 1 Processor -- start 2024-01-25T15:04:48.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7fce57e51640 1 -- start start 2024-01-25T15:04:48.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7fc14759e640 1 -- 172.21.15.29:0/3848807967 wait complete. 2024-01-25T15:04:48.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7f424a011640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42440676c0 0x7f42440ab070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:33708/0 (socket says 172.21.15.29:33708) 2024-01-25T15:04:48.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7f424a011640 1 -- 172.21.15.29:0/1614483828 learned_addr learned my addr 172.21.15.29:0/1614483828 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:48.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7f1b227fc640 1 -- 172.21.15.29:0/3687349057 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c005ad0 con 0x7f1b18003a20 2024-01-25T15:04:48.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7f424a011640 1 -- 172.21.15.29:0/1614483828 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f42440c2150 msgr2=0x7f424413af00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-25T15:04:48.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7f424a011640 1 --2- 172.21.15.29:0/1614483828 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f42440c2150 0x7f424413af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7f424a011640 1 -- 172.21.15.29:0/1614483828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42440c18d0 msgr2=0x7f4244147570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-25T15:04:48.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7f1b33c6e640 1 -- 172.21.15.29:0/3687349057 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b2c1e9d00 con 0x7f1b18003a20 2024-01-25T15:04:48.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7f1b33c6e640 1 -- 172.21.15.29:0/3687349057 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2c1e9a00 con 0x7f1b18003a20 2024-01-25T15:04:48.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.167+0000 7f1b227fc640 1 -- 172.21.15.29:0/3687349057 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1c0015a0 con 0x7f1b18003a20 2024-01-25T15:04:48.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.167+0000 7f1b227fc640 1 -- 172.21.15.29:0/3687349057 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c001710 con 0x7f1b18003a20 2024-01-25T15:04:48.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.167+0000 7f4249810640 1 --2- 172.21.15.29:0/1614483828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42440c18d0 0x7f4244147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.167+0000 7f424a011640 1 --2- 172.21.15.29:0/1614483828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42440c18d0 0x7f4244147570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.167+0000 7f424a011640 1 -- 172.21.15.29:0/1614483828 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4240009400 con 0x7f42440676c0 2024-01-25T15:04:48.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.167+0000 7f4249810640 1 --2- 172.21.15.29:0/1614483828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42440c18d0 0x7f4244147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:48.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.167+0000 7f8ea9eca640 1 -- start start 2024-01-25T15:04:48.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.167+0000 7f424a011640 1 --2- 172.21.15.29:0/1614483828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42440676c0 0x7f42440ab070 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f423c00c7f0 tx=0x7f423c00ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.168+0000 7fc14759e640 1 Processor -- start 2024-01-25T15:04:48.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.167+0000 7fce57e51640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce5006dbc0 0x7fce501e8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.167+0000 7fce57e51640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce500abcf0 0x7fce500c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.167+0000 7fce57e51640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce50154090 0x7fce501536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.167+0000 7fce57e51640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce501eabf0 con 0x7fce5006dbc0 2024-01-25T15:04:48.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.168+0000 7f1b33c6e640 1 -- 172.21.15.29:0/3687349057 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b14005290 con 0x7f1b18003a20 2024-01-25T15:04:48.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7f0edcff9640 1 -- 172.21.15.29:0/344616016 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0ed0031a90 con 0x7f0ee00c2f80 2024-01-25T15:04:48.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.167+0000 7fce57e51640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce500c5790 con 0x7fce50154090 2024-01-25T15:04:48.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.168+0000 7fc14759e640 1 -- start start 2024-01-25T15:04:48.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7f8ea9eca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea40676c0 0x7f8ea4147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.167+0000 7fce57e51640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce500c5a30 con 0x7fce500abcf0 2024-01-25T15:04:48.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.168+0000 7fce55bed640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce5006dbc0 0x7fce501e8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.168+0000 7fce55bed640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce5006dbc0 0x7fce501e8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44744/0 (socket says 172.21.15.29:44744) 2024-01-25T15:04:48.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7f8ea9eca640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ea40c18d0 0x7f8ea4141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.168+0000 7fce55bed640 1 -- 172.21.15.29:0/3851761150 learned_addr learned my addr 172.21.15.29:0/3851761150 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:48.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.168+0000 7fce55bed640 1 -- 172.21.15.29:0/3851761150 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce500abcf0 msgr2=0x7fce500c5250 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-25T15:04:48.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.168+0000 7fce55bed640 1 --2- 172.21.15.29:0/3851761150 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce500abcf0 0x7fce500c5250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.168+0000 7fce55bed640 1 -- 172.21.15.29:0/3851761150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce50154090 msgr2=0x7fce501536f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-25T15:04:48.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.168+0000 7fce55bed640 1 --2- 172.21.15.29:0/3851761150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce50154090 0x7fce501536f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.168+0000 7fce55bed640 1 -- 172.21.15.29:0/3851761150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce48009a70 con 0x7fce5006dbc0 2024-01-25T15:04:48.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7f8ea9eca640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea40c2150 0x7f8ea413fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7fce55bed640 1 --2- 172.21.15.29:0/3851761150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce5006dbc0 0x7fce501e8230 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fce40011fa0 tx=0x7fce40007410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7f8ea37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea40676c0 0x7f8ea4147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7f0edcff9640 1 --2- 172.21.15.29:0/344616016 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0ecc06afa0 0x7f0ecc06d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7f8ea37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea40676c0 0x7f8ea4147390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44760/0 (socket says 172.21.15.29:44760) 2024-01-25T15:04:48.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7f0edcff9640 1 -- 172.21.15.29:0/344616016 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0ed0042070 con 0x7f0ee00c2f80 2024-01-25T15:04:48.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7f8ea9eca640 1 -- 172.21.15.29:0/3107554138 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea4150e00 con 0x7f8ea40676c0 2024-01-25T15:04:48.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7f8ea37fe640 1 -- 172.21.15.29:0/3107554138 learned_addr learned my addr 172.21.15.29:0/3107554138 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:48.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7f8ea9eca640 1 -- 172.21.15.29:0/3107554138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea414f650 con 0x7f8ea40c2150 2024-01-25T15:04:48.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7f8ea9eca640 1 -- 172.21.15.29:0/3107554138 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea41478d0 con 0x7f8ea40c18d0 2024-01-25T15:04:48.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7ff4ff59e640 1 -- 172.21.15.29:0/428990924 shutdown_connections 2024-01-25T15:04:48.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.166+0000 7ff4ff59e640 1 -- 172.21.15.29:0/428990924 wait complete. 2024-01-25T15:04:48.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.168+0000 7ff4ff59e640 1 Processor -- start 2024-01-25T15:04:48.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.168+0000 7ff4ff59e640 1 -- start start 2024-01-25T15:04:48.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7ff4ff59e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5000721e0 0x7ff5000c0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7ff4ff59e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5000c2aa0 0x7ff5002093d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7ff4ff59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff500155360 0x7ff5001543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7ff4ff59e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50020b8e0 con 0x7ff5000c2aa0 2024-01-25T15:04:48.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7ff4ff59e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5001548e0 con 0x7ff500155360 2024-01-25T15:04:48.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7ff4ff59e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5000bc7a0 con 0x7ff5000721e0 2024-01-25T15:04:48.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7ff4fdd9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5000c2aa0 0x7ff5002093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7ff4fdd9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5000c2aa0 0x7ff5002093d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44772/0 (socket says 172.21.15.29:44772) 2024-01-25T15:04:48.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7ff4fdd9b640 1 -- 172.21.15.29:0/1223503906 learned_addr learned my addr 172.21.15.29:0/1223503906 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:48.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7ff4fe59c640 1 --2- 172.21.15.29:0/1223503906 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5000721e0 0x7ff5000c0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7ff4fed9d640 1 --2- 172.21.15.29:0/1223503906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff500155360 0x7ff5001543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7f1b227fc640 1 -- 172.21.15.29:0/3687349057 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f1b1c015110 con 0x7f1b18003a20 2024-01-25T15:04:48.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7fc14759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc130003cb0 0x7fc140041d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7f0ee69c5640 1 -- 172.21.15.29:0/344616016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee0074010 con 0x7f0ee00c2f80 2024-01-25T15:04:48.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7fce467fc640 1 -- 172.21.15.29:0/3851761150 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40027070 con 0x7fce5006dbc0 2024-01-25T15:04:48.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7fce467fc640 1 -- 172.21.15.29:0/3851761150 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4000b070 con 0x7fce5006dbc0 2024-01-25T15:04:48.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7fc14759e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc140040bf0 0x7fc1400e0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7fc14759e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1401744b0 0x7fc140174960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7fc14759e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc140174ea0 con 0x7fc140040bf0 2024-01-25T15:04:48.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7fc14759e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc140042260 con 0x7fc130003cb0 2024-01-25T15:04:48.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7fc14759e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1400457b0 con 0x7fc1401744b0 2024-01-25T15:04:48.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7f0edffff640 1 --2- 172.21.15.29:0/344616016 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0ecc06afa0 0x7f0ecc06d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7ff4fe59c640 1 -- 172.21.15.29:0/1223503906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff500155360 msgr2=0x7ff5001543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7ff4fe59c640 1 --2- 172.21.15.29:0/1223503906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff500155360 0x7ff5001543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7ff4fe59c640 1 -- 172.21.15.29:0/1223503906 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5000c2aa0 msgr2=0x7ff5002093d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7f423affd640 1 -- 172.21.15.29:0/1614483828 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c00aa50 con 0x7f42440676c0 2024-01-25T15:04:48.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7f423affd640 1 -- 172.21.15.29:0/1614483828 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c00abb0 con 0x7f42440676c0 2024-01-25T15:04:48.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.169+0000 7f423affd640 1 -- 172.21.15.29:0/1614483828 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c012420 con 0x7f42440676c0 2024-01-25T15:04:48.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7f424c275640 1 -- 172.21.15.29:0/1614483828 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f424413b440 con 0x7f42440676c0 2024-01-25T15:04:48.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7fc14659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc130003cb0 0x7fc140041d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7fce467fc640 1 -- 172.21.15.29:0/3851761150 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40007e50 con 0x7fce5006dbc0 2024-01-25T15:04:48.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7fce57e51640 1 -- 172.21.15.29:0/3851761150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce501eae40 con 0x7fce5006dbc0 2024-01-25T15:04:48.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7fce57e51640 1 -- 172.21.15.29:0/3851761150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce501eb400 con 0x7fce5006dbc0 2024-01-25T15:04:48.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7f1b227fc640 1 --2- 172.21.15.29:0/3687349057 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1b1006afa0 0x7f1b1006d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7f424c275640 1 -- 172.21.15.29:0/1614483828 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42440abde0 con 0x7f42440676c0 2024-01-25T15:04:48.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.171+0000 7f1b227fc640 1 -- 172.21.15.29:0/3687349057 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1b1c0ab3a0 con 0x7f1b18003a20 2024-01-25T15:04:48.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7f8ea2ffd640 1 --2- 172.21.15.29:0/3107554138 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ea40c18d0 0x7f8ea4141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.170+0000 7f8ea3fff640 1 --2- 172.21.15.29:0/3107554138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea40c2150 0x7f8ea413fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.171+0000 7f8ea37fe640 1 -- 172.21.15.29:0/3107554138 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ea40c18d0 msgr2=0x7f8ea4141ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.171+0000 7f8ea37fe640 1 --2- 172.21.15.29:0/3107554138 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ea40c18d0 0x7f8ea4141ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.171+0000 7f8ea37fe640 1 -- 172.21.15.29:0/3107554138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea40c2150 msgr2=0x7f8ea413fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.171+0000 7f8ea37fe640 1 --2- 172.21.15.29:0/3107554138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea40c2150 0x7f8ea413fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.171+0000 7f8ea37fe640 1 -- 172.21.15.29:0/3107554138 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c009a70 con 0x7f8ea40676c0 2024-01-25T15:04:48.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.171+0000 7f1b31209640 1 --2- 172.21.15.29:0/3687349057 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1b1006afa0 0x7f1b1006d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.171+0000 7f8ea37fe640 1 --2- 172.21.15.29:0/3107554138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea40676c0 0x7f8ea4147390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800c500 tx=0x7f8e9800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.171+0000 7fc145d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc140040bf0 0x7fc1400e0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.171+0000 7fc145d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc140040bf0 0x7fc1400e0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44774/0 (socket says 172.21.15.29:44774) 2024-01-25T15:04:48.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.171+0000 7fc145d9b640 1 -- 172.21.15.29:0/1894425588 learned_addr learned my addr 172.21.15.29:0/1894425588 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:48.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.171+0000 7fc146d9d640 1 --2- 172.21.15.29:0/1894425588 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1401744b0 0x7fc140174960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.171+0000 7fc145d9b640 1 -- 172.21.15.29:0/1894425588 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1401744b0 msgr2=0x7fc140174960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.171+0000 7ff4fe59c640 1 --2- 172.21.15.29:0/1223503906 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5000c2aa0 0x7ff5002093d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.171+0000 7ff4fe59c640 1 -- 172.21.15.29:0/1223503906 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f800ba90 con 0x7ff5000721e0 2024-01-25T15:04:48.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.171+0000 7ff4fdd9b640 1 --2- 172.21.15.29:0/1223503906 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5000c2aa0 0x7ff5002093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:48.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.171+0000 7fc145d9b640 1 --2- 172.21.15.29:0/1894425588 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1401744b0 0x7fc140174960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.171+0000 7fc145d9b640 1 -- 172.21.15.29:0/1894425588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc130003cb0 msgr2=0x7fc140041d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.171+0000 7fc145d9b640 1 --2- 172.21.15.29:0/1894425588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc130003cb0 0x7fc140041d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.172+0000 7fc145d9b640 1 -- 172.21.15.29:0/1894425588 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc140173e60 con 0x7fc140040bf0 2024-01-25T15:04:48.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.172+0000 7ff4fe59c640 1 --2- 172.21.15.29:0/1223503906 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5000721e0 0x7ff5000c0c60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0005880 tx=0x7ff4f000cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.172+0000 7fce57e51640 1 -- 172.21.15.29:0/3851761150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce50067be0 con 0x7fce5006dbc0 2024-01-25T15:04:48.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.172+0000 7fc145d9b640 1 --2- 172.21.15.29:0/1894425588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc140040bf0 0x7fc1400e0c10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc13c00f8e0 tx=0x7fc13c00fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.172+0000 7f1b31209640 1 --2- 172.21.15.29:0/3687349057 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1b1006afa0 0x7f1b1006d460 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0c1af0 tx=0x7f1b28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.172+0000 7f424c275640 1 -- 172.21.15.29:0/1614483828 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4244071b60 con 0x7f42440676c0 2024-01-25T15:04:48.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.172+0000 7f0edffff640 1 --2- 172.21.15.29:0/344616016 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0ecc06afa0 0x7f0ecc06d460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4000f60 tx=0x7f0ed4006cd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.172+0000 7f423affd640 1 -- 172.21.15.29:0/1614483828 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f423c012580 con 0x7f42440676c0 2024-01-25T15:04:48.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.173+0000 7f423affd640 1 --2- 172.21.15.29:0/1614483828 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f422806af20 0x7f422806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.173+0000 7f423affd640 1 -- 172.21.15.29:0/1614483828 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f423c0897a0 con 0x7f42440676c0 2024-01-25T15:04:48.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.173+0000 7f4249810640 1 --2- 172.21.15.29:0/1614483828 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f422806af20 0x7f422806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.173+0000 7f4249810640 1 --2- 172.21.15.29:0/1614483828 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f422806af20 0x7f422806d3e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4240036000 tx=0x7f424003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.174+0000 7ff4eeffd640 1 -- 172.21.15.29:0/1223503906 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0005ab0 con 0x7ff5000721e0 2024-01-25T15:04:48.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.175+0000 7ff4ff59e640 1 -- 172.21.15.29:0/1223503906 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5000bca80 con 0x7ff5000721e0 2024-01-25T15:04:48.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.175+0000 7ff4eeffd640 1 -- 172.21.15.29:0/1223503906 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f0005c30 con 0x7ff5000721e0 2024-01-25T15:04:48.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.175+0000 7ff4ff59e640 1 -- 172.21.15.29:0/1223503906 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5000bcd60 con 0x7ff5000721e0 2024-01-25T15:04:48.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.175+0000 7ff4eeffd640 1 -- 172.21.15.29:0/1223503906 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f00072b0 con 0x7ff5000721e0 2024-01-25T15:04:48.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.175+0000 7f1b227fc640 1 -- 172.21.15.29:0/3687349057 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f1b1c0760a0 con 0x7f1b18003a20 2024-01-25T15:04:48.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.176+0000 7ff4ff59e640 1 -- 172.21.15.29:0/1223503906 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e4005290 con 0x7ff5000721e0 2024-01-25T15:04:48.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.176+0000 7ff4eeffd640 1 -- 172.21.15.29:0/1223503906 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ff4f0007410 con 0x7ff5000721e0 2024-01-25T15:04:48.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.177+0000 7ff4eeffd640 1 --2- 172.21.15.29:0/1223503906 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff4e006afd0 0x7ff4e006d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.177+0000 7ff4eeffd640 1 -- 172.21.15.29:0/1223503906 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff4f0088e20 con 0x7ff5000721e0 2024-01-25T15:04:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.177+0000 7f0edcff9640 1 -- 172.21.15.29:0/344616016 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f0ed0076ee0 con 0x7f0ee00c2f80 2024-01-25T15:04:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.177+0000 7ff4fdd9b640 1 --2- 172.21.15.29:0/1223503906 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff4e006afd0 0x7ff4e006d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.178+0000 7fc136ffd640 1 -- 172.21.15.29:0/1894425588 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c0053a0 con 0x7fc140040bf0 2024-01-25T15:04:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.177+0000 7f8e8bfff640 1 -- 172.21.15.29:0/3107554138 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98005ce0 con 0x7f8ea40676c0 2024-01-25T15:04:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.177+0000 7f8e8bfff640 1 -- 172.21.15.29:0/3107554138 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e98005e40 con 0x7f8ea40676c0 2024-01-25T15:04:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.177+0000 7f8e8bfff640 1 -- 172.21.15.29:0/3107554138 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e980072f0 con 0x7f8ea40676c0 2024-01-25T15:04:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.177+0000 7f8ea9eca640 1 -- 172.21.15.29:0/3107554138 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea4144cb0 con 0x7f8ea40676c0 2024-01-25T15:04:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.177+0000 7f8ea9eca640 1 -- 172.21.15.29:0/3107554138 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea4150460 con 0x7f8ea40676c0 2024-01-25T15:04:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.178+0000 7fc14759e640 1 -- 172.21.15.29:0/1894425588 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1400454d0 con 0x7fc140040bf0 2024-01-25T15:04:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.178+0000 7fc14759e640 1 -- 172.21.15.29:0/1894425588 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14003fae0 con 0x7fc140040bf0 2024-01-25T15:04:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.178+0000 7fc136ffd640 1 -- 172.21.15.29:0/1894425588 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c00d630 con 0x7fc140040bf0 2024-01-25T15:04:48.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.178+0000 7fc136ffd640 1 -- 172.21.15.29:0/1894425588 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c00d9e0 con 0x7fc140040bf0 2024-01-25T15:04:48.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.178+0000 7f8ea9eca640 1 -- 172.21.15.29:0/3107554138 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea4074010 con 0x7f8ea40676c0 2024-01-25T15:04:48.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.179+0000 7f423affd640 1 -- 172.21.15.29:0/1614483828 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f423c0543f0 con 0x7f42440676c0 2024-01-25T15:04:48.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.179+0000 7fce467fc640 1 -- 172.21.15.29:0/3851761150 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fce40011400 con 0x7fce5006dbc0 2024-01-25T15:04:48.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.180+0000 7ff4fdd9b640 1 --2- 172.21.15.29:0/1223503906 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff4e006afd0 0x7ff4e006d490 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff5000a4b90 tx=0x7ff4f800b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.180+0000 7fc14759e640 1 -- 172.21.15.29:0/1894425588 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12c005290 con 0x7fc140040bf0 2024-01-25T15:04:48.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.180+0000 7fce467fc640 1 --2- 172.21.15.29:0/3851761150 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fce3406aed0 0x7fce3406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.180+0000 7fce467fc640 1 -- 172.21.15.29:0/3851761150 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fce4009ac00 con 0x7fce5006dbc0 2024-01-25T15:04:48.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.180+0000 7fce553ec640 1 --2- 172.21.15.29:0/3851761150 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fce3406aed0 0x7fce3406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.181+0000 7fce553ec640 1 --2- 172.21.15.29:0/3851761150 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fce3406aed0 0x7fce3406d390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fce4c005880 tx=0x7fce4c001000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.181+0000 7ff4eeffd640 1 -- 172.21.15.29:0/1223503906 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7ff4f0053b20 con 0x7ff5000721e0 2024-01-25T15:04:48.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.185+0000 7fce467fc640 1 -- 172.21.15.29:0/3851761150 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fce400657c0 con 0x7fce5006dbc0 2024-01-25T15:04:48.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.190+0000 7f8e8bfff640 1 -- 172.21.15.29:0/3107554138 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8e98007450 con 0x7f8ea40676c0 2024-01-25T15:04:48.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.191+0000 7f8e8bfff640 1 --2- 172.21.15.29:0/3107554138 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8e9006aed0 0x7f8e9006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.191+0000 7f8e8bfff640 1 -- 172.21.15.29:0/3107554138 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8e98089690 con 0x7f8ea40676c0 2024-01-25T15:04:48.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.191+0000 7f8ea2ffd640 1 --2- 172.21.15.29:0/3107554138 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8e9006aed0 0x7f8e9006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.188+0000 7fc136ffd640 1 -- 172.21.15.29:0/1894425588 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fc13c00db40 con 0x7fc140040bf0 2024-01-25T15:04:48.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.188+0000 7fc136ffd640 1 --2- 172.21.15.29:0/1894425588 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc12806afa0 0x7fc12806d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.189+0000 7fc136ffd640 1 -- 172.21.15.29:0/1894425588 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc13c08a330 con 0x7fc140040bf0 2024-01-25T15:04:48.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.189+0000 7fc14659c640 1 --2- 172.21.15.29:0/1894425588 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc12806afa0 0x7fc12806d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.191+0000 7fc14659c640 1 --2- 172.21.15.29:0/1894425588 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc12806afa0 0x7fc12806d460 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc138033000 tx=0x7fc138009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.192+0000 7f8ea2ffd640 1 --2- 172.21.15.29:0/3107554138 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8e9006aed0 0x7f8e9006d390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c036000 tx=0x7f8e9c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.196+0000 7f8e8bfff640 1 -- 172.21.15.29:0/3107554138 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8e98057e20 con 0x7f8ea40676c0 2024-01-25T15:04:48.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.205+0000 7fc136ffd640 1 -- 172.21.15.29:0/1894425588 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fc13c054f80 con 0x7fc140040bf0 2024-01-25T15:04:48.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.516+0000 7f7c549f4640 1 -- 172.21.15.29:0/1343871973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f7c500a6cd0 con 0x7f7c500c4290 2024-01-25T15:04:48.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.517+0000 7f7c37fff640 1 -- 172.21.15.29:0/1343871973 <== mon.1 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7c48019020 con 0x7f7c500c4290 2024-01-25T15:04:48.518 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-01-25T15:04:48.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.521+0000 7f7c35ffb640 1 -- 172.21.15.29:0/1343871973 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7c3c06afa0 msgr2=0x7f7c3c06d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.521+0000 7f7c35ffb640 1 --2- 172.21.15.29:0/1343871973 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7c3c06afa0 0x7f7c3c06d460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7c44034000 tx=0x7f7c44008030 comp rx=0 tx=0).stop 2024-01-25T15:04:48.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.521+0000 7f7c35ffb640 1 -- 172.21.15.29:0/1343871973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c500c4290 msgr2=0x7f7c50144de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.521+0000 7f7c35ffb640 1 --2- 172.21.15.29:0/1343871973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c500c4290 0x7f7c50144de0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800ba80 tx=0x7f7c4800bf40 comp rx=0 tx=0).stop 2024-01-25T15:04:48.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.521+0000 7f7c35ffb640 1 -- 172.21.15.29:0/1343871973 shutdown_connections 2024-01-25T15:04:48.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.521+0000 7f7c35ffb640 1 --2- 172.21.15.29:0/1343871973 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c500c4c90 0x7f7c50153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.521+0000 7f7c35ffb640 1 --2- 172.21.15.29:0/1343871973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c500c4290 0x7f7c50144de0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.521+0000 7f7c35ffb640 1 --2- 172.21.15.29:0/1343871973 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7c3c06afa0 0x7f7c3c06d460 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.521+0000 7f7c35ffb640 1 --2- 172.21.15.29:0/1343871973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c5006dcb0 0x7f7c501448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.521+0000 7f7c35ffb640 1 -- 172.21.15.29:0/1343871973 >> 172.21.15.29:0/1343871973 conn(0x7f7c500c5b90 msgr2=0x7f7c500705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:48.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.521+0000 7f7c35ffb640 1 -- 172.21.15.29:0/1343871973 shutdown_connections 2024-01-25T15:04:48.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.521+0000 7f7c35ffb640 1 -- 172.21.15.29:0/1343871973 wait complete. 2024-01-25T15:04:48.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2024-01-25T15:04:48.539 DEBUG:teuthology.parallel:result is None 2024-01-25T15:04:48.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.560+0000 7f424c275640 1 -- 172.21.15.29:0/1614483828 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f424406ae60 con 0x7f42440676c0 2024-01-25T15:04:48.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.561+0000 7f423affd640 1 -- 172.21.15.29:0/1614483828 <== mon.1 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f423c003f70 con 0x7f42440676c0 2024-01-25T15:04:48.561 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-01-25T15:04:48.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.563+0000 7f424c275640 1 -- 172.21.15.29:0/1614483828 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f422806af20 msgr2=0x7f422806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.563+0000 7f424c275640 1 --2- 172.21.15.29:0/1614483828 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f422806af20 0x7f422806d3e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4240036000 tx=0x7f424003d040 comp rx=0 tx=0).stop 2024-01-25T15:04:48.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.563+0000 7f424c275640 1 -- 172.21.15.29:0/1614483828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42440676c0 msgr2=0x7f42440ab070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.563+0000 7f424c275640 1 --2- 172.21.15.29:0/1614483828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42440676c0 0x7f42440ab070 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f423c00c7f0 tx=0x7f423c00ccb0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.563+0000 7f424c275640 1 -- 172.21.15.29:0/1614483828 shutdown_connections 2024-01-25T15:04:48.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.563+0000 7f424c275640 1 --2- 172.21.15.29:0/1614483828 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f42440c2150 0x7f424413af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.563+0000 7f424c275640 1 --2- 172.21.15.29:0/1614483828 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f422806af20 0x7f422806d3e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.563+0000 7f424c275640 1 --2- 172.21.15.29:0/1614483828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42440c18d0 0x7f4244147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.563+0000 7f424c275640 1 --2- 172.21.15.29:0/1614483828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42440676c0 0x7f42440ab070 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.563+0000 7f424c275640 1 -- 172.21.15.29:0/1614483828 >> 172.21.15.29:0/1614483828 conn(0x7f424406a6c0 msgr2=0x7f424415fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:48.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.563+0000 7f424c275640 1 -- 172.21.15.29:0/1614483828 shutdown_connections 2024-01-25T15:04:48.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.563+0000 7f424c275640 1 -- 172.21.15.29:0/1614483828 wait complete. 2024-01-25T15:04:48.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2024-01-25T15:04:48.575 DEBUG:teuthology.parallel:result is None 2024-01-25T15:04:48.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.594+0000 7f1b33c6e640 1 -- 172.21.15.29:0/3687349057 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1b14005810 con 0x7f1b18003a20 2024-01-25T15:04:48.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.595+0000 7f1b227fc640 1 -- 172.21.15.29:0/3687349057 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b1c0796c0 con 0x7f1b18003a20 2024-01-25T15:04:48.596 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-01-25T15:04:48.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.597+0000 7f1b33c6e640 1 -- 172.21.15.29:0/3687349057 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1b1006afa0 msgr2=0x7f1b1006d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.597+0000 7f1b33c6e640 1 --2- 172.21.15.29:0/3687349057 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1b1006afa0 0x7f1b1006d460 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0c1af0 tx=0x7f1b28009040 comp rx=0 tx=0).stop 2024-01-25T15:04:48.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.597+0000 7f1b33c6e640 1 -- 172.21.15.29:0/3687349057 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b18003a20 msgr2=0x7f1b2c149f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.597+0000 7f1b33c6e640 1 --2- 172.21.15.29:0/3687349057 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b18003a20 0x7f1b2c149f80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c034d80 tx=0x7f1b1c001b70 comp rx=0 tx=0).stop 2024-01-25T15:04:48.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.597+0000 7fce57e51640 1 -- 172.21.15.29:0/3851761150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fce501eb5f0 con 0x7fce5006dbc0 2024-01-25T15:04:48.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.597+0000 7f1b33c6e640 1 -- 172.21.15.29:0/3687349057 shutdown_connections 2024-01-25T15:04:48.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.597+0000 7f1b33c6e640 1 --2- 172.21.15.29:0/3687349057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b2c150150 0x7f1b2c1e94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.597+0000 7f1b33c6e640 1 --2- 172.21.15.29:0/3687349057 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1b1006afa0 0x7f1b1006d460 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.597+0000 7f1b33c6e640 1 --2- 172.21.15.29:0/3687349057 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b2c14c700 0x7f1b2c14bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.597+0000 7f1b33c6e640 1 --2- 172.21.15.29:0/3687349057 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1b18003a20 0x7f1b2c149f80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.597+0000 7f1b33c6e640 1 -- 172.21.15.29:0/3687349057 >> 172.21.15.29:0/3687349057 conn(0x7f1b2c0c7f80 msgr2=0x7f1b2c1553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:48.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.597+0000 7f1b33c6e640 1 -- 172.21.15.29:0/3687349057 shutdown_connections 2024-01-25T15:04:48.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.597+0000 7f1b33c6e640 1 -- 172.21.15.29:0/3687349057 wait complete. 2024-01-25T15:04:48.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.598+0000 7fce467fc640 1 -- 172.21.15.29:0/3851761150 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fce4000d090 con 0x7fce5006dbc0 2024-01-25T15:04:48.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.598+0000 7f0ee69c5640 1 -- 172.21.15.29:0/344616016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0ee00ac780 con 0x7f0ee00c2f80 2024-01-25T15:04:48.601 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-01-25T15:04:48.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.598+0000 7f0edcff9640 1 -- 172.21.15.29:0/344616016 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0ed007a500 con 0x7f0ee00c2f80 2024-01-25T15:04:48.601 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-01-25T15:04:48.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.601+0000 7ff4ff59e640 1 -- 172.21.15.29:0/1223503906 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff4e4005540 con 0x7ff5000721e0 2024-01-25T15:04:48.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.601+0000 7fce57e51640 1 -- 172.21.15.29:0/3851761150 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fce3406aed0 msgr2=0x7fce3406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.601+0000 7fce57e51640 1 --2- 172.21.15.29:0/3851761150 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fce3406aed0 0x7fce3406d390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fce4c005880 tx=0x7fce4c001000 comp rx=0 tx=0).stop 2024-01-25T15:04:48.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.601+0000 7fce57e51640 1 -- 172.21.15.29:0/3851761150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce5006dbc0 msgr2=0x7fce501e8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.601+0000 7fce57e51640 1 --2- 172.21.15.29:0/3851761150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce5006dbc0 0x7fce501e8230 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fce40011fa0 tx=0x7fce40007410 comp rx=0 tx=0).stop 2024-01-25T15:04:48.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.601+0000 7fce57e51640 1 -- 172.21.15.29:0/3851761150 shutdown_connections 2024-01-25T15:04:48.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.601+0000 7fce57e51640 1 --2- 172.21.15.29:0/3851761150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce50154090 0x7fce501536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.601+0000 7fce57e51640 1 --2- 172.21.15.29:0/3851761150 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce500abcf0 0x7fce500c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.601+0000 7fce57e51640 1 --2- 172.21.15.29:0/3851761150 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fce3406aed0 0x7fce3406d390 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.601+0000 7fce57e51640 1 --2- 172.21.15.29:0/3851761150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce5006dbc0 0x7fce501e8230 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.601+0000 7fce57e51640 1 -- 172.21.15.29:0/3851761150 >> 172.21.15.29:0/3851761150 conn(0x7fce500c2a10 msgr2=0x7fce500aa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:48.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.601+0000 7fce57e51640 1 -- 172.21.15.29:0/3851761150 shutdown_connections 2024-01-25T15:04:48.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.601+0000 7fce57e51640 1 -- 172.21.15.29:0/3851761150 wait complete. 2024-01-25T15:04:48.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.601+0000 7f0ee69c5640 1 -- 172.21.15.29:0/344616016 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0ecc06afa0 msgr2=0x7f0ecc06d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.601+0000 7ff4eeffd640 1 -- 172.21.15.29:0/1223503906 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4f0057140 con 0x7ff5000721e0 2024-01-25T15:04:48.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.601+0000 7f0ee69c5640 1 --2- 172.21.15.29:0/344616016 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0ecc06afa0 0x7f0ecc06d460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4000f60 tx=0x7f0ed4006cd0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.604 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-01-25T15:04:48.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.601+0000 7f0ee69c5640 1 -- 172.21.15.29:0/344616016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ee00c2f80 msgr2=0x7f0ee01549f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.601+0000 7f0ee69c5640 1 --2- 172.21.15.29:0/344616016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ee00c2f80 0x7f0ee01549f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0033000 tx=0x7f0ed00046c0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.602+0000 7f0ee69c5640 1 -- 172.21.15.29:0/344616016 shutdown_connections 2024-01-25T15:04:48.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.602+0000 7f0ee69c5640 1 --2- 172.21.15.29:0/344616016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ee014b2a0 0x7f0ee0144550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.602+0000 7f0ee69c5640 1 --2- 172.21.15.29:0/344616016 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0ecc06afa0 0x7f0ecc06d460 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.602+0000 7f0ee69c5640 1 --2- 172.21.15.29:0/344616016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ee00c2f80 0x7f0ee01549f0 secure :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0033000 tx=0x7f0ed00046c0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.602+0000 7f0ee69c5640 1 --2- 172.21.15.29:0/344616016 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ee006d600 0x7f0ee014e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.602+0000 7f0ee69c5640 1 -- 172.21.15.29:0/344616016 >> 172.21.15.29:0/344616016 conn(0x7f0ee00c39b0 msgr2=0x7f0ee006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:48.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.602+0000 7f0ee69c5640 1 -- 172.21.15.29:0/344616016 shutdown_connections 2024-01-25T15:04:48.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.602+0000 7f0ee69c5640 1 -- 172.21.15.29:0/344616016 wait complete. 2024-01-25T15:04:48.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.605+0000 7ff4ff59e640 1 -- 172.21.15.29:0/1223503906 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff4e006afd0 msgr2=0x7ff4e006d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.605+0000 7ff4ff59e640 1 --2- 172.21.15.29:0/1223503906 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff4e006afd0 0x7ff4e006d490 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff5000a4b90 tx=0x7ff4f800b000 comp rx=0 tx=0).stop 2024-01-25T15:04:48.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.605+0000 7ff4ff59e640 1 -- 172.21.15.29:0/1223503906 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5000721e0 msgr2=0x7ff5000c0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.605+0000 7ff4ff59e640 1 --2- 172.21.15.29:0/1223503906 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5000721e0 0x7ff5000c0c60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0005880 tx=0x7ff4f000cbe0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.605+0000 7ff4ff59e640 1 -- 172.21.15.29:0/1223503906 shutdown_connections 2024-01-25T15:04:48.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.605+0000 7ff4ff59e640 1 --2- 172.21.15.29:0/1223503906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff500155360 0x7ff5001543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.605+0000 7ff4ff59e640 1 --2- 172.21.15.29:0/1223503906 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff4e006afd0 0x7ff4e006d490 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.605+0000 7ff4ff59e640 1 --2- 172.21.15.29:0/1223503906 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5000c2aa0 0x7ff5002093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.605+0000 7ff4ff59e640 1 --2- 172.21.15.29:0/1223503906 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff5000721e0 0x7ff5000c0c60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.605+0000 7ff4ff59e640 1 -- 172.21.15.29:0/1223503906 >> 172.21.15.29:0/1223503906 conn(0x7ff5000a89e0 msgr2=0x7ff50006b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:48.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.605+0000 7ff4ff59e640 1 -- 172.21.15.29:0/1223503906 shutdown_connections 2024-01-25T15:04:48.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.605+0000 7ff4ff59e640 1 -- 172.21.15.29:0/1223503906 wait complete. 2024-01-25T15:04:48.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.611+0000 7f8ea9eca640 1 -- 172.21.15.29:0/3107554138 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8ea414c690 con 0x7f8ea40676c0 2024-01-25T15:04:48.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.611+0000 7f8e8bfff640 1 -- 172.21.15.29:0/3107554138 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8e980579b0 con 0x7f8ea40676c0 2024-01-25T15:04:48.612 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-01-25T15:04:48.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2024-01-25T15:04:48.613 DEBUG:teuthology.parallel:result is None 2024-01-25T15:04:48.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.615+0000 7fc14759e640 1 -- 172.21.15.29:0/1894425588 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc12c005810 con 0x7fc140040bf0 2024-01-25T15:04:48.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.615+0000 7f8ea9eca640 1 -- 172.21.15.29:0/3107554138 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8e9006aed0 msgr2=0x7f8e9006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.615+0000 7f8ea9eca640 1 --2- 172.21.15.29:0/3107554138 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8e9006aed0 0x7f8e9006d390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c036000 tx=0x7f8e9c030000 comp rx=0 tx=0).stop 2024-01-25T15:04:48.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.615+0000 7f8ea9eca640 1 -- 172.21.15.29:0/3107554138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea40676c0 msgr2=0x7f8ea4147390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.615+0000 7f8ea9eca640 1 --2- 172.21.15.29:0/3107554138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea40676c0 0x7f8ea4147390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800c500 tx=0x7f8e9800c9c0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.615+0000 7f8ea9eca640 1 -- 172.21.15.29:0/3107554138 shutdown_connections 2024-01-25T15:04:48.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.615+0000 7f8ea9eca640 1 --2- 172.21.15.29:0/3107554138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea40c2150 0x7f8ea413fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.615+0000 7f8ea9eca640 1 --2- 172.21.15.29:0/3107554138 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ea40c18d0 0x7f8ea4141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.615+0000 7f8ea9eca640 1 --2- 172.21.15.29:0/3107554138 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8e9006aed0 0x7f8e9006d390 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.615+0000 7f8ea9eca640 1 --2- 172.21.15.29:0/3107554138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea40676c0 0x7f8ea4147390 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.615+0000 7f8ea9eca640 1 -- 172.21.15.29:0/3107554138 >> 172.21.15.29:0/3107554138 conn(0x7f8ea406a6c0 msgr2=0x7f8ea406aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:48.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.615+0000 7f8ea9eca640 1 -- 172.21.15.29:0/3107554138 shutdown_connections 2024-01-25T15:04:48.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.615+0000 7f8ea9eca640 1 -- 172.21.15.29:0/3107554138 wait complete. 2024-01-25T15:04:48.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.617+0000 7fc136ffd640 1 -- 172.21.15.29:0/1894425588 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc13c0585a0 con 0x7fc140040bf0 2024-01-25T15:04:48.618 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-01-25T15:04:48.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.619+0000 7fc14759e640 1 -- 172.21.15.29:0/1894425588 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc12806afa0 msgr2=0x7fc12806d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.619+0000 7fc14759e640 1 --2- 172.21.15.29:0/1894425588 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc12806afa0 0x7fc12806d460 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc138033000 tx=0x7fc138009030 comp rx=0 tx=0).stop 2024-01-25T15:04:48.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.619+0000 7fc14759e640 1 -- 172.21.15.29:0/1894425588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc140040bf0 msgr2=0x7fc1400e0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.619+0000 7fc14759e640 1 --2- 172.21.15.29:0/1894425588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc140040bf0 0x7fc1400e0c10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc13c00f8e0 tx=0x7fc13c00fda0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.619+0000 7fc14759e640 1 -- 172.21.15.29:0/1894425588 shutdown_connections 2024-01-25T15:04:48.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.619+0000 7fc14759e640 1 --2- 172.21.15.29:0/1894425588 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc1401744b0 0x7fc140174960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.619+0000 7fc14759e640 1 --2- 172.21.15.29:0/1894425588 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc12806afa0 0x7fc12806d460 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.619+0000 7fc14759e640 1 --2- 172.21.15.29:0/1894425588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc140040bf0 0x7fc1400e0c10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.619+0000 7fc14759e640 1 --2- 172.21.15.29:0/1894425588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc130003cb0 0x7fc140041d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.619+0000 7fc14759e640 1 -- 172.21.15.29:0/1894425588 >> 172.21.15.29:0/1894425588 conn(0x7fc140048250 msgr2=0x7fc1400e2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:48.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.619+0000 7fc14759e640 1 -- 172.21.15.29:0/1894425588 shutdown_connections 2024-01-25T15:04:48.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.619+0000 7fc14759e640 1 -- 172.21.15.29:0/1894425588 wait complete. 2024-01-25T15:04:48.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2024-01-25T15:04:48.622 DEBUG:teuthology.parallel:result is None 2024-01-25T15:04:48.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2024-01-25T15:04:48.623 DEBUG:teuthology.parallel:result is None 2024-01-25T15:04:48.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2024-01-25T15:04:48.625 DEBUG:teuthology.parallel:result is None 2024-01-25T15:04:48.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2024-01-25T15:04:48.630 DEBUG:teuthology.parallel:result is None 2024-01-25T15:04:48.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-01-25T15:04:48.632 DEBUG:teuthology.parallel:result is None 2024-01-25T15:04:48.632 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-25T15:04:48.632 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-25T15:04:48.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.773+0000 7fde685a4640 1 Processor -- start 2024-01-25T15:04:48.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.773+0000 7fde685a4640 1 -- start start 2024-01-25T15:04:48.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.774+0000 7fde685a4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fde6006b2b0 0x7fde6006b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.774+0000 7fde685a4640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde600c66b0 0x7fde6015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.774+0000 7fde685a4640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde601521d0 con 0x7fde601551a0 2024-01-25T15:04:48.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.774+0000 7fde685a4640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde6006be50 con 0x7fde6006b2b0 2024-01-25T15:04:48.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.774+0000 7fde685a4640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde600c5b10 con 0x7fde600c66b0 2024-01-25T15:04:48.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.774+0000 7fde66b41640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde600c66b0 0x7fde6015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.774+0000 7fde66340640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fde6006b2b0 0x7fde6006b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.774+0000 7fde66b41640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde600c66b0 0x7fde6015f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:40728/0 (socket says 172.21.15.29:40728) 2024-01-25T15:04:48.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.774+0000 7fde66b41640 1 -- 172.21.15.29:0/951705634 learned_addr learned my addr 172.21.15.29:0/951705634 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:48.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.774+0000 7fde66340640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fde6006b2b0 0x7fde6006b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:33734/0 (socket says 172.21.15.29:33734) 2024-01-25T15:04:48.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.775+0000 7fde66340640 1 -- 172.21.15.29:0/951705634 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde600c66b0 msgr2=0x7fde6015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:48.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.775+0000 7fde66340640 1 --2- 172.21.15.29:0/951705634 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde600c66b0 0x7fde6015f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.775+0000 7fde66340640 1 -- 172.21.15.29:0/951705634 >> v1:172.21.15.52:6789/0 conn(0x7fde601551a0 legacy=0x7fde600c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.775+0000 7fde66340640 1 -- 172.21.15.29:0/951705634 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde600c4f20 con 0x7fde6006b2b0 2024-01-25T15:04:48.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.775+0000 7fde6533e640 1 -- 172.21.15.29:0/951705634 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 334001752 0 0) 0x7fde601521d0 con 0x7fde601551a0 2024-01-25T15:04:48.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.775+0000 7fde66b41640 1 --2- 172.21.15.29:0/951705634 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde600c66b0 0x7fde6015f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:48.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.775+0000 7fde66340640 1 --2- 172.21.15.29:0/951705634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde6006b2b0 0x7fde6006b690 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fde580097a0 tx=0x7fde5802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbbc120a419c086b server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.776+0000 7fde6533e640 1 -- 172.21.15.29:0/951705634 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde58031780 con 0x7fde6006b2b0 2024-01-25T15:04:48.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.776+0000 7fde6533e640 1 -- 172.21.15.29:0/951705634 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde580318e0 con 0x7fde6006b2b0 2024-01-25T15:04:48.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.776+0000 7fde6533e640 1 -- 172.21.15.29:0/951705634 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde58031c70 con 0x7fde6006b2b0 2024-01-25T15:04:48.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.776+0000 7fde685a4640 1 -- 172.21.15.29:0/951705634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde6006b2b0 msgr2=0x7fde6006b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.776+0000 7fde685a4640 1 --2- 172.21.15.29:0/951705634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde6006b2b0 0x7fde6006b690 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fde580097a0 tx=0x7fde5802b820 comp rx=0 tx=0).stop 2024-01-25T15:04:48.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.776+0000 7fde685a4640 1 -- 172.21.15.29:0/951705634 shutdown_connections 2024-01-25T15:04:48.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.776+0000 7fde685a4640 1 --2- 172.21.15.29:0/951705634 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde600c66b0 0x7fde6015f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.776+0000 7fde685a4640 1 --2- 172.21.15.29:0/951705634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde6006b2b0 0x7fde6006b690 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.776+0000 7fde685a4640 1 -- 172.21.15.29:0/951705634 >> 172.21.15.29:0/951705634 conn(0x7fde600ca1f0 msgr2=0x7fde600ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:48.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.776+0000 7fde685a4640 1 -- 172.21.15.29:0/951705634 shutdown_connections 2024-01-25T15:04:48.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.776+0000 7fde685a4640 1 -- 172.21.15.29:0/951705634 wait complete. 2024-01-25T15:04:48.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.777+0000 7fde685a4640 1 Processor -- start 2024-01-25T15:04:48.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.777+0000 7fde685a4640 1 -- start start 2024-01-25T15:04:48.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.778+0000 7fde685a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde6006b2b0 0x7fde601ee190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.778+0000 7fde685a4640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde600c66b0 0x7fde6014aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.778+0000 7fde685a4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde601551a0 0x7fde600aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.778+0000 7fde685a4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde601ee6d0 con 0x7fde6006b2b0 2024-01-25T15:04:48.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.778+0000 7fde685a4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde600ad860 con 0x7fde601551a0 2024-01-25T15:04:48.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.778+0000 7fde685a4640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde601543e0 con 0x7fde600c66b0 2024-01-25T15:04:48.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.778+0000 7fde66340640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde6006b2b0 0x7fde601ee190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.778+0000 7fde66340640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde6006b2b0 0x7fde601ee190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44788/0 (socket says 172.21.15.29:44788) 2024-01-25T15:04:48.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.778+0000 7fde66340640 1 -- 172.21.15.29:0/1936471531 learned_addr learned my addr 172.21.15.29:0/1936471531 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:48.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.778+0000 7fde66b41640 1 --2- 172.21.15.29:0/1936471531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde601551a0 0x7fde600aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.778+0000 7fde65b3f640 1 --2- 172.21.15.29:0/1936471531 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde600c66b0 0x7fde6014aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.779+0000 7fde66340640 1 -- 172.21.15.29:0/1936471531 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde600c66b0 msgr2=0x7fde6014aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.779+0000 7fde66340640 1 --2- 172.21.15.29:0/1936471531 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde600c66b0 0x7fde6014aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.779+0000 7fde66340640 1 -- 172.21.15.29:0/1936471531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde601551a0 msgr2=0x7fde600aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.779+0000 7fde66340640 1 --2- 172.21.15.29:0/1936471531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde601551a0 0x7fde600aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.779+0000 7fde66340640 1 -- 172.21.15.29:0/1936471531 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde50009b30 con 0x7fde6006b2b0 2024-01-25T15:04:48.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.779+0000 7fde66340640 1 --2- 172.21.15.29:0/1936471531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde6006b2b0 0x7fde601ee190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fde580098c0 tx=0x7fde580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.779+0000 7fde5effd640 1 -- 172.21.15.29:0/1936471531 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde58032820 con 0x7fde6006b2b0 2024-01-25T15:04:48.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.779+0000 7fde5effd640 1 -- 172.21.15.29:0/1936471531 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde58032980 con 0x7fde6006b2b0 2024-01-25T15:04:48.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.779+0000 7fde685a4640 1 -- 172.21.15.29:0/1936471531 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde58009400 con 0x7fde6006b2b0 2024-01-25T15:04:48.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.779+0000 7fde5effd640 1 -- 172.21.15.29:0/1936471531 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde58032d30 con 0x7fde6006b2b0 2024-01-25T15:04:48.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.779+0000 7fde685a4640 1 -- 172.21.15.29:0/1936471531 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde600acc50 con 0x7fde6006b2b0 2024-01-25T15:04:48.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.780+0000 7fde685a4640 1 -- 172.21.15.29:0/1936471531 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde60074080 con 0x7fde6006b2b0 2024-01-25T15:04:48.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.780+0000 7fde5effd640 1 -- 172.21.15.29:0/1936471531 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fde5804e440 con 0x7fde6006b2b0 2024-01-25T15:04:48.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.781+0000 7fde5effd640 1 --2- 172.21.15.29:0/1936471531 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fde4c06aed0 0x7fde4c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:48.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.781+0000 7fde5effd640 1 -- 172.21.15.29:0/1936471531 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fde580ab7c0 con 0x7fde6006b2b0 2024-01-25T15:04:48.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.781+0000 7fde65b3f640 1 --2- 172.21.15.29:0/1936471531 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fde4c06aed0 0x7fde4c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:48.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.782+0000 7fde65b3f640 1 --2- 172.21.15.29:0/1936471531 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fde4c06aed0 0x7fde4c06d390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fde600c1290 tx=0x7fde54009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:48.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.785+0000 7fde5effd640 1 -- 172.21.15.29:0/1936471531 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fde580764e0 con 0x7fde6006b2b0 2024-01-25T15:04:48.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.962+0000 7fde685a4640 1 -- 172.21.15.29:0/1936471531 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fde60155600 con 0x7fde4c06aed0 2024-01-25T15:04:48.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.971+0000 7fde5effd640 1 -- 172.21.15.29:0/1936471531 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345254 (secure 0 0 0) 0x7fde5400f820 con 0x7fde4c06aed0 2024-01-25T15:04:48.975 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:48.979 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-25T15:04:48.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.974+0000 7fde685a4640 1 -- 172.21.15.29:0/1936471531 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fde4c06aed0 msgr2=0x7fde4c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.974+0000 7fde685a4640 1 --2- 172.21.15.29:0/1936471531 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fde4c06aed0 0x7fde4c06d390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fde600c1290 tx=0x7fde54009040 comp rx=0 tx=0).stop 2024-01-25T15:04:48.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.974+0000 7fde685a4640 1 -- 172.21.15.29:0/1936471531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde6006b2b0 msgr2=0x7fde601ee190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:48.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.974+0000 7fde685a4640 1 --2- 172.21.15.29:0/1936471531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde6006b2b0 0x7fde601ee190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fde580098c0 tx=0x7fde580046c0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.974+0000 7fde685a4640 1 -- 172.21.15.29:0/1936471531 shutdown_connections 2024-01-25T15:04:48.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.974+0000 7fde685a4640 1 --2- 172.21.15.29:0/1936471531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde601551a0 0x7fde600aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.974+0000 7fde685a4640 1 --2- 172.21.15.29:0/1936471531 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde600c66b0 0x7fde6014aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.974+0000 7fde685a4640 1 --2- 172.21.15.29:0/1936471531 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fde4c06aed0 0x7fde4c06d390 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.974+0000 7fde685a4640 1 --2- 172.21.15.29:0/1936471531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde6006b2b0 0x7fde601ee190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:48.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.974+0000 7fde685a4640 1 -- 172.21.15.29:0/1936471531 >> 172.21.15.29:0/1936471531 conn(0x7fde600ca1f0 msgr2=0x7fde60150bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:48.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.974+0000 7fde685a4640 1 -- 172.21.15.29:0/1936471531 shutdown_connections 2024-01-25T15:04:48.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:48.974+0000 7fde685a4640 1 -- 172.21.15.29:0/1936471531 wait complete. 2024-01-25T15:04:48.985 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-01-25T15:04:48.920871+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248496,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754726224,"statfs":{"total":773094113280,"available":772839653376,"internally_reserved":0,"allocated":3284992,"data_stored":1988350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003362"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027891+0000","last_change":"2024-01-25T15:04:26.549355+0000","last_active":"2024-01-25T15:04:33.027891+0000","last_peered":"2024-01-25T15:04:33.027891+0000","last_clean":"2024-01-25T15:04:33.027891+0000","last_became_active":"2024-01-25T15:04:26.549068+0000","last_became_peered":"2024-01-25T15:04:26.549068+0000","last_unstale":"2024-01-25T15:04:33.027891+0000","last_undegraded":"2024-01-25T15:04:33.027891+0000","last_fullsized":"2024-01-25T15:04:33.027891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:30:22.770050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518335+0000","last_change":"2024-01-25T15:04:27.536360+0000","last_active":"2024-01-25T15:04:32.518335+0000","last_peered":"2024-01-25T15:04:32.518335+0000","last_clean":"2024-01-25T15:04:32.518335+0000","last_became_active":"2024-01-25T15:04:27.534273+0000","last_became_peered":"2024-01-25T15:04:27.534273+0000","last_unstale":"2024-01-25T15:04:32.518335+0000","last_undegraded":"2024-01-25T15:04:32.518335+0000","last_fullsized":"2024-01-25T15:04:32.518335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:47:59.032295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517804+0000","last_change":"2024-01-25T15:04:31.803406+0000","last_active":"2024-01-25T15:04:32.517804+0000","last_peered":"2024-01-25T15:04:32.517804+0000","last_clean":"2024-01-25T15:04:32.517804+0000","last_became_active":"2024-01-25T15:04:31.803079+0000","last_became_peered":"2024-01-25T15:04:31.803079+0000","last_unstale":"2024-01-25T15:04:32.517804+0000","last_undegraded":"2024-01-25T15:04:32.517804+0000","last_fullsized":"2024-01-25T15:04:32.517804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:25:43.747285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518611+0000","last_change":"2024-01-25T15:04:26.545449+0000","last_active":"2024-01-25T15:04:32.518611+0000","last_peered":"2024-01-25T15:04:32.518611+0000","last_clean":"2024-01-25T15:04:32.518611+0000","last_became_active":"2024-01-25T15:04:26.545144+0000","last_became_peered":"2024-01-25T15:04:26.545144+0000","last_unstale":"2024-01-25T15:04:32.518611+0000","last_undegraded":"2024-01-25T15:04:32.518611+0000","last_fullsized":"2024-01-25T15:04:32.518611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:56:52.022913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027714+0000","last_change":"2024-01-25T15:04:27.523808+0000","last_active":"2024-01-25T15:04:33.027714+0000","last_peered":"2024-01-25T15:04:33.027714+0000","last_clean":"2024-01-25T15:04:33.027714+0000","last_became_active":"2024-01-25T15:04:27.523173+0000","last_became_peered":"2024-01-25T15:04:27.523173+0000","last_unstale":"2024-01-25T15:04:33.027714+0000","last_undegraded":"2024-01-25T15:04:33.027714+0000","last_fullsized":"2024-01-25T15:04:33.027714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:30.257021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227919+0000","last_change":"2024-01-25T15:04:31.589158+0000","last_active":"2024-01-25T15:04:33.227919+0000","last_peered":"2024-01-25T15:04:33.227919+0000","last_clean":"2024-01-25T15:04:33.227919+0000","last_became_active":"2024-01-25T15:04:31.588664+0000","last_became_peered":"2024-01-25T15:04:31.588664+0000","last_unstale":"2024-01-25T15:04:33.227919+0000","last_undegraded":"2024-01-25T15:04:33.227919+0000","last_fullsized":"2024-01-25T15:04:33.227919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:34.289728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228764+0000","last_change":"2024-01-25T15:04:26.548904+0000","last_active":"2024-01-25T15:04:33.228764+0000","last_peered":"2024-01-25T15:04:33.228764+0000","last_clean":"2024-01-25T15:04:33.228764+0000","last_became_active":"2024-01-25T15:04:26.548603+0000","last_became_peered":"2024-01-25T15:04:26.548603+0000","last_unstale":"2024-01-25T15:04:33.228764+0000","last_undegraded":"2024-01-25T15:04:33.228764+0000","last_fullsized":"2024-01-25T15:04:33.228764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:04:15.478889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227876+0000","last_change":"2024-01-25T15:04:27.524924+0000","last_active":"2024-01-25T15:04:33.227876+0000","last_peered":"2024-01-25T15:04:33.227876+0000","last_clean":"2024-01-25T15:04:33.227876+0000","last_became_active":"2024-01-25T15:04:27.524657+0000","last_became_peered":"2024-01-25T15:04:27.524657+0000","last_unstale":"2024-01-25T15:04:33.227876+0000","last_undegraded":"2024-01-25T15:04:33.227876+0000","last_fullsized":"2024-01-25T15:04:33.227876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:13:43.582651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228255+0000","last_change":"2024-01-25T15:04:31.589682+0000","last_active":"2024-01-25T15:04:33.228255+0000","last_peered":"2024-01-25T15:04:33.228255+0000","last_clean":"2024-01-25T15:04:33.228255+0000","last_became_active":"2024-01-25T15:04:31.589163+0000","last_became_peered":"2024-01-25T15:04:31.589163+0000","last_unstale":"2024-01-25T15:04:33.228255+0000","last_undegraded":"2024-01-25T15:04:33.228255+0000","last_fullsized":"2024-01-25T15:04:33.228255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:48:03.065003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228571+0000","last_change":"2024-01-25T15:04:26.550079+0000","last_active":"2024-01-25T15:04:33.228571+0000","last_peered":"2024-01-25T15:04:33.228571+0000","last_clean":"2024-01-25T15:04:33.228571+0000","last_became_active":"2024-01-25T15:04:26.549674+0000","last_became_peered":"2024-01-25T15:04:26.549674+0000","last_unstale":"2024-01-25T15:04:33.228571+0000","last_undegraded":"2024-01-25T15:04:33.228571+0000","last_fullsized":"2024-01-25T15:04:33.228571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:08:52.043568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228692+0000","last_change":"2024-01-25T15:04:27.523220+0000","last_active":"2024-01-25T15:04:33.228692+0000","last_peered":"2024-01-25T15:04:33.228692+0000","last_clean":"2024-01-25T15:04:33.228692+0000","last_became_active":"2024-01-25T15:04:27.522900+0000","last_became_peered":"2024-01-25T15:04:27.522900+0000","last_unstale":"2024-01-25T15:04:33.228692+0000","last_undegraded":"2024-01-25T15:04:33.228692+0000","last_fullsized":"2024-01-25T15:04:33.228692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:29:19.932806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228034+0000","last_change":"2024-01-25T15:04:31.582261+0000","last_active":"2024-01-25T15:04:33.228034+0000","last_peered":"2024-01-25T15:04:33.228034+0000","last_clean":"2024-01-25T15:04:33.228034+0000","last_became_active":"2024-01-25T15:04:31.581830+0000","last_became_peered":"2024-01-25T15:04:31.581830+0000","last_unstale":"2024-01-25T15:04:33.228034+0000","last_undegraded":"2024-01-25T15:04:33.228034+0000","last_fullsized":"2024-01-25T15:04:33.228034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:45:12.093528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518616+0000","last_change":"2024-01-25T15:04:27.528164+0000","last_active":"2024-01-25T15:04:32.518616+0000","last_peered":"2024-01-25T15:04:32.518616+0000","last_clean":"2024-01-25T15:04:32.518616+0000","last_became_active":"2024-01-25T15:04:27.527873+0000","last_became_peered":"2024-01-25T15:04:27.527873+0000","last_unstale":"2024-01-25T15:04:32.518616+0000","last_undegraded":"2024-01-25T15:04:32.518616+0000","last_fullsized":"2024-01-25T15:04:32.518616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:30:17.007992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229067+0000","last_change":"2024-01-25T15:04:26.552160+0000","last_active":"2024-01-25T15:04:33.229067+0000","last_peered":"2024-01-25T15:04:33.229067+0000","last_clean":"2024-01-25T15:04:33.229067+0000","last_became_active":"2024-01-25T15:04:26.551735+0000","last_became_peered":"2024-01-25T15:04:26.551735+0000","last_unstale":"2024-01-25T15:04:33.229067+0000","last_undegraded":"2024-01-25T15:04:33.229067+0000","last_fullsized":"2024-01-25T15:04:33.229067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:04:56.733153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229250+0000","last_change":"2024-01-25T15:04:31.589097+0000","last_active":"2024-01-25T15:04:33.229250+0000","last_peered":"2024-01-25T15:04:33.229250+0000","last_clean":"2024-01-25T15:04:33.229250+0000","last_became_active":"2024-01-25T15:04:31.588673+0000","last_became_peered":"2024-01-25T15:04:31.588673+0000","last_unstale":"2024-01-25T15:04:33.229250+0000","last_undegraded":"2024-01-25T15:04:33.229250+0000","last_fullsized":"2024-01-25T15:04:33.229250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:58:33.277497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518113+0000","last_change":"2024-01-25T15:04:27.537840+0000","last_active":"2024-01-25T15:04:32.518113+0000","last_peered":"2024-01-25T15:04:32.518113+0000","last_clean":"2024-01-25T15:04:32.518113+0000","last_became_active":"2024-01-25T15:04:27.537456+0000","last_became_peered":"2024-01-25T15:04:27.537456+0000","last_unstale":"2024-01-25T15:04:32.518113+0000","last_undegraded":"2024-01-25T15:04:32.518113+0000","last_fullsized":"2024-01-25T15:04:32.518113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:45:08.060821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188403+0000","last_change":"2024-01-25T15:04:26.548251+0000","last_active":"2024-01-25T15:04:33.188403+0000","last_peered":"2024-01-25T15:04:33.188403+0000","last_clean":"2024-01-25T15:04:33.188403+0000","last_became_active":"2024-01-25T15:04:26.547939+0000","last_became_peered":"2024-01-25T15:04:26.547939+0000","last_unstale":"2024-01-25T15:04:33.188403+0000","last_undegraded":"2024-01-25T15:04:33.188403+0000","last_fullsized":"2024-01-25T15:04:33.188403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:04:56.733153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228362+0000","last_change":"2024-01-25T15:04:31.590194+0000","last_active":"2024-01-25T15:04:33.228362+0000","last_peered":"2024-01-25T15:04:33.228362+0000","last_clean":"2024-01-25T15:04:33.228362+0000","last_became_active":"2024-01-25T15:04:31.589755+0000","last_became_peered":"2024-01-25T15:04:31.589755+0000","last_unstale":"2024-01-25T15:04:33.228362+0000","last_undegraded":"2024-01-25T15:04:33.228362+0000","last_fullsized":"2024-01-25T15:04:33.228362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:13:47.615358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518097+0000","last_change":"2024-01-25T15:04:27.529881+0000","last_active":"2024-01-25T15:04:32.518097+0000","last_peered":"2024-01-25T15:04:32.518097+0000","last_clean":"2024-01-25T15:04:32.518097+0000","last_became_active":"2024-01-25T15:04:27.529347+0000","last_became_peered":"2024-01-25T15:04:27.529347+0000","last_unstale":"2024-01-25T15:04:32.518097+0000","last_undegraded":"2024-01-25T15:04:32.518097+0000","last_fullsized":"2024-01-25T15:04:32.518097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:19:41.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188030+0000","last_change":"2024-01-25T15:04:26.549223+0000","last_active":"2024-01-25T15:04:33.188030+0000","last_peered":"2024-01-25T15:04:33.188030+0000","last_clean":"2024-01-25T15:04:33.188030+0000","last_became_active":"2024-01-25T15:04:26.548915+0000","last_became_peered":"2024-01-25T15:04:26.548915+0000","last_unstale":"2024-01-25T15:04:33.188030+0000","last_undegraded":"2024-01-25T15:04:33.188030+0000","last_fullsized":"2024-01-25T15:04:33.188030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:08:52.043568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188626+0000","last_change":"2024-01-25T15:04:31.801159+0000","last_active":"2024-01-25T15:04:33.188626+0000","last_peered":"2024-01-25T15:04:33.188626+0000","last_clean":"2024-01-25T15:04:33.188626+0000","last_became_active":"2024-01-25T15:04:31.800733+0000","last_became_peered":"2024-01-25T15:04:31.800733+0000","last_unstale":"2024-01-25T15:04:33.188626+0000","last_undegraded":"2024-01-25T15:04:33.188626+0000","last_fullsized":"2024-01-25T15:04:33.188626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:58:07.965682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229691+0000","last_change":"2024-01-25T15:04:27.529655+0000","last_active":"2024-01-25T15:04:33.229691+0000","last_peered":"2024-01-25T15:04:33.229691+0000","last_clean":"2024-01-25T15:04:33.229691+0000","last_became_active":"2024-01-25T15:04:27.529390+0000","last_became_peered":"2024-01-25T15:04:27.529390+0000","last_unstale":"2024-01-25T15:04:33.229691+0000","last_undegraded":"2024-01-25T15:04:33.229691+0000","last_fullsized":"2024-01-25T15:04:33.229691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:15:45.949448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227503+0000","last_change":"2024-01-25T15:04:26.548483+0000","last_active":"2024-01-25T15:04:33.227503+0000","last_peered":"2024-01-25T15:04:33.227503+0000","last_clean":"2024-01-25T15:04:33.227503+0000","last_became_active":"2024-01-25T15:04:26.548215+0000","last_became_peered":"2024-01-25T15:04:26.548215+0000","last_unstale":"2024-01-25T15:04:33.227503+0000","last_undegraded":"2024-01-25T15:04:33.227503+0000","last_fullsized":"2024-01-25T15:04:33.227503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:17:49.229771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228793+0000","last_change":"2024-01-25T15:04:31.588835+0000","last_active":"2024-01-25T15:04:33.228793+0000","last_peered":"2024-01-25T15:04:33.228793+0000","last_clean":"2024-01-25T15:04:33.228793+0000","last_became_active":"2024-01-25T15:04:31.588379+0000","last_became_peered":"2024-01-25T15:04:31.588379+0000","last_unstale":"2024-01-25T15:04:33.228793+0000","last_undegraded":"2024-01-25T15:04:33.228793+0000","last_fullsized":"2024-01-25T15:04:33.228793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:07:22.654442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.028081+0000","last_change":"2024-01-25T15:04:27.526537+0000","last_active":"2024-01-25T15:04:33.028081+0000","last_peered":"2024-01-25T15:04:33.028081+0000","last_clean":"2024-01-25T15:04:33.028081+0000","last_became_active":"2024-01-25T15:04:27.526228+0000","last_became_peered":"2024-01-25T15:04:27.526228+0000","last_unstale":"2024-01-25T15:04:33.028081+0000","last_undegraded":"2024-01-25T15:04:33.028081+0000","last_fullsized":"2024-01-25T15:04:33.028081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:30:17.007992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519264+0000","last_change":"2024-01-25T15:04:26.548972+0000","last_active":"2024-01-25T15:04:32.519264+0000","last_peered":"2024-01-25T15:04:32.519264+0000","last_clean":"2024-01-25T15:04:32.519264+0000","last_became_active":"2024-01-25T15:04:26.548698+0000","last_became_peered":"2024-01-25T15:04:26.548698+0000","last_unstale":"2024-01-25T15:04:32.519264+0000","last_undegraded":"2024-01-25T15:04:32.519264+0000","last_fullsized":"2024-01-25T15:04:32.519264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:04:56.733153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229547+0000","last_change":"2024-01-25T15:04:31.802696+0000","last_active":"2024-01-25T15:04:33.229547+0000","last_peered":"2024-01-25T15:04:33.229547+0000","last_clean":"2024-01-25T15:04:33.229547+0000","last_became_active":"2024-01-25T15:04:31.802303+0000","last_became_peered":"2024-01-25T15:04:31.802303+0000","last_unstale":"2024-01-25T15:04:33.229547+0000","last_undegraded":"2024-01-25T15:04:33.229547+0000","last_fullsized":"2024-01-25T15:04:33.229547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:47:52.136422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518826+0000","last_change":"2024-01-25T15:04:27.539946+0000","last_active":"2024-01-25T15:04:32.518826+0000","last_peered":"2024-01-25T15:04:32.518826+0000","last_clean":"2024-01-25T15:04:32.518826+0000","last_became_active":"2024-01-25T15:04:27.539623+0000","last_became_peered":"2024-01-25T15:04:27.539623+0000","last_unstale":"2024-01-25T15:04:32.518826+0000","last_undegraded":"2024-01-25T15:04:32.518826+0000","last_fullsized":"2024-01-25T15:04:32.518826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:07:18.621735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188491+0000","last_change":"2024-01-25T15:04:26.545936+0000","last_active":"2024-01-25T15:04:33.188491+0000","last_peered":"2024-01-25T15:04:33.188491+0000","last_clean":"2024-01-25T15:04:33.188491+0000","last_became_active":"2024-01-25T15:04:26.545607+0000","last_became_peered":"2024-01-25T15:04:26.545607+0000","last_unstale":"2024-01-25T15:04:33.188491+0000","last_undegraded":"2024-01-25T15:04:33.188491+0000","last_fullsized":"2024-01-25T15:04:33.188491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:15:44.944688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517706+0000","last_change":"2024-01-25T15:04:31.804100+0000","last_active":"2024-01-25T15:04:32.517706+0000","last_peered":"2024-01-25T15:04:32.517706+0000","last_clean":"2024-01-25T15:04:32.517706+0000","last_became_active":"2024-01-25T15:04:31.803678+0000","last_became_peered":"2024-01-25T15:04:31.803678+0000","last_unstale":"2024-01-25T15:04:32.517706+0000","last_undegraded":"2024-01-25T15:04:32.517706+0000","last_fullsized":"2024-01-25T15:04:32.517706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:41:20.297981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188527+0000","last_change":"2024-01-25T15:04:27.530931+0000","last_active":"2024-01-25T15:04:33.188527+0000","last_peered":"2024-01-25T15:04:33.188527+0000","last_clean":"2024-01-25T15:04:33.188527+0000","last_became_active":"2024-01-25T15:04:27.530621+0000","last_became_peered":"2024-01-25T15:04:27.530621+0000","last_unstale":"2024-01-25T15:04:33.188527+0000","last_undegraded":"2024-01-25T15:04:33.188527+0000","last_fullsized":"2024-01-25T15:04:33.188527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:19:41.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228955+0000","last_change":"2024-01-25T15:04:26.548270+0000","last_active":"2024-01-25T15:04:33.228955+0000","last_peered":"2024-01-25T15:04:33.228955+0000","last_clean":"2024-01-25T15:04:33.228955+0000","last_became_active":"2024-01-25T15:04:26.547977+0000","last_became_peered":"2024-01-25T15:04:26.547977+0000","last_unstale":"2024-01-25T15:04:33.228955+0000","last_undegraded":"2024-01-25T15:04:33.228955+0000","last_fullsized":"2024-01-25T15:04:33.228955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:40:17.099358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027687+0000","last_change":"2024-01-25T15:04:31.800974+0000","last_active":"2024-01-25T15:04:33.027687+0000","last_peered":"2024-01-25T15:04:33.027687+0000","last_clean":"2024-01-25T15:04:33.027687+0000","last_became_active":"2024-01-25T15:04:31.800562+0000","last_became_peered":"2024-01-25T15:04:31.800562+0000","last_unstale":"2024-01-25T15:04:33.027687+0000","last_undegraded":"2024-01-25T15:04:33.027687+0000","last_fullsized":"2024-01-25T15:04:33.027687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:55:06.438077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228790+0000","last_change":"2024-01-25T15:04:27.531901+0000","last_active":"2024-01-25T15:04:33.228790+0000","last_peered":"2024-01-25T15:04:33.228790+0000","last_clean":"2024-01-25T15:04:33.228790+0000","last_became_active":"2024-01-25T15:04:27.531519+0000","last_became_peered":"2024-01-25T15:04:27.531519+0000","last_unstale":"2024-01-25T15:04:33.228790+0000","last_undegraded":"2024-01-25T15:04:33.228790+0000","last_fullsized":"2024-01-25T15:04:33.228790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:47:48.103715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188610+0000","last_change":"2024-01-25T15:04:26.544391+0000","last_active":"2024-01-25T15:04:33.188610+0000","last_peered":"2024-01-25T15:04:33.188610+0000","last_clean":"2024-01-25T15:04:33.188610+0000","last_became_active":"2024-01-25T15:04:26.544092+0000","last_became_peered":"2024-01-25T15:04:26.544092+0000","last_unstale":"2024-01-25T15:04:33.188610+0000","last_undegraded":"2024-01-25T15:04:33.188610+0000","last_fullsized":"2024-01-25T15:04:33.188610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:17:49.229771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188192+0000","last_change":"2024-01-25T15:04:31.588590+0000","last_active":"2024-01-25T15:04:33.188192+0000","last_peered":"2024-01-25T15:04:33.188192+0000","last_clean":"2024-01-25T15:04:33.188192+0000","last_became_active":"2024-01-25T15:04:31.588221+0000","last_became_peered":"2024-01-25T15:04:31.588221+0000","last_unstale":"2024-01-25T15:04:33.188192+0000","last_undegraded":"2024-01-25T15:04:33.188192+0000","last_fullsized":"2024-01-25T15:04:33.188192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:04.647058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229204+0000","last_change":"2024-01-25T15:04:27.535794+0000","last_active":"2024-01-25T15:04:33.229204+0000","last_peered":"2024-01-25T15:04:33.229204+0000","last_clean":"2024-01-25T15:04:33.229204+0000","last_became_active":"2024-01-25T15:04:27.535528+0000","last_became_peered":"2024-01-25T15:04:27.535528+0000","last_unstale":"2024-01-25T15:04:33.229204+0000","last_undegraded":"2024-01-25T15:04:33.229204+0000","last_fullsized":"2024-01-25T15:04:33.229204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:04:57.737913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229149+0000","last_change":"2024-01-25T15:04:26.543493+0000","last_active":"2024-01-25T15:04:33.229149+0000","last_peered":"2024-01-25T15:04:33.229149+0000","last_clean":"2024-01-25T15:04:33.229149+0000","last_became_active":"2024-01-25T15:04:26.543214+0000","last_became_peered":"2024-01-25T15:04:26.543214+0000","last_unstale":"2024-01-25T15:04:33.229149+0000","last_undegraded":"2024-01-25T15:04:33.229149+0000","last_fullsized":"2024-01-25T15:04:33.229149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:56:52.022913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188481+0000","last_change":"2024-01-25T15:04:31.589300+0000","last_active":"2024-01-25T15:04:33.188481+0000","last_peered":"2024-01-25T15:04:33.188481+0000","last_clean":"2024-01-25T15:04:33.188481+0000","last_became_active":"2024-01-25T15:04:31.588325+0000","last_became_peered":"2024-01-25T15:04:31.588325+0000","last_unstale":"2024-01-25T15:04:33.188481+0000","last_undegraded":"2024-01-25T15:04:33.188481+0000","last_fullsized":"2024-01-25T15:04:33.188481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:55:06.438077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.187995+0000","last_change":"2024-01-25T15:04:27.530775+0000","last_active":"2024-01-25T15:04:33.187995+0000","last_peered":"2024-01-25T15:04:33.187995+0000","last_clean":"2024-01-25T15:04:33.187995+0000","last_became_active":"2024-01-25T15:04:27.530457+0000","last_became_peered":"2024-01-25T15:04:27.530457+0000","last_unstale":"2024-01-25T15:04:33.187995+0000","last_undegraded":"2024-01-25T15:04:33.187995+0000","last_fullsized":"2024-01-25T15:04:33.187995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:30:17.007992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519122+0000","last_change":"2024-01-25T15:04:26.542850+0000","last_active":"2024-01-25T15:04:32.519122+0000","last_peered":"2024-01-25T15:04:32.519122+0000","last_clean":"2024-01-25T15:04:32.519122+0000","last_became_active":"2024-01-25T15:04:26.542553+0000","last_became_peered":"2024-01-25T15:04:26.542553+0000","last_unstale":"2024-01-25T15:04:32.519122+0000","last_undegraded":"2024-01-25T15:04:32.519122+0000","last_fullsized":"2024-01-25T15:04:32.519122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:00:16.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188633+0000","last_change":"2024-01-25T15:04:31.587087+0000","last_active":"2024-01-25T15:04:33.188633+0000","last_peered":"2024-01-25T15:04:33.188633+0000","last_clean":"2024-01-25T15:04:33.188633+0000","last_became_active":"2024-01-25T15:04:31.586473+0000","last_became_peered":"2024-01-25T15:04:31.586473+0000","last_unstale":"2024-01-25T15:04:33.188633+0000","last_undegraded":"2024-01-25T15:04:33.188633+0000","last_fullsized":"2024-01-25T15:04:33.188633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:48:53.794961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027426+0000","last_change":"2024-01-25T15:04:27.523437+0000","last_active":"2024-01-25T15:04:33.027426+0000","last_peered":"2024-01-25T15:04:33.027426+0000","last_clean":"2024-01-25T15:04:33.027426+0000","last_became_active":"2024-01-25T15:04:27.523120+0000","last_became_peered":"2024-01-25T15:04:27.523120+0000","last_unstale":"2024-01-25T15:04:33.027426+0000","last_undegraded":"2024-01-25T15:04:33.027426+0000","last_fullsized":"2024-01-25T15:04:33.027426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:55:39.574847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227614+0000","last_change":"2024-01-25T15:04:26.548357+0000","last_active":"2024-01-25T15:04:33.227614+0000","last_peered":"2024-01-25T15:04:33.227614+0000","last_clean":"2024-01-25T15:04:33.227614+0000","last_became_active":"2024-01-25T15:04:26.548083+0000","last_became_peered":"2024-01-25T15:04:26.548083+0000","last_unstale":"2024-01-25T15:04:33.227614+0000","last_undegraded":"2024-01-25T15:04:33.227614+0000","last_fullsized":"2024-01-25T15:04:33.227614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:15:44.944688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.028012+0000","last_change":"2024-01-25T15:04:31.802800+0000","last_active":"2024-01-25T15:04:33.028012+0000","last_peered":"2024-01-25T15:04:33.028012+0000","last_clean":"2024-01-25T15:04:33.028012+0000","last_became_active":"2024-01-25T15:04:31.802424+0000","last_became_peered":"2024-01-25T15:04:31.802424+0000","last_unstale":"2024-01-25T15:04:33.028012+0000","last_undegraded":"2024-01-25T15:04:33.028012+0000","last_fullsized":"2024-01-25T15:04:33.028012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:21:03.688233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517912+0000","last_change":"2024-01-25T15:04:27.540477+0000","last_active":"2024-01-25T15:04:32.517912+0000","last_peered":"2024-01-25T15:04:32.517912+0000","last_clean":"2024-01-25T15:04:32.517912+0000","last_became_active":"2024-01-25T15:04:27.539902+0000","last_became_peered":"2024-01-25T15:04:27.539902+0000","last_unstale":"2024-01-25T15:04:32.517912+0000","last_undegraded":"2024-01-25T15:04:32.517912+0000","last_fullsized":"2024-01-25T15:04:32.517912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:58:29.244789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228206+0000","last_change":"2024-01-25T15:04:26.552279+0000","last_active":"2024-01-25T15:04:33.228206+0000","last_peered":"2024-01-25T15:04:33.228206+0000","last_clean":"2024-01-25T15:04:33.228206+0000","last_became_active":"2024-01-25T15:04:26.552022+0000","last_became_peered":"2024-01-25T15:04:26.552022+0000","last_unstale":"2024-01-25T15:04:33.228206+0000","last_undegraded":"2024-01-25T15:04:33.228206+0000","last_fullsized":"2024-01-25T15:04:33.228206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:30:22.770050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227688+0000","last_change":"2024-01-25T15:04:16.181635+0000","last_active":"2024-01-25T15:04:33.227688+0000","last_peered":"2024-01-25T15:04:33.227688+0000","last_clean":"2024-01-25T15:04:33.227688+0000","last_became_active":"2024-01-25T15:04:16.179890+0000","last_became_peered":"2024-01-25T15:04:16.179890+0000","last_unstale":"2024-01-25T15:04:33.227688+0000","last_undegraded":"2024-01-25T15:04:33.227688+0000","last_fullsized":"2024-01-25T15:04:33.227688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_clean_scrub_stamp":"2024-01-25T15:04:14.956188+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:49:00.618327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518629+0000","last_change":"2024-01-25T15:04:31.805290+0000","last_active":"2024-01-25T15:04:32.518629+0000","last_peered":"2024-01-25T15:04:32.518629+0000","last_clean":"2024-01-25T15:04:32.518629+0000","last_became_active":"2024-01-25T15:04:31.804864+0000","last_became_peered":"2024-01-25T15:04:31.804864+0000","last_unstale":"2024-01-25T15:04:32.518629+0000","last_undegraded":"2024-01-25T15:04:32.518629+0000","last_fullsized":"2024-01-25T15:04:32.518629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:04.647058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228586+0000","last_change":"2024-01-25T15:04:27.541813+0000","last_active":"2024-01-25T15:04:33.228586+0000","last_peered":"2024-01-25T15:04:33.228586+0000","last_clean":"2024-01-25T15:04:33.228586+0000","last_became_active":"2024-01-25T15:04:27.541486+0000","last_became_peered":"2024-01-25T15:04:27.541486+0000","last_unstale":"2024-01-25T15:04:33.228586+0000","last_undegraded":"2024-01-25T15:04:33.228586+0000","last_fullsized":"2024-01-25T15:04:33.228586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:55:02.405369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519311+0000","last_change":"2024-01-25T15:04:26.552363+0000","last_active":"2024-01-25T15:04:32.519311+0000","last_peered":"2024-01-25T15:04:32.519311+0000","last_clean":"2024-01-25T15:04:32.519311+0000","last_became_active":"2024-01-25T15:04:26.552012+0000","last_became_peered":"2024-01-25T15:04:26.552012+0000","last_unstale":"2024-01-25T15:04:32.519311+0000","last_undegraded":"2024-01-25T15:04:32.519311+0000","last_fullsized":"2024-01-25T15:04:32.519311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:30:22.770050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518534+0000","last_change":"2024-01-25T15:04:31.803682+0000","last_active":"2024-01-25T15:04:32.518534+0000","last_peered":"2024-01-25T15:04:32.518534+0000","last_clean":"2024-01-25T15:04:32.518534+0000","last_became_active":"2024-01-25T15:04:31.803296+0000","last_became_peered":"2024-01-25T15:04:31.803296+0000","last_unstale":"2024-01-25T15:04:32.518534+0000","last_undegraded":"2024-01-25T15:04:32.518534+0000","last_fullsized":"2024-01-25T15:04:32.518534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:58:33.277497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227972+0000","last_change":"2024-01-25T15:04:27.536077+0000","last_active":"2024-01-25T15:04:33.227972+0000","last_peered":"2024-01-25T15:04:33.227972+0000","last_clean":"2024-01-25T15:04:33.227972+0000","last_became_active":"2024-01-25T15:04:27.535816+0000","last_became_peered":"2024-01-25T15:04:27.535816+0000","last_unstale":"2024-01-25T15:04:33.227972+0000","last_undegraded":"2024-01-25T15:04:33.227972+0000","last_fullsized":"2024-01-25T15:04:33.227972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:58:03.932974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188722+0000","last_change":"2024-01-25T15:04:26.540088+0000","last_active":"2024-01-25T15:04:33.188722+0000","last_peered":"2024-01-25T15:04:33.188722+0000","last_clean":"2024-01-25T15:04:33.188722+0000","last_became_active":"2024-01-25T15:04:26.539758+0000","last_became_peered":"2024-01-25T15:04:26.539758+0000","last_unstale":"2024-01-25T15:04:33.188722+0000","last_undegraded":"2024-01-25T15:04:33.188722+0000","last_fullsized":"2024-01-25T15:04:33.188722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:09:05.578946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027869+0000","last_change":"2024-01-25T15:04:31.588679+0000","last_active":"2024-01-25T15:04:33.027869+0000","last_peered":"2024-01-25T15:04:33.027869+0000","last_clean":"2024-01-25T15:04:33.027869+0000","last_became_active":"2024-01-25T15:04:31.588266+0000","last_became_peered":"2024-01-25T15:04:31.588266+0000","last_unstale":"2024-01-25T15:04:33.027869+0000","last_undegraded":"2024-01-25T15:04:33.027869+0000","last_fullsized":"2024-01-25T15:04:33.027869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:48:53.794961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229583+0000","last_change":"2024-01-25T15:04:27.539641+0000","last_active":"2024-01-25T15:04:33.229583+0000","last_peered":"2024-01-25T15:04:33.229583+0000","last_clean":"2024-01-25T15:04:33.229583+0000","last_became_active":"2024-01-25T15:04:27.539345+0000","last_became_peered":"2024-01-25T15:04:27.539345+0000","last_unstale":"2024-01-25T15:04:33.229583+0000","last_undegraded":"2024-01-25T15:04:33.229583+0000","last_fullsized":"2024-01-25T15:04:33.229583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:53:55.186236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519214+0000","last_change":"2024-01-25T15:04:26.534562+0000","last_active":"2024-01-25T15:04:32.519214+0000","last_peered":"2024-01-25T15:04:32.519214+0000","last_clean":"2024-01-25T15:04:32.519214+0000","last_became_active":"2024-01-25T15:04:26.534281+0000","last_became_peered":"2024-01-25T15:04:26.534281+0000","last_unstale":"2024-01-25T15:04:32.519214+0000","last_undegraded":"2024-01-25T15:04:32.519214+0000","last_fullsized":"2024-01-25T15:04:32.519214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:05:27.178453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227545+0000","last_change":"2024-01-25T15:04:31.802670+0000","last_active":"2024-01-25T15:04:33.227545+0000","last_peered":"2024-01-25T15:04:33.227545+0000","last_clean":"2024-01-25T15:04:33.227545+0000","last_became_active":"2024-01-25T15:04:31.802294+0000","last_became_peered":"2024-01-25T15:04:31.802294+0000","last_unstale":"2024-01-25T15:04:33.227545+0000","last_undegraded":"2024-01-25T15:04:33.227545+0000","last_fullsized":"2024-01-25T15:04:33.227545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:53:59.218943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228093+0000","last_change":"2024-01-25T15:04:27.539159+0000","last_active":"2024-01-25T15:04:33.228093+0000","last_peered":"2024-01-25T15:04:33.228093+0000","last_clean":"2024-01-25T15:04:33.228093+0000","last_became_active":"2024-01-25T15:04:27.538865+0000","last_became_peered":"2024-01-25T15:04:27.538865+0000","last_unstale":"2024-01-25T15:04:33.228093+0000","last_undegraded":"2024-01-25T15:04:33.228093+0000","last_fullsized":"2024-01-25T15:04:33.228093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:47:48.103715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228169+0000","last_change":"2024-01-25T15:04:26.545573+0000","last_active":"2024-01-25T15:04:33.228169+0000","last_peered":"2024-01-25T15:04:33.228169+0000","last_clean":"2024-01-25T15:04:33.228169+0000","last_became_active":"2024-01-25T15:04:26.545279+0000","last_became_peered":"2024-01-25T15:04:26.545279+0000","last_unstale":"2024-01-25T15:04:33.228169+0000","last_undegraded":"2024-01-25T15:04:33.228169+0000","last_fullsized":"2024-01-25T15:04:33.228169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:45:28.838538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229521+0000","last_change":"2024-01-25T15:04:31.590311+0000","last_active":"2024-01-25T15:04:33.229521+0000","last_peered":"2024-01-25T15:04:33.229521+0000","last_clean":"2024-01-25T15:04:33.229521+0000","last_became_active":"2024-01-25T15:04:31.589798+0000","last_became_peered":"2024-01-25T15:04:31.589798+0000","last_unstale":"2024-01-25T15:04:33.229521+0000","last_undegraded":"2024-01-25T15:04:33.229521+0000","last_fullsized":"2024-01-25T15:04:33.229521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:04.647058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227885+0000","last_change":"2024-01-25T15:04:27.539911+0000","last_active":"2024-01-25T15:04:33.227885+0000","last_peered":"2024-01-25T15:04:33.227885+0000","last_clean":"2024-01-25T15:04:33.227885+0000","last_became_active":"2024-01-25T15:04:27.539414+0000","last_became_peered":"2024-01-25T15:04:27.539414+0000","last_unstale":"2024-01-25T15:04:33.227885+0000","last_undegraded":"2024-01-25T15:04:33.227885+0000","last_fullsized":"2024-01-25T15:04:33.227885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:07:18.621735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518745+0000","last_change":"2024-01-25T15:04:26.538656+0000","last_active":"2024-01-25T15:04:32.518745+0000","last_peered":"2024-01-25T15:04:32.518745+0000","last_clean":"2024-01-25T15:04:32.518745+0000","last_became_active":"2024-01-25T15:04:26.538352+0000","last_became_peered":"2024-01-25T15:04:26.538352+0000","last_unstale":"2024-01-25T15:04:32.518745+0000","last_undegraded":"2024-01-25T15:04:32.518745+0000","last_fullsized":"2024-01-25T15:04:32.518745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:56:52.022913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027848+0000","last_change":"2024-01-25T15:04:31.581015+0000","last_active":"2024-01-25T15:04:33.027848+0000","last_peered":"2024-01-25T15:04:33.027848+0000","last_clean":"2024-01-25T15:04:33.027848+0000","last_became_active":"2024-01-25T15:04:31.580253+0000","last_became_peered":"2024-01-25T15:04:31.580253+0000","last_unstale":"2024-01-25T15:04:33.027848+0000","last_undegraded":"2024-01-25T15:04:33.027848+0000","last_fullsized":"2024-01-25T15:04:33.027848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:58:07.965682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518484+0000","last_change":"2024-01-25T15:04:27.536648+0000","last_active":"2024-01-25T15:04:32.518484+0000","last_peered":"2024-01-25T15:04:32.518484+0000","last_clean":"2024-01-25T15:04:32.518484+0000","last_became_active":"2024-01-25T15:04:27.536010+0000","last_became_peered":"2024-01-25T15:04:27.536010+0000","last_unstale":"2024-01-25T15:04:32.518484+0000","last_undegraded":"2024-01-25T15:04:32.518484+0000","last_fullsized":"2024-01-25T15:04:32.518484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:48.199996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518565+0000","last_change":"2024-01-25T15:04:26.540469+0000","last_active":"2024-01-25T15:04:32.518565+0000","last_peered":"2024-01-25T15:04:32.518565+0000","last_clean":"2024-01-25T15:04:32.518565+0000","last_became_active":"2024-01-25T15:04:26.540180+0000","last_became_peered":"2024-01-25T15:04:26.540180+0000","last_unstale":"2024-01-25T15:04:32.518565+0000","last_undegraded":"2024-01-25T15:04:32.518565+0000","last_fullsized":"2024-01-25T15:04:32.518565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:56:52.022913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518587+0000","last_change":"2024-01-25T15:04:31.804865+0000","last_active":"2024-01-25T15:04:32.518587+0000","last_peered":"2024-01-25T15:04:32.518587+0000","last_clean":"2024-01-25T15:04:32.518587+0000","last_became_active":"2024-01-25T15:04:31.804470+0000","last_became_peered":"2024-01-25T15:04:31.804470+0000","last_unstale":"2024-01-25T15:04:32.518587+0000","last_undegraded":"2024-01-25T15:04:32.518587+0000","last_fullsized":"2024-01-25T15:04:32.518587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:11:49.452494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228951+0000","last_change":"2024-01-25T15:04:27.541056+0000","last_active":"2024-01-25T15:04:33.228951+0000","last_peered":"2024-01-25T15:04:33.228951+0000","last_clean":"2024-01-25T15:04:33.228951+0000","last_became_active":"2024-01-25T15:04:27.539554+0000","last_became_peered":"2024-01-25T15:04:27.539554+0000","last_unstale":"2024-01-25T15:04:33.228951+0000","last_undegraded":"2024-01-25T15:04:33.228951+0000","last_fullsized":"2024-01-25T15:04:33.228951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:00.614350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229053+0000","last_change":"2024-01-25T15:04:26.551429+0000","last_active":"2024-01-25T15:04:33.229053+0000","last_peered":"2024-01-25T15:04:33.229053+0000","last_clean":"2024-01-25T15:04:33.229053+0000","last_became_active":"2024-01-25T15:04:26.551181+0000","last_became_peered":"2024-01-25T15:04:26.551181+0000","last_unstale":"2024-01-25T15:04:33.229053+0000","last_undegraded":"2024-01-25T15:04:33.229053+0000","last_fullsized":"2024-01-25T15:04:33.229053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:00:16.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518432+0000","last_change":"2024-01-25T15:04:31.800938+0000","last_active":"2024-01-25T15:04:32.518432+0000","last_peered":"2024-01-25T15:04:32.518432+0000","last_clean":"2024-01-25T15:04:32.518432+0000","last_became_active":"2024-01-25T15:04:31.800545+0000","last_became_peered":"2024-01-25T15:04:31.800545+0000","last_unstale":"2024-01-25T15:04:32.518432+0000","last_undegraded":"2024-01-25T15:04:32.518432+0000","last_fullsized":"2024-01-25T15:04:32.518432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:26:14.960523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027624+0000","last_change":"2024-01-25T15:04:27.534211+0000","last_active":"2024-01-25T15:04:33.027624+0000","last_peered":"2024-01-25T15:04:33.027624+0000","last_clean":"2024-01-25T15:04:33.027624+0000","last_became_active":"2024-01-25T15:04:27.533793+0000","last_became_peered":"2024-01-25T15:04:27.533793+0000","last_unstale":"2024-01-25T15:04:33.027624+0000","last_undegraded":"2024-01-25T15:04:33.027624+0000","last_fullsized":"2024-01-25T15:04:33.027624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:55:36.165047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027906+0000","last_change":"2024-01-25T15:04:26.547052+0000","last_active":"2024-01-25T15:04:33.027906+0000","last_peered":"2024-01-25T15:04:33.027906+0000","last_clean":"2024-01-25T15:04:33.027906+0000","last_became_active":"2024-01-25T15:04:26.546739+0000","last_became_peered":"2024-01-25T15:04:26.546739+0000","last_unstale":"2024-01-25T15:04:33.027906+0000","last_undegraded":"2024-01-25T15:04:33.027906+0000","last_fullsized":"2024-01-25T15:04:33.027906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:05:27.178453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228631+0000","last_change":"2024-01-25T15:04:31.801553+0000","last_active":"2024-01-25T15:04:33.228631+0000","last_peered":"2024-01-25T15:04:33.228631+0000","last_clean":"2024-01-25T15:04:33.228631+0000","last_became_active":"2024-01-25T15:04:31.801117+0000","last_became_peered":"2024-01-25T15:04:31.801117+0000","last_unstale":"2024-01-25T15:04:33.228631+0000","last_undegraded":"2024-01-25T15:04:33.228631+0000","last_fullsized":"2024-01-25T15:04:33.228631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:41:20.297981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228502+0000","last_change":"2024-01-25T15:04:27.542771+0000","last_active":"2024-01-25T15:04:33.228502+0000","last_peered":"2024-01-25T15:04:33.228502+0000","last_clean":"2024-01-25T15:04:33.228502+0000","last_became_active":"2024-01-25T15:04:27.542443+0000","last_became_peered":"2024-01-25T15:04:27.542443+0000","last_unstale":"2024-01-25T15:04:33.228502+0000","last_undegraded":"2024-01-25T15:04:33.228502+0000","last_fullsized":"2024-01-25T15:04:33.228502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:13:43.582651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:36.881976+0000","last_change":"2024-01-25T15:04:26.543626+0000","last_active":"2024-01-25T15:04:36.881976+0000","last_peered":"2024-01-25T15:04:36.881976+0000","last_clean":"2024-01-25T15:04:36.881976+0000","last_became_active":"2024-01-25T15:04:26.543134+0000","last_became_peered":"2024-01-25T15:04:26.543134+0000","last_unstale":"2024-01-25T15:04:36.881976+0000","last_undegraded":"2024-01-25T15:04:36.881976+0000","last_fullsized":"2024-01-25T15:04:36.881976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:17:49.229771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188193+0000","last_change":"2024-01-25T15:04:31.590781+0000","last_active":"2024-01-25T15:04:33.188193+0000","last_peered":"2024-01-25T15:04:33.188193+0000","last_clean":"2024-01-25T15:04:33.188193+0000","last_became_active":"2024-01-25T15:04:31.589830+0000","last_became_peered":"2024-01-25T15:04:31.589830+0000","last_unstale":"2024-01-25T15:04:33.188193+0000","last_undegraded":"2024-01-25T15:04:33.188193+0000","last_fullsized":"2024-01-25T15:04:33.188193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:47:52.136422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228853+0000","last_change":"2024-01-25T15:04:27.530991+0000","last_active":"2024-01-25T15:04:33.228853+0000","last_peered":"2024-01-25T15:04:33.228853+0000","last_clean":"2024-01-25T15:04:33.228853+0000","last_became_active":"2024-01-25T15:04:27.530694+0000","last_became_peered":"2024-01-25T15:04:27.530694+0000","last_unstale":"2024-01-25T15:04:33.228853+0000","last_undegraded":"2024-01-25T15:04:33.228853+0000","last_fullsized":"2024-01-25T15:04:33.228853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:04:16.483649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188688+0000","last_change":"2024-01-25T15:04:26.552321+0000","last_active":"2024-01-25T15:04:33.188688+0000","last_peered":"2024-01-25T15:04:33.188688+0000","last_clean":"2024-01-25T15:04:33.188688+0000","last_became_active":"2024-01-25T15:04:26.552007+0000","last_became_peered":"2024-01-25T15:04:26.552007+0000","last_unstale":"2024-01-25T15:04:33.188688+0000","last_undegraded":"2024-01-25T15:04:33.188688+0000","last_fullsized":"2024-01-25T15:04:33.188688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:56:52.022913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228472+0000","last_change":"2024-01-25T15:04:31.589216+0000","last_active":"2024-01-25T15:04:33.228472+0000","last_peered":"2024-01-25T15:04:33.228472+0000","last_clean":"2024-01-25T15:04:33.228472+0000","last_became_active":"2024-01-25T15:04:31.588411+0000","last_became_peered":"2024-01-25T15:04:31.588411+0000","last_unstale":"2024-01-25T15:04:33.228472+0000","last_undegraded":"2024-01-25T15:04:33.228472+0000","last_fullsized":"2024-01-25T15:04:33.228472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:29:23.965513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027809+0000","last_change":"2024-01-25T15:04:27.524082+0000","last_active":"2024-01-25T15:04:33.027809+0000","last_peered":"2024-01-25T15:04:33.027809+0000","last_clean":"2024-01-25T15:04:33.027809+0000","last_became_active":"2024-01-25T15:04:27.523538+0000","last_became_peered":"2024-01-25T15:04:27.523538+0000","last_unstale":"2024-01-25T15:04:33.027809+0000","last_undegraded":"2024-01-25T15:04:33.027809+0000","last_fullsized":"2024-01-25T15:04:33.027809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:45:08.060821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229389+0000","last_change":"2024-01-25T15:04:26.546430+0000","last_active":"2024-01-25T15:04:33.229389+0000","last_peered":"2024-01-25T15:04:33.229389+0000","last_clean":"2024-01-25T15:04:33.229389+0000","last_became_active":"2024-01-25T15:04:26.546172+0000","last_became_peered":"2024-01-25T15:04:26.546172+0000","last_unstale":"2024-01-25T15:04:33.229389+0000","last_undegraded":"2024-01-25T15:04:33.229389+0000","last_fullsized":"2024-01-25T15:04:33.229389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:17:49.229771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518237+0000","last_change":"2024-01-25T15:04:31.585484+0000","last_active":"2024-01-25T15:04:32.518237+0000","last_peered":"2024-01-25T15:04:32.518237+0000","last_clean":"2024-01-25T15:04:32.518237+0000","last_became_active":"2024-01-25T15:04:31.585107+0000","last_became_peered":"2024-01-25T15:04:31.585107+0000","last_unstale":"2024-01-25T15:04:32.518237+0000","last_undegraded":"2024-01-25T15:04:32.518237+0000","last_fullsized":"2024-01-25T15:04:32.518237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:52:39.722794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229300+0000","last_change":"2024-01-25T15:04:27.539659+0000","last_active":"2024-01-25T15:04:33.229300+0000","last_peered":"2024-01-25T15:04:33.229300+0000","last_clean":"2024-01-25T15:04:33.229300+0000","last_became_active":"2024-01-25T15:04:27.539382+0000","last_became_peered":"2024-01-25T15:04:27.539382+0000","last_unstale":"2024-01-25T15:04:33.229300+0000","last_undegraded":"2024-01-25T15:04:33.229300+0000","last_fullsized":"2024-01-25T15:04:33.229300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:47:59.032295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519043+0000","last_change":"2024-01-25T15:04:26.550083+0000","last_active":"2024-01-25T15:04:32.519043+0000","last_peered":"2024-01-25T15:04:32.519043+0000","last_clean":"2024-01-25T15:04:32.519043+0000","last_became_active":"2024-01-25T15:04:26.549812+0000","last_became_peered":"2024-01-25T15:04:26.549812+0000","last_unstale":"2024-01-25T15:04:32.519043+0000","last_undegraded":"2024-01-25T15:04:32.519043+0000","last_fullsized":"2024-01-25T15:04:32.519043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:15:44.944688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518046+0000","last_change":"2024-01-25T15:04:31.802519+0000","last_active":"2024-01-25T15:04:32.518046+0000","last_peered":"2024-01-25T15:04:32.518046+0000","last_clean":"2024-01-25T15:04:32.518046+0000","last_became_active":"2024-01-25T15:04:31.802179+0000","last_became_peered":"2024-01-25T15:04:31.802179+0000","last_unstale":"2024-01-25T15:04:32.518046+0000","last_undegraded":"2024-01-25T15:04:32.518046+0000","last_fullsized":"2024-01-25T15:04:32.518046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:07:22.928800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.028016+0000","last_change":"2024-01-25T15:04:31.803027+0000","last_active":"2024-01-25T15:04:33.028016+0000","last_peered":"2024-01-25T15:04:33.028016+0000","last_clean":"2024-01-25T15:04:33.028016+0000","last_became_active":"2024-01-25T15:04:31.802543+0000","last_became_peered":"2024-01-25T15:04:31.802543+0000","last_unstale":"2024-01-25T15:04:33.028016+0000","last_undegraded":"2024-01-25T15:04:33.028016+0000","last_fullsized":"2024-01-25T15:04:33.028016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:53:59.218943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.187926+0000","last_change":"2024-01-25T15:04:27.537760+0000","last_active":"2024-01-25T15:04:33.187926+0000","last_peered":"2024-01-25T15:04:33.187926+0000","last_clean":"2024-01-25T15:04:33.187926+0000","last_became_active":"2024-01-25T15:04:27.537411+0000","last_became_peered":"2024-01-25T15:04:27.537411+0000","last_unstale":"2024-01-25T15:04:33.187926+0000","last_undegraded":"2024-01-25T15:04:33.187926+0000","last_fullsized":"2024-01-25T15:04:33.187926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:24:46.429617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227807+0000","last_change":"2024-01-25T15:04:26.553364+0000","last_active":"2024-01-25T15:04:33.227807+0000","last_peered":"2024-01-25T15:04:33.227807+0000","last_clean":"2024-01-25T15:04:33.227807+0000","last_became_active":"2024-01-25T15:04:26.553023+0000","last_became_peered":"2024-01-25T15:04:26.553023+0000","last_unstale":"2024-01-25T15:04:33.227807+0000","last_undegraded":"2024-01-25T15:04:33.227807+0000","last_fullsized":"2024-01-25T15:04:33.227807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:09:05.578946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518883+0000","last_change":"2024-01-25T15:04:31.588551+0000","last_active":"2024-01-25T15:04:32.518883+0000","last_peered":"2024-01-25T15:04:32.518883+0000","last_clean":"2024-01-25T15:04:32.518883+0000","last_became_active":"2024-01-25T15:04:31.588144+0000","last_became_peered":"2024-01-25T15:04:31.588144+0000","last_unstale":"2024-01-25T15:04:32.518883+0000","last_undegraded":"2024-01-25T15:04:32.518883+0000","last_fullsized":"2024-01-25T15:04:32.518883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:47:52.136422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517990+0000","last_change":"2024-01-25T15:04:27.537715+0000","last_active":"2024-01-25T15:04:32.517990+0000","last_peered":"2024-01-25T15:04:32.517990+0000","last_clean":"2024-01-25T15:04:32.517990+0000","last_became_active":"2024-01-25T15:04:27.537433+0000","last_became_peered":"2024-01-25T15:04:27.537433+0000","last_unstale":"2024-01-25T15:04:32.517990+0000","last_undegraded":"2024-01-25T15:04:32.517990+0000","last_fullsized":"2024-01-25T15:04:32.517990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:48.199996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518112+0000","last_change":"2024-01-25T15:04:26.543354+0000","last_active":"2024-01-25T15:04:32.518112+0000","last_peered":"2024-01-25T15:04:32.518112+0000","last_clean":"2024-01-25T15:04:32.518112+0000","last_became_active":"2024-01-25T15:04:26.543047+0000","last_became_peered":"2024-01-25T15:04:26.543047+0000","last_unstale":"2024-01-25T15:04:32.518112+0000","last_undegraded":"2024-01-25T15:04:32.518112+0000","last_fullsized":"2024-01-25T15:04:32.518112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:30:22.770050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518843+0000","last_change":"2024-01-25T15:04:26.541507+0000","last_active":"2024-01-25T15:04:32.518843+0000","last_peered":"2024-01-25T15:04:32.518843+0000","last_clean":"2024-01-25T15:04:32.518843+0000","last_became_active":"2024-01-25T15:04:26.540128+0000","last_became_peered":"2024-01-25T15:04:26.540128+0000","last_unstale":"2024-01-25T15:04:32.518843+0000","last_undegraded":"2024-01-25T15:04:32.518843+0000","last_fullsized":"2024-01-25T15:04:32.518843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:09:05.578946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027825+0000","last_change":"2024-01-25T15:04:27.525314+0000","last_active":"2024-01-25T15:04:33.027825+0000","last_peered":"2024-01-25T15:04:33.027825+0000","last_clean":"2024-01-25T15:04:33.027825+0000","last_became_active":"2024-01-25T15:04:27.525018+0000","last_became_peered":"2024-01-25T15:04:27.525018+0000","last_unstale":"2024-01-25T15:04:33.027825+0000","last_undegraded":"2024-01-25T15:04:33.027825+0000","last_fullsized":"2024-01-25T15:04:33.027825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:19:41.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519186+0000","last_change":"2024-01-25T15:04:31.591768+0000","last_active":"2024-01-25T15:04:32.519186+0000","last_peered":"2024-01-25T15:04:32.519186+0000","last_clean":"2024-01-25T15:04:32.519186+0000","last_became_active":"2024-01-25T15:04:31.591336+0000","last_became_peered":"2024-01-25T15:04:31.591336+0000","last_unstale":"2024-01-25T15:04:32.519186+0000","last_undegraded":"2024-01-25T15:04:32.519186+0000","last_fullsized":"2024-01-25T15:04:32.519186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:40:22.136826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518266+0000","last_change":"2024-01-25T15:04:26.550151+0000","last_active":"2024-01-25T15:04:32.518266+0000","last_peered":"2024-01-25T15:04:32.518266+0000","last_clean":"2024-01-25T15:04:32.518266+0000","last_became_active":"2024-01-25T15:04:26.549856+0000","last_became_peered":"2024-01-25T15:04:26.549856+0000","last_unstale":"2024-01-25T15:04:32.518266+0000","last_undegraded":"2024-01-25T15:04:32.518266+0000","last_fullsized":"2024-01-25T15:04:32.518266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:00:16.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228279+0000","last_change":"2024-01-25T15:04:27.526178+0000","last_active":"2024-01-25T15:04:33.228279+0000","last_peered":"2024-01-25T15:04:33.228279+0000","last_clean":"2024-01-25T15:04:33.228279+0000","last_became_active":"2024-01-25T15:04:27.525798+0000","last_became_peered":"2024-01-25T15:04:27.525798+0000","last_unstale":"2024-01-25T15:04:33.228279+0000","last_undegraded":"2024-01-25T15:04:33.228279+0000","last_fullsized":"2024-01-25T15:04:33.228279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:17:50.234531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518933+0000","last_change":"2024-01-25T15:04:31.584854+0000","last_active":"2024-01-25T15:04:32.518933+0000","last_peered":"2024-01-25T15:04:32.518933+0000","last_clean":"2024-01-25T15:04:32.518933+0000","last_became_active":"2024-01-25T15:04:31.584482+0000","last_became_peered":"2024-01-25T15:04:31.584482+0000","last_unstale":"2024-01-25T15:04:32.518933+0000","last_undegraded":"2024-01-25T15:04:32.518933+0000","last_fullsized":"2024-01-25T15:04:32.518933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:52:29.681769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519137+0000","last_change":"2024-01-25T15:04:27.536761+0000","last_active":"2024-01-25T15:04:32.519137+0000","last_peered":"2024-01-25T15:04:32.519137+0000","last_clean":"2024-01-25T15:04:32.519137+0000","last_became_active":"2024-01-25T15:04:27.536382+0000","last_became_peered":"2024-01-25T15:04:27.536382+0000","last_unstale":"2024-01-25T15:04:32.519137+0000","last_undegraded":"2024-01-25T15:04:32.519137+0000","last_fullsized":"2024-01-25T15:04:32.519137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:24:46.429617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519085+0000","last_change":"2024-01-25T15:04:27.529750+0000","last_active":"2024-01-25T15:04:32.519085+0000","last_peered":"2024-01-25T15:04:32.519085+0000","last_clean":"2024-01-25T15:04:32.519085+0000","last_became_active":"2024-01-25T15:04:27.529437+0000","last_became_peered":"2024-01-25T15:04:27.529437+0000","last_unstale":"2024-01-25T15:04:32.519085+0000","last_undegraded":"2024-01-25T15:04:32.519085+0000","last_fullsized":"2024-01-25T15:04:32.519085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:15:45.949448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228955+0000","last_change":"2024-01-25T15:04:27.538760+0000","last_active":"2024-01-25T15:04:33.228955+0000","last_peered":"2024-01-25T15:04:33.228955+0000","last_clean":"2024-01-25T15:04:33.228955+0000","last_became_active":"2024-01-25T15:04:27.537353+0000","last_became_peered":"2024-01-25T15:04:27.537353+0000","last_unstale":"2024-01-25T15:04:33.228955+0000","last_undegraded":"2024-01-25T15:04:33.228955+0000","last_fullsized":"2024-01-25T15:04:33.228955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:58:29.244789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027745+0000","last_change":"2024-01-25T15:04:27.534768+0000","last_active":"2024-01-25T15:04:33.027745+0000","last_peered":"2024-01-25T15:04:33.027745+0000","last_clean":"2024-01-25T15:04:33.027745+0000","last_became_active":"2024-01-25T15:04:27.534414+0000","last_became_peered":"2024-01-25T15:04:27.534414+0000","last_unstale":"2024-01-25T15:04:33.027745+0000","last_undegraded":"2024-01-25T15:04:33.027745+0000","last_fullsized":"2024-01-25T15:04:33.027745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:59:41.393305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518613+0000","last_change":"2024-01-25T15:04:27.532970+0000","last_active":"2024-01-25T15:04:32.518613+0000","last_peered":"2024-01-25T15:04:32.518613+0000","last_clean":"2024-01-25T15:04:32.518613+0000","last_became_active":"2024-01-25T15:04:27.532645+0000","last_became_peered":"2024-01-25T15:04:27.532645+0000","last_unstale":"2024-01-25T15:04:32.518613+0000","last_undegraded":"2024-01-25T15:04:32.518613+0000","last_fullsized":"2024-01-25T15:04:32.518613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:13:43.582651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188513+0000","last_change":"2024-01-25T15:04:27.538503+0000","last_active":"2024-01-25T15:04:33.188513+0000","last_peered":"2024-01-25T15:04:33.188513+0000","last_clean":"2024-01-25T15:04:33.188513+0000","last_became_active":"2024-01-25T15:04:27.538210+0000","last_became_peered":"2024-01-25T15:04:27.538210+0000","last_unstale":"2024-01-25T15:04:33.188513+0000","last_undegraded":"2024-01-25T15:04:33.188513+0000","last_fullsized":"2024-01-25T15:04:33.188513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:59:41.393305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519315+0000","last_change":"2024-01-25T15:04:27.540013+0000","last_active":"2024-01-25T15:04:32.519315+0000","last_peered":"2024-01-25T15:04:32.519315+0000","last_clean":"2024-01-25T15:04:32.519315+0000","last_became_active":"2024-01-25T15:04:27.539736+0000","last_became_peered":"2024-01-25T15:04:27.539736+0000","last_unstale":"2024-01-25T15:04:32.519315+0000","last_undegraded":"2024-01-25T15:04:32.519315+0000","last_fullsized":"2024-01-25T15:04:32.519315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:45:08.060821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518509+0000","last_change":"2024-01-25T15:04:27.536541+0000","last_active":"2024-01-25T15:04:32.518509+0000","last_peered":"2024-01-25T15:04:32.518509+0000","last_clean":"2024-01-25T15:04:32.518509+0000","last_became_active":"2024-01-25T15:04:27.534323+0000","last_became_peered":"2024-01-25T15:04:27.534323+0000","last_unstale":"2024-01-25T15:04:32.518509+0000","last_undegraded":"2024-01-25T15:04:32.518509+0000","last_fullsized":"2024-01-25T15:04:32.518509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:29:19.932806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227705+0000","last_change":"2024-01-25T15:04:27.534565+0000","last_active":"2024-01-25T15:04:33.227705+0000","last_peered":"2024-01-25T15:04:33.227705+0000","last_clean":"2024-01-25T15:04:33.227705+0000","last_became_active":"2024-01-25T15:04:27.534263+0000","last_became_peered":"2024-01-25T15:04:27.534263+0000","last_unstale":"2024-01-25T15:04:33.227705+0000","last_undegraded":"2024-01-25T15:04:33.227705+0000","last_fullsized":"2024-01-25T15:04:33.227705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:30.257021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517959+0000","last_change":"2024-01-25T15:04:27.532801+0000","last_active":"2024-01-25T15:04:32.517959+0000","last_peered":"2024-01-25T15:04:32.517959+0000","last_clean":"2024-01-25T15:04:32.517959+0000","last_became_active":"2024-01-25T15:04:27.532521+0000","last_became_peered":"2024-01-25T15:04:27.532521+0000","last_unstale":"2024-01-25T15:04:32.517959+0000","last_undegraded":"2024-01-25T15:04:32.517959+0000","last_fullsized":"2024-01-25T15:04:32.517959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:59:41.393305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229237+0000","last_change":"2024-01-25T15:04:27.531785+0000","last_active":"2024-01-25T15:04:33.229237+0000","last_peered":"2024-01-25T15:04:33.229237+0000","last_clean":"2024-01-25T15:04:33.229237+0000","last_became_active":"2024-01-25T15:04:27.531502+0000","last_became_peered":"2024-01-25T15:04:27.531502+0000","last_unstale":"2024-01-25T15:04:33.229237+0000","last_undegraded":"2024-01-25T15:04:33.229237+0000","last_fullsized":"2024-01-25T15:04:33.229237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:07:18.621735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027629+0000","last_change":"2024-01-25T15:04:27.538527+0000","last_active":"2024-01-25T15:04:33.027629+0000","last_peered":"2024-01-25T15:04:33.027629+0000","last_clean":"2024-01-25T15:04:33.027629+0000","last_became_active":"2024-01-25T15:04:27.538169+0000","last_became_peered":"2024-01-25T15:04:27.538169+0000","last_unstale":"2024-01-25T15:04:33.027629+0000","last_undegraded":"2024-01-25T15:04:33.027629+0000","last_fullsized":"2024-01-25T15:04:33.027629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:48.199996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519087+0000","last_change":"2024-01-25T15:04:27.528595+0000","last_active":"2024-01-25T15:04:32.519087+0000","last_peered":"2024-01-25T15:04:32.519087+0000","last_clean":"2024-01-25T15:04:32.519087+0000","last_became_active":"2024-01-25T15:04:27.528222+0000","last_became_peered":"2024-01-25T15:04:27.528222+0000","last_unstale":"2024-01-25T15:04:32.519087+0000","last_undegraded":"2024-01-25T15:04:32.519087+0000","last_fullsized":"2024-01-25T15:04:32.519087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:59:41.393305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228858+0000","last_change":"2024-01-25T15:04:27.539219+0000","last_active":"2024-01-25T15:04:33.228858+0000","last_peered":"2024-01-25T15:04:33.228858+0000","last_clean":"2024-01-25T15:04:33.228858+0000","last_became_active":"2024-01-25T15:04:27.538920+0000","last_became_peered":"2024-01-25T15:04:27.538920+0000","last_unstale":"2024-01-25T15:04:33.228858+0000","last_undegraded":"2024-01-25T15:04:33.228858+0000","last_fullsized":"2024-01-25T15:04:33.228858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:58:03.932974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519156+0000","last_change":"2024-01-25T15:04:27.531810+0000","last_active":"2024-01-25T15:04:32.519156+0000","last_peered":"2024-01-25T15:04:32.519156+0000","last_clean":"2024-01-25T15:04:32.519156+0000","last_became_active":"2024-01-25T15:04:27.531489+0000","last_became_peered":"2024-01-25T15:04:27.531489+0000","last_unstale":"2024-01-25T15:04:32.519156+0000","last_undegraded":"2024-01-25T15:04:32.519156+0000","last_fullsized":"2024-01-25T15:04:32.519156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:04:57.737913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228241+0000","last_change":"2024-01-25T15:04:27.532610+0000","last_active":"2024-01-25T15:04:33.228241+0000","last_peered":"2024-01-25T15:04:33.228241+0000","last_clean":"2024-01-25T15:04:33.228241+0000","last_became_active":"2024-01-25T15:04:27.532332+0000","last_became_peered":"2024-01-25T15:04:27.532332+0000","last_unstale":"2024-01-25T15:04:33.228241+0000","last_undegraded":"2024-01-25T15:04:33.228241+0000","last_fullsized":"2024-01-25T15:04:33.228241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:00.614350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227608+0000","last_change":"2024-01-25T15:04:27.535483+0000","last_active":"2024-01-25T15:04:33.227608+0000","last_peered":"2024-01-25T15:04:33.227608+0000","last_clean":"2024-01-25T15:04:33.227608+0000","last_became_active":"2024-01-25T15:04:27.534992+0000","last_became_peered":"2024-01-25T15:04:27.534992+0000","last_unstale":"2024-01-25T15:04:33.227608+0000","last_undegraded":"2024-01-25T15:04:33.227608+0000","last_fullsized":"2024-01-25T15:04:33.227608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:19:41.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188004+0000","last_change":"2024-01-25T15:04:27.528466+0000","last_active":"2024-01-25T15:04:33.188004+0000","last_peered":"2024-01-25T15:04:33.188004+0000","last_clean":"2024-01-25T15:04:33.188004+0000","last_became_active":"2024-01-25T15:04:27.528170+0000","last_became_peered":"2024-01-25T15:04:27.528170+0000","last_unstale":"2024-01-25T15:04:33.188004+0000","last_undegraded":"2024-01-25T15:04:33.188004+0000","last_fullsized":"2024-01-25T15:04:33.188004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:48.199996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027681+0000","last_change":"2024-01-25T15:04:27.527057+0000","last_active":"2024-01-25T15:04:33.027681+0000","last_peered":"2024-01-25T15:04:33.027681+0000","last_clean":"2024-01-25T15:04:33.027681+0000","last_became_active":"2024-01-25T15:04:27.526733+0000","last_became_peered":"2024-01-25T15:04:27.526733+0000","last_unstale":"2024-01-25T15:04:33.027681+0000","last_undegraded":"2024-01-25T15:04:33.027681+0000","last_fullsized":"2024-01-25T15:04:33.027681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:38:10.985262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518080+0000","last_change":"2024-01-25T15:04:27.533940+0000","last_active":"2024-01-25T15:04:32.518080+0000","last_peered":"2024-01-25T15:04:32.518080+0000","last_clean":"2024-01-25T15:04:32.518080+0000","last_became_active":"2024-01-25T15:04:27.533453+0000","last_became_peered":"2024-01-25T15:04:27.533453+0000","last_unstale":"2024-01-25T15:04:32.518080+0000","last_undegraded":"2024-01-25T15:04:32.518080+0000","last_fullsized":"2024-01-25T15:04:32.518080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:30.257021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228629+0000","last_change":"2024-01-25T15:04:27.529157+0000","last_active":"2024-01-25T15:04:33.228629+0000","last_peered":"2024-01-25T15:04:33.228629+0000","last_clean":"2024-01-25T15:04:33.228629+0000","last_became_active":"2024-01-25T15:04:27.528880+0000","last_became_peered":"2024-01-25T15:04:27.528880+0000","last_unstale":"2024-01-25T15:04:33.228629+0000","last_undegraded":"2024-01-25T15:04:33.228629+0000","last_fullsized":"2024-01-25T15:04:33.228629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:08:53.048328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518689+0000","last_change":"2024-01-25T15:04:27.528325+0000","last_active":"2024-01-25T15:04:32.518689+0000","last_peered":"2024-01-25T15:04:32.518689+0000","last_clean":"2024-01-25T15:04:32.518689+0000","last_became_active":"2024-01-25T15:04:27.527673+0000","last_became_peered":"2024-01-25T15:04:27.527673+0000","last_unstale":"2024-01-25T15:04:32.518689+0000","last_undegraded":"2024-01-25T15:04:32.518689+0000","last_fullsized":"2024-01-25T15:04:32.518689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:19:41.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519157+0000","last_change":"2024-01-25T15:04:27.530713+0000","last_active":"2024-01-25T15:04:32.519157+0000","last_peered":"2024-01-25T15:04:32.519157+0000","last_clean":"2024-01-25T15:04:32.519157+0000","last_became_active":"2024-01-25T15:04:27.530468+0000","last_became_peered":"2024-01-25T15:04:27.530468+0000","last_unstale":"2024-01-25T15:04:32.519157+0000","last_undegraded":"2024-01-25T15:04:32.519157+0000","last_fullsized":"2024-01-25T15:04:32.519157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:30.257021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229579+0000","last_change":"2024-01-25T15:04:27.542678+0000","last_active":"2024-01-25T15:04:33.229579+0000","last_peered":"2024-01-25T15:04:33.229579+0000","last_clean":"2024-01-25T15:04:33.229579+0000","last_became_active":"2024-01-25T15:04:27.542362+0000","last_became_peered":"2024-01-25T15:04:27.542362+0000","last_unstale":"2024-01-25T15:04:33.229579+0000","last_undegraded":"2024-01-25T15:04:33.229579+0000","last_fullsized":"2024-01-25T15:04:33.229579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:20:59.655525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517884+0000","last_change":"2024-01-25T15:04:27.540118+0000","last_active":"2024-01-25T15:04:32.517884+0000","last_peered":"2024-01-25T15:04:32.517884+0000","last_clean":"2024-01-25T15:04:32.517884+0000","last_became_active":"2024-01-25T15:04:27.539793+0000","last_became_peered":"2024-01-25T15:04:27.539793+0000","last_unstale":"2024-01-25T15:04:32.517884+0000","last_undegraded":"2024-01-25T15:04:32.517884+0000","last_fullsized":"2024-01-25T15:04:32.517884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:30:17.007992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227778+0000","last_change":"2024-01-25T15:04:27.540459+0000","last_active":"2024-01-25T15:04:33.227778+0000","last_peered":"2024-01-25T15:04:33.227778+0000","last_clean":"2024-01-25T15:04:33.227778+0000","last_became_active":"2024-01-25T15:04:27.540170+0000","last_became_peered":"2024-01-25T15:04:27.540170+0000","last_unstale":"2024-01-25T15:04:33.227778+0000","last_undegraded":"2024-01-25T15:04:33.227778+0000","last_fullsized":"2024-01-25T15:04:33.227778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:29:19.932806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228818+0000","last_change":"2024-01-25T15:04:27.533910+0000","last_active":"2024-01-25T15:04:33.228818+0000","last_peered":"2024-01-25T15:04:33.228818+0000","last_clean":"2024-01-25T15:04:33.228818+0000","last_became_active":"2024-01-25T15:04:27.533483+0000","last_became_peered":"2024-01-25T15:04:27.533483+0000","last_unstale":"2024-01-25T15:04:33.228818+0000","last_undegraded":"2024-01-25T15:04:33.228818+0000","last_fullsized":"2024-01-25T15:04:33.228818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:55:02.405369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228766+0000","last_change":"2024-01-25T15:04:27.539149+0000","last_active":"2024-01-25T15:04:33.228766+0000","last_peered":"2024-01-25T15:04:33.228766+0000","last_clean":"2024-01-25T15:04:33.228766+0000","last_became_active":"2024-01-25T15:04:27.538850+0000","last_became_peered":"2024-01-25T15:04:27.538850+0000","last_unstale":"2024-01-25T15:04:33.228766+0000","last_undegraded":"2024-01-25T15:04:33.228766+0000","last_fullsized":"2024-01-25T15:04:33.228766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:58:29.244789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227771+0000","last_change":"2024-01-25T15:04:27.534907+0000","last_active":"2024-01-25T15:04:33.227771+0000","last_peered":"2024-01-25T15:04:33.227771+0000","last_clean":"2024-01-25T15:04:33.227771+0000","last_became_active":"2024-01-25T15:04:27.534407+0000","last_became_peered":"2024-01-25T15:04:27.534407+0000","last_unstale":"2024-01-25T15:04:33.227771+0000","last_undegraded":"2024-01-25T15:04:33.227771+0000","last_fullsized":"2024-01-25T15:04:33.227771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:45:08.060821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027683+0000","last_change":"2024-01-25T15:04:27.529037+0000","last_active":"2024-01-25T15:04:33.027683+0000","last_peered":"2024-01-25T15:04:33.027683+0000","last_clean":"2024-01-25T15:04:33.027683+0000","last_became_active":"2024-01-25T15:04:27.528713+0000","last_became_peered":"2024-01-25T15:04:27.528713+0000","last_unstale":"2024-01-25T15:04:33.027683+0000","last_undegraded":"2024-01-25T15:04:33.027683+0000","last_fullsized":"2024-01-25T15:04:33.027683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:24:46.429617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188418+0000","last_change":"2024-01-25T15:04:27.531477+0000","last_active":"2024-01-25T15:04:33.188418+0000","last_peered":"2024-01-25T15:04:33.188418+0000","last_clean":"2024-01-25T15:04:33.188418+0000","last_became_active":"2024-01-25T15:04:27.531188+0000","last_became_peered":"2024-01-25T15:04:27.531188+0000","last_unstale":"2024-01-25T15:04:33.188418+0000","last_undegraded":"2024-01-25T15:04:33.188418+0000","last_fullsized":"2024-01-25T15:04:33.188418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:30.257021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229461+0000","last_change":"2024-01-25T15:04:27.541633+0000","last_active":"2024-01-25T15:04:33.229461+0000","last_peered":"2024-01-25T15:04:33.229461+0000","last_clean":"2024-01-25T15:04:33.229461+0000","last_became_active":"2024-01-25T15:04:27.539292+0000","last_became_peered":"2024-01-25T15:04:27.539292+0000","last_unstale":"2024-01-25T15:04:33.229461+0000","last_undegraded":"2024-01-25T15:04:33.229461+0000","last_fullsized":"2024-01-25T15:04:33.229461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:48:49.762254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":860160,"data_stored":690798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:04:48.991 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-25T15:04:49.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.126+0000 7f2c9a91d640 1 Processor -- start 2024-01-25T15:04:49.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.126+0000 7f2c9a91d640 1 -- start start 2024-01-25T15:04:49.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.127+0000 7f2c9a91d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2c940c4f00 0x7f2c94155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:49.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.127+0000 7f2c9a91d640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c940c66c0 con 0x7f2c940c55e0 2024-01-25T15:04:49.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.127+0000 7f2c9a91d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c9406cfc0 con 0x7f2c941520b0 2024-01-25T15:04:49.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.127+0000 7f2c9a91d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c94152490 con 0x7f2c940c4f00 2024-01-25T15:04:49.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.127+0000 7f2c937fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2c940c55e0 0x7f2c940c5b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59014/0 (socket says 172.21.15.29:59014) 2024-01-25T15:04:49.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.127+0000 7f2c98eba640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2c940c4f00 0x7f2c94155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:49.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.127+0000 7f2c937fe640 1 -- 172.21.15.29:0/1685701117 learned_addr learned my addr 172.21.15.29:0/1685701117 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:49.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.127+0000 7f2c92ffd640 1 -- 172.21.15.29:0/1685701117 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186886611 0 0) 0x7f2c940c66c0 con 0x7f2c940c55e0 2024-01-25T15:04:49.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.127+0000 7f2c92ffd640 1 -- 172.21.15.29:0/1685701117 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c7c003520 con 0x7f2c940c55e0 2024-01-25T15:04:49.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.127+0000 7f2c98eba640 1 -- 172.21.15.29:0/1685701117 >> v1:172.21.15.52:6789/0 conn(0x7f2c941520b0 legacy=0x7f2c940c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:49.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.127+0000 7f2c98eba640 1 -- 172.21.15.29:0/1685701117 >> v1:172.21.15.29:6789/0 conn(0x7f2c940c55e0 legacy=0x7f2c940c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:49.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.127+0000 7f2c98eba640 1 -- 172.21.15.29:0/1685701117 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c940c8830 con 0x7f2c940c4f00 2024-01-25T15:04:49.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.128+0000 7f2c98eba640 1 --2- 172.21.15.29:0/1685701117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c940c4f00 0x7f2c94155570 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c009d90 tx=0x7f2c8c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d3cab10df39278 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:49.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.128+0000 7f2c92ffd640 1 -- 172.21.15.29:0/1685701117 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c02cc60 con 0x7f2c940c4f00 2024-01-25T15:04:49.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.128+0000 7f2c92ffd640 1 -- 172.21.15.29:0/1685701117 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8c02cdc0 con 0x7f2c940c4f00 2024-01-25T15:04:49.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.128+0000 7f2c92ffd640 1 -- 172.21.15.29:0/1685701117 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c034660 con 0x7f2c940c4f00 2024-01-25T15:04:49.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.129+0000 7f2c9a91d640 1 -- 172.21.15.29:0/1685701117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c940c4f00 msgr2=0x7f2c94155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:49.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.129+0000 7f2c9a91d640 1 --2- 172.21.15.29:0/1685701117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c940c4f00 0x7f2c94155570 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c009d90 tx=0x7f2c8c02beb0 comp rx=0 tx=0).stop 2024-01-25T15:04:49.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.129+0000 7f2c9a91d640 1 -- 172.21.15.29:0/1685701117 shutdown_connections 2024-01-25T15:04:49.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.129+0000 7f2c9a91d640 1 --2- 172.21.15.29:0/1685701117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c940c4f00 0x7f2c94155570 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:49.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.129+0000 7f2c9a91d640 1 -- 172.21.15.29:0/1685701117 >> 172.21.15.29:0/1685701117 conn(0x7f2c940ca220 msgr2=0x7f2c940ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:49.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.129+0000 7f2c9a91d640 1 -- 172.21.15.29:0/1685701117 shutdown_connections 2024-01-25T15:04:49.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.129+0000 7f2c9a91d640 1 -- 172.21.15.29:0/1685701117 wait complete. 2024-01-25T15:04:49.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.130+0000 7f2c9a91d640 1 Processor -- start 2024-01-25T15:04:49.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.130+0000 7f2c9a91d640 1 -- start start 2024-01-25T15:04:49.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.131+0000 7f2c9a91d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c940c4f00 0x7f2c941edd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:49.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.131+0000 7f2c9a91d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c941520b0 0x7f2c9414cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:49.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.131+0000 7f2c9a91d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c9414db70 0x7f2c9414a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:49.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.131+0000 7f2c9a91d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9414b570 con 0x7f2c940c4f00 2024-01-25T15:04:49.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.131+0000 7f2c9a91d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c941ed900 con 0x7f2c9414db70 2024-01-25T15:04:49.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.131+0000 7f2c9a91d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9414d250 con 0x7f2c941520b0 2024-01-25T15:04:49.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.131+0000 7f2c93fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c940c4f00 0x7f2c941edd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:49.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.131+0000 7f2c93fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c940c4f00 0x7f2c941edd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44810/0 (socket says 172.21.15.29:44810) 2024-01-25T15:04:49.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.131+0000 7f2c93fff640 1 -- 172.21.15.29:0/791340077 learned_addr learned my addr 172.21.15.29:0/791340077 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:49.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.131+0000 7f2c98eba640 1 --2- 172.21.15.29:0/791340077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c9414db70 0x7f2c9414a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:49.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.131+0000 7f2c937fe640 1 --2- 172.21.15.29:0/791340077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c941520b0 0x7f2c9414cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:49.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.131+0000 7f2c93fff640 1 -- 172.21.15.29:0/791340077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c941520b0 msgr2=0x7f2c9414cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:49.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.131+0000 7f2c93fff640 1 --2- 172.21.15.29:0/791340077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c941520b0 0x7f2c9414cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:49.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.131+0000 7f2c93fff640 1 -- 172.21.15.29:0/791340077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c9414db70 msgr2=0x7f2c9414a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:49.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.131+0000 7f2c93fff640 1 --2- 172.21.15.29:0/791340077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c9414db70 0x7f2c9414a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:49.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.131+0000 7f2c93fff640 1 -- 172.21.15.29:0/791340077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8c009a70 con 0x7f2c940c4f00 2024-01-25T15:04:49.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.131+0000 7f2c93fff640 1 --2- 172.21.15.29:0/791340077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c940c4f00 0x7f2c941edd90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800c3c0 tx=0x7f2c8800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:49.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.132+0000 7f2c90ff9640 1 -- 172.21.15.29:0/791340077 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c880052d0 con 0x7f2c940c4f00 2024-01-25T15:04:49.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.132+0000 7f2c90ff9640 1 -- 172.21.15.29:0/791340077 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c88005450 con 0x7f2c940c4f00 2024-01-25T15:04:49.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.132+0000 7f2c9a91d640 1 -- 172.21.15.29:0/791340077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c9414e0c0 con 0x7f2c940c4f00 2024-01-25T15:04:49.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.132+0000 7f2c90ff9640 1 -- 172.21.15.29:0/791340077 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c88007260 con 0x7f2c940c4f00 2024-01-25T15:04:49.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.132+0000 7f2c9a91d640 1 -- 172.21.15.29:0/791340077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c941ed2b0 con 0x7f2c940c4f00 2024-01-25T15:04:49.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.133+0000 7f2c9a91d640 1 -- 172.21.15.29:0/791340077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c94074080 con 0x7f2c940c4f00 2024-01-25T15:04:49.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.133+0000 7f2c90ff9640 1 -- 172.21.15.29:0/791340077 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2c880073c0 con 0x7f2c940c4f00 2024-01-25T15:04:49.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.133+0000 7f2c90ff9640 1 --2- 172.21.15.29:0/791340077 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2c8006af00 0x7f2c8006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:49.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.134+0000 7f2c90ff9640 1 -- 172.21.15.29:0/791340077 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2c88088b00 con 0x7f2c940c4f00 2024-01-25T15:04:49.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.134+0000 7f2c937fe640 1 --2- 172.21.15.29:0/791340077 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2c8006af00 0x7f2c8006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:49.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.134+0000 7f2c937fe640 1 --2- 172.21.15.29:0/791340077 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2c8006af00 0x7f2c8006d3c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2c940b0060 tx=0x7f2c84007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:49.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.138+0000 7f2c90ff9640 1 -- 172.21.15.29:0/791340077 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2c88053820 con 0x7f2c940c4f00 2024-01-25T15:04:49.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.316+0000 7f2c9a91d640 1 -- 172.21.15.29:0/791340077 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2c94154d70 con 0x7f2c8006af00 2024-01-25T15:04:49.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.325+0000 7f2c90ff9640 1 -- 172.21.15.29:0/791340077 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345254 (secure 0 0 0) 0x7f2c840014d0 con 0x7f2c8006af00 2024-01-25T15:04:49.330 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:49.332 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-25T15:04:49.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.329+0000 7f2c9a91d640 1 -- 172.21.15.29:0/791340077 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2c8006af00 msgr2=0x7f2c8006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:49.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.329+0000 7f2c9a91d640 1 --2- 172.21.15.29:0/791340077 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2c8006af00 0x7f2c8006d3c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2c940b0060 tx=0x7f2c84007d30 comp rx=0 tx=0).stop 2024-01-25T15:04:49.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.329+0000 7f2c9a91d640 1 -- 172.21.15.29:0/791340077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c940c4f00 msgr2=0x7f2c941edd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:49.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.329+0000 7f2c9a91d640 1 --2- 172.21.15.29:0/791340077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c940c4f00 0x7f2c941edd90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800c3c0 tx=0x7f2c8800c880 comp rx=0 tx=0).stop 2024-01-25T15:04:49.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.329+0000 7f2c9a91d640 1 -- 172.21.15.29:0/791340077 shutdown_connections 2024-01-25T15:04:49.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.329+0000 7f2c9a91d640 1 --2- 172.21.15.29:0/791340077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c9414db70 0x7f2c9414a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:49.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.329+0000 7f2c9a91d640 1 --2- 172.21.15.29:0/791340077 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c941520b0 0x7f2c9414cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:49.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.329+0000 7f2c9a91d640 1 --2- 172.21.15.29:0/791340077 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2c8006af00 0x7f2c8006d3c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:49.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.329+0000 7f2c9a91d640 1 --2- 172.21.15.29:0/791340077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c940c4f00 0x7f2c941edd90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:49.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.329+0000 7f2c9a91d640 1 -- 172.21.15.29:0/791340077 >> 172.21.15.29:0/791340077 conn(0x7f2c940ca220 msgr2=0x7f2c94073260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:49.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.329+0000 7f2c9a91d640 1 -- 172.21.15.29:0/791340077 shutdown_connections 2024-01-25T15:04:49.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.329+0000 7f2c9a91d640 1 -- 172.21.15.29:0/791340077 wait complete. 2024-01-25T15:04:49.340 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-01-25T15:04:48.920871+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248496,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754726224,"statfs":{"total":773094113280,"available":772839653376,"internally_reserved":0,"allocated":3284992,"data_stored":1988350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003362"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027891+0000","last_change":"2024-01-25T15:04:26.549355+0000","last_active":"2024-01-25T15:04:33.027891+0000","last_peered":"2024-01-25T15:04:33.027891+0000","last_clean":"2024-01-25T15:04:33.027891+0000","last_became_active":"2024-01-25T15:04:26.549068+0000","last_became_peered":"2024-01-25T15:04:26.549068+0000","last_unstale":"2024-01-25T15:04:33.027891+0000","last_undegraded":"2024-01-25T15:04:33.027891+0000","last_fullsized":"2024-01-25T15:04:33.027891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:30:22.770050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518335+0000","last_change":"2024-01-25T15:04:27.536360+0000","last_active":"2024-01-25T15:04:32.518335+0000","last_peered":"2024-01-25T15:04:32.518335+0000","last_clean":"2024-01-25T15:04:32.518335+0000","last_became_active":"2024-01-25T15:04:27.534273+0000","last_became_peered":"2024-01-25T15:04:27.534273+0000","last_unstale":"2024-01-25T15:04:32.518335+0000","last_undegraded":"2024-01-25T15:04:32.518335+0000","last_fullsized":"2024-01-25T15:04:32.518335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:47:59.032295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517804+0000","last_change":"2024-01-25T15:04:31.803406+0000","last_active":"2024-01-25T15:04:32.517804+0000","last_peered":"2024-01-25T15:04:32.517804+0000","last_clean":"2024-01-25T15:04:32.517804+0000","last_became_active":"2024-01-25T15:04:31.803079+0000","last_became_peered":"2024-01-25T15:04:31.803079+0000","last_unstale":"2024-01-25T15:04:32.517804+0000","last_undegraded":"2024-01-25T15:04:32.517804+0000","last_fullsized":"2024-01-25T15:04:32.517804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:25:43.747285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518611+0000","last_change":"2024-01-25T15:04:26.545449+0000","last_active":"2024-01-25T15:04:32.518611+0000","last_peered":"2024-01-25T15:04:32.518611+0000","last_clean":"2024-01-25T15:04:32.518611+0000","last_became_active":"2024-01-25T15:04:26.545144+0000","last_became_peered":"2024-01-25T15:04:26.545144+0000","last_unstale":"2024-01-25T15:04:32.518611+0000","last_undegraded":"2024-01-25T15:04:32.518611+0000","last_fullsized":"2024-01-25T15:04:32.518611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:56:52.022913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027714+0000","last_change":"2024-01-25T15:04:27.523808+0000","last_active":"2024-01-25T15:04:33.027714+0000","last_peered":"2024-01-25T15:04:33.027714+0000","last_clean":"2024-01-25T15:04:33.027714+0000","last_became_active":"2024-01-25T15:04:27.523173+0000","last_became_peered":"2024-01-25T15:04:27.523173+0000","last_unstale":"2024-01-25T15:04:33.027714+0000","last_undegraded":"2024-01-25T15:04:33.027714+0000","last_fullsized":"2024-01-25T15:04:33.027714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:30.257021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227919+0000","last_change":"2024-01-25T15:04:31.589158+0000","last_active":"2024-01-25T15:04:33.227919+0000","last_peered":"2024-01-25T15:04:33.227919+0000","last_clean":"2024-01-25T15:04:33.227919+0000","last_became_active":"2024-01-25T15:04:31.588664+0000","last_became_peered":"2024-01-25T15:04:31.588664+0000","last_unstale":"2024-01-25T15:04:33.227919+0000","last_undegraded":"2024-01-25T15:04:33.227919+0000","last_fullsized":"2024-01-25T15:04:33.227919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:34.289728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228764+0000","last_change":"2024-01-25T15:04:26.548904+0000","last_active":"2024-01-25T15:04:33.228764+0000","last_peered":"2024-01-25T15:04:33.228764+0000","last_clean":"2024-01-25T15:04:33.228764+0000","last_became_active":"2024-01-25T15:04:26.548603+0000","last_became_peered":"2024-01-25T15:04:26.548603+0000","last_unstale":"2024-01-25T15:04:33.228764+0000","last_undegraded":"2024-01-25T15:04:33.228764+0000","last_fullsized":"2024-01-25T15:04:33.228764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:04:15.478889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227876+0000","last_change":"2024-01-25T15:04:27.524924+0000","last_active":"2024-01-25T15:04:33.227876+0000","last_peered":"2024-01-25T15:04:33.227876+0000","last_clean":"2024-01-25T15:04:33.227876+0000","last_became_active":"2024-01-25T15:04:27.524657+0000","last_became_peered":"2024-01-25T15:04:27.524657+0000","last_unstale":"2024-01-25T15:04:33.227876+0000","last_undegraded":"2024-01-25T15:04:33.227876+0000","last_fullsized":"2024-01-25T15:04:33.227876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:13:43.582651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228255+0000","last_change":"2024-01-25T15:04:31.589682+0000","last_active":"2024-01-25T15:04:33.228255+0000","last_peered":"2024-01-25T15:04:33.228255+0000","last_clean":"2024-01-25T15:04:33.228255+0000","last_became_active":"2024-01-25T15:04:31.589163+0000","last_became_peered":"2024-01-25T15:04:31.589163+0000","last_unstale":"2024-01-25T15:04:33.228255+0000","last_undegraded":"2024-01-25T15:04:33.228255+0000","last_fullsized":"2024-01-25T15:04:33.228255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:48:03.065003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228571+0000","last_change":"2024-01-25T15:04:26.550079+0000","last_active":"2024-01-25T15:04:33.228571+0000","last_peered":"2024-01-25T15:04:33.228571+0000","last_clean":"2024-01-25T15:04:33.228571+0000","last_became_active":"2024-01-25T15:04:26.549674+0000","last_became_peered":"2024-01-25T15:04:26.549674+0000","last_unstale":"2024-01-25T15:04:33.228571+0000","last_undegraded":"2024-01-25T15:04:33.228571+0000","last_fullsized":"2024-01-25T15:04:33.228571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:08:52.043568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228692+0000","last_change":"2024-01-25T15:04:27.523220+0000","last_active":"2024-01-25T15:04:33.228692+0000","last_peered":"2024-01-25T15:04:33.228692+0000","last_clean":"2024-01-25T15:04:33.228692+0000","last_became_active":"2024-01-25T15:04:27.522900+0000","last_became_peered":"2024-01-25T15:04:27.522900+0000","last_unstale":"2024-01-25T15:04:33.228692+0000","last_undegraded":"2024-01-25T15:04:33.228692+0000","last_fullsized":"2024-01-25T15:04:33.228692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:29:19.932806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228034+0000","last_change":"2024-01-25T15:04:31.582261+0000","last_active":"2024-01-25T15:04:33.228034+0000","last_peered":"2024-01-25T15:04:33.228034+0000","last_clean":"2024-01-25T15:04:33.228034+0000","last_became_active":"2024-01-25T15:04:31.581830+0000","last_became_peered":"2024-01-25T15:04:31.581830+0000","last_unstale":"2024-01-25T15:04:33.228034+0000","last_undegraded":"2024-01-25T15:04:33.228034+0000","last_fullsized":"2024-01-25T15:04:33.228034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:45:12.093528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518616+0000","last_change":"2024-01-25T15:04:27.528164+0000","last_active":"2024-01-25T15:04:32.518616+0000","last_peered":"2024-01-25T15:04:32.518616+0000","last_clean":"2024-01-25T15:04:32.518616+0000","last_became_active":"2024-01-25T15:04:27.527873+0000","last_became_peered":"2024-01-25T15:04:27.527873+0000","last_unstale":"2024-01-25T15:04:32.518616+0000","last_undegraded":"2024-01-25T15:04:32.518616+0000","last_fullsized":"2024-01-25T15:04:32.518616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:30:17.007992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229067+0000","last_change":"2024-01-25T15:04:26.552160+0000","last_active":"2024-01-25T15:04:33.229067+0000","last_peered":"2024-01-25T15:04:33.229067+0000","last_clean":"2024-01-25T15:04:33.229067+0000","last_became_active":"2024-01-25T15:04:26.551735+0000","last_became_peered":"2024-01-25T15:04:26.551735+0000","last_unstale":"2024-01-25T15:04:33.229067+0000","last_undegraded":"2024-01-25T15:04:33.229067+0000","last_fullsized":"2024-01-25T15:04:33.229067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:04:56.733153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229250+0000","last_change":"2024-01-25T15:04:31.589097+0000","last_active":"2024-01-25T15:04:33.229250+0000","last_peered":"2024-01-25T15:04:33.229250+0000","last_clean":"2024-01-25T15:04:33.229250+0000","last_became_active":"2024-01-25T15:04:31.588673+0000","last_became_peered":"2024-01-25T15:04:31.588673+0000","last_unstale":"2024-01-25T15:04:33.229250+0000","last_undegraded":"2024-01-25T15:04:33.229250+0000","last_fullsized":"2024-01-25T15:04:33.229250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:58:33.277497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518113+0000","last_change":"2024-01-25T15:04:27.537840+0000","last_active":"2024-01-25T15:04:32.518113+0000","last_peered":"2024-01-25T15:04:32.518113+0000","last_clean":"2024-01-25T15:04:32.518113+0000","last_became_active":"2024-01-25T15:04:27.537456+0000","last_became_peered":"2024-01-25T15:04:27.537456+0000","last_unstale":"2024-01-25T15:04:32.518113+0000","last_undegraded":"2024-01-25T15:04:32.518113+0000","last_fullsized":"2024-01-25T15:04:32.518113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:45:08.060821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188403+0000","last_change":"2024-01-25T15:04:26.548251+0000","last_active":"2024-01-25T15:04:33.188403+0000","last_peered":"2024-01-25T15:04:33.188403+0000","last_clean":"2024-01-25T15:04:33.188403+0000","last_became_active":"2024-01-25T15:04:26.547939+0000","last_became_peered":"2024-01-25T15:04:26.547939+0000","last_unstale":"2024-01-25T15:04:33.188403+0000","last_undegraded":"2024-01-25T15:04:33.188403+0000","last_fullsized":"2024-01-25T15:04:33.188403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:04:56.733153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228362+0000","last_change":"2024-01-25T15:04:31.590194+0000","last_active":"2024-01-25T15:04:33.228362+0000","last_peered":"2024-01-25T15:04:33.228362+0000","last_clean":"2024-01-25T15:04:33.228362+0000","last_became_active":"2024-01-25T15:04:31.589755+0000","last_became_peered":"2024-01-25T15:04:31.589755+0000","last_unstale":"2024-01-25T15:04:33.228362+0000","last_undegraded":"2024-01-25T15:04:33.228362+0000","last_fullsized":"2024-01-25T15:04:33.228362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:13:47.615358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518097+0000","last_change":"2024-01-25T15:04:27.529881+0000","last_active":"2024-01-25T15:04:32.518097+0000","last_peered":"2024-01-25T15:04:32.518097+0000","last_clean":"2024-01-25T15:04:32.518097+0000","last_became_active":"2024-01-25T15:04:27.529347+0000","last_became_peered":"2024-01-25T15:04:27.529347+0000","last_unstale":"2024-01-25T15:04:32.518097+0000","last_undegraded":"2024-01-25T15:04:32.518097+0000","last_fullsized":"2024-01-25T15:04:32.518097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:19:41.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188030+0000","last_change":"2024-01-25T15:04:26.549223+0000","last_active":"2024-01-25T15:04:33.188030+0000","last_peered":"2024-01-25T15:04:33.188030+0000","last_clean":"2024-01-25T15:04:33.188030+0000","last_became_active":"2024-01-25T15:04:26.548915+0000","last_became_peered":"2024-01-25T15:04:26.548915+0000","last_unstale":"2024-01-25T15:04:33.188030+0000","last_undegraded":"2024-01-25T15:04:33.188030+0000","last_fullsized":"2024-01-25T15:04:33.188030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:08:52.043568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188626+0000","last_change":"2024-01-25T15:04:31.801159+0000","last_active":"2024-01-25T15:04:33.188626+0000","last_peered":"2024-01-25T15:04:33.188626+0000","last_clean":"2024-01-25T15:04:33.188626+0000","last_became_active":"2024-01-25T15:04:31.800733+0000","last_became_peered":"2024-01-25T15:04:31.800733+0000","last_unstale":"2024-01-25T15:04:33.188626+0000","last_undegraded":"2024-01-25T15:04:33.188626+0000","last_fullsized":"2024-01-25T15:04:33.188626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:58:07.965682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229691+0000","last_change":"2024-01-25T15:04:27.529655+0000","last_active":"2024-01-25T15:04:33.229691+0000","last_peered":"2024-01-25T15:04:33.229691+0000","last_clean":"2024-01-25T15:04:33.229691+0000","last_became_active":"2024-01-25T15:04:27.529390+0000","last_became_peered":"2024-01-25T15:04:27.529390+0000","last_unstale":"2024-01-25T15:04:33.229691+0000","last_undegraded":"2024-01-25T15:04:33.229691+0000","last_fullsized":"2024-01-25T15:04:33.229691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:15:45.949448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227503+0000","last_change":"2024-01-25T15:04:26.548483+0000","last_active":"2024-01-25T15:04:33.227503+0000","last_peered":"2024-01-25T15:04:33.227503+0000","last_clean":"2024-01-25T15:04:33.227503+0000","last_became_active":"2024-01-25T15:04:26.548215+0000","last_became_peered":"2024-01-25T15:04:26.548215+0000","last_unstale":"2024-01-25T15:04:33.227503+0000","last_undegraded":"2024-01-25T15:04:33.227503+0000","last_fullsized":"2024-01-25T15:04:33.227503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:17:49.229771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228793+0000","last_change":"2024-01-25T15:04:31.588835+0000","last_active":"2024-01-25T15:04:33.228793+0000","last_peered":"2024-01-25T15:04:33.228793+0000","last_clean":"2024-01-25T15:04:33.228793+0000","last_became_active":"2024-01-25T15:04:31.588379+0000","last_became_peered":"2024-01-25T15:04:31.588379+0000","last_unstale":"2024-01-25T15:04:33.228793+0000","last_undegraded":"2024-01-25T15:04:33.228793+0000","last_fullsized":"2024-01-25T15:04:33.228793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:07:22.654442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.028081+0000","last_change":"2024-01-25T15:04:27.526537+0000","last_active":"2024-01-25T15:04:33.028081+0000","last_peered":"2024-01-25T15:04:33.028081+0000","last_clean":"2024-01-25T15:04:33.028081+0000","last_became_active":"2024-01-25T15:04:27.526228+0000","last_became_peered":"2024-01-25T15:04:27.526228+0000","last_unstale":"2024-01-25T15:04:33.028081+0000","last_undegraded":"2024-01-25T15:04:33.028081+0000","last_fullsized":"2024-01-25T15:04:33.028081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:30:17.007992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519264+0000","last_change":"2024-01-25T15:04:26.548972+0000","last_active":"2024-01-25T15:04:32.519264+0000","last_peered":"2024-01-25T15:04:32.519264+0000","last_clean":"2024-01-25T15:04:32.519264+0000","last_became_active":"2024-01-25T15:04:26.548698+0000","last_became_peered":"2024-01-25T15:04:26.548698+0000","last_unstale":"2024-01-25T15:04:32.519264+0000","last_undegraded":"2024-01-25T15:04:32.519264+0000","last_fullsized":"2024-01-25T15:04:32.519264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:04:56.733153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229547+0000","last_change":"2024-01-25T15:04:31.802696+0000","last_active":"2024-01-25T15:04:33.229547+0000","last_peered":"2024-01-25T15:04:33.229547+0000","last_clean":"2024-01-25T15:04:33.229547+0000","last_became_active":"2024-01-25T15:04:31.802303+0000","last_became_peered":"2024-01-25T15:04:31.802303+0000","last_unstale":"2024-01-25T15:04:33.229547+0000","last_undegraded":"2024-01-25T15:04:33.229547+0000","last_fullsized":"2024-01-25T15:04:33.229547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:47:52.136422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518826+0000","last_change":"2024-01-25T15:04:27.539946+0000","last_active":"2024-01-25T15:04:32.518826+0000","last_peered":"2024-01-25T15:04:32.518826+0000","last_clean":"2024-01-25T15:04:32.518826+0000","last_became_active":"2024-01-25T15:04:27.539623+0000","last_became_peered":"2024-01-25T15:04:27.539623+0000","last_unstale":"2024-01-25T15:04:32.518826+0000","last_undegraded":"2024-01-25T15:04:32.518826+0000","last_fullsized":"2024-01-25T15:04:32.518826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:07:18.621735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188491+0000","last_change":"2024-01-25T15:04:26.545936+0000","last_active":"2024-01-25T15:04:33.188491+0000","last_peered":"2024-01-25T15:04:33.188491+0000","last_clean":"2024-01-25T15:04:33.188491+0000","last_became_active":"2024-01-25T15:04:26.545607+0000","last_became_peered":"2024-01-25T15:04:26.545607+0000","last_unstale":"2024-01-25T15:04:33.188491+0000","last_undegraded":"2024-01-25T15:04:33.188491+0000","last_fullsized":"2024-01-25T15:04:33.188491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:15:44.944688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517706+0000","last_change":"2024-01-25T15:04:31.804100+0000","last_active":"2024-01-25T15:04:32.517706+0000","last_peered":"2024-01-25T15:04:32.517706+0000","last_clean":"2024-01-25T15:04:32.517706+0000","last_became_active":"2024-01-25T15:04:31.803678+0000","last_became_peered":"2024-01-25T15:04:31.803678+0000","last_unstale":"2024-01-25T15:04:32.517706+0000","last_undegraded":"2024-01-25T15:04:32.517706+0000","last_fullsized":"2024-01-25T15:04:32.517706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:41:20.297981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188527+0000","last_change":"2024-01-25T15:04:27.530931+0000","last_active":"2024-01-25T15:04:33.188527+0000","last_peered":"2024-01-25T15:04:33.188527+0000","last_clean":"2024-01-25T15:04:33.188527+0000","last_became_active":"2024-01-25T15:04:27.530621+0000","last_became_peered":"2024-01-25T15:04:27.530621+0000","last_unstale":"2024-01-25T15:04:33.188527+0000","last_undegraded":"2024-01-25T15:04:33.188527+0000","last_fullsized":"2024-01-25T15:04:33.188527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:19:41.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228955+0000","last_change":"2024-01-25T15:04:26.548270+0000","last_active":"2024-01-25T15:04:33.228955+0000","last_peered":"2024-01-25T15:04:33.228955+0000","last_clean":"2024-01-25T15:04:33.228955+0000","last_became_active":"2024-01-25T15:04:26.547977+0000","last_became_peered":"2024-01-25T15:04:26.547977+0000","last_unstale":"2024-01-25T15:04:33.228955+0000","last_undegraded":"2024-01-25T15:04:33.228955+0000","last_fullsized":"2024-01-25T15:04:33.228955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:40:17.099358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027687+0000","last_change":"2024-01-25T15:04:31.800974+0000","last_active":"2024-01-25T15:04:33.027687+0000","last_peered":"2024-01-25T15:04:33.027687+0000","last_clean":"2024-01-25T15:04:33.027687+0000","last_became_active":"2024-01-25T15:04:31.800562+0000","last_became_peered":"2024-01-25T15:04:31.800562+0000","last_unstale":"2024-01-25T15:04:33.027687+0000","last_undegraded":"2024-01-25T15:04:33.027687+0000","last_fullsized":"2024-01-25T15:04:33.027687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:55:06.438077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228790+0000","last_change":"2024-01-25T15:04:27.531901+0000","last_active":"2024-01-25T15:04:33.228790+0000","last_peered":"2024-01-25T15:04:33.228790+0000","last_clean":"2024-01-25T15:04:33.228790+0000","last_became_active":"2024-01-25T15:04:27.531519+0000","last_became_peered":"2024-01-25T15:04:27.531519+0000","last_unstale":"2024-01-25T15:04:33.228790+0000","last_undegraded":"2024-01-25T15:04:33.228790+0000","last_fullsized":"2024-01-25T15:04:33.228790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:47:48.103715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188610+0000","last_change":"2024-01-25T15:04:26.544391+0000","last_active":"2024-01-25T15:04:33.188610+0000","last_peered":"2024-01-25T15:04:33.188610+0000","last_clean":"2024-01-25T15:04:33.188610+0000","last_became_active":"2024-01-25T15:04:26.544092+0000","last_became_peered":"2024-01-25T15:04:26.544092+0000","last_unstale":"2024-01-25T15:04:33.188610+0000","last_undegraded":"2024-01-25T15:04:33.188610+0000","last_fullsized":"2024-01-25T15:04:33.188610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:17:49.229771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188192+0000","last_change":"2024-01-25T15:04:31.588590+0000","last_active":"2024-01-25T15:04:33.188192+0000","last_peered":"2024-01-25T15:04:33.188192+0000","last_clean":"2024-01-25T15:04:33.188192+0000","last_became_active":"2024-01-25T15:04:31.588221+0000","last_became_peered":"2024-01-25T15:04:31.588221+0000","last_unstale":"2024-01-25T15:04:33.188192+0000","last_undegraded":"2024-01-25T15:04:33.188192+0000","last_fullsized":"2024-01-25T15:04:33.188192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:04.647058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229204+0000","last_change":"2024-01-25T15:04:27.535794+0000","last_active":"2024-01-25T15:04:33.229204+0000","last_peered":"2024-01-25T15:04:33.229204+0000","last_clean":"2024-01-25T15:04:33.229204+0000","last_became_active":"2024-01-25T15:04:27.535528+0000","last_became_peered":"2024-01-25T15:04:27.535528+0000","last_unstale":"2024-01-25T15:04:33.229204+0000","last_undegraded":"2024-01-25T15:04:33.229204+0000","last_fullsized":"2024-01-25T15:04:33.229204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:04:57.737913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229149+0000","last_change":"2024-01-25T15:04:26.543493+0000","last_active":"2024-01-25T15:04:33.229149+0000","last_peered":"2024-01-25T15:04:33.229149+0000","last_clean":"2024-01-25T15:04:33.229149+0000","last_became_active":"2024-01-25T15:04:26.543214+0000","last_became_peered":"2024-01-25T15:04:26.543214+0000","last_unstale":"2024-01-25T15:04:33.229149+0000","last_undegraded":"2024-01-25T15:04:33.229149+0000","last_fullsized":"2024-01-25T15:04:33.229149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:56:52.022913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188481+0000","last_change":"2024-01-25T15:04:31.589300+0000","last_active":"2024-01-25T15:04:33.188481+0000","last_peered":"2024-01-25T15:04:33.188481+0000","last_clean":"2024-01-25T15:04:33.188481+0000","last_became_active":"2024-01-25T15:04:31.588325+0000","last_became_peered":"2024-01-25T15:04:31.588325+0000","last_unstale":"2024-01-25T15:04:33.188481+0000","last_undegraded":"2024-01-25T15:04:33.188481+0000","last_fullsized":"2024-01-25T15:04:33.188481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:55:06.438077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.187995+0000","last_change":"2024-01-25T15:04:27.530775+0000","last_active":"2024-01-25T15:04:33.187995+0000","last_peered":"2024-01-25T15:04:33.187995+0000","last_clean":"2024-01-25T15:04:33.187995+0000","last_became_active":"2024-01-25T15:04:27.530457+0000","last_became_peered":"2024-01-25T15:04:27.530457+0000","last_unstale":"2024-01-25T15:04:33.187995+0000","last_undegraded":"2024-01-25T15:04:33.187995+0000","last_fullsized":"2024-01-25T15:04:33.187995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:30:17.007992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519122+0000","last_change":"2024-01-25T15:04:26.542850+0000","last_active":"2024-01-25T15:04:32.519122+0000","last_peered":"2024-01-25T15:04:32.519122+0000","last_clean":"2024-01-25T15:04:32.519122+0000","last_became_active":"2024-01-25T15:04:26.542553+0000","last_became_peered":"2024-01-25T15:04:26.542553+0000","last_unstale":"2024-01-25T15:04:32.519122+0000","last_undegraded":"2024-01-25T15:04:32.519122+0000","last_fullsized":"2024-01-25T15:04:32.519122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:00:16.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188633+0000","last_change":"2024-01-25T15:04:31.587087+0000","last_active":"2024-01-25T15:04:33.188633+0000","last_peered":"2024-01-25T15:04:33.188633+0000","last_clean":"2024-01-25T15:04:33.188633+0000","last_became_active":"2024-01-25T15:04:31.586473+0000","last_became_peered":"2024-01-25T15:04:31.586473+0000","last_unstale":"2024-01-25T15:04:33.188633+0000","last_undegraded":"2024-01-25T15:04:33.188633+0000","last_fullsized":"2024-01-25T15:04:33.188633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:48:53.794961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027426+0000","last_change":"2024-01-25T15:04:27.523437+0000","last_active":"2024-01-25T15:04:33.027426+0000","last_peered":"2024-01-25T15:04:33.027426+0000","last_clean":"2024-01-25T15:04:33.027426+0000","last_became_active":"2024-01-25T15:04:27.523120+0000","last_became_peered":"2024-01-25T15:04:27.523120+0000","last_unstale":"2024-01-25T15:04:33.027426+0000","last_undegraded":"2024-01-25T15:04:33.027426+0000","last_fullsized":"2024-01-25T15:04:33.027426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:55:39.574847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227614+0000","last_change":"2024-01-25T15:04:26.548357+0000","last_active":"2024-01-25T15:04:33.227614+0000","last_peered":"2024-01-25T15:04:33.227614+0000","last_clean":"2024-01-25T15:04:33.227614+0000","last_became_active":"2024-01-25T15:04:26.548083+0000","last_became_peered":"2024-01-25T15:04:26.548083+0000","last_unstale":"2024-01-25T15:04:33.227614+0000","last_undegraded":"2024-01-25T15:04:33.227614+0000","last_fullsized":"2024-01-25T15:04:33.227614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:15:44.944688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.028012+0000","last_change":"2024-01-25T15:04:31.802800+0000","last_active":"2024-01-25T15:04:33.028012+0000","last_peered":"2024-01-25T15:04:33.028012+0000","last_clean":"2024-01-25T15:04:33.028012+0000","last_became_active":"2024-01-25T15:04:31.802424+0000","last_became_peered":"2024-01-25T15:04:31.802424+0000","last_unstale":"2024-01-25T15:04:33.028012+0000","last_undegraded":"2024-01-25T15:04:33.028012+0000","last_fullsized":"2024-01-25T15:04:33.028012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:21:03.688233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517912+0000","last_change":"2024-01-25T15:04:27.540477+0000","last_active":"2024-01-25T15:04:32.517912+0000","last_peered":"2024-01-25T15:04:32.517912+0000","last_clean":"2024-01-25T15:04:32.517912+0000","last_became_active":"2024-01-25T15:04:27.539902+0000","last_became_peered":"2024-01-25T15:04:27.539902+0000","last_unstale":"2024-01-25T15:04:32.517912+0000","last_undegraded":"2024-01-25T15:04:32.517912+0000","last_fullsized":"2024-01-25T15:04:32.517912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:58:29.244789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228206+0000","last_change":"2024-01-25T15:04:26.552279+0000","last_active":"2024-01-25T15:04:33.228206+0000","last_peered":"2024-01-25T15:04:33.228206+0000","last_clean":"2024-01-25T15:04:33.228206+0000","last_became_active":"2024-01-25T15:04:26.552022+0000","last_became_peered":"2024-01-25T15:04:26.552022+0000","last_unstale":"2024-01-25T15:04:33.228206+0000","last_undegraded":"2024-01-25T15:04:33.228206+0000","last_fullsized":"2024-01-25T15:04:33.228206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:30:22.770050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227688+0000","last_change":"2024-01-25T15:04:16.181635+0000","last_active":"2024-01-25T15:04:33.227688+0000","last_peered":"2024-01-25T15:04:33.227688+0000","last_clean":"2024-01-25T15:04:33.227688+0000","last_became_active":"2024-01-25T15:04:16.179890+0000","last_became_peered":"2024-01-25T15:04:16.179890+0000","last_unstale":"2024-01-25T15:04:33.227688+0000","last_undegraded":"2024-01-25T15:04:33.227688+0000","last_fullsized":"2024-01-25T15:04:33.227688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_clean_scrub_stamp":"2024-01-25T15:04:14.956188+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:49:00.618327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518629+0000","last_change":"2024-01-25T15:04:31.805290+0000","last_active":"2024-01-25T15:04:32.518629+0000","last_peered":"2024-01-25T15:04:32.518629+0000","last_clean":"2024-01-25T15:04:32.518629+0000","last_became_active":"2024-01-25T15:04:31.804864+0000","last_became_peered":"2024-01-25T15:04:31.804864+0000","last_unstale":"2024-01-25T15:04:32.518629+0000","last_undegraded":"2024-01-25T15:04:32.518629+0000","last_fullsized":"2024-01-25T15:04:32.518629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:04.647058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228586+0000","last_change":"2024-01-25T15:04:27.541813+0000","last_active":"2024-01-25T15:04:33.228586+0000","last_peered":"2024-01-25T15:04:33.228586+0000","last_clean":"2024-01-25T15:04:33.228586+0000","last_became_active":"2024-01-25T15:04:27.541486+0000","last_became_peered":"2024-01-25T15:04:27.541486+0000","last_unstale":"2024-01-25T15:04:33.228586+0000","last_undegraded":"2024-01-25T15:04:33.228586+0000","last_fullsized":"2024-01-25T15:04:33.228586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:55:02.405369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519311+0000","last_change":"2024-01-25T15:04:26.552363+0000","last_active":"2024-01-25T15:04:32.519311+0000","last_peered":"2024-01-25T15:04:32.519311+0000","last_clean":"2024-01-25T15:04:32.519311+0000","last_became_active":"2024-01-25T15:04:26.552012+0000","last_became_peered":"2024-01-25T15:04:26.552012+0000","last_unstale":"2024-01-25T15:04:32.519311+0000","last_undegraded":"2024-01-25T15:04:32.519311+0000","last_fullsized":"2024-01-25T15:04:32.519311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:30:22.770050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518534+0000","last_change":"2024-01-25T15:04:31.803682+0000","last_active":"2024-01-25T15:04:32.518534+0000","last_peered":"2024-01-25T15:04:32.518534+0000","last_clean":"2024-01-25T15:04:32.518534+0000","last_became_active":"2024-01-25T15:04:31.803296+0000","last_became_peered":"2024-01-25T15:04:31.803296+0000","last_unstale":"2024-01-25T15:04:32.518534+0000","last_undegraded":"2024-01-25T15:04:32.518534+0000","last_fullsized":"2024-01-25T15:04:32.518534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:58:33.277497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227972+0000","last_change":"2024-01-25T15:04:27.536077+0000","last_active":"2024-01-25T15:04:33.227972+0000","last_peered":"2024-01-25T15:04:33.227972+0000","last_clean":"2024-01-25T15:04:33.227972+0000","last_became_active":"2024-01-25T15:04:27.535816+0000","last_became_peered":"2024-01-25T15:04:27.535816+0000","last_unstale":"2024-01-25T15:04:33.227972+0000","last_undegraded":"2024-01-25T15:04:33.227972+0000","last_fullsized":"2024-01-25T15:04:33.227972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:58:03.932974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188722+0000","last_change":"2024-01-25T15:04:26.540088+0000","last_active":"2024-01-25T15:04:33.188722+0000","last_peered":"2024-01-25T15:04:33.188722+0000","last_clean":"2024-01-25T15:04:33.188722+0000","last_became_active":"2024-01-25T15:04:26.539758+0000","last_became_peered":"2024-01-25T15:04:26.539758+0000","last_unstale":"2024-01-25T15:04:33.188722+0000","last_undegraded":"2024-01-25T15:04:33.188722+0000","last_fullsized":"2024-01-25T15:04:33.188722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:09:05.578946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027869+0000","last_change":"2024-01-25T15:04:31.588679+0000","last_active":"2024-01-25T15:04:33.027869+0000","last_peered":"2024-01-25T15:04:33.027869+0000","last_clean":"2024-01-25T15:04:33.027869+0000","last_became_active":"2024-01-25T15:04:31.588266+0000","last_became_peered":"2024-01-25T15:04:31.588266+0000","last_unstale":"2024-01-25T15:04:33.027869+0000","last_undegraded":"2024-01-25T15:04:33.027869+0000","last_fullsized":"2024-01-25T15:04:33.027869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:48:53.794961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229583+0000","last_change":"2024-01-25T15:04:27.539641+0000","last_active":"2024-01-25T15:04:33.229583+0000","last_peered":"2024-01-25T15:04:33.229583+0000","last_clean":"2024-01-25T15:04:33.229583+0000","last_became_active":"2024-01-25T15:04:27.539345+0000","last_became_peered":"2024-01-25T15:04:27.539345+0000","last_unstale":"2024-01-25T15:04:33.229583+0000","last_undegraded":"2024-01-25T15:04:33.229583+0000","last_fullsized":"2024-01-25T15:04:33.229583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:53:55.186236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519214+0000","last_change":"2024-01-25T15:04:26.534562+0000","last_active":"2024-01-25T15:04:32.519214+0000","last_peered":"2024-01-25T15:04:32.519214+0000","last_clean":"2024-01-25T15:04:32.519214+0000","last_became_active":"2024-01-25T15:04:26.534281+0000","last_became_peered":"2024-01-25T15:04:26.534281+0000","last_unstale":"2024-01-25T15:04:32.519214+0000","last_undegraded":"2024-01-25T15:04:32.519214+0000","last_fullsized":"2024-01-25T15:04:32.519214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:05:27.178453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227545+0000","last_change":"2024-01-25T15:04:31.802670+0000","last_active":"2024-01-25T15:04:33.227545+0000","last_peered":"2024-01-25T15:04:33.227545+0000","last_clean":"2024-01-25T15:04:33.227545+0000","last_became_active":"2024-01-25T15:04:31.802294+0000","last_became_peered":"2024-01-25T15:04:31.802294+0000","last_unstale":"2024-01-25T15:04:33.227545+0000","last_undegraded":"2024-01-25T15:04:33.227545+0000","last_fullsized":"2024-01-25T15:04:33.227545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:53:59.218943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228093+0000","last_change":"2024-01-25T15:04:27.539159+0000","last_active":"2024-01-25T15:04:33.228093+0000","last_peered":"2024-01-25T15:04:33.228093+0000","last_clean":"2024-01-25T15:04:33.228093+0000","last_became_active":"2024-01-25T15:04:27.538865+0000","last_became_peered":"2024-01-25T15:04:27.538865+0000","last_unstale":"2024-01-25T15:04:33.228093+0000","last_undegraded":"2024-01-25T15:04:33.228093+0000","last_fullsized":"2024-01-25T15:04:33.228093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:47:48.103715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228169+0000","last_change":"2024-01-25T15:04:26.545573+0000","last_active":"2024-01-25T15:04:33.228169+0000","last_peered":"2024-01-25T15:04:33.228169+0000","last_clean":"2024-01-25T15:04:33.228169+0000","last_became_active":"2024-01-25T15:04:26.545279+0000","last_became_peered":"2024-01-25T15:04:26.545279+0000","last_unstale":"2024-01-25T15:04:33.228169+0000","last_undegraded":"2024-01-25T15:04:33.228169+0000","last_fullsized":"2024-01-25T15:04:33.228169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:45:28.838538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229521+0000","last_change":"2024-01-25T15:04:31.590311+0000","last_active":"2024-01-25T15:04:33.229521+0000","last_peered":"2024-01-25T15:04:33.229521+0000","last_clean":"2024-01-25T15:04:33.229521+0000","last_became_active":"2024-01-25T15:04:31.589798+0000","last_became_peered":"2024-01-25T15:04:31.589798+0000","last_unstale":"2024-01-25T15:04:33.229521+0000","last_undegraded":"2024-01-25T15:04:33.229521+0000","last_fullsized":"2024-01-25T15:04:33.229521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:04.647058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227885+0000","last_change":"2024-01-25T15:04:27.539911+0000","last_active":"2024-01-25T15:04:33.227885+0000","last_peered":"2024-01-25T15:04:33.227885+0000","last_clean":"2024-01-25T15:04:33.227885+0000","last_became_active":"2024-01-25T15:04:27.539414+0000","last_became_peered":"2024-01-25T15:04:27.539414+0000","last_unstale":"2024-01-25T15:04:33.227885+0000","last_undegraded":"2024-01-25T15:04:33.227885+0000","last_fullsized":"2024-01-25T15:04:33.227885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:07:18.621735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518745+0000","last_change":"2024-01-25T15:04:26.538656+0000","last_active":"2024-01-25T15:04:32.518745+0000","last_peered":"2024-01-25T15:04:32.518745+0000","last_clean":"2024-01-25T15:04:32.518745+0000","last_became_active":"2024-01-25T15:04:26.538352+0000","last_became_peered":"2024-01-25T15:04:26.538352+0000","last_unstale":"2024-01-25T15:04:32.518745+0000","last_undegraded":"2024-01-25T15:04:32.518745+0000","last_fullsized":"2024-01-25T15:04:32.518745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:56:52.022913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027848+0000","last_change":"2024-01-25T15:04:31.581015+0000","last_active":"2024-01-25T15:04:33.027848+0000","last_peered":"2024-01-25T15:04:33.027848+0000","last_clean":"2024-01-25T15:04:33.027848+0000","last_became_active":"2024-01-25T15:04:31.580253+0000","last_became_peered":"2024-01-25T15:04:31.580253+0000","last_unstale":"2024-01-25T15:04:33.027848+0000","last_undegraded":"2024-01-25T15:04:33.027848+0000","last_fullsized":"2024-01-25T15:04:33.027848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:58:07.965682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518484+0000","last_change":"2024-01-25T15:04:27.536648+0000","last_active":"2024-01-25T15:04:32.518484+0000","last_peered":"2024-01-25T15:04:32.518484+0000","last_clean":"2024-01-25T15:04:32.518484+0000","last_became_active":"2024-01-25T15:04:27.536010+0000","last_became_peered":"2024-01-25T15:04:27.536010+0000","last_unstale":"2024-01-25T15:04:32.518484+0000","last_undegraded":"2024-01-25T15:04:32.518484+0000","last_fullsized":"2024-01-25T15:04:32.518484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:48.199996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518565+0000","last_change":"2024-01-25T15:04:26.540469+0000","last_active":"2024-01-25T15:04:32.518565+0000","last_peered":"2024-01-25T15:04:32.518565+0000","last_clean":"2024-01-25T15:04:32.518565+0000","last_became_active":"2024-01-25T15:04:26.540180+0000","last_became_peered":"2024-01-25T15:04:26.540180+0000","last_unstale":"2024-01-25T15:04:32.518565+0000","last_undegraded":"2024-01-25T15:04:32.518565+0000","last_fullsized":"2024-01-25T15:04:32.518565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:56:52.022913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518587+0000","last_change":"2024-01-25T15:04:31.804865+0000","last_active":"2024-01-25T15:04:32.518587+0000","last_peered":"2024-01-25T15:04:32.518587+0000","last_clean":"2024-01-25T15:04:32.518587+0000","last_became_active":"2024-01-25T15:04:31.804470+0000","last_became_peered":"2024-01-25T15:04:31.804470+0000","last_unstale":"2024-01-25T15:04:32.518587+0000","last_undegraded":"2024-01-25T15:04:32.518587+0000","last_fullsized":"2024-01-25T15:04:32.518587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:11:49.452494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228951+0000","last_change":"2024-01-25T15:04:27.541056+0000","last_active":"2024-01-25T15:04:33.228951+0000","last_peered":"2024-01-25T15:04:33.228951+0000","last_clean":"2024-01-25T15:04:33.228951+0000","last_became_active":"2024-01-25T15:04:27.539554+0000","last_became_peered":"2024-01-25T15:04:27.539554+0000","last_unstale":"2024-01-25T15:04:33.228951+0000","last_undegraded":"2024-01-25T15:04:33.228951+0000","last_fullsized":"2024-01-25T15:04:33.228951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:00.614350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229053+0000","last_change":"2024-01-25T15:04:26.551429+0000","last_active":"2024-01-25T15:04:33.229053+0000","last_peered":"2024-01-25T15:04:33.229053+0000","last_clean":"2024-01-25T15:04:33.229053+0000","last_became_active":"2024-01-25T15:04:26.551181+0000","last_became_peered":"2024-01-25T15:04:26.551181+0000","last_unstale":"2024-01-25T15:04:33.229053+0000","last_undegraded":"2024-01-25T15:04:33.229053+0000","last_fullsized":"2024-01-25T15:04:33.229053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:00:16.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518432+0000","last_change":"2024-01-25T15:04:31.800938+0000","last_active":"2024-01-25T15:04:32.518432+0000","last_peered":"2024-01-25T15:04:32.518432+0000","last_clean":"2024-01-25T15:04:32.518432+0000","last_became_active":"2024-01-25T15:04:31.800545+0000","last_became_peered":"2024-01-25T15:04:31.800545+0000","last_unstale":"2024-01-25T15:04:32.518432+0000","last_undegraded":"2024-01-25T15:04:32.518432+0000","last_fullsized":"2024-01-25T15:04:32.518432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:26:14.960523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027624+0000","last_change":"2024-01-25T15:04:27.534211+0000","last_active":"2024-01-25T15:04:33.027624+0000","last_peered":"2024-01-25T15:04:33.027624+0000","last_clean":"2024-01-25T15:04:33.027624+0000","last_became_active":"2024-01-25T15:04:27.533793+0000","last_became_peered":"2024-01-25T15:04:27.533793+0000","last_unstale":"2024-01-25T15:04:33.027624+0000","last_undegraded":"2024-01-25T15:04:33.027624+0000","last_fullsized":"2024-01-25T15:04:33.027624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:55:36.165047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027906+0000","last_change":"2024-01-25T15:04:26.547052+0000","last_active":"2024-01-25T15:04:33.027906+0000","last_peered":"2024-01-25T15:04:33.027906+0000","last_clean":"2024-01-25T15:04:33.027906+0000","last_became_active":"2024-01-25T15:04:26.546739+0000","last_became_peered":"2024-01-25T15:04:26.546739+0000","last_unstale":"2024-01-25T15:04:33.027906+0000","last_undegraded":"2024-01-25T15:04:33.027906+0000","last_fullsized":"2024-01-25T15:04:33.027906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:05:27.178453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228631+0000","last_change":"2024-01-25T15:04:31.801553+0000","last_active":"2024-01-25T15:04:33.228631+0000","last_peered":"2024-01-25T15:04:33.228631+0000","last_clean":"2024-01-25T15:04:33.228631+0000","last_became_active":"2024-01-25T15:04:31.801117+0000","last_became_peered":"2024-01-25T15:04:31.801117+0000","last_unstale":"2024-01-25T15:04:33.228631+0000","last_undegraded":"2024-01-25T15:04:33.228631+0000","last_fullsized":"2024-01-25T15:04:33.228631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:41:20.297981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228502+0000","last_change":"2024-01-25T15:04:27.542771+0000","last_active":"2024-01-25T15:04:33.228502+0000","last_peered":"2024-01-25T15:04:33.228502+0000","last_clean":"2024-01-25T15:04:33.228502+0000","last_became_active":"2024-01-25T15:04:27.542443+0000","last_became_peered":"2024-01-25T15:04:27.542443+0000","last_unstale":"2024-01-25T15:04:33.228502+0000","last_undegraded":"2024-01-25T15:04:33.228502+0000","last_fullsized":"2024-01-25T15:04:33.228502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:13:43.582651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:36.881976+0000","last_change":"2024-01-25T15:04:26.543626+0000","last_active":"2024-01-25T15:04:36.881976+0000","last_peered":"2024-01-25T15:04:36.881976+0000","last_clean":"2024-01-25T15:04:36.881976+0000","last_became_active":"2024-01-25T15:04:26.543134+0000","last_became_peered":"2024-01-25T15:04:26.543134+0000","last_unstale":"2024-01-25T15:04:36.881976+0000","last_undegraded":"2024-01-25T15:04:36.881976+0000","last_fullsized":"2024-01-25T15:04:36.881976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:17:49.229771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188193+0000","last_change":"2024-01-25T15:04:31.590781+0000","last_active":"2024-01-25T15:04:33.188193+0000","last_peered":"2024-01-25T15:04:33.188193+0000","last_clean":"2024-01-25T15:04:33.188193+0000","last_became_active":"2024-01-25T15:04:31.589830+0000","last_became_peered":"2024-01-25T15:04:31.589830+0000","last_unstale":"2024-01-25T15:04:33.188193+0000","last_undegraded":"2024-01-25T15:04:33.188193+0000","last_fullsized":"2024-01-25T15:04:33.188193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:47:52.136422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228853+0000","last_change":"2024-01-25T15:04:27.530991+0000","last_active":"2024-01-25T15:04:33.228853+0000","last_peered":"2024-01-25T15:04:33.228853+0000","last_clean":"2024-01-25T15:04:33.228853+0000","last_became_active":"2024-01-25T15:04:27.530694+0000","last_became_peered":"2024-01-25T15:04:27.530694+0000","last_unstale":"2024-01-25T15:04:33.228853+0000","last_undegraded":"2024-01-25T15:04:33.228853+0000","last_fullsized":"2024-01-25T15:04:33.228853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:04:16.483649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188688+0000","last_change":"2024-01-25T15:04:26.552321+0000","last_active":"2024-01-25T15:04:33.188688+0000","last_peered":"2024-01-25T15:04:33.188688+0000","last_clean":"2024-01-25T15:04:33.188688+0000","last_became_active":"2024-01-25T15:04:26.552007+0000","last_became_peered":"2024-01-25T15:04:26.552007+0000","last_unstale":"2024-01-25T15:04:33.188688+0000","last_undegraded":"2024-01-25T15:04:33.188688+0000","last_fullsized":"2024-01-25T15:04:33.188688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:56:52.022913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228472+0000","last_change":"2024-01-25T15:04:31.589216+0000","last_active":"2024-01-25T15:04:33.228472+0000","last_peered":"2024-01-25T15:04:33.228472+0000","last_clean":"2024-01-25T15:04:33.228472+0000","last_became_active":"2024-01-25T15:04:31.588411+0000","last_became_peered":"2024-01-25T15:04:31.588411+0000","last_unstale":"2024-01-25T15:04:33.228472+0000","last_undegraded":"2024-01-25T15:04:33.228472+0000","last_fullsized":"2024-01-25T15:04:33.228472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:29:23.965513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027809+0000","last_change":"2024-01-25T15:04:27.524082+0000","last_active":"2024-01-25T15:04:33.027809+0000","last_peered":"2024-01-25T15:04:33.027809+0000","last_clean":"2024-01-25T15:04:33.027809+0000","last_became_active":"2024-01-25T15:04:27.523538+0000","last_became_peered":"2024-01-25T15:04:27.523538+0000","last_unstale":"2024-01-25T15:04:33.027809+0000","last_undegraded":"2024-01-25T15:04:33.027809+0000","last_fullsized":"2024-01-25T15:04:33.027809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:45:08.060821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229389+0000","last_change":"2024-01-25T15:04:26.546430+0000","last_active":"2024-01-25T15:04:33.229389+0000","last_peered":"2024-01-25T15:04:33.229389+0000","last_clean":"2024-01-25T15:04:33.229389+0000","last_became_active":"2024-01-25T15:04:26.546172+0000","last_became_peered":"2024-01-25T15:04:26.546172+0000","last_unstale":"2024-01-25T15:04:33.229389+0000","last_undegraded":"2024-01-25T15:04:33.229389+0000","last_fullsized":"2024-01-25T15:04:33.229389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:17:49.229771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518237+0000","last_change":"2024-01-25T15:04:31.585484+0000","last_active":"2024-01-25T15:04:32.518237+0000","last_peered":"2024-01-25T15:04:32.518237+0000","last_clean":"2024-01-25T15:04:32.518237+0000","last_became_active":"2024-01-25T15:04:31.585107+0000","last_became_peered":"2024-01-25T15:04:31.585107+0000","last_unstale":"2024-01-25T15:04:32.518237+0000","last_undegraded":"2024-01-25T15:04:32.518237+0000","last_fullsized":"2024-01-25T15:04:32.518237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:52:39.722794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229300+0000","last_change":"2024-01-25T15:04:27.539659+0000","last_active":"2024-01-25T15:04:33.229300+0000","last_peered":"2024-01-25T15:04:33.229300+0000","last_clean":"2024-01-25T15:04:33.229300+0000","last_became_active":"2024-01-25T15:04:27.539382+0000","last_became_peered":"2024-01-25T15:04:27.539382+0000","last_unstale":"2024-01-25T15:04:33.229300+0000","last_undegraded":"2024-01-25T15:04:33.229300+0000","last_fullsized":"2024-01-25T15:04:33.229300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:47:59.032295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519043+0000","last_change":"2024-01-25T15:04:26.550083+0000","last_active":"2024-01-25T15:04:32.519043+0000","last_peered":"2024-01-25T15:04:32.519043+0000","last_clean":"2024-01-25T15:04:32.519043+0000","last_became_active":"2024-01-25T15:04:26.549812+0000","last_became_peered":"2024-01-25T15:04:26.549812+0000","last_unstale":"2024-01-25T15:04:32.519043+0000","last_undegraded":"2024-01-25T15:04:32.519043+0000","last_fullsized":"2024-01-25T15:04:32.519043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:15:44.944688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518046+0000","last_change":"2024-01-25T15:04:31.802519+0000","last_active":"2024-01-25T15:04:32.518046+0000","last_peered":"2024-01-25T15:04:32.518046+0000","last_clean":"2024-01-25T15:04:32.518046+0000","last_became_active":"2024-01-25T15:04:31.802179+0000","last_became_peered":"2024-01-25T15:04:31.802179+0000","last_unstale":"2024-01-25T15:04:32.518046+0000","last_undegraded":"2024-01-25T15:04:32.518046+0000","last_fullsized":"2024-01-25T15:04:32.518046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:07:22.928800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.028016+0000","last_change":"2024-01-25T15:04:31.803027+0000","last_active":"2024-01-25T15:04:33.028016+0000","last_peered":"2024-01-25T15:04:33.028016+0000","last_clean":"2024-01-25T15:04:33.028016+0000","last_became_active":"2024-01-25T15:04:31.802543+0000","last_became_peered":"2024-01-25T15:04:31.802543+0000","last_unstale":"2024-01-25T15:04:33.028016+0000","last_undegraded":"2024-01-25T15:04:33.028016+0000","last_fullsized":"2024-01-25T15:04:33.028016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:53:59.218943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.187926+0000","last_change":"2024-01-25T15:04:27.537760+0000","last_active":"2024-01-25T15:04:33.187926+0000","last_peered":"2024-01-25T15:04:33.187926+0000","last_clean":"2024-01-25T15:04:33.187926+0000","last_became_active":"2024-01-25T15:04:27.537411+0000","last_became_peered":"2024-01-25T15:04:27.537411+0000","last_unstale":"2024-01-25T15:04:33.187926+0000","last_undegraded":"2024-01-25T15:04:33.187926+0000","last_fullsized":"2024-01-25T15:04:33.187926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:24:46.429617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227807+0000","last_change":"2024-01-25T15:04:26.553364+0000","last_active":"2024-01-25T15:04:33.227807+0000","last_peered":"2024-01-25T15:04:33.227807+0000","last_clean":"2024-01-25T15:04:33.227807+0000","last_became_active":"2024-01-25T15:04:26.553023+0000","last_became_peered":"2024-01-25T15:04:26.553023+0000","last_unstale":"2024-01-25T15:04:33.227807+0000","last_undegraded":"2024-01-25T15:04:33.227807+0000","last_fullsized":"2024-01-25T15:04:33.227807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:09:05.578946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518883+0000","last_change":"2024-01-25T15:04:31.588551+0000","last_active":"2024-01-25T15:04:32.518883+0000","last_peered":"2024-01-25T15:04:32.518883+0000","last_clean":"2024-01-25T15:04:32.518883+0000","last_became_active":"2024-01-25T15:04:31.588144+0000","last_became_peered":"2024-01-25T15:04:31.588144+0000","last_unstale":"2024-01-25T15:04:32.518883+0000","last_undegraded":"2024-01-25T15:04:32.518883+0000","last_fullsized":"2024-01-25T15:04:32.518883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:47:52.136422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517990+0000","last_change":"2024-01-25T15:04:27.537715+0000","last_active":"2024-01-25T15:04:32.517990+0000","last_peered":"2024-01-25T15:04:32.517990+0000","last_clean":"2024-01-25T15:04:32.517990+0000","last_became_active":"2024-01-25T15:04:27.537433+0000","last_became_peered":"2024-01-25T15:04:27.537433+0000","last_unstale":"2024-01-25T15:04:32.517990+0000","last_undegraded":"2024-01-25T15:04:32.517990+0000","last_fullsized":"2024-01-25T15:04:32.517990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:48.199996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518112+0000","last_change":"2024-01-25T15:04:26.543354+0000","last_active":"2024-01-25T15:04:32.518112+0000","last_peered":"2024-01-25T15:04:32.518112+0000","last_clean":"2024-01-25T15:04:32.518112+0000","last_became_active":"2024-01-25T15:04:26.543047+0000","last_became_peered":"2024-01-25T15:04:26.543047+0000","last_unstale":"2024-01-25T15:04:32.518112+0000","last_undegraded":"2024-01-25T15:04:32.518112+0000","last_fullsized":"2024-01-25T15:04:32.518112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:30:22.770050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518843+0000","last_change":"2024-01-25T15:04:26.541507+0000","last_active":"2024-01-25T15:04:32.518843+0000","last_peered":"2024-01-25T15:04:32.518843+0000","last_clean":"2024-01-25T15:04:32.518843+0000","last_became_active":"2024-01-25T15:04:26.540128+0000","last_became_peered":"2024-01-25T15:04:26.540128+0000","last_unstale":"2024-01-25T15:04:32.518843+0000","last_undegraded":"2024-01-25T15:04:32.518843+0000","last_fullsized":"2024-01-25T15:04:32.518843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:09:05.578946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027825+0000","last_change":"2024-01-25T15:04:27.525314+0000","last_active":"2024-01-25T15:04:33.027825+0000","last_peered":"2024-01-25T15:04:33.027825+0000","last_clean":"2024-01-25T15:04:33.027825+0000","last_became_active":"2024-01-25T15:04:27.525018+0000","last_became_peered":"2024-01-25T15:04:27.525018+0000","last_unstale":"2024-01-25T15:04:33.027825+0000","last_undegraded":"2024-01-25T15:04:33.027825+0000","last_fullsized":"2024-01-25T15:04:33.027825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:19:41.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519186+0000","last_change":"2024-01-25T15:04:31.591768+0000","last_active":"2024-01-25T15:04:32.519186+0000","last_peered":"2024-01-25T15:04:32.519186+0000","last_clean":"2024-01-25T15:04:32.519186+0000","last_became_active":"2024-01-25T15:04:31.591336+0000","last_became_peered":"2024-01-25T15:04:31.591336+0000","last_unstale":"2024-01-25T15:04:32.519186+0000","last_undegraded":"2024-01-25T15:04:32.519186+0000","last_fullsized":"2024-01-25T15:04:32.519186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:40:22.136826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518266+0000","last_change":"2024-01-25T15:04:26.550151+0000","last_active":"2024-01-25T15:04:32.518266+0000","last_peered":"2024-01-25T15:04:32.518266+0000","last_clean":"2024-01-25T15:04:32.518266+0000","last_became_active":"2024-01-25T15:04:26.549856+0000","last_became_peered":"2024-01-25T15:04:26.549856+0000","last_unstale":"2024-01-25T15:04:32.518266+0000","last_undegraded":"2024-01-25T15:04:32.518266+0000","last_fullsized":"2024-01-25T15:04:32.518266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:25.519894+0000","last_clean_scrub_stamp":"2024-01-25T15:04:25.519894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:00:16.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228279+0000","last_change":"2024-01-25T15:04:27.526178+0000","last_active":"2024-01-25T15:04:33.228279+0000","last_peered":"2024-01-25T15:04:33.228279+0000","last_clean":"2024-01-25T15:04:33.228279+0000","last_became_active":"2024-01-25T15:04:27.525798+0000","last_became_peered":"2024-01-25T15:04:27.525798+0000","last_unstale":"2024-01-25T15:04:33.228279+0000","last_undegraded":"2024-01-25T15:04:33.228279+0000","last_fullsized":"2024-01-25T15:04:33.228279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:17:50.234531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518933+0000","last_change":"2024-01-25T15:04:31.584854+0000","last_active":"2024-01-25T15:04:32.518933+0000","last_peered":"2024-01-25T15:04:32.518933+0000","last_clean":"2024-01-25T15:04:32.518933+0000","last_became_active":"2024-01-25T15:04:31.584482+0000","last_became_peered":"2024-01-25T15:04:31.584482+0000","last_unstale":"2024-01-25T15:04:32.518933+0000","last_undegraded":"2024-01-25T15:04:32.518933+0000","last_fullsized":"2024-01-25T15:04:32.518933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:30.557362+0000","last_clean_scrub_stamp":"2024-01-25T15:04:30.557362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:52:29.681769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519137+0000","last_change":"2024-01-25T15:04:27.536761+0000","last_active":"2024-01-25T15:04:32.519137+0000","last_peered":"2024-01-25T15:04:32.519137+0000","last_clean":"2024-01-25T15:04:32.519137+0000","last_became_active":"2024-01-25T15:04:27.536382+0000","last_became_peered":"2024-01-25T15:04:27.536382+0000","last_unstale":"2024-01-25T15:04:32.519137+0000","last_undegraded":"2024-01-25T15:04:32.519137+0000","last_fullsized":"2024-01-25T15:04:32.519137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:24:46.429617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519085+0000","last_change":"2024-01-25T15:04:27.529750+0000","last_active":"2024-01-25T15:04:32.519085+0000","last_peered":"2024-01-25T15:04:32.519085+0000","last_clean":"2024-01-25T15:04:32.519085+0000","last_became_active":"2024-01-25T15:04:27.529437+0000","last_became_peered":"2024-01-25T15:04:27.529437+0000","last_unstale":"2024-01-25T15:04:32.519085+0000","last_undegraded":"2024-01-25T15:04:32.519085+0000","last_fullsized":"2024-01-25T15:04:32.519085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:15:45.949448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228955+0000","last_change":"2024-01-25T15:04:27.538760+0000","last_active":"2024-01-25T15:04:33.228955+0000","last_peered":"2024-01-25T15:04:33.228955+0000","last_clean":"2024-01-25T15:04:33.228955+0000","last_became_active":"2024-01-25T15:04:27.537353+0000","last_became_peered":"2024-01-25T15:04:27.537353+0000","last_unstale":"2024-01-25T15:04:33.228955+0000","last_undegraded":"2024-01-25T15:04:33.228955+0000","last_fullsized":"2024-01-25T15:04:33.228955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:58:29.244789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027745+0000","last_change":"2024-01-25T15:04:27.534768+0000","last_active":"2024-01-25T15:04:33.027745+0000","last_peered":"2024-01-25T15:04:33.027745+0000","last_clean":"2024-01-25T15:04:33.027745+0000","last_became_active":"2024-01-25T15:04:27.534414+0000","last_became_peered":"2024-01-25T15:04:27.534414+0000","last_unstale":"2024-01-25T15:04:33.027745+0000","last_undegraded":"2024-01-25T15:04:33.027745+0000","last_fullsized":"2024-01-25T15:04:33.027745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:59:41.393305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518613+0000","last_change":"2024-01-25T15:04:27.532970+0000","last_active":"2024-01-25T15:04:32.518613+0000","last_peered":"2024-01-25T15:04:32.518613+0000","last_clean":"2024-01-25T15:04:32.518613+0000","last_became_active":"2024-01-25T15:04:27.532645+0000","last_became_peered":"2024-01-25T15:04:27.532645+0000","last_unstale":"2024-01-25T15:04:32.518613+0000","last_undegraded":"2024-01-25T15:04:32.518613+0000","last_fullsized":"2024-01-25T15:04:32.518613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:13:43.582651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188513+0000","last_change":"2024-01-25T15:04:27.538503+0000","last_active":"2024-01-25T15:04:33.188513+0000","last_peered":"2024-01-25T15:04:33.188513+0000","last_clean":"2024-01-25T15:04:33.188513+0000","last_became_active":"2024-01-25T15:04:27.538210+0000","last_became_peered":"2024-01-25T15:04:27.538210+0000","last_unstale":"2024-01-25T15:04:33.188513+0000","last_undegraded":"2024-01-25T15:04:33.188513+0000","last_fullsized":"2024-01-25T15:04:33.188513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:59:41.393305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519315+0000","last_change":"2024-01-25T15:04:27.540013+0000","last_active":"2024-01-25T15:04:32.519315+0000","last_peered":"2024-01-25T15:04:32.519315+0000","last_clean":"2024-01-25T15:04:32.519315+0000","last_became_active":"2024-01-25T15:04:27.539736+0000","last_became_peered":"2024-01-25T15:04:27.539736+0000","last_unstale":"2024-01-25T15:04:32.519315+0000","last_undegraded":"2024-01-25T15:04:32.519315+0000","last_fullsized":"2024-01-25T15:04:32.519315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:45:08.060821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518509+0000","last_change":"2024-01-25T15:04:27.536541+0000","last_active":"2024-01-25T15:04:32.518509+0000","last_peered":"2024-01-25T15:04:32.518509+0000","last_clean":"2024-01-25T15:04:32.518509+0000","last_became_active":"2024-01-25T15:04:27.534323+0000","last_became_peered":"2024-01-25T15:04:27.534323+0000","last_unstale":"2024-01-25T15:04:32.518509+0000","last_undegraded":"2024-01-25T15:04:32.518509+0000","last_fullsized":"2024-01-25T15:04:32.518509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:29:19.932806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227705+0000","last_change":"2024-01-25T15:04:27.534565+0000","last_active":"2024-01-25T15:04:33.227705+0000","last_peered":"2024-01-25T15:04:33.227705+0000","last_clean":"2024-01-25T15:04:33.227705+0000","last_became_active":"2024-01-25T15:04:27.534263+0000","last_became_peered":"2024-01-25T15:04:27.534263+0000","last_unstale":"2024-01-25T15:04:33.227705+0000","last_undegraded":"2024-01-25T15:04:33.227705+0000","last_fullsized":"2024-01-25T15:04:33.227705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:30.257021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517959+0000","last_change":"2024-01-25T15:04:27.532801+0000","last_active":"2024-01-25T15:04:32.517959+0000","last_peered":"2024-01-25T15:04:32.517959+0000","last_clean":"2024-01-25T15:04:32.517959+0000","last_became_active":"2024-01-25T15:04:27.532521+0000","last_became_peered":"2024-01-25T15:04:27.532521+0000","last_unstale":"2024-01-25T15:04:32.517959+0000","last_undegraded":"2024-01-25T15:04:32.517959+0000","last_fullsized":"2024-01-25T15:04:32.517959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:59:41.393305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229237+0000","last_change":"2024-01-25T15:04:27.531785+0000","last_active":"2024-01-25T15:04:33.229237+0000","last_peered":"2024-01-25T15:04:33.229237+0000","last_clean":"2024-01-25T15:04:33.229237+0000","last_became_active":"2024-01-25T15:04:27.531502+0000","last_became_peered":"2024-01-25T15:04:27.531502+0000","last_unstale":"2024-01-25T15:04:33.229237+0000","last_undegraded":"2024-01-25T15:04:33.229237+0000","last_fullsized":"2024-01-25T15:04:33.229237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:07:18.621735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027629+0000","last_change":"2024-01-25T15:04:27.538527+0000","last_active":"2024-01-25T15:04:33.027629+0000","last_peered":"2024-01-25T15:04:33.027629+0000","last_clean":"2024-01-25T15:04:33.027629+0000","last_became_active":"2024-01-25T15:04:27.538169+0000","last_became_peered":"2024-01-25T15:04:27.538169+0000","last_unstale":"2024-01-25T15:04:33.027629+0000","last_undegraded":"2024-01-25T15:04:33.027629+0000","last_fullsized":"2024-01-25T15:04:33.027629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:48.199996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519087+0000","last_change":"2024-01-25T15:04:27.528595+0000","last_active":"2024-01-25T15:04:32.519087+0000","last_peered":"2024-01-25T15:04:32.519087+0000","last_clean":"2024-01-25T15:04:32.519087+0000","last_became_active":"2024-01-25T15:04:27.528222+0000","last_became_peered":"2024-01-25T15:04:27.528222+0000","last_unstale":"2024-01-25T15:04:32.519087+0000","last_undegraded":"2024-01-25T15:04:32.519087+0000","last_fullsized":"2024-01-25T15:04:32.519087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:59:41.393305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228858+0000","last_change":"2024-01-25T15:04:27.539219+0000","last_active":"2024-01-25T15:04:33.228858+0000","last_peered":"2024-01-25T15:04:33.228858+0000","last_clean":"2024-01-25T15:04:33.228858+0000","last_became_active":"2024-01-25T15:04:27.538920+0000","last_became_peered":"2024-01-25T15:04:27.538920+0000","last_unstale":"2024-01-25T15:04:33.228858+0000","last_undegraded":"2024-01-25T15:04:33.228858+0000","last_fullsized":"2024-01-25T15:04:33.228858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:58:03.932974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519156+0000","last_change":"2024-01-25T15:04:27.531810+0000","last_active":"2024-01-25T15:04:32.519156+0000","last_peered":"2024-01-25T15:04:32.519156+0000","last_clean":"2024-01-25T15:04:32.519156+0000","last_became_active":"2024-01-25T15:04:27.531489+0000","last_became_peered":"2024-01-25T15:04:27.531489+0000","last_unstale":"2024-01-25T15:04:32.519156+0000","last_undegraded":"2024-01-25T15:04:32.519156+0000","last_fullsized":"2024-01-25T15:04:32.519156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:04:57.737913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228241+0000","last_change":"2024-01-25T15:04:27.532610+0000","last_active":"2024-01-25T15:04:33.228241+0000","last_peered":"2024-01-25T15:04:33.228241+0000","last_clean":"2024-01-25T15:04:33.228241+0000","last_became_active":"2024-01-25T15:04:27.532332+0000","last_became_peered":"2024-01-25T15:04:27.532332+0000","last_unstale":"2024-01-25T15:04:33.228241+0000","last_undegraded":"2024-01-25T15:04:33.228241+0000","last_fullsized":"2024-01-25T15:04:33.228241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:00.614350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227608+0000","last_change":"2024-01-25T15:04:27.535483+0000","last_active":"2024-01-25T15:04:33.227608+0000","last_peered":"2024-01-25T15:04:33.227608+0000","last_clean":"2024-01-25T15:04:33.227608+0000","last_became_active":"2024-01-25T15:04:27.534992+0000","last_became_peered":"2024-01-25T15:04:27.534992+0000","last_unstale":"2024-01-25T15:04:33.227608+0000","last_undegraded":"2024-01-25T15:04:33.227608+0000","last_fullsized":"2024-01-25T15:04:33.227608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:19:41.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188004+0000","last_change":"2024-01-25T15:04:27.528466+0000","last_active":"2024-01-25T15:04:33.188004+0000","last_peered":"2024-01-25T15:04:33.188004+0000","last_clean":"2024-01-25T15:04:33.188004+0000","last_became_active":"2024-01-25T15:04:27.528170+0000","last_became_peered":"2024-01-25T15:04:27.528170+0000","last_unstale":"2024-01-25T15:04:33.188004+0000","last_undegraded":"2024-01-25T15:04:33.188004+0000","last_fullsized":"2024-01-25T15:04:33.188004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:48.199996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027681+0000","last_change":"2024-01-25T15:04:27.527057+0000","last_active":"2024-01-25T15:04:33.027681+0000","last_peered":"2024-01-25T15:04:33.027681+0000","last_clean":"2024-01-25T15:04:33.027681+0000","last_became_active":"2024-01-25T15:04:27.526733+0000","last_became_peered":"2024-01-25T15:04:27.526733+0000","last_unstale":"2024-01-25T15:04:33.027681+0000","last_undegraded":"2024-01-25T15:04:33.027681+0000","last_fullsized":"2024-01-25T15:04:33.027681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:38:10.985262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518080+0000","last_change":"2024-01-25T15:04:27.533940+0000","last_active":"2024-01-25T15:04:32.518080+0000","last_peered":"2024-01-25T15:04:32.518080+0000","last_clean":"2024-01-25T15:04:32.518080+0000","last_became_active":"2024-01-25T15:04:27.533453+0000","last_became_peered":"2024-01-25T15:04:27.533453+0000","last_unstale":"2024-01-25T15:04:32.518080+0000","last_undegraded":"2024-01-25T15:04:32.518080+0000","last_fullsized":"2024-01-25T15:04:32.518080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:30.257021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228629+0000","last_change":"2024-01-25T15:04:27.529157+0000","last_active":"2024-01-25T15:04:33.228629+0000","last_peered":"2024-01-25T15:04:33.228629+0000","last_clean":"2024-01-25T15:04:33.228629+0000","last_became_active":"2024-01-25T15:04:27.528880+0000","last_became_peered":"2024-01-25T15:04:27.528880+0000","last_unstale":"2024-01-25T15:04:33.228629+0000","last_undegraded":"2024-01-25T15:04:33.228629+0000","last_fullsized":"2024-01-25T15:04:33.228629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:08:53.048328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.518689+0000","last_change":"2024-01-25T15:04:27.528325+0000","last_active":"2024-01-25T15:04:32.518689+0000","last_peered":"2024-01-25T15:04:32.518689+0000","last_clean":"2024-01-25T15:04:32.518689+0000","last_became_active":"2024-01-25T15:04:27.527673+0000","last_became_peered":"2024-01-25T15:04:27.527673+0000","last_unstale":"2024-01-25T15:04:32.518689+0000","last_undegraded":"2024-01-25T15:04:32.518689+0000","last_fullsized":"2024-01-25T15:04:32.518689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:19:41.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.519157+0000","last_change":"2024-01-25T15:04:27.530713+0000","last_active":"2024-01-25T15:04:32.519157+0000","last_peered":"2024-01-25T15:04:32.519157+0000","last_clean":"2024-01-25T15:04:32.519157+0000","last_became_active":"2024-01-25T15:04:27.530468+0000","last_became_peered":"2024-01-25T15:04:27.530468+0000","last_unstale":"2024-01-25T15:04:32.519157+0000","last_undegraded":"2024-01-25T15:04:32.519157+0000","last_fullsized":"2024-01-25T15:04:32.519157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:30.257021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229579+0000","last_change":"2024-01-25T15:04:27.542678+0000","last_active":"2024-01-25T15:04:33.229579+0000","last_peered":"2024-01-25T15:04:33.229579+0000","last_clean":"2024-01-25T15:04:33.229579+0000","last_became_active":"2024-01-25T15:04:27.542362+0000","last_became_peered":"2024-01-25T15:04:27.542362+0000","last_unstale":"2024-01-25T15:04:33.229579+0000","last_undegraded":"2024-01-25T15:04:33.229579+0000","last_fullsized":"2024-01-25T15:04:33.229579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:20:59.655525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:32.517884+0000","last_change":"2024-01-25T15:04:27.540118+0000","last_active":"2024-01-25T15:04:32.517884+0000","last_peered":"2024-01-25T15:04:32.517884+0000","last_clean":"2024-01-25T15:04:32.517884+0000","last_became_active":"2024-01-25T15:04:27.539793+0000","last_became_peered":"2024-01-25T15:04:27.539793+0000","last_unstale":"2024-01-25T15:04:32.517884+0000","last_undegraded":"2024-01-25T15:04:32.517884+0000","last_fullsized":"2024-01-25T15:04:32.517884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:30:17.007992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227778+0000","last_change":"2024-01-25T15:04:27.540459+0000","last_active":"2024-01-25T15:04:33.227778+0000","last_peered":"2024-01-25T15:04:33.227778+0000","last_clean":"2024-01-25T15:04:33.227778+0000","last_became_active":"2024-01-25T15:04:27.540170+0000","last_became_peered":"2024-01-25T15:04:27.540170+0000","last_unstale":"2024-01-25T15:04:33.227778+0000","last_undegraded":"2024-01-25T15:04:33.227778+0000","last_fullsized":"2024-01-25T15:04:33.227778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:29:19.932806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228818+0000","last_change":"2024-01-25T15:04:27.533910+0000","last_active":"2024-01-25T15:04:33.228818+0000","last_peered":"2024-01-25T15:04:33.228818+0000","last_clean":"2024-01-25T15:04:33.228818+0000","last_became_active":"2024-01-25T15:04:27.533483+0000","last_became_peered":"2024-01-25T15:04:27.533483+0000","last_unstale":"2024-01-25T15:04:33.228818+0000","last_undegraded":"2024-01-25T15:04:33.228818+0000","last_fullsized":"2024-01-25T15:04:33.228818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:55:02.405369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.228766+0000","last_change":"2024-01-25T15:04:27.539149+0000","last_active":"2024-01-25T15:04:33.228766+0000","last_peered":"2024-01-25T15:04:33.228766+0000","last_clean":"2024-01-25T15:04:33.228766+0000","last_became_active":"2024-01-25T15:04:27.538850+0000","last_became_peered":"2024-01-25T15:04:27.538850+0000","last_unstale":"2024-01-25T15:04:33.228766+0000","last_undegraded":"2024-01-25T15:04:33.228766+0000","last_fullsized":"2024-01-25T15:04:33.228766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:58:29.244789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.227771+0000","last_change":"2024-01-25T15:04:27.534907+0000","last_active":"2024-01-25T15:04:33.227771+0000","last_peered":"2024-01-25T15:04:33.227771+0000","last_clean":"2024-01-25T15:04:33.227771+0000","last_became_active":"2024-01-25T15:04:27.534407+0000","last_became_peered":"2024-01-25T15:04:27.534407+0000","last_unstale":"2024-01-25T15:04:33.227771+0000","last_undegraded":"2024-01-25T15:04:33.227771+0000","last_fullsized":"2024-01-25T15:04:33.227771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:45:08.060821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.027683+0000","last_change":"2024-01-25T15:04:27.529037+0000","last_active":"2024-01-25T15:04:33.027683+0000","last_peered":"2024-01-25T15:04:33.027683+0000","last_clean":"2024-01-25T15:04:33.027683+0000","last_became_active":"2024-01-25T15:04:27.528713+0000","last_became_peered":"2024-01-25T15:04:27.528713+0000","last_unstale":"2024-01-25T15:04:33.027683+0000","last_undegraded":"2024-01-25T15:04:33.027683+0000","last_fullsized":"2024-01-25T15:04:33.027683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:24:46.429617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.188418+0000","last_change":"2024-01-25T15:04:27.531477+0000","last_active":"2024-01-25T15:04:33.188418+0000","last_peered":"2024-01-25T15:04:33.188418+0000","last_clean":"2024-01-25T15:04:33.188418+0000","last_became_active":"2024-01-25T15:04:27.531188+0000","last_became_peered":"2024-01-25T15:04:27.531188+0000","last_unstale":"2024-01-25T15:04:33.188418+0000","last_undegraded":"2024-01-25T15:04:33.188418+0000","last_fullsized":"2024-01-25T15:04:33.188418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:27:30.257021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-25T15:04:33.229461+0000","last_change":"2024-01-25T15:04:27.541633+0000","last_active":"2024-01-25T15:04:33.229461+0000","last_peered":"2024-01-25T15:04:33.229461+0000","last_clean":"2024-01-25T15:04:33.229461+0000","last_became_active":"2024-01-25T15:04:27.539292+0000","last_became_peered":"2024-01-25T15:04:27.539292+0000","last_unstale":"2024-01-25T15:04:33.229461+0000","last_undegraded":"2024-01-25T15:04:33.229461+0000","last_fullsized":"2024-01-25T15:04:33.229461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:26.524655+0000","last_clean_scrub_stamp":"2024-01-25T15:04:26.524655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:48:49.762254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":860160,"data_stored":690798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:04:49.346 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-25T15:04:49.346 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-25T15:04:49.346 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-25T15:04:49.346 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-25T15:04:49.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.480+0000 7fd7434d5640 1 Processor -- start 2024-01-25T15:04:49.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.480+0000 7fd7434d5640 1 -- start start 2024-01-25T15:04:49.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.481+0000 7fd7434d5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd73c0c6980 0x7fd73c1530b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:49.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.481+0000 7fd7434d5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd73c0c3c30 0x7fd73c0c8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:49.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.481+0000 7fd7434d5640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73c0c3100 con 0x7fd73c14c6f0 2024-01-25T15:04:49.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.481+0000 7fd7434d5640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd73c0c41d0 con 0x7fd73c0c3c30 2024-01-25T15:04:49.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.481+0000 7fd7434d5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c1525d0 con 0x7fd73c0c6980 2024-01-25T15:04:49.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.481+0000 7fd741271640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd73c14c6f0 0x7fd73c0c29f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59020/0 (socket says 172.21.15.29:59020) 2024-01-25T15:04:49.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.481+0000 7fd741271640 1 -- 172.21.15.29:0/3666873197 learned_addr learned my addr 172.21.15.29:0/3666873197 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:49.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.481+0000 7fd741a72640 1 --2- 172.21.15.29:0/3666873197 >> v2:172.21.15.29:3300/0 conn(0x7fd73c0c3c30 0x7fd73c0c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:49.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.482+0000 7fd740a70640 1 --2- 172.21.15.29:0/3666873197 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd73c0c6980 0x7fd73c1530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:49.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.482+0000 7fd73bfff640 1 -- 172.21.15.29:0/3666873197 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834942747 0 0) 0x7fd73c0c3100 con 0x7fd73c14c6f0 2024-01-25T15:04:49.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.482+0000 7fd73bfff640 1 -- 172.21.15.29:0/3666873197 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd724003520 con 0x7fd73c14c6f0 2024-01-25T15:04:49.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.482+0000 7fd741a72640 1 -- 172.21.15.29:0/3666873197 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd73c0c6980 msgr2=0x7fd73c1530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:49.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.482+0000 7fd741a72640 1 --2- 172.21.15.29:0/3666873197 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd73c0c6980 0x7fd73c1530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:49.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.482+0000 7fd741a72640 1 -- 172.21.15.29:0/3666873197 >> v1:172.21.15.29:6789/0 conn(0x7fd73c14c6f0 legacy=0x7fd73c0c29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:49.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.482+0000 7fd741a72640 1 -- 172.21.15.29:0/3666873197 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c1528b0 con 0x7fd73c0c3c30 2024-01-25T15:04:49.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.482+0000 7fd741a72640 1 --2- 172.21.15.29:0/3666873197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73c0c3c30 0x7fd73c0c8360 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009d90 tx=0x7fd72c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ce9d50703a695d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:49.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.483+0000 7fd73bfff640 1 -- 172.21.15.29:0/3666873197 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c02cbc0 con 0x7fd73c0c3c30 2024-01-25T15:04:49.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.483+0000 7fd73bfff640 1 -- 172.21.15.29:0/3666873197 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72c02cd20 con 0x7fd73c0c3c30 2024-01-25T15:04:49.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.483+0000 7fd73bfff640 1 -- 172.21.15.29:0/3666873197 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c034660 con 0x7fd73c0c3c30 2024-01-25T15:04:49.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.483+0000 7fd7434d5640 1 -- 172.21.15.29:0/3666873197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73c0c3c30 msgr2=0x7fd73c0c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:49.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.483+0000 7fd7434d5640 1 --2- 172.21.15.29:0/3666873197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73c0c3c30 0x7fd73c0c8360 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009d90 tx=0x7fd72c02be10 comp rx=0 tx=0).stop 2024-01-25T15:04:49.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.483+0000 7fd7434d5640 1 -- 172.21.15.29:0/3666873197 shutdown_connections 2024-01-25T15:04:49.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.483+0000 7fd7434d5640 1 --2- 172.21.15.29:0/3666873197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73c0c3c30 0x7fd73c0c8360 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:49.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.483+0000 7fd7434d5640 1 --2- 172.21.15.29:0/3666873197 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd73c0c6980 0x7fd73c1530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:49.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.483+0000 7fd7434d5640 1 -- 172.21.15.29:0/3666873197 >> 172.21.15.29:0/3666873197 conn(0x7fd73c06a8a0 msgr2=0x7fd73c06acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:49.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.483+0000 7fd7434d5640 1 -- 172.21.15.29:0/3666873197 shutdown_connections 2024-01-25T15:04:49.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.483+0000 7fd7434d5640 1 -- 172.21.15.29:0/3666873197 wait complete. 2024-01-25T15:04:49.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.484+0000 7fd7434d5640 1 Processor -- start 2024-01-25T15:04:49.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.484+0000 7fd7434d5640 1 -- start start 2024-01-25T15:04:49.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.485+0000 7fd7434d5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73c0c3c30 0x7fd73c1ea8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:49.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.485+0000 7fd7434d5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd73c0c6980 0x7fd73c0c1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:49.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.485+0000 7fd7434d5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd73c14c6f0 0x7fd73c148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:49.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.485+0000 7fd7434d5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c1494b0 con 0x7fd73c0c3c30 2024-01-25T15:04:49.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.485+0000 7fd7434d5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c1eae10 con 0x7fd73c0c6980 2024-01-25T15:04:49.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.485+0000 7fd7434d5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c1499e0 con 0x7fd73c14c6f0 2024-01-25T15:04:49.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.485+0000 7fd741271640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73c0c3c30 0x7fd73c1ea8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:49.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.485+0000 7fd741271640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73c0c3c30 0x7fd73c1ea8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44830/0 (socket says 172.21.15.29:44830) 2024-01-25T15:04:49.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.485+0000 7fd741271640 1 -- 172.21.15.29:0/2958870397 learned_addr learned my addr 172.21.15.29:0/2958870397 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:49.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.485+0000 7fd741a72640 1 --2- 172.21.15.29:0/2958870397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd73c14c6f0 0x7fd73c148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:49.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.485+0000 7fd740a70640 1 --2- 172.21.15.29:0/2958870397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd73c0c6980 0x7fd73c0c1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:49.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.485+0000 7fd741271640 1 -- 172.21.15.29:0/2958870397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd73c14c6f0 msgr2=0x7fd73c148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:49.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.485+0000 7fd741271640 1 --2- 172.21.15.29:0/2958870397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd73c14c6f0 0x7fd73c148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:49.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.485+0000 7fd741271640 1 -- 172.21.15.29:0/2958870397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd73c0c6980 msgr2=0x7fd73c0c1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:49.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.485+0000 7fd741271640 1 --2- 172.21.15.29:0/2958870397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd73c0c6980 0x7fd73c0c1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:49.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.486+0000 7fd741271640 1 -- 172.21.15.29:0/2958870397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c009a70 con 0x7fd73c0c3c30 2024-01-25T15:04:49.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.486+0000 7fd741a72640 1 --2- 172.21.15.29:0/2958870397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd73c14c6f0 0x7fd73c148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:49.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.486+0000 7fd741271640 1 --2- 172.21.15.29:0/2958870397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73c0c3c30 0x7fd73c1ea8d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd73400c3c0 tx=0x7fd73400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:49.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.486+0000 7fd739ffb640 1 -- 172.21.15.29:0/2958870397 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd734005ce0 con 0x7fd73c0c3c30 2024-01-25T15:04:49.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.486+0000 7fd739ffb640 1 -- 172.21.15.29:0/2958870397 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd734005e40 con 0x7fd73c0c3c30 2024-01-25T15:04:49.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.486+0000 7fd739ffb640 1 -- 172.21.15.29:0/2958870397 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7340072f0 con 0x7fd73c0c3c30 2024-01-25T15:04:49.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.486+0000 7fd7434d5640 1 -- 172.21.15.29:0/2958870397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73c149700 con 0x7fd73c0c3c30 2024-01-25T15:04:49.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.486+0000 7fd7434d5640 1 -- 172.21.15.29:0/2958870397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73c06ccf0 con 0x7fd73c0c3c30 2024-01-25T15:04:49.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.487+0000 7fd7434d5640 1 -- 172.21.15.29:0/2958870397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73c074080 con 0x7fd73c0c3c30 2024-01-25T15:04:49.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.487+0000 7fd739ffb640 1 -- 172.21.15.29:0/2958870397 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fd734007450 con 0x7fd73c0c3c30 2024-01-25T15:04:49.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.488+0000 7fd739ffb640 1 --2- 172.21.15.29:0/2958870397 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd72806aed0 0x7fd72806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:49.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.488+0000 7fd739ffb640 1 -- 172.21.15.29:0/2958870397 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd734088e70 con 0x7fd73c0c3c30 2024-01-25T15:04:49.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.488+0000 7fd740a70640 1 --2- 172.21.15.29:0/2958870397 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd72806aed0 0x7fd72806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:49.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.488+0000 7fd740a70640 1 --2- 172.21.15.29:0/2958870397 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd72806aed0 0x7fd72806d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd73c06d560 tx=0x7fd730008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:49.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.492+0000 7fd739ffb640 1 -- 172.21.15.29:0/2958870397 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fd734053ae0 con 0x7fd73c0c3c30 2024-01-25T15:04:49.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.709+0000 7fd7434d5640 1 -- 172.21.15.29:0/2958870397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd73c0c6e20 con 0x7fd73c0c3c30 2024-01-25T15:04:49.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.709+0000 7fd739ffb640 1 -- 172.21.15.29:0/2958870397 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fd734017020 con 0x7fd73c0c3c30 2024-01-25T15:04:49.710 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:49.711 INFO:teuthology.orchestra.run.smithi029.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-25T15:04:49.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.711+0000 7fd7434d5640 1 -- 172.21.15.29:0/2958870397 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd72806aed0 msgr2=0x7fd72806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:49.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.711+0000 7fd7434d5640 1 --2- 172.21.15.29:0/2958870397 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd72806aed0 0x7fd72806d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd73c06d560 tx=0x7fd730008040 comp rx=0 tx=0).stop 2024-01-25T15:04:49.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.711+0000 7fd7434d5640 1 -- 172.21.15.29:0/2958870397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73c0c3c30 msgr2=0x7fd73c1ea8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:49.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.711+0000 7fd7434d5640 1 --2- 172.21.15.29:0/2958870397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73c0c3c30 0x7fd73c1ea8d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd73400c3c0 tx=0x7fd73400c880 comp rx=0 tx=0).stop 2024-01-25T15:04:49.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.711+0000 7fd7434d5640 1 -- 172.21.15.29:0/2958870397 shutdown_connections 2024-01-25T15:04:49.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.711+0000 7fd7434d5640 1 --2- 172.21.15.29:0/2958870397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd73c14c6f0 0x7fd73c148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:49.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.711+0000 7fd7434d5640 1 --2- 172.21.15.29:0/2958870397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd73c0c6980 0x7fd73c0c1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:49.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.711+0000 7fd7434d5640 1 --2- 172.21.15.29:0/2958870397 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd72806aed0 0x7fd72806d390 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:49.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.711+0000 7fd7434d5640 1 --2- 172.21.15.29:0/2958870397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73c0c3c30 0x7fd73c1ea8d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:49.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.711+0000 7fd7434d5640 1 -- 172.21.15.29:0/2958870397 >> 172.21.15.29:0/2958870397 conn(0x7fd73c06a8a0 msgr2=0x7fd73c0c28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:49.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.711+0000 7fd7434d5640 1 -- 172.21.15.29:0/2958870397 shutdown_connections 2024-01-25T15:04:49.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.711+0000 7fd7434d5640 1 -- 172.21.15.29:0/2958870397 wait complete. 2024-01-25T15:04:49.723 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-25T15:04:49.723 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:04:49.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.823+0000 7f508ce18640 1 Processor -- start 2024-01-25T15:04:49.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.823+0000 7f508ce18640 1 -- start start 2024-01-25T15:04:49.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.824+0000 7f508ce18640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f50880c6980 0x7f50881530b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:49.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.824+0000 7f508ce18640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50880c3100 con 0x7f50880c3c30 2024-01-25T15:04:49.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.824+0000 7f508ce18640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50880c41d0 con 0x7f508814c6f0 2024-01-25T15:04:49.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.824+0000 7f508ce18640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50881525d0 con 0x7f50880c6980 2024-01-25T15:04:49.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.824+0000 7f507ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f50880c6980 0x7f50881530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:49.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.824+0000 7f5086d9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f50880c3c30 0x7f50880c8360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59036/0 (socket says 172.21.15.29:59036) 2024-01-25T15:04:49.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.824+0000 7f5086d9d640 1 -- 172.21.15.29:0/188904230 learned_addr learned my addr 172.21.15.29:0/188904230 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:49.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.825+0000 7f507ffff640 1 -- 172.21.15.29:0/188904230 >> v1:172.21.15.52:6789/0 conn(0x7f508814c6f0 legacy=0x7f50880c29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:49.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.825+0000 7f507ffff640 1 -- 172.21.15.29:0/188904230 >> v1:172.21.15.29:6789/0 conn(0x7f50880c3c30 legacy=0x7f50880c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:49.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.825+0000 7f507ffff640 1 -- 172.21.15.29:0/188904230 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50881528b0 con 0x7f50880c6980 2024-01-25T15:04:49.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.825+0000 7f507ffff640 1 --2- 172.21.15.29:0/188904230 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50880c6980 0x7f50881530b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f50700097a0 tx=0x7f507002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16a913bd1227285 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:49.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.825+0000 7f5085d9b640 1 -- 172.21.15.29:0/188904230 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070031830 con 0x7f50880c6980 2024-01-25T15:04:49.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.825+0000 7f5085d9b640 1 -- 172.21.15.29:0/188904230 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5070031990 con 0x7f50880c6980 2024-01-25T15:04:49.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.826+0000 7f5085d9b640 1 -- 172.21.15.29:0/188904230 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070031d20 con 0x7f50880c6980 2024-01-25T15:04:49.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.826+0000 7f508ce18640 1 -- 172.21.15.29:0/188904230 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50880c6980 msgr2=0x7f50881530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:49.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.826+0000 7f508ce18640 1 --2- 172.21.15.29:0/188904230 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50880c6980 0x7f50881530b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f50700097a0 tx=0x7f507002b8d0 comp rx=0 tx=0).stop 2024-01-25T15:04:49.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.826+0000 7f508ce18640 1 -- 172.21.15.29:0/188904230 shutdown_connections 2024-01-25T15:04:49.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.826+0000 7f508ce18640 1 --2- 172.21.15.29:0/188904230 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50880c6980 0x7f50881530b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:49.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.826+0000 7f508ce18640 1 -- 172.21.15.29:0/188904230 >> 172.21.15.29:0/188904230 conn(0x7f508806a8a0 msgr2=0x7f508806acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:49.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.826+0000 7f508ce18640 1 -- 172.21.15.29:0/188904230 shutdown_connections 2024-01-25T15:04:49.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.826+0000 7f508ce18640 1 -- 172.21.15.29:0/188904230 wait complete. 2024-01-25T15:04:49.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.827+0000 7f508ce18640 1 Processor -- start 2024-01-25T15:04:49.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.827+0000 7f508ce18640 1 -- start start 2024-01-25T15:04:49.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.828+0000 7f508ce18640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f50880c3c30 0x7f50880ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:49.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.828+0000 7f508ce18640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50880c6980 0x7f5088147a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:49.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.828+0000 7f508ce18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f508814c6f0 0x7f5088147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:49.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.828+0000 7f508ce18640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50881494b0 con 0x7f50880c6980 2024-01-25T15:04:49.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.828+0000 7f508ce18640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5088149790 con 0x7f508814c6f0 2024-01-25T15:04:49.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.828+0000 7f508ce18640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508806e710 con 0x7f50880c3c30 2024-01-25T15:04:49.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.828+0000 7f507ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50880c6980 0x7f5088147a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:49.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.828+0000 7f507ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50880c6980 0x7f5088147a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44840/0 (socket says 172.21.15.29:44840) 2024-01-25T15:04:49.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.828+0000 7f507ffff640 1 -- 172.21.15.29:0/1707524497 learned_addr learned my addr 172.21.15.29:0/1707524497 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:49.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.828+0000 7f5086d9d640 1 --2- 172.21.15.29:0/1707524497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f508814c6f0 0x7f5088147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:49.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.828+0000 7f508659c640 1 --2- 172.21.15.29:0/1707524497 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f50880c3c30 0x7f50880ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:49.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.828+0000 7f507ffff640 1 -- 172.21.15.29:0/1707524497 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f50880c3c30 msgr2=0x7f50880ac4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:49.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.828+0000 7f507ffff640 1 --2- 172.21.15.29:0/1707524497 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f50880c3c30 0x7f50880ac4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:49.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.828+0000 7f507ffff640 1 -- 172.21.15.29:0/1707524497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f508814c6f0 msgr2=0x7f5088147fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:49.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.828+0000 7f507ffff640 1 --2- 172.21.15.29:0/1707524497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f508814c6f0 0x7f5088147fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:49.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.828+0000 7f507ffff640 1 -- 172.21.15.29:0/1707524497 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5070009400 con 0x7f50880c6980 2024-01-25T15:04:49.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.829+0000 7f5086d9d640 1 --2- 172.21.15.29:0/1707524497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f508814c6f0 0x7f5088147fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:49.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.829+0000 7f508659c640 1 --2- 172.21.15.29:0/1707524497 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f50880c3c30 0x7f50880ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:49.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.829+0000 7f507ffff640 1 --2- 172.21.15.29:0/1707524497 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50880c6980 0x7f5088147a80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f50700098c0 tx=0x7f50700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:49.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.829+0000 7f507effd640 1 -- 172.21.15.29:0/1707524497 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507003ba70 con 0x7f50880c6980 2024-01-25T15:04:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.829+0000 7f507effd640 1 -- 172.21.15.29:0/1707524497 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507003bbf0 con 0x7f50880c6980 2024-01-25T15:04:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.829+0000 7f508ce18640 1 -- 172.21.15.29:0/1707524497 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508806e9f0 con 0x7f50880c6980 2024-01-25T15:04:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.829+0000 7f507effd640 1 -- 172.21.15.29:0/1707524497 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50700453f0 con 0x7f50880c6980 2024-01-25T15:04:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.829+0000 7f508ce18640 1 -- 172.21.15.29:0/1707524497 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508806fcc0 con 0x7f50880c6980 2024-01-25T15:04:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.830+0000 7f508ce18640 1 -- 172.21.15.29:0/1707524497 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5088074080 con 0x7f50880c6980 2024-01-25T15:04:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.830+0000 7f507effd640 1 -- 172.21.15.29:0/1707524497 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f507004e450 con 0x7f50880c6980 2024-01-25T15:04:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.831+0000 7f507effd640 1 --2- 172.21.15.29:0/1707524497 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f506806af00 0x7f506806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.831+0000 7f507effd640 1 -- 172.21.15.29:0/1707524497 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f50700abb00 con 0x7f50880c6980 2024-01-25T15:04:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.831+0000 7f508659c640 1 --2- 172.21.15.29:0/1707524497 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f506806af00 0x7f506806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:49.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.831+0000 7f508659c640 1 --2- 172.21.15.29:0/1707524497 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f506806af00 0x7f506806d3c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f50880a7cc0 tx=0x7f5078008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:49.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:49.835+0000 7f507effd640 1 -- 172.21.15.29:0/1707524497 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f5070076770 con 0x7f50880c6980 2024-01-25T15:04:50.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.016+0000 7f508ce18640 1 -- 172.21.15.29:0/1707524497 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50880c6e20 con 0x7f50880c6980 2024-01-25T15:04:50.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.017+0000 7f507effd640 1 -- 172.21.15.29:0/1707524497 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18311 (secure 0 0 0) 0x7f5070035020 con 0x7f50880c6980 2024-01-25T15:04:50.018 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:50.018 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:31.978871+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:04:50.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.019+0000 7f508ce18640 1 -- 172.21.15.29:0/1707524497 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f506806af00 msgr2=0x7f506806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:50.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.019+0000 7f508ce18640 1 --2- 172.21.15.29:0/1707524497 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f506806af00 0x7f506806d3c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f50880a7cc0 tx=0x7f5078008040 comp rx=0 tx=0).stop 2024-01-25T15:04:50.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.019+0000 7f508ce18640 1 -- 172.21.15.29:0/1707524497 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50880c6980 msgr2=0x7f5088147a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:50.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.019+0000 7f508ce18640 1 --2- 172.21.15.29:0/1707524497 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50880c6980 0x7f5088147a80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f50700098c0 tx=0x7f50700046c0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.019+0000 7f508ce18640 1 -- 172.21.15.29:0/1707524497 shutdown_connections 2024-01-25T15:04:50.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.019+0000 7f508ce18640 1 --2- 172.21.15.29:0/1707524497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f508814c6f0 0x7f5088147fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.019+0000 7f508ce18640 1 --2- 172.21.15.29:0/1707524497 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f506806af00 0x7f506806d3c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.019+0000 7f508ce18640 1 --2- 172.21.15.29:0/1707524497 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50880c6980 0x7f5088147a80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.019+0000 7f508ce18640 1 --2- 172.21.15.29:0/1707524497 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f50880c3c30 0x7f50880ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.019+0000 7f508ce18640 1 -- 172.21.15.29:0/1707524497 >> 172.21.15.29:0/1707524497 conn(0x7f508806a8a0 msgr2=0x7f50880c28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:50.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.020+0000 7f508ce18640 1 -- 172.21.15.29:0/1707524497 shutdown_connections 2024-01-25T15:04:50.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.020+0000 7f508ce18640 1 -- 172.21.15.29:0/1707524497 wait complete. 2024-01-25T15:04:50.031 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T15:04:14.955791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T15:04:24.986626+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T15:04:25.873673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-25T15:04:29.578261+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-25T15:04:50.032 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:04:50.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.135+0000 7f6936a3d640 1 Processor -- start 2024-01-25T15:04:50.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.135+0000 7f6936a3d640 1 -- start start 2024-01-25T15:04:50.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.136+0000 7f6936a3d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f693006b490 0x7f69300c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:50.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.136+0000 7f6936a3d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f69300c8620 0x7f6930151c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:50.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.136+0000 7f6936a3d640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69300c6770 con 0x7f6930158b80 2024-01-25T15:04:50.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.136+0000 7f6936a3d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6930154f10 con 0x7f693006b490 2024-01-25T15:04:50.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.136+0000 7f6936a3d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69301551f0 con 0x7f69300c8620 2024-01-25T15:04:50.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.136+0000 7f692ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f693006b490 0x7f69300c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:50.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.136+0000 7f692f7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6930158b80 0x7f69300c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59044/0 (socket says 172.21.15.29:59044) 2024-01-25T15:04:50.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.136+0000 7f692ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f693006b490 0x7f69300c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44856/0 (socket says 172.21.15.29:44856) 2024-01-25T15:04:50.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.136+0000 7f692f7fe640 1 -- 172.21.15.29:0/3343824345 learned_addr learned my addr 172.21.15.29:0/3343824345 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:50.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.136+0000 7f6934fda640 1 --2- 172.21.15.29:0/3343824345 >> v2:172.21.15.52:3300/0 conn(0x7f69300c8620 0x7f6930151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:50.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.136+0000 7f692ffff640 1 -- 172.21.15.29:0/3343824345 >> v2:172.21.15.52:3300/0 conn(0x7f69300c8620 msgr2=0x7f6930151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:50.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.136+0000 7f692ffff640 1 --2- 172.21.15.29:0/3343824345 >> v2:172.21.15.52:3300/0 conn(0x7f69300c8620 0x7f6930151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.136+0000 7f692ffff640 1 -- 172.21.15.29:0/3343824345 >> v1:172.21.15.29:6789/0 conn(0x7f6930158b80 legacy=0x7f69300c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:50.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.136+0000 7f692ffff640 1 -- 172.21.15.29:0/3343824345 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69301554d0 con 0x7f693006b490 2024-01-25T15:04:50.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.136+0000 7f692effd640 1 -- 172.21.15.29:0/3343824345 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275888614 0 0) 0x7f69300c6770 con 0x7f6930158b80 2024-01-25T15:04:50.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.136+0000 7f6934fda640 1 --2- 172.21.15.29:0/3343824345 >> v2:172.21.15.52:3300/0 conn(0x7f69300c8620 0x7f6930151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:50.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.137+0000 7f692ffff640 1 --2- 172.21.15.29:0/3343824345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f693006b490 0x7f69300c6120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f693008b850 tx=0x7f692402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee5addc965ccaa4 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:50.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.137+0000 7f692effd640 1 -- 172.21.15.29:0/3343824345 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692402e070 con 0x7f693006b490 2024-01-25T15:04:50.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.137+0000 7f692effd640 1 -- 172.21.15.29:0/3343824345 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69240315a0 con 0x7f693006b490 2024-01-25T15:04:50.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.137+0000 7f692effd640 1 -- 172.21.15.29:0/3343824345 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924031930 con 0x7f693006b490 2024-01-25T15:04:50.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.138+0000 7f6936a3d640 1 -- 172.21.15.29:0/3343824345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f693006b490 msgr2=0x7f69300c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:50.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.138+0000 7f6936a3d640 1 --2- 172.21.15.29:0/3343824345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f693006b490 0x7f69300c6120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f693008b850 tx=0x7f692402b840 comp rx=0 tx=0).stop 2024-01-25T15:04:50.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.138+0000 7f6936a3d640 1 -- 172.21.15.29:0/3343824345 shutdown_connections 2024-01-25T15:04:50.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.138+0000 7f6936a3d640 1 --2- 172.21.15.29:0/3343824345 >> v2:172.21.15.52:3300/0 conn(0x7f69300c8620 0x7f6930151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.138+0000 7f6936a3d640 1 --2- 172.21.15.29:0/3343824345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f693006b490 0x7f69300c6120 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.138+0000 7f6936a3d640 1 -- 172.21.15.29:0/3343824345 >> 172.21.15.29:0/3343824345 conn(0x7f69300ca010 msgr2=0x7f69300ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:50.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.138+0000 7f6936a3d640 1 -- 172.21.15.29:0/3343824345 shutdown_connections 2024-01-25T15:04:50.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.138+0000 7f6936a3d640 1 -- 172.21.15.29:0/3343824345 wait complete. 2024-01-25T15:04:50.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.139+0000 7f6936a3d640 1 Processor -- start 2024-01-25T15:04:50.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.139+0000 7f6936a3d640 1 -- start start 2024-01-25T15:04:50.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.140+0000 7f6936a3d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f693006b490 0x7f69300c00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:50.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.140+0000 7f6936a3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69300c8620 0x7f693014b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:50.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.140+0000 7f6936a3d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6930158b80 0x7f69300aaa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:50.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.140+0000 7f6936a3d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6930157bb0 con 0x7f693006b490 2024-01-25T15:04:50.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.140+0000 7f6936a3d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6930157e00 con 0x7f69300c8620 2024-01-25T15:04:50.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.140+0000 7f6936a3d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69300bdbc0 con 0x7f6930158b80 2024-01-25T15:04:50.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.140+0000 7f692ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f693006b490 0x7f69300c00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:50.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.140+0000 7f692ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f693006b490 0x7f69300c00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44860/0 (socket says 172.21.15.29:44860) 2024-01-25T15:04:50.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.140+0000 7f692ffff640 1 -- 172.21.15.29:0/1034420699 learned_addr learned my addr 172.21.15.29:0/1034420699 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:50.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.140+0000 7f692f7fe640 1 --2- 172.21.15.29:0/1034420699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69300c8620 0x7f693014b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:50.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.140+0000 7f6934fda640 1 --2- 172.21.15.29:0/1034420699 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6930158b80 0x7f69300aaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:50.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.140+0000 7f692ffff640 1 -- 172.21.15.29:0/1034420699 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6930158b80 msgr2=0x7f69300aaa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:50.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.140+0000 7f692ffff640 1 --2- 172.21.15.29:0/1034420699 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6930158b80 0x7f69300aaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.140+0000 7f692ffff640 1 -- 172.21.15.29:0/1034420699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69300c8620 msgr2=0x7f693014b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:50.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.140+0000 7f692ffff640 1 --2- 172.21.15.29:0/1034420699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69300c8620 0x7f693014b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.140+0000 7f692ffff640 1 -- 172.21.15.29:0/1034420699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6924009400 con 0x7f693006b490 2024-01-25T15:04:50.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.140+0000 7f692ffff640 1 --2- 172.21.15.29:0/1034420699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f693006b490 0x7f69300c00a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6924034040 tx=0x7f69240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:50.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.141+0000 7f692cff9640 1 -- 172.21.15.29:0/1034420699 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924004230 con 0x7f693006b490 2024-01-25T15:04:50.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.141+0000 7f692cff9640 1 -- 172.21.15.29:0/1034420699 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6924031f00 con 0x7f693006b490 2024-01-25T15:04:50.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.141+0000 7f6936a3d640 1 -- 172.21.15.29:0/1034420699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6930155b70 con 0x7f693006b490 2024-01-25T15:04:50.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.141+0000 7f692cff9640 1 -- 172.21.15.29:0/1034420699 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924032640 con 0x7f693006b490 2024-01-25T15:04:50.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.141+0000 7f6936a3d640 1 -- 172.21.15.29:0/1034420699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69300be180 con 0x7f693006b490 2024-01-25T15:04:50.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.141+0000 7f6936a3d640 1 -- 172.21.15.29:0/1034420699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69300a97d0 con 0x7f693006b490 2024-01-25T15:04:50.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.142+0000 7f692cff9640 1 -- 172.21.15.29:0/1034420699 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f69240327a0 con 0x7f693006b490 2024-01-25T15:04:50.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.142+0000 7f692cff9640 1 --2- 172.21.15.29:0/1034420699 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f691c06aed0 0x7f691c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:50.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.142+0000 7f692cff9640 1 -- 172.21.15.29:0/1034420699 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f69240ab940 con 0x7f693006b490 2024-01-25T15:04:50.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.143+0000 7f692f7fe640 1 --2- 172.21.15.29:0/1034420699 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f691c06aed0 0x7f691c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:50.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.143+0000 7f692f7fe640 1 --2- 172.21.15.29:0/1034420699 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f691c06aed0 0x7f691c06d390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f69300bd280 tx=0x7f6920009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:50.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.147+0000 7f692cff9640 1 -- 172.21.15.29:0/1034420699 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f69240765b0 con 0x7f693006b490 2024-01-25T15:04:50.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.326+0000 7f6936a3d640 1 -- 172.21.15.29:0/1034420699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6930074010 con 0x7f693006b490 2024-01-25T15:04:50.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.326+0000 7f692cff9640 1 -- 172.21.15.29:0/1034420699 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6924079bd0 con 0x7f693006b490 2024-01-25T15:04:50.327 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-25T15:04:50.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.328+0000 7f6936a3d640 1 -- 172.21.15.29:0/1034420699 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f691c06aed0 msgr2=0x7f691c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:50.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.328+0000 7f6936a3d640 1 --2- 172.21.15.29:0/1034420699 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f691c06aed0 0x7f691c06d390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f69300bd280 tx=0x7f6920009040 comp rx=0 tx=0).stop 2024-01-25T15:04:50.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.328+0000 7f6936a3d640 1 -- 172.21.15.29:0/1034420699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f693006b490 msgr2=0x7f69300c00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:50.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.328+0000 7f6936a3d640 1 --2- 172.21.15.29:0/1034420699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f693006b490 0x7f69300c00a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6924034040 tx=0x7f69240046c0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.328+0000 7f6936a3d640 1 -- 172.21.15.29:0/1034420699 shutdown_connections 2024-01-25T15:04:50.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.328+0000 7f6936a3d640 1 --2- 172.21.15.29:0/1034420699 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6930158b80 0x7f69300aaa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.328+0000 7f6936a3d640 1 --2- 172.21.15.29:0/1034420699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69300c8620 0x7f693014b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.328+0000 7f6936a3d640 1 --2- 172.21.15.29:0/1034420699 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f691c06aed0 0x7f691c06d390 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.328+0000 7f6936a3d640 1 --2- 172.21.15.29:0/1034420699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f693006b490 0x7f69300c00a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.328+0000 7f6936a3d640 1 -- 172.21.15.29:0/1034420699 >> 172.21.15.29:0/1034420699 conn(0x7f69300ca010 msgr2=0x7f69300c5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:50.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.328+0000 7f6936a3d640 1 -- 172.21.15.29:0/1034420699 shutdown_connections 2024-01-25T15:04:50.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.328+0000 7f6936a3d640 1 -- 172.21.15.29:0/1034420699 wait complete. 2024-01-25T15:04:50.340 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:04:50.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.443+0000 7fc35ff90640 1 Processor -- start 2024-01-25T15:04:50.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.444+0000 7fc35ff90640 1 -- start start 2024-01-25T15:04:50.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.444+0000 7fc35ff90640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc35806b490 0x7fc3580c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:50.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.444+0000 7fc35ff90640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc358158b80 0x7fc3580c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:50.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.444+0000 7fc35ff90640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3580c88e0 con 0x7fc3580c8450 2024-01-25T15:04:50.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.444+0000 7fc35ff90640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3580c6770 con 0x7fc35806b490 2024-01-25T15:04:50.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.444+0000 7fc35ff90640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc358154f10 con 0x7fc358158b80 2024-01-25T15:04:50.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.445+0000 7fc35dd2c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc35806b490 0x7fc3580c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:50.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.445+0000 7fc35e52d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc3580c8450 0x7fc358151c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59046/0 (socket says 172.21.15.29:59046) 2024-01-25T15:04:50.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.445+0000 7fc35e52d640 1 -- 172.21.15.29:0/2713240569 learned_addr learned my addr 172.21.15.29:0/2713240569 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:50.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.445+0000 7fc35d52b640 1 --2- 172.21.15.29:0/2713240569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc358158b80 0x7fc3580c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:50.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.445+0000 7fc35dd2c640 1 -- 172.21.15.29:0/2713240569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc358158b80 msgr2=0x7fc3580c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:50.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.445+0000 7fc35dd2c640 1 --2- 172.21.15.29:0/2713240569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc358158b80 0x7fc3580c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.445+0000 7fc35dd2c640 1 -- 172.21.15.29:0/2713240569 >> v1:172.21.15.29:6789/0 conn(0x7fc3580c8450 legacy=0x7fc358151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:50.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.445+0000 7fc35dd2c640 1 -- 172.21.15.29:0/2713240569 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3581551f0 con 0x7fc35806b490 2024-01-25T15:04:50.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.446+0000 7fc35dd2c640 1 --2- 172.21.15.29:0/2713240569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc35806b490 0x7fc3580c6120 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc3540097a0 tx=0x7fc35402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb4a299b96c411a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:50.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.446+0000 7fc35cd2a640 1 -- 172.21.15.29:0/2713240569 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35402e070 con 0x7fc35806b490 2024-01-25T15:04:50.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.446+0000 7fc35cd2a640 1 -- 172.21.15.29:0/2713240569 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3540315a0 con 0x7fc35806b490 2024-01-25T15:04:50.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.446+0000 7fc35cd2a640 1 -- 172.21.15.29:0/2713240569 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354031930 con 0x7fc35806b490 2024-01-25T15:04:50.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.446+0000 7fc35ff90640 1 -- 172.21.15.29:0/2713240569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc35806b490 msgr2=0x7fc3580c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:50.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.446+0000 7fc35ff90640 1 --2- 172.21.15.29:0/2713240569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc35806b490 0x7fc3580c6120 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc3540097a0 tx=0x7fc35402b840 comp rx=0 tx=0).stop 2024-01-25T15:04:50.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.446+0000 7fc35ff90640 1 -- 172.21.15.29:0/2713240569 shutdown_connections 2024-01-25T15:04:50.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.446+0000 7fc35ff90640 1 --2- 172.21.15.29:0/2713240569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc358158b80 0x7fc3580c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.446+0000 7fc35ff90640 1 --2- 172.21.15.29:0/2713240569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc35806b490 0x7fc3580c6120 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.446+0000 7fc35ff90640 1 -- 172.21.15.29:0/2713240569 >> 172.21.15.29:0/2713240569 conn(0x7fc3580ca010 msgr2=0x7fc3580ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:50.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.446+0000 7fc35ff90640 1 -- 172.21.15.29:0/2713240569 shutdown_connections 2024-01-25T15:04:50.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.446+0000 7fc35ff90640 1 -- 172.21.15.29:0/2713240569 wait complete. 2024-01-25T15:04:50.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.447+0000 7fc35ff90640 1 Processor -- start 2024-01-25T15:04:50.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.448+0000 7fc35ff90640 1 -- start start 2024-01-25T15:04:50.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.448+0000 7fc35ff90640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc35806b490 0x7fc3580ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:50.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.448+0000 7fc35ff90640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3580c8450 0x7fc3580bfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:50.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.448+0000 7fc35ff90640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc358158b80 0x7fc3580c0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:50.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.448+0000 7fc35ff90640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3581570e0 con 0x7fc3580c8450 2024-01-25T15:04:50.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.448+0000 7fc35ff90640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3581ead40 con 0x7fc35806b490 2024-01-25T15:04:50.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.448+0000 7fc35ff90640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3581eb020 con 0x7fc358158b80 2024-01-25T15:04:50.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.448+0000 7fc35d52b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3580c8450 0x7fc3580bfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:50.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.448+0000 7fc35d52b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3580c8450 0x7fc3580bfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44874/0 (socket says 172.21.15.29:44874) 2024-01-25T15:04:50.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.448+0000 7fc35d52b640 1 -- 172.21.15.29:0/3546314643 learned_addr learned my addr 172.21.15.29:0/3546314643 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:50.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.449+0000 7fc35e52d640 1 --2- 172.21.15.29:0/3546314643 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc358158b80 0x7fc3580c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:50.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.449+0000 7fc35dd2c640 1 --2- 172.21.15.29:0/3546314643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc35806b490 0x7fc3580ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:50.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.449+0000 7fc35d52b640 1 -- 172.21.15.29:0/3546314643 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc358158b80 msgr2=0x7fc3580c0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:50.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.449+0000 7fc35d52b640 1 --2- 172.21.15.29:0/3546314643 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc358158b80 0x7fc3580c0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.449+0000 7fc35d52b640 1 -- 172.21.15.29:0/3546314643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc35806b490 msgr2=0x7fc3580ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:50.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.449+0000 7fc35d52b640 1 --2- 172.21.15.29:0/3546314643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc35806b490 0x7fc3580ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.449+0000 7fc35d52b640 1 -- 172.21.15.29:0/3546314643 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc354009400 con 0x7fc3580c8450 2024-01-25T15:04:50.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.449+0000 7fc35e52d640 1 --2- 172.21.15.29:0/3546314643 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc358158b80 0x7fc3580c0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:50.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.449+0000 7fc35dd2c640 1 --2- 172.21.15.29:0/3546314643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc35806b490 0x7fc3580ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:50.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.449+0000 7fc35d52b640 1 --2- 172.21.15.29:0/3546314643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3580c8450 0x7fc3580bfbc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc34800d5f0 tx=0x7fc34800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:50.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.449+0000 7fc34e7fc640 1 -- 172.21.15.29:0/3546314643 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3480125f0 con 0x7fc3580c8450 2024-01-25T15:04:50.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.449+0000 7fc34e7fc640 1 -- 172.21.15.29:0/3546314643 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc348012750 con 0x7fc3580c8450 2024-01-25T15:04:50.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.449+0000 7fc35ff90640 1 -- 172.21.15.29:0/3546314643 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc358157350 con 0x7fc3580c8450 2024-01-25T15:04:50.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.449+0000 7fc34e7fc640 1 -- 172.21.15.29:0/3546314643 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc348012b00 con 0x7fc3580c8450 2024-01-25T15:04:50.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.449+0000 7fc35ff90640 1 -- 172.21.15.29:0/3546314643 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3580ab7f0 con 0x7fc3580c8450 2024-01-25T15:04:50.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.450+0000 7fc35ff90640 1 -- 172.21.15.29:0/3546314643 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35806cf80 con 0x7fc3580c8450 2024-01-25T15:04:50.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.450+0000 7fc34e7fc640 1 -- 172.21.15.29:0/3546314643 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fc348012c60 con 0x7fc3580c8450 2024-01-25T15:04:50.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.451+0000 7fc34e7fc640 1 --2- 172.21.15.29:0/3546314643 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc33c06af00 0x7fc33c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:50.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.451+0000 7fc34e7fc640 1 -- 172.21.15.29:0/3546314643 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc348089d80 con 0x7fc3580c8450 2024-01-25T15:04:50.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.451+0000 7fc35dd2c640 1 --2- 172.21.15.29:0/3546314643 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc33c06af00 0x7fc33c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:50.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.451+0000 7fc35dd2c640 1 --2- 172.21.15.29:0/3546314643 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc33c06af00 0x7fc33c06d3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc354036000 tx=0x7fc35403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:50.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.455+0000 7fc34e7fc640 1 -- 172.21.15.29:0/3546314643 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fc3480549f0 con 0x7fc3580c8450 2024-01-25T15:04:50.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.639+0000 7fc35ff90640 1 -- 172.21.15.29:0/3546314643 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3580aa950 con 0x7fc3580c8450 2024-01-25T15:04:50.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.640+0000 7fc34e7fc640 1 -- 172.21.15.29:0/3546314643 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc348058010 con 0x7fc3580c8450 2024-01-25T15:04:50.641 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:04:50.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.642+0000 7fc35ff90640 1 -- 172.21.15.29:0/3546314643 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc33c06af00 msgr2=0x7fc33c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:50.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.642+0000 7fc35ff90640 1 --2- 172.21.15.29:0/3546314643 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc33c06af00 0x7fc33c06d3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc354036000 tx=0x7fc35403d040 comp rx=0 tx=0).stop 2024-01-25T15:04:50.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.642+0000 7fc35ff90640 1 -- 172.21.15.29:0/3546314643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3580c8450 msgr2=0x7fc3580bfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:50.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.642+0000 7fc35ff90640 1 --2- 172.21.15.29:0/3546314643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3580c8450 0x7fc3580bfbc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc34800d5f0 tx=0x7fc34800dab0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.642+0000 7fc35ff90640 1 -- 172.21.15.29:0/3546314643 shutdown_connections 2024-01-25T15:04:50.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.642+0000 7fc35ff90640 1 --2- 172.21.15.29:0/3546314643 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc358158b80 0x7fc3580c0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.642+0000 7fc35ff90640 1 --2- 172.21.15.29:0/3546314643 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc33c06af00 0x7fc33c06d3c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.642+0000 7fc35ff90640 1 --2- 172.21.15.29:0/3546314643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3580c8450 0x7fc3580bfbc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.642+0000 7fc35ff90640 1 --2- 172.21.15.29:0/3546314643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc35806b490 0x7fc3580ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.642+0000 7fc35ff90640 1 -- 172.21.15.29:0/3546314643 >> 172.21.15.29:0/3546314643 conn(0x7fc3580ca010 msgr2=0x7fc3580c8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:50.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.642+0000 7fc35ff90640 1 -- 172.21.15.29:0/3546314643 shutdown_connections 2024-01-25T15:04:50.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.642+0000 7fc35ff90640 1 -- 172.21.15.29:0/3546314643 wait complete. 2024-01-25T15:04:50.653 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:04:50.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.756+0000 7efce1215640 1 Processor -- start 2024-01-25T15:04:50.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.756+0000 7efce1215640 1 -- start start 2024-01-25T15:04:50.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.757+0000 7efce1215640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efcdc06d560 0x7efcdc06b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:50.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.757+0000 7efce1215640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efcdc0c4fe0 0x7efcdc06b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:50.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.757+0000 7efce1215640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcdc0afaa0 con 0x7efcdc0af6c0 2024-01-25T15:04:50.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.757+0000 7efce1215640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcdc06c480 con 0x7efcdc06d560 2024-01-25T15:04:50.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.757+0000 7efce1215640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc155290 con 0x7efcdc0c4fe0 2024-01-25T15:04:50.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.757+0000 7efcd3fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efcdc06d560 0x7efcdc06b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:50.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.757+0000 7efcd3fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efcdc06d560 0x7efcdc06b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44880/0 (socket says 172.21.15.29:44880) 2024-01-25T15:04:50.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.757+0000 7efcd3fff640 1 -- 172.21.15.29:0/2233944071 learned_addr learned my addr 172.21.15.29:0/2233944071 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:50.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.758+0000 7efcdb59e640 1 --2- 172.21.15.29:0/2233944071 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efcdc0c4fe0 0x7efcdc06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:50.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.758+0000 7efcd3fff640 1 -- 172.21.15.29:0/2233944071 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efcdc0c4fe0 msgr2=0x7efcdc06b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:50.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.758+0000 7efcd3fff640 1 --2- 172.21.15.29:0/2233944071 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efcdc0c4fe0 0x7efcdc06b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.758+0000 7efcd3fff640 1 -- 172.21.15.29:0/2233944071 >> v1:172.21.15.52:6789/0 conn(0x7efcdc0af6c0 legacy=0x7efcdc0c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:50.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.758+0000 7efcd3fff640 1 -- 172.21.15.29:0/2233944071 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc0c6060 con 0x7efcdc06d560 2024-01-25T15:04:50.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.758+0000 7efcdb59e640 1 --2- 172.21.15.29:0/2233944071 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efcdc0c4fe0 0x7efcdc06b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:50.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.758+0000 7efcd3fff640 1 --2- 172.21.15.29:0/2233944071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc06d560 0x7efcdc06b220 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efcc4009870 tx=0x7efcc402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8183ced4e2f2d751 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:50.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.758+0000 7efcda59c640 1 -- 172.21.15.29:0/2233944071 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc4031640 con 0x7efcdc06d560 2024-01-25T15:04:50.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.759+0000 7efcda59c640 1 -- 172.21.15.29:0/2233944071 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc40317a0 con 0x7efcdc06d560 2024-01-25T15:04:50.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.759+0000 7efcda59c640 1 -- 172.21.15.29:0/2233944071 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc4031b30 con 0x7efcdc06d560 2024-01-25T15:04:50.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.759+0000 7efce1215640 1 -- 172.21.15.29:0/2233944071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc06d560 msgr2=0x7efcdc06b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:50.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.759+0000 7efce1215640 1 --2- 172.21.15.29:0/2233944071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc06d560 0x7efcdc06b220 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efcc4009870 tx=0x7efcc402b8f0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.759+0000 7efce1215640 1 -- 172.21.15.29:0/2233944071 shutdown_connections 2024-01-25T15:04:50.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.759+0000 7efce1215640 1 --2- 172.21.15.29:0/2233944071 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efcdc0c4fe0 0x7efcdc06b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.759+0000 7efce1215640 1 --2- 172.21.15.29:0/2233944071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc06d560 0x7efcdc06b220 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.759+0000 7efce1215640 1 -- 172.21.15.29:0/2233944071 >> 172.21.15.29:0/2233944071 conn(0x7efcdc0c6ca0 msgr2=0x7efcdc0c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:50.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.759+0000 7efce1215640 1 -- 172.21.15.29:0/2233944071 shutdown_connections 2024-01-25T15:04:50.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.759+0000 7efce1215640 1 -- 172.21.15.29:0/2233944071 wait complete. 2024-01-25T15:04:50.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.760+0000 7efce1215640 1 Processor -- start 2024-01-25T15:04:50.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.760+0000 7efce1215640 1 -- start start 2024-01-25T15:04:50.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.761+0000 7efce1215640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcdc06d560 0x7efcdc0bdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:50.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.761+0000 7efce1215640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efcdc0af6c0 0x7efcdc1ed900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:50.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.761+0000 7efce1215640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc0c4fe0 0x7efcdc14e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:50.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.761+0000 7efce1215640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc1ee1d0 con 0x7efcdc0c4fe0 2024-01-25T15:04:50.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.761+0000 7efce1215640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc0c3eb0 con 0x7efcdc06d560 2024-01-25T15:04:50.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.761+0000 7efce1215640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc0c4190 con 0x7efcdc0af6c0 2024-01-25T15:04:50.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.761+0000 7efcdb59e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc0c4fe0 0x7efcdc14e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:50.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.761+0000 7efcdb59e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc0c4fe0 0x7efcdc14e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44882/0 (socket says 172.21.15.29:44882) 2024-01-25T15:04:50.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.761+0000 7efcdb59e640 1 -- 172.21.15.29:0/572998508 learned_addr learned my addr 172.21.15.29:0/572998508 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:50.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.761+0000 7efcd3fff640 1 --2- 172.21.15.29:0/572998508 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efcdc0af6c0 0x7efcdc1ed900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:50.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.761+0000 7efcdad9d640 1 --2- 172.21.15.29:0/572998508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcdc06d560 0x7efcdc0bdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:50.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.761+0000 7efcdb59e640 1 -- 172.21.15.29:0/572998508 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efcdc0af6c0 msgr2=0x7efcdc1ed900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:50.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.761+0000 7efcdb59e640 1 --2- 172.21.15.29:0/572998508 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efcdc0af6c0 0x7efcdc1ed900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.761+0000 7efcdb59e640 1 -- 172.21.15.29:0/572998508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcdc06d560 msgr2=0x7efcdc0bdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:50.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.761+0000 7efcdb59e640 1 --2- 172.21.15.29:0/572998508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcdc06d560 0x7efcdc0bdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.761+0000 7efcdb59e640 1 -- 172.21.15.29:0/572998508 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc40094d0 con 0x7efcdc0c4fe0 2024-01-25T15:04:50.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.762+0000 7efcdb59e640 1 --2- 172.21.15.29:0/572998508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc0c4fe0 0x7efcdc14e400 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efcd400cd50 tx=0x7efcd400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:50.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.762+0000 7efcd37fe640 1 -- 172.21.15.29:0/572998508 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd400f680 con 0x7efcdc0c4fe0 2024-01-25T15:04:50.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.762+0000 7efcd37fe640 1 -- 172.21.15.29:0/572998508 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd400f800 con 0x7efcdc0c4fe0 2024-01-25T15:04:50.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.762+0000 7efce1215640 1 -- 172.21.15.29:0/572998508 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcdc0c3210 con 0x7efcdc0c4fe0 2024-01-25T15:04:50.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.762+0000 7efcd37fe640 1 -- 172.21.15.29:0/572998508 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd400fbb0 con 0x7efcdc0c4fe0 2024-01-25T15:04:50.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.762+0000 7efce1215640 1 -- 172.21.15.29:0/572998508 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc1ee4b0 con 0x7efcdc0c4fe0 2024-01-25T15:04:50.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.763+0000 7efce1215640 1 -- 172.21.15.29:0/572998508 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcdc074010 con 0x7efcdc0c4fe0 2024-01-25T15:04:50.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.763+0000 7efcd37fe640 1 -- 172.21.15.29:0/572998508 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7efcd400b040 con 0x7efcdc0c4fe0 2024-01-25T15:04:50.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.764+0000 7efcd37fe640 1 --2- 172.21.15.29:0/572998508 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efcbc06aed0 0x7efcbc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:50.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.764+0000 7efcd37fe640 1 -- 172.21.15.29:0/572998508 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efcd408a2d0 con 0x7efcdc0c4fe0 2024-01-25T15:04:50.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.764+0000 7efcdad9d640 1 --2- 172.21.15.29:0/572998508 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efcbc06aed0 0x7efcbc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:50.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.764+0000 7efcdad9d640 1 --2- 172.21.15.29:0/572998508 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efcbc06aed0 0x7efcbc06d390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efcdc158e90 tx=0x7efccc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:50.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.768+0000 7efcd37fe640 1 -- 172.21.15.29:0/572998508 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7efcd4054f40 con 0x7efcdc0c4fe0 2024-01-25T15:04:50.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.950+0000 7efce1215640 1 -- 172.21.15.29:0/572998508 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efcdc156760 con 0x7efcdc0c4fe0 2024-01-25T15:04:50.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.950+0000 7efcd37fe640 1 -- 172.21.15.29:0/572998508 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7efcd4058560 con 0x7efcdc0c4fe0 2024-01-25T15:04:50.951 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-25T15:04:50.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.952+0000 7efce1215640 1 -- 172.21.15.29:0/572998508 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efcbc06aed0 msgr2=0x7efcbc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:50.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.952+0000 7efce1215640 1 --2- 172.21.15.29:0/572998508 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efcbc06aed0 0x7efcbc06d390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efcdc158e90 tx=0x7efccc009040 comp rx=0 tx=0).stop 2024-01-25T15:04:50.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.952+0000 7efce1215640 1 -- 172.21.15.29:0/572998508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc0c4fe0 msgr2=0x7efcdc14e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:50.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.952+0000 7efce1215640 1 --2- 172.21.15.29:0/572998508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc0c4fe0 0x7efcdc14e400 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efcd400cd50 tx=0x7efcd400a650 comp rx=0 tx=0).stop 2024-01-25T15:04:50.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.952+0000 7efce1215640 1 -- 172.21.15.29:0/572998508 shutdown_connections 2024-01-25T15:04:50.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.952+0000 7efce1215640 1 --2- 172.21.15.29:0/572998508 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efcbc06aed0 0x7efcbc06d390 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.952+0000 7efce1215640 1 --2- 172.21.15.29:0/572998508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efcdc0c4fe0 0x7efcdc14e400 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.952+0000 7efce1215640 1 --2- 172.21.15.29:0/572998508 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efcdc0af6c0 0x7efcdc1ed900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.952+0000 7efce1215640 1 --2- 172.21.15.29:0/572998508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcdc06d560 0x7efcdc0bdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:50.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.952+0000 7efce1215640 1 -- 172.21.15.29:0/572998508 >> 172.21.15.29:0/572998508 conn(0x7efcdc0c6ca0 msgr2=0x7efcdc0a9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:50.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.952+0000 7efce1215640 1 -- 172.21.15.29:0/572998508 shutdown_connections 2024-01-25T15:04:50.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:50.952+0000 7efce1215640 1 -- 172.21.15.29:0/572998508 wait complete. 2024-01-25T15:04:50.964 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-25T15:04:51.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.067+0000 7f27707f5640 1 Processor -- start 2024-01-25T15:04:51.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.067+0000 7f27707f5640 1 -- start start 2024-01-25T15:04:51.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.068+0000 7f27707f5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f276806b710 0x7f27680c6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:51.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.068+0000 7f27707f5640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27680c58c0 con 0x7f276806b2b0 2024-01-25T15:04:51.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.068+0000 7f27707f5640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27680c4990 con 0x7f2768151d80 2024-01-25T15:04:51.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.068+0000 7f27707f5640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f276806c0a0 con 0x7f276806b710 2024-01-25T15:04:51.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.068+0000 7f276dd90640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f276806b2b0 0x7f27680c5d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59056/0 (socket says 172.21.15.29:59056) 2024-01-25T15:04:51.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.068+0000 7f276dd90640 1 -- 172.21.15.29:0/3426734741 learned_addr learned my addr 172.21.15.29:0/3426734741 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:51.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.068+0000 7f276ed92640 1 --2- 172.21.15.29:0/3426734741 >> v2:172.21.15.52:3300/0 conn(0x7f276806b710 0x7f27680c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:51.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.068+0000 7f276d58f640 1 -- 172.21.15.29:0/3426734741 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406563603 0 0) 0x7f27680c58c0 con 0x7f276806b2b0 2024-01-25T15:04:51.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.068+0000 7f276d58f640 1 -- 172.21.15.29:0/3426734741 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2754003520 con 0x7f276806b2b0 2024-01-25T15:04:51.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.068+0000 7f276d58f640 1 -- 172.21.15.29:0/3426734741 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2484881701 0 0) 0x7f2754003520 con 0x7f276806b2b0 2024-01-25T15:04:51.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.068+0000 7f276d58f640 1 -- 172.21.15.29:0/3426734741 >> v2:172.21.15.52:3300/0 conn(0x7f276806b710 msgr2=0x7f27680c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:51.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.068+0000 7f276d58f640 1 --2- 172.21.15.29:0/3426734741 >> v2:172.21.15.52:3300/0 conn(0x7f276806b710 0x7f27680c6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.068+0000 7f276d58f640 1 -- 172.21.15.29:0/3426734741 >> v1:172.21.15.52:6789/0 conn(0x7f2768151d80 legacy=0x7f2768155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:51.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.068+0000 7f276d58f640 1 -- 172.21.15.29:0/3426734741 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27680c4c30 con 0x7f276806b2b0 2024-01-25T15:04:51.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.068+0000 7f276d58f640 1 -- 172.21.15.29:0/3426734741 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f2758001670 con 0x7f276806b2b0 2024-01-25T15:04:51.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.068+0000 7f276d58f640 1 -- 172.21.15.29:0/3426734741 >> v1:172.21.15.29:6789/0 conn(0x7f276806b2b0 legacy=0x7f27680c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.068+0000 7f276d58f640 1 --2- 172.21.15.29:0/3426734741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2754003a10 0x7f2754003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.068+0000 7f276d58f640 1 --2- 172.21.15.29:0/3426734741 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27540047c0 0x7f2754004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.068+0000 7f276d58f640 1 --2- 172.21.15.29:0/3426734741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27540052a0 0x7f275400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.069+0000 7f276d58f640 1 -- 172.21.15.29:0/3426734741 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275400c140 con 0x7f2754003a10 2024-01-25T15:04:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.069+0000 7f276d58f640 1 -- 172.21.15.29:0/3426734741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275400c2b0 con 0x7f27540052a0 2024-01-25T15:04:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.069+0000 7f276d58f640 1 -- 172.21.15.29:0/3426734741 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275400c470 con 0x7f27540047c0 2024-01-25T15:04:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.069+0000 7f276e591640 1 --2- 172.21.15.29:0/3426734741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2754003a10 0x7f2754003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.069+0000 7f276dd90640 1 --2- 172.21.15.29:0/3426734741 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27540047c0 0x7f2754004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.069+0000 7f276ed92640 1 --2- 172.21.15.29:0/3426734741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27540052a0 0x7f275400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.069+0000 7f276e591640 1 -- 172.21.15.29:0/3426734741 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27540047c0 msgr2=0x7f2754004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.069+0000 7f276e591640 1 --2- 172.21.15.29:0/3426734741 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27540047c0 0x7f2754004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.069+0000 7f276e591640 1 -- 172.21.15.29:0/3426734741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27540052a0 msgr2=0x7f275400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.069+0000 7f276e591640 1 --2- 172.21.15.29:0/3426734741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27540052a0 0x7f275400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.069+0000 7f276e591640 1 -- 172.21.15.29:0/3426734741 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2754003520 con 0x7f2754003a10 2024-01-25T15:04:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.069+0000 7f276ed92640 1 --2- 172.21.15.29:0/3426734741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27540052a0 0x7f275400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:51.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.069+0000 7f276ed92640 1 -- 172.21.15.29:0/3426734741 reap_dead start 2024-01-25T15:04:51.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.070+0000 7f276e591640 1 --2- 172.21.15.29:0/3426734741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2754003a10 0x7f2754003e30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2764001720 tx=0x7f27540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e80fcbdd29fb075 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:51.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.070+0000 7f276d58f640 1 -- 172.21.15.29:0/3426734741 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27640052d0 con 0x7f2754003a10 2024-01-25T15:04:51.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.070+0000 7f276d58f640 1 -- 172.21.15.29:0/3426734741 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276402e050 con 0x7f2754003a10 2024-01-25T15:04:51.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.070+0000 7f276d58f640 1 -- 172.21.15.29:0/3426734741 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2764003830 con 0x7f2754003a10 2024-01-25T15:04:51.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.070+0000 7f27707f5640 1 -- 172.21.15.29:0/3426734741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2754003a10 msgr2=0x7f2754003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:51.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.070+0000 7f27707f5640 1 --2- 172.21.15.29:0/3426734741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2754003a10 0x7f2754003e30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2764001720 tx=0x7f27540057f0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.070+0000 7f27707f5640 1 -- 172.21.15.29:0/3426734741 shutdown_connections 2024-01-25T15:04:51.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.070+0000 7f27707f5640 1 --2- 172.21.15.29:0/3426734741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2754003a10 0x7f2754003e30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.070+0000 7f27707f5640 1 -- 172.21.15.29:0/3426734741 >> 172.21.15.29:0/3426734741 conn(0x7f27680ca1f0 msgr2=0x7f27680ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:51.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.070+0000 7f27707f5640 1 -- 172.21.15.29:0/3426734741 shutdown_connections 2024-01-25T15:04:51.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.070+0000 7f27707f5640 1 -- 172.21.15.29:0/3426734741 wait complete. 2024-01-25T15:04:51.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.071+0000 7f27707f5640 1 Processor -- start 2024-01-25T15:04:51.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.071+0000 7f27707f5640 1 -- start start 2024-01-25T15:04:51.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.072+0000 7f27707f5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2754003a10 0x7f2768148930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:51.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.072+0000 7f27707f5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27681ed3f0 0x7f27681ed870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:51.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.072+0000 7f27707f5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27680be730 0x7f27680beb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:51.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.072+0000 7f27707f5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27680c3c30 con 0x7f27681ed3f0 2024-01-25T15:04:51.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.072+0000 7f27707f5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27681ee330 con 0x7f2754003a10 2024-01-25T15:04:51.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.072+0000 7f27707f5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2768154440 con 0x7f27680be730 2024-01-25T15:04:51.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.072+0000 7f276dd90640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27681ed3f0 0x7f27681ed870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:51.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.072+0000 7f276dd90640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27681ed3f0 0x7f27681ed870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44906/0 (socket says 172.21.15.29:44906) 2024-01-25T15:04:51.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.072+0000 7f276dd90640 1 -- 172.21.15.29:0/3829828288 learned_addr learned my addr 172.21.15.29:0/3829828288 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:51.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.072+0000 7f276ed92640 1 --2- 172.21.15.29:0/3829828288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27680be730 0x7f27680beb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:51.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.072+0000 7f276e591640 1 --2- 172.21.15.29:0/3829828288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2754003a10 0x7f2768148930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:51.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.072+0000 7f276dd90640 1 -- 172.21.15.29:0/3829828288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27680be730 msgr2=0x7f27680beb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:51.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.072+0000 7f276dd90640 1 --2- 172.21.15.29:0/3829828288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27680be730 0x7f27680beb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.073+0000 7f276dd90640 1 -- 172.21.15.29:0/3829828288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2754003a10 msgr2=0x7f2768148930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:51.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.073+0000 7f276dd90640 1 --2- 172.21.15.29:0/3829828288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2754003a10 0x7f2768148930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.073+0000 7f276dd90640 1 -- 172.21.15.29:0/3829828288 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27681eddb0 con 0x7f27681ed3f0 2024-01-25T15:04:51.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.073+0000 7f276ed92640 1 --2- 172.21.15.29:0/3829828288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27680be730 0x7f27680beb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:51.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.073+0000 7f276e591640 1 --2- 172.21.15.29:0/3829828288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2754003a10 0x7f2768148930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:51.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.073+0000 7f276dd90640 1 --2- 172.21.15.29:0/3829828288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27681ed3f0 0x7f27681ed870 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f27580011e0 tx=0x7f2758007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:51.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.073+0000 7f275effd640 1 -- 172.21.15.29:0/3829828288 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2758001650 con 0x7f27681ed3f0 2024-01-25T15:04:51.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.073+0000 7f275effd640 1 -- 172.21.15.29:0/3829828288 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275800f9c0 con 0x7f27681ed3f0 2024-01-25T15:04:51.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.073+0000 7f275effd640 1 -- 172.21.15.29:0/3829828288 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275800fd50 con 0x7f27681ed3f0 2024-01-25T15:04:51.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.073+0000 7f27707f5640 1 -- 172.21.15.29:0/3829828288 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27680c0890 con 0x7f27681ed3f0 2024-01-25T15:04:51.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.073+0000 7f27707f5640 1 -- 172.21.15.29:0/3829828288 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27681ee050 con 0x7f27681ed3f0 2024-01-25T15:04:51.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.074+0000 7f27707f5640 1 -- 172.21.15.29:0/3829828288 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2768074010 con 0x7f27681ed3f0 2024-01-25T15:04:51.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.074+0000 7f275effd640 1 -- 172.21.15.29:0/3829828288 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f275801d460 con 0x7f27681ed3f0 2024-01-25T15:04:51.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.075+0000 7f275effd640 1 --2- 172.21.15.29:0/3829828288 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f274c06af00 0x7f274c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:51.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.075+0000 7f275effd640 1 -- 172.21.15.29:0/3829828288 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2758089ac0 con 0x7f27681ed3f0 2024-01-25T15:04:51.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.075+0000 7f276e591640 1 --2- 172.21.15.29:0/3829828288 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f274c06af00 0x7f274c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:51.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.075+0000 7f276e591640 1 --2- 172.21.15.29:0/3829828288 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f274c06af00 0x7f274c06d3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2764033000 tx=0x7f2764009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:51.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.079+0000 7f275effd640 1 -- 172.21.15.29:0/3829828288 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2758054690 con 0x7f27681ed3f0 2024-01-25T15:04:51.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.262+0000 7f27707f5640 1 -- 172.21.15.29:0/3829828288 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f27680c4440 con 0x7f27681ed3f0 2024-01-25T15:04:51.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.262+0000 7f275effd640 1 -- 172.21.15.29:0/3829828288 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2758057cb0 con 0x7f27681ed3f0 2024-01-25T15:04:51.263 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:04:51.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.264+0000 7f27707f5640 1 -- 172.21.15.29:0/3829828288 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f274c06af00 msgr2=0x7f274c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:51.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.264+0000 7f27707f5640 1 --2- 172.21.15.29:0/3829828288 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f274c06af00 0x7f274c06d3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2764033000 tx=0x7f2764009030 comp rx=0 tx=0).stop 2024-01-25T15:04:51.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.264+0000 7f27707f5640 1 -- 172.21.15.29:0/3829828288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27681ed3f0 msgr2=0x7f27681ed870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:51.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.264+0000 7f27707f5640 1 --2- 172.21.15.29:0/3829828288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27681ed3f0 0x7f27681ed870 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f27580011e0 tx=0x7f2758007720 comp rx=0 tx=0).stop 2024-01-25T15:04:51.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.264+0000 7f27707f5640 1 -- 172.21.15.29:0/3829828288 shutdown_connections 2024-01-25T15:04:51.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.264+0000 7f27707f5640 1 --2- 172.21.15.29:0/3829828288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f27680be730 0x7f27680beb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.264+0000 7f27707f5640 1 --2- 172.21.15.29:0/3829828288 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f274c06af00 0x7f274c06d3c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.264+0000 7f27707f5640 1 --2- 172.21.15.29:0/3829828288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27681ed3f0 0x7f27681ed870 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.264+0000 7f27707f5640 1 --2- 172.21.15.29:0/3829828288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2754003a10 0x7f2768148930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.264+0000 7f27707f5640 1 -- 172.21.15.29:0/3829828288 >> 172.21.15.29:0/3829828288 conn(0x7f27680ca1f0 msgr2=0x7f2768150da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:51.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.264+0000 7f27707f5640 1 -- 172.21.15.29:0/3829828288 shutdown_connections 2024-01-25T15:04:51.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.265+0000 7f27707f5640 1 -- 172.21.15.29:0/3829828288 wait complete. 2024-01-25T15:04:51.276 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:04:51.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.376+0000 7f15bd62b640 1 Processor -- start 2024-01-25T15:04:51.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.376+0000 7f15bd62b640 1 -- start start 2024-01-25T15:04:51.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.377+0000 7f15bd62b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f15b80c8620 0x7f15b806bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:51.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.377+0000 7f15bd62b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b8155430 con 0x7f15b80c4990 2024-01-25T15:04:51.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.377+0000 7f15bd62b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b8154b40 con 0x7f15b8152160 2024-01-25T15:04:51.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.377+0000 7f15bd62b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b8152540 con 0x7f15b80c8620 2024-01-25T15:04:51.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.377+0000 7f15b67fc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f15b80c4990 0x7f15b80c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59062/0 (socket says 172.21.15.29:59062) 2024-01-25T15:04:51.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.377+0000 7f15b67fc640 1 -- 172.21.15.29:0/3544387797 learned_addr learned my addr 172.21.15.29:0/3544387797 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:51.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.377+0000 7f15b77fe640 1 --2- 172.21.15.29:0/3544387797 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f15b80c8620 0x7f15b806bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:51.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.377+0000 7f15b5ffb640 1 -- 172.21.15.29:0/3544387797 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128230743 0 0) 0x7f15b8155430 con 0x7f15b80c4990 2024-01-25T15:04:51.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.377+0000 7f15b5ffb640 1 -- 172.21.15.29:0/3544387797 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15a4003520 con 0x7f15b80c4990 2024-01-25T15:04:51.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.377+0000 7f15b5ffb640 1 -- 172.21.15.29:0/3544387797 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153770630 0 0) 0x7f15b8154b40 con 0x7f15b8152160 2024-01-25T15:04:51.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.377+0000 7f15b5ffb640 1 -- 172.21.15.29:0/3544387797 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15b8155430 con 0x7f15b8152160 2024-01-25T15:04:51.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.377+0000 7f15b5ffb640 1 -- 172.21.15.29:0/3544387797 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2175585787 0 0) 0x7f15a4003520 con 0x7f15b80c4990 2024-01-25T15:04:51.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.377+0000 7f15b5ffb640 1 -- 172.21.15.29:0/3544387797 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f15b80c8620 msgr2=0x7f15b806bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:51.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.377+0000 7f15b5ffb640 1 --2- 172.21.15.29:0/3544387797 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f15b80c8620 0x7f15b806bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.377+0000 7f15b5ffb640 1 -- 172.21.15.29:0/3544387797 >> v1:172.21.15.52:6789/0 conn(0x7f15b8152160 legacy=0x7f15b80c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:51.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.378+0000 7f15b5ffb640 1 -- 172.21.15.29:0/3544387797 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b80c64b0 con 0x7f15b80c4990 2024-01-25T15:04:51.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.378+0000 7f15b5ffb640 1 -- 172.21.15.29:0/3544387797 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f15a0001670 con 0x7f15b80c4990 2024-01-25T15:04:51.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.378+0000 7f15b77fe640 1 --2- 172.21.15.29:0/3544387797 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f15b80c8620 0x7f15b806bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:51.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.378+0000 7f15b5ffb640 1 -- 172.21.15.29:0/3544387797 >> v1:172.21.15.29:6789/0 conn(0x7f15b80c4990 legacy=0x7f15b80c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:51.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.378+0000 7f15b5ffb640 1 --2- 172.21.15.29:0/3544387797 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f15a4003b30 0x7f15a4003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:51.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.378+0000 7f15b5ffb640 1 --2- 172.21.15.29:0/3544387797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15a40047c0 0x7f15a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:51.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.378+0000 7f15b5ffb640 1 --2- 172.21.15.29:0/3544387797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15a4005180 0x7f15a400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:51.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.378+0000 7f15b5ffb640 1 -- 172.21.15.29:0/3544387797 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b8152540 con 0x7f15a40047c0 2024-01-25T15:04:51.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.378+0000 7f15b5ffb640 1 -- 172.21.15.29:0/3544387797 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a400bf20 con 0x7f15a4005180 2024-01-25T15:04:51.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.378+0000 7f15b5ffb640 1 -- 172.21.15.29:0/3544387797 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a400c0e0 con 0x7f15a4003b30 2024-01-25T15:04:51.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.378+0000 7f15b67fc640 1 --2- 172.21.15.29:0/3544387797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15a40047c0 0x7f15a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:51.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.378+0000 7f15b77fe640 1 --2- 172.21.15.29:0/3544387797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15a4005180 0x7f15a400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:51.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.378+0000 7f15b6ffd640 1 --2- 172.21.15.29:0/3544387797 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f15a4003b30 0x7f15a4003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:51.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.378+0000 7f15b67fc640 1 -- 172.21.15.29:0/3544387797 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f15a4003b30 msgr2=0x7f15a4003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:51.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.378+0000 7f15b67fc640 1 --2- 172.21.15.29:0/3544387797 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f15a4003b30 0x7f15a4003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.378+0000 7f15b67fc640 1 -- 172.21.15.29:0/3544387797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15a4005180 msgr2=0x7f15a400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:51.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.378+0000 7f15b67fc640 1 --2- 172.21.15.29:0/3544387797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15a4005180 0x7f15a400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.378+0000 7f15b67fc640 1 -- 172.21.15.29:0/3544387797 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a8009a70 con 0x7f15a40047c0 2024-01-25T15:04:51.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.378+0000 7f15b6ffd640 1 --2- 172.21.15.29:0/3544387797 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f15a4003b30 0x7f15a4003f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:51.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.379+0000 7f15b67fc640 1 --2- 172.21.15.29:0/3544387797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15a40047c0 0x7f15a4004c40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f15a0007f70 tx=0x7f15a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb1422f361ddb7a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:51.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.379+0000 7f15b5ffb640 1 -- 172.21.15.29:0/3544387797 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a0005ad0 con 0x7f15a40047c0 2024-01-25T15:04:51.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.379+0000 7f15b5ffb640 1 -- 172.21.15.29:0/3544387797 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a0005c50 con 0x7f15a40047c0 2024-01-25T15:04:51.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.379+0000 7f15b5ffb640 1 -- 172.21.15.29:0/3544387797 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a0007070 con 0x7f15a40047c0 2024-01-25T15:04:51.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.379+0000 7f15bd62b640 1 -- 172.21.15.29:0/3544387797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15a40047c0 msgr2=0x7f15a4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:51.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.379+0000 7f15bd62b640 1 --2- 172.21.15.29:0/3544387797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15a40047c0 0x7f15a4004c40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f15a0007f70 tx=0x7f15a40057f0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.379+0000 7f15b77fe640 1 -- 172.21.15.29:0/3544387797 reap_dead start 2024-01-25T15:04:51.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.379+0000 7f15bd62b640 1 -- 172.21.15.29:0/3544387797 shutdown_connections 2024-01-25T15:04:51.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.379+0000 7f15bd62b640 1 -- 172.21.15.29:0/3544387797 >> 172.21.15.29:0/3544387797 conn(0x7f15b80ca1f0 msgr2=0x7f15b80ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:51.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.380+0000 7f15bd62b640 1 -- 172.21.15.29:0/3544387797 shutdown_connections 2024-01-25T15:04:51.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.380+0000 7f15bd62b640 1 -- 172.21.15.29:0/3544387797 wait complete. 2024-01-25T15:04:51.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.381+0000 7f15bd62b640 1 Processor -- start 2024-01-25T15:04:51.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.381+0000 7f15bd62b640 1 -- start start 2024-01-25T15:04:51.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.381+0000 7f15bd62b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15a40047c0 0x7f15b81ea230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:51.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.381+0000 7f15bd62b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b80bdf60 0x7f15b8157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:51.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.381+0000 7f15bd62b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f15b80becd0 0x7f15b81584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:51.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.382+0000 7f15bd62b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b8157b70 con 0x7f15b80bdf60 2024-01-25T15:04:51.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.382+0000 7f15bd62b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b80c1f50 con 0x7f15a40047c0 2024-01-25T15:04:51.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.382+0000 7f15bd62b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b81e7c60 con 0x7f15b80becd0 2024-01-25T15:04:51.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.382+0000 7f15b67fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b80bdf60 0x7f15b8157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:51.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.382+0000 7f15b67fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b80bdf60 0x7f15b8157f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44932/0 (socket says 172.21.15.29:44932) 2024-01-25T15:04:51.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.382+0000 7f15b67fc640 1 -- 172.21.15.29:0/4830103 learned_addr learned my addr 172.21.15.29:0/4830103 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:51.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.382+0000 7f15b77fe640 1 --2- 172.21.15.29:0/4830103 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f15b80becd0 0x7f15b81584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:51.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.382+0000 7f15b6ffd640 1 --2- 172.21.15.29:0/4830103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15a40047c0 0x7f15b81ea230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:51.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.382+0000 7f15b67fc640 1 -- 172.21.15.29:0/4830103 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f15b80becd0 msgr2=0x7f15b81584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:51.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.382+0000 7f15b67fc640 1 --2- 172.21.15.29:0/4830103 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f15b80becd0 0x7f15b81584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.382+0000 7f15b67fc640 1 -- 172.21.15.29:0/4830103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15a40047c0 msgr2=0x7f15b81ea230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:51.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.382+0000 7f15b67fc640 1 --2- 172.21.15.29:0/4830103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15a40047c0 0x7f15b81ea230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.382+0000 7f15b67fc640 1 -- 172.21.15.29:0/4830103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b81eabb0 con 0x7f15b80bdf60 2024-01-25T15:04:51.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.382+0000 7f15b67fc640 1 --2- 172.21.15.29:0/4830103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b80bdf60 0x7f15b8157f90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f15a0007f70 tx=0x7f15b808c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:51.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.382+0000 7f15af7fe640 1 -- 172.21.15.29:0/4830103 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a0039070 con 0x7f15b80bdf60 2024-01-25T15:04:51.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.382+0000 7f15af7fe640 1 -- 172.21.15.29:0/4830103 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a0007480 con 0x7f15b80bdf60 2024-01-25T15:04:51.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.382+0000 7f15af7fe640 1 -- 172.21.15.29:0/4830103 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a002c740 con 0x7f15b80bdf60 2024-01-25T15:04:51.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.382+0000 7f15bd62b640 1 -- 172.21.15.29:0/4830103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b80be3e0 con 0x7f15b80bdf60 2024-01-25T15:04:51.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.382+0000 7f15bd62b640 1 -- 172.21.15.29:0/4830103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b80bdc20 con 0x7f15b80bdf60 2024-01-25T15:04:51.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.383+0000 7f15bd62b640 1 -- 172.21.15.29:0/4830103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b8068580 con 0x7f15b80bdf60 2024-01-25T15:04:51.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.384+0000 7f15af7fe640 1 -- 172.21.15.29:0/4830103 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f15a0032070 con 0x7f15b80bdf60 2024-01-25T15:04:51.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.384+0000 7f15af7fe640 1 --2- 172.21.15.29:0/4830103 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f159806aed0 0x7f159806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:51.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.384+0000 7f15af7fe640 1 -- 172.21.15.29:0/4830103 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f15a003c040 con 0x7f15b80bdf60 2024-01-25T15:04:51.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.385+0000 7f15b6ffd640 1 --2- 172.21.15.29:0/4830103 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f159806aed0 0x7f159806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:51.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.385+0000 7f15b6ffd640 1 --2- 172.21.15.29:0/4830103 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f159806aed0 0x7f159806d390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f15b0001790 tx=0x7f15b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:51.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.389+0000 7f15af7fe640 1 -- 172.21.15.29:0/4830103 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f15b8068580 con 0x7f15b80bdf60 2024-01-25T15:04:51.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.609+0000 7f15bd62b640 1 -- 172.21.15.29:0/4830103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15b8068580 con 0x7f15b80bdf60 2024-01-25T15:04:51.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.609+0000 7f15af7fe640 1 -- 172.21.15.29:0/4830103 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4931 (secure 0 0 0) 0x7f15b8068580 con 0x7f15b80bdf60 2024-01-25T15:04:51.610 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:51.610 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6836/2584242962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2584242962},{"type":"v1","addr":"172.21.15.52:6836","nonce":2584242962}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1800543981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1800543981},{"type":"v1","addr":"172.21.15.29:6834","nonce":1800543981}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3686497601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3686497601},{"type":"v1","addr":"172.21.15.29:6835","nonce":3686497601}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:04:26.896909+0000","modified":"2024-01-25T15:04:42.952775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6837/417879912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6835","nonce":417879912},{"type":"v1","addr":"172.21.15.52:6837","nonce":417879912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-25T15:04:51.610 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-01-25T15:04:51.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.611+0000 7f15bd62b640 1 -- 172.21.15.29:0/4830103 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f159806aed0 msgr2=0x7f159806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:51.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.611+0000 7f15bd62b640 1 --2- 172.21.15.29:0/4830103 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f159806aed0 0x7f159806d390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f15b0001790 tx=0x7f15b0009040 comp rx=0 tx=0).stop 2024-01-25T15:04:51.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.611+0000 7f15bd62b640 1 -- 172.21.15.29:0/4830103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b80bdf60 msgr2=0x7f15b8157f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:51.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.611+0000 7f15bd62b640 1 --2- 172.21.15.29:0/4830103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b80bdf60 0x7f15b8157f90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f15a0007f70 tx=0x7f15b808c140 comp rx=0 tx=0).stop 2024-01-25T15:04:51.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.611+0000 7f15bd62b640 1 -- 172.21.15.29:0/4830103 shutdown_connections 2024-01-25T15:04:51.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.611+0000 7f15bd62b640 1 --2- 172.21.15.29:0/4830103 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f15b80becd0 0x7f15b81584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.611+0000 7f15bd62b640 1 --2- 172.21.15.29:0/4830103 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f159806aed0 0x7f159806d390 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.611+0000 7f15bd62b640 1 --2- 172.21.15.29:0/4830103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b80bdf60 0x7f15b8157f90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.611+0000 7f15bd62b640 1 --2- 172.21.15.29:0/4830103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15a40047c0 0x7f15b81ea230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.611+0000 7f15bd62b640 1 -- 172.21.15.29:0/4830103 >> 172.21.15.29:0/4830103 conn(0x7f15b80ca1f0 msgr2=0x7f15b80c4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.611+0000 7f15bd62b640 1 -- 172.21.15.29:0/4830103 shutdown_connections 2024-01-25T15:04:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.611+0000 7f15bd62b640 1 -- 172.21.15.29:0/4830103 wait complete. 2024-01-25T15:04:51.623 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:04:51.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.724+0000 7fafb08ee640 1 Processor -- start 2024-01-25T15:04:51.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.724+0000 7fafb08ee640 1 -- start start 2024-01-25T15:04:51.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.725+0000 7fafb08ee640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fafac1520b0 0x7fafac155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:51.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.725+0000 7fafb08ee640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fafac0c55e0 0x7fafac0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:51.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.725+0000 7fafb08ee640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafac0c66c0 con 0x7fafac0c4f00 2024-01-25T15:04:51.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.725+0000 7fafb08ee640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafac06cfc0 con 0x7fafac1520b0 2024-01-25T15:04:51.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.725+0000 7fafb08ee640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafac152490 con 0x7fafac0c55e0 2024-01-25T15:04:51.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.725+0000 7fafaa59c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fafac1520b0 0x7fafac155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:51.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.725+0000 7fafaad9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fafac0c4f00 0x7fafac0c5b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59064/0 (socket says 172.21.15.29:59064) 2024-01-25T15:04:51.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.725+0000 7fafaad9d640 1 -- 172.21.15.29:0/3211535594 learned_addr learned my addr 172.21.15.29:0/3211535594 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:51.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.725+0000 7fafaa59c640 1 -- 172.21.15.29:0/3211535594 >> v2:172.21.15.52:3300/0 conn(0x7fafac0c55e0 msgr2=0x7fafac0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:51.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.725+0000 7fafaa59c640 1 --2- 172.21.15.29:0/3211535594 >> v2:172.21.15.52:3300/0 conn(0x7fafac0c55e0 0x7fafac0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.725+0000 7fafaa59c640 1 -- 172.21.15.29:0/3211535594 >> v1:172.21.15.29:6789/0 conn(0x7fafac0c4f00 legacy=0x7fafac0c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:51.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.725+0000 7fafaa59c640 1 -- 172.21.15.29:0/3211535594 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac0c6910 con 0x7fafac1520b0 2024-01-25T15:04:51.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.725+0000 7fafa959a640 1 -- 172.21.15.29:0/3211535594 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538029755 0 0) 0x7fafac0c66c0 con 0x7fafac0c4f00 2024-01-25T15:04:51.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.726+0000 7fafaa59c640 1 --2- 172.21.15.29:0/3211535594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafac1520b0 0x7fafac155570 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fafac08b9f0 tx=0x7fafa402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e50506b3c6ae2 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:51.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.726+0000 7fafa959a640 1 -- 172.21.15.29:0/3211535594 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa402e070 con 0x7fafac1520b0 2024-01-25T15:04:51.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.726+0000 7fafa959a640 1 -- 172.21.15.29:0/3211535594 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa40315a0 con 0x7fafac1520b0 2024-01-25T15:04:51.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.726+0000 7fafa959a640 1 -- 172.21.15.29:0/3211535594 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4031930 con 0x7fafac1520b0 2024-01-25T15:04:51.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.727+0000 7fafb08ee640 1 -- 172.21.15.29:0/3211535594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafac1520b0 msgr2=0x7fafac155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:51.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.727+0000 7fafb08ee640 1 --2- 172.21.15.29:0/3211535594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafac1520b0 0x7fafac155570 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fafac08b9f0 tx=0x7fafa402b840 comp rx=0 tx=0).stop 2024-01-25T15:04:51.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.727+0000 7fafb08ee640 1 -- 172.21.15.29:0/3211535594 shutdown_connections 2024-01-25T15:04:51.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.727+0000 7fafb08ee640 1 --2- 172.21.15.29:0/3211535594 >> v2:172.21.15.52:3300/0 conn(0x7fafac0c55e0 0x7fafac0c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.727+0000 7fafb08ee640 1 --2- 172.21.15.29:0/3211535594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafac1520b0 0x7fafac155570 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.727+0000 7fafb08ee640 1 -- 172.21.15.29:0/3211535594 >> 172.21.15.29:0/3211535594 conn(0x7fafac0ca220 msgr2=0x7fafac0ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:51.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.727+0000 7fafb08ee640 1 -- 172.21.15.29:0/3211535594 shutdown_connections 2024-01-25T15:04:51.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.727+0000 7fafb08ee640 1 -- 172.21.15.29:0/3211535594 wait complete. 2024-01-25T15:04:51.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.728+0000 7fafb08ee640 1 Processor -- start 2024-01-25T15:04:51.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.728+0000 7fafb08ee640 1 -- start start 2024-01-25T15:04:51.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.729+0000 7fafb08ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafac0c4f00 0x7fafac0c1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:51.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.729+0000 7fafb08ee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafac1520b0 0x7fafac1edfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:51.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.729+0000 7fafb08ee640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fafac14e900 0x7fafac1ea860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:51.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.729+0000 7fafb08ee640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac1ee4f0 con 0x7fafac1520b0 2024-01-25T15:04:51.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.729+0000 7fafb08ee640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac1574d0 con 0x7fafac0c4f00 2024-01-25T15:04:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.729+0000 7fafb08ee640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafac157720 con 0x7fafac14e900 2024-01-25T15:04:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.729+0000 7fafa9d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafac1520b0 0x7fafac1edfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.729+0000 7fafa9d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafac1520b0 0x7fafac1edfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44952/0 (socket says 172.21.15.29:44952) 2024-01-25T15:04:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.729+0000 7fafa9d9b640 1 -- 172.21.15.29:0/478386628 learned_addr learned my addr 172.21.15.29:0/478386628 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.729+0000 7fafaad9d640 1 --2- 172.21.15.29:0/478386628 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fafac14e900 0x7fafac1ea860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.729+0000 7fafaa59c640 1 --2- 172.21.15.29:0/478386628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafac0c4f00 0x7fafac0c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.729+0000 7fafa9d9b640 1 -- 172.21.15.29:0/478386628 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fafac14e900 msgr2=0x7fafac1ea860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.729+0000 7fafa9d9b640 1 --2- 172.21.15.29:0/478386628 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fafac14e900 0x7fafac1ea860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.729+0000 7fafa9d9b640 1 -- 172.21.15.29:0/478386628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafac0c4f00 msgr2=0x7fafac0c1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.729+0000 7fafa9d9b640 1 --2- 172.21.15.29:0/478386628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafac0c4f00 0x7fafac0c1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.730+0000 7fafa9d9b640 1 -- 172.21.15.29:0/478386628 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa4009400 con 0x7fafac1520b0 2024-01-25T15:04:51.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.730+0000 7fafa9d9b640 1 --2- 172.21.15.29:0/478386628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafac1520b0 0x7fafac1edfb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fafa000b4a0 tx=0x7fafa000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:51.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.730+0000 7faf9affd640 1 -- 172.21.15.29:0/478386628 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0010610 con 0x7fafac1520b0 2024-01-25T15:04:51.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.730+0000 7faf9affd640 1 -- 172.21.15.29:0/478386628 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa0010770 con 0x7fafac1520b0 2024-01-25T15:04:51.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.730+0000 7faf9affd640 1 -- 172.21.15.29:0/478386628 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0010b20 con 0x7fafac1520b0 2024-01-25T15:04:51.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.730+0000 7fafb08ee640 1 -- 172.21.15.29:0/478386628 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafac157a00 con 0x7fafac1520b0 2024-01-25T15:04:51.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.730+0000 7fafb08ee640 1 -- 172.21.15.29:0/478386628 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafac1ea340 con 0x7fafac1520b0 2024-01-25T15:04:51.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.731+0000 7fafb08ee640 1 -- 172.21.15.29:0/478386628 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafac06d280 con 0x7fafac1520b0 2024-01-25T15:04:51.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.731+0000 7faf9affd640 1 -- 172.21.15.29:0/478386628 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fafa0010c80 con 0x7fafac1520b0 2024-01-25T15:04:51.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.732+0000 7faf9affd640 1 --2- 172.21.15.29:0/478386628 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faf8c06aed0 0x7faf8c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:51.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.732+0000 7faf9affd640 1 -- 172.21.15.29:0/478386628 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fafa0089440 con 0x7fafac1520b0 2024-01-25T15:04:51.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.732+0000 7fafaa59c640 1 --2- 172.21.15.29:0/478386628 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faf8c06aed0 0x7faf8c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:51.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.733+0000 7fafaa59c640 1 --2- 172.21.15.29:0/478386628 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faf8c06aed0 0x7faf8c06d390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fafa4036000 tx=0x7fafa403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:51.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.736+0000 7faf9affd640 1 -- 172.21.15.29:0/478386628 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fafa0054160 con 0x7fafac1520b0 2024-01-25T15:04:51.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.915+0000 7fafb08ee640 1 -- 172.21.15.29:0/478386628 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafac1ea560 con 0x7fafac1520b0 2024-01-25T15:04:51.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.916+0000 7faf9affd640 1 -- 172.21.15.29:0/478386628 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18311 (secure 0 0 0) 0x7fafa0057780 con 0x7fafac1520b0 2024-01-25T15:04:51.917 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:51.917 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:31.978871+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:04:51.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.918+0000 7fafb08ee640 1 -- 172.21.15.29:0/478386628 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faf8c06aed0 msgr2=0x7faf8c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:51.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.918+0000 7fafb08ee640 1 --2- 172.21.15.29:0/478386628 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faf8c06aed0 0x7faf8c06d390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fafa4036000 tx=0x7fafa403d040 comp rx=0 tx=0).stop 2024-01-25T15:04:51.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.918+0000 7fafb08ee640 1 -- 172.21.15.29:0/478386628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafac1520b0 msgr2=0x7fafac1edfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:51.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.918+0000 7fafb08ee640 1 --2- 172.21.15.29:0/478386628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafac1520b0 0x7fafac1edfb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fafa000b4a0 tx=0x7fafa000b960 comp rx=0 tx=0).stop 2024-01-25T15:04:51.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.918+0000 7fafb08ee640 1 -- 172.21.15.29:0/478386628 shutdown_connections 2024-01-25T15:04:51.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.918+0000 7fafb08ee640 1 --2- 172.21.15.29:0/478386628 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fafac14e900 0x7fafac1ea860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.918+0000 7fafb08ee640 1 --2- 172.21.15.29:0/478386628 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faf8c06aed0 0x7faf8c06d390 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.918+0000 7fafb08ee640 1 --2- 172.21.15.29:0/478386628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafac1520b0 0x7fafac1edfb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.918+0000 7fafb08ee640 1 --2- 172.21.15.29:0/478386628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafac0c4f00 0x7fafac0c1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:51.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.918+0000 7fafb08ee640 1 -- 172.21.15.29:0/478386628 >> 172.21.15.29:0/478386628 conn(0x7fafac0ca220 msgr2=0x7fafac0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:51.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.918+0000 7fafb08ee640 1 -- 172.21.15.29:0/478386628 shutdown_connections 2024-01-25T15:04:51.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:51.918+0000 7fafb08ee640 1 -- 172.21.15.29:0/478386628 wait complete. 2024-01-25T15:04:51.930 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T15:04:14.955791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T15:04:24.986626+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T15:04:25.873673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-25T15:04:29.578261+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-25T15:04:51.930 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:04:52.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.034+0000 7f2df55ca640 1 Processor -- start 2024-01-25T15:04:52.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.034+0000 7f2df55ca640 1 -- start start 2024-01-25T15:04:52.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.034+0000 7f2df55ca640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2df00af6c0 0x7f2df00c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.034+0000 7f2df55ca640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2df006d560 0x7f2df006b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.034+0000 7f2df55ca640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2df00c5a70 0x7f2df006b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.034+0000 7f2df55ca640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df006c480 con 0x7f2df00af6c0 2024-01-25T15:04:52.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.034+0000 7f2df55ca640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df0155290 con 0x7f2df006d560 2024-01-25T15:04:52.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.034+0000 7f2df55ca640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df006bff0 con 0x7f2df00c5a70 2024-01-25T15:04:52.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.034+0000 7f2deeffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2df00af6c0 0x7f2df00c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.035+0000 7f2deeffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2df00af6c0 0x7f2df00c5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44960/0 (socket says 172.21.15.29:44960) 2024-01-25T15:04:52.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.035+0000 7f2deeffd640 1 -- 172.21.15.29:0/648321121 learned_addr learned my addr 172.21.15.29:0/648321121 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.035+0000 7f2de7fff640 1 --2- 172.21.15.29:0/648321121 >> v2:172.21.15.52:3300/0 conn(0x7f2df006d560 0x7f2df006b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.035+0000 7f2def7fe640 1 --2- 172.21.15.29:0/648321121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2df00c5a70 0x7f2df006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.035+0000 7f2deeffd640 1 -- 172.21.15.29:0/648321121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2df00c5a70 msgr2=0x7f2df006b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.035+0000 7f2deeffd640 1 --2- 172.21.15.29:0/648321121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2df00c5a70 0x7f2df006b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.035+0000 7f2deeffd640 1 -- 172.21.15.29:0/648321121 >> v2:172.21.15.52:3300/0 conn(0x7f2df006d560 msgr2=0x7f2df006b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.035+0000 7f2deeffd640 1 --2- 172.21.15.29:0/648321121 >> v2:172.21.15.52:3300/0 conn(0x7f2df006d560 0x7f2df006b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.035+0000 7f2deeffd640 1 -- 172.21.15.29:0/648321121 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df00afaa0 con 0x7f2df00af6c0 2024-01-25T15:04:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.036+0000 7f2deeffd640 1 --2- 172.21.15.29:0/648321121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2df00af6c0 0x7f2df00c5530 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2df0158e90 tx=0x7f2de002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a930bda4d924783 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.036+0000 7f2dee7fc640 1 -- 172.21.15.29:0/648321121 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de0031640 con 0x7f2df00af6c0 2024-01-25T15:04:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.036+0000 7f2dee7fc640 1 -- 172.21.15.29:0/648321121 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de00317a0 con 0x7f2df00af6c0 2024-01-25T15:04:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.036+0000 7f2dee7fc640 1 -- 172.21.15.29:0/648321121 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de0031b30 con 0x7f2df00af6c0 2024-01-25T15:04:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.036+0000 7f2df55ca640 1 -- 172.21.15.29:0/648321121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2df00af6c0 msgr2=0x7f2df00c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.036+0000 7f2df55ca640 1 --2- 172.21.15.29:0/648321121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2df00af6c0 0x7f2df00c5530 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2df0158e90 tx=0x7f2de002b8f0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.036+0000 7f2df55ca640 1 -- 172.21.15.29:0/648321121 shutdown_connections 2024-01-25T15:04:52.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.036+0000 7f2df55ca640 1 --2- 172.21.15.29:0/648321121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2df00c5a70 0x7f2df006b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.036+0000 7f2df55ca640 1 --2- 172.21.15.29:0/648321121 >> v2:172.21.15.52:3300/0 conn(0x7f2df006d560 0x7f2df006b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.036+0000 7f2df55ca640 1 --2- 172.21.15.29:0/648321121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2df00af6c0 0x7f2df00c5530 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.036+0000 7f2df55ca640 1 -- 172.21.15.29:0/648321121 >> 172.21.15.29:0/648321121 conn(0x7f2df00c6ca0 msgr2=0x7f2df00c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:52.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.036+0000 7f2df55ca640 1 -- 172.21.15.29:0/648321121 shutdown_connections 2024-01-25T15:04:52.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.036+0000 7f2df55ca640 1 -- 172.21.15.29:0/648321121 wait complete. 2024-01-25T15:04:52.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.037+0000 7f2df55ca640 1 Processor -- start 2024-01-25T15:04:52.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.038+0000 7f2df55ca640 1 -- start start 2024-01-25T15:04:52.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.038+0000 7f2df55ca640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df006d560 0x7f2df014ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.038+0000 7f2df55ca640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2df00af6c0 0x7f2df014e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.038+0000 7f2df55ca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2df00c5a70 0x7f2df01ea240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.038+0000 7f2df55ca640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df01eb1d0 con 0x7f2df00c5a70 2024-01-25T15:04:52.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.038+0000 7f2df55ca640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df0158930 con 0x7f2df006d560 2024-01-25T15:04:52.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.038+0000 7f2df55ca640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df01eaef0 con 0x7f2df00af6c0 2024-01-25T15:04:52.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.038+0000 7f2def7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2df00c5a70 0x7f2df01ea240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.038+0000 7f2def7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2df00c5a70 0x7f2df01ea240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44970/0 (socket says 172.21.15.29:44970) 2024-01-25T15:04:52.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.038+0000 7f2def7fe640 1 -- 172.21.15.29:0/1495037186 learned_addr learned my addr 172.21.15.29:0/1495037186 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:52.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.039+0000 7f2de7fff640 1 --2- 172.21.15.29:0/1495037186 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2df00af6c0 0x7f2df014e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.039+0000 7f2deeffd640 1 --2- 172.21.15.29:0/1495037186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df006d560 0x7f2df014ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.039+0000 7f2def7fe640 1 -- 172.21.15.29:0/1495037186 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2df00af6c0 msgr2=0x7f2df014e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:52.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.039+0000 7f2def7fe640 1 --2- 172.21.15.29:0/1495037186 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2df00af6c0 0x7f2df014e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.039+0000 7f2def7fe640 1 -- 172.21.15.29:0/1495037186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df006d560 msgr2=0x7f2df014ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:52.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.039+0000 7f2def7fe640 1 --2- 172.21.15.29:0/1495037186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df006d560 0x7f2df014ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.039+0000 7f2def7fe640 1 -- 172.21.15.29:0/1495037186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de00094d0 con 0x7f2df00c5a70 2024-01-25T15:04:52.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.039+0000 7f2de7fff640 1 --2- 172.21.15.29:0/1495037186 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2df00af6c0 0x7f2df014e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:52.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.039+0000 7f2deeffd640 1 --2- 172.21.15.29:0/1495037186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df006d560 0x7f2df014ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:52.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.039+0000 7f2def7fe640 1 --2- 172.21.15.29:0/1495037186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2df00c5a70 0x7f2df01ea240 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2de8007d80 tx=0x7f2de800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:52.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.039+0000 7f2de77fe640 1 -- 172.21.15.29:0/1495037186 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de8014420 con 0x7f2df00c5a70 2024-01-25T15:04:52.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.039+0000 7f2de77fe640 1 -- 172.21.15.29:0/1495037186 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de8014580 con 0x7f2df00c5a70 2024-01-25T15:04:52.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.039+0000 7f2df55ca640 1 -- 172.21.15.29:0/1495037186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df01585c0 con 0x7f2df00c5a70 2024-01-25T15:04:52.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.039+0000 7f2de77fe640 1 -- 172.21.15.29:0/1495037186 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de8014930 con 0x7f2df00c5a70 2024-01-25T15:04:52.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.039+0000 7f2df55ca640 1 -- 172.21.15.29:0/1495037186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df014e890 con 0x7f2df00c5a70 2024-01-25T15:04:52.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.040+0000 7f2df55ca640 1 -- 172.21.15.29:0/1495037186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df014eab0 con 0x7f2df00c5a70 2024-01-25T15:04:52.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.040+0000 7f2de77fe640 1 -- 172.21.15.29:0/1495037186 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2de8014a90 con 0x7f2df00c5a70 2024-01-25T15:04:52.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.041+0000 7f2de77fe640 1 --2- 172.21.15.29:0/1495037186 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2dd006aed0 0x7f2dd006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.041+0000 7f2de77fe640 1 -- 172.21.15.29:0/1495037186 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2de808a1f0 con 0x7f2df00c5a70 2024-01-25T15:04:52.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.041+0000 7f2deeffd640 1 --2- 172.21.15.29:0/1495037186 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2dd006aed0 0x7f2dd006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.041+0000 7f2deeffd640 1 --2- 172.21.15.29:0/1495037186 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2dd006aed0 0x7f2dd006d390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2de0036000 tx=0x7f2de003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:52.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.045+0000 7f2de77fe640 1 -- 172.21.15.29:0/1495037186 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2de8054dd0 con 0x7f2df00c5a70 2024-01-25T15:04:52.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.223+0000 7f2df55ca640 1 -- 172.21.15.29:0/1495037186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2df00676c0 con 0x7f2df00c5a70 2024-01-25T15:04:52.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.223+0000 7f2de77fe640 1 -- 172.21.15.29:0/1495037186 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2de80583f0 con 0x7f2df00c5a70 2024-01-25T15:04:52.224 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-25T15:04:52.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.225+0000 7f2df55ca640 1 -- 172.21.15.29:0/1495037186 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2dd006aed0 msgr2=0x7f2dd006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:52.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.225+0000 7f2df55ca640 1 --2- 172.21.15.29:0/1495037186 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2dd006aed0 0x7f2dd006d390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2de0036000 tx=0x7f2de003c040 comp rx=0 tx=0).stop 2024-01-25T15:04:52.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.225+0000 7f2df55ca640 1 -- 172.21.15.29:0/1495037186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2df00c5a70 msgr2=0x7f2df01ea240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:52.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.225+0000 7f2df55ca640 1 --2- 172.21.15.29:0/1495037186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2df00c5a70 0x7f2df01ea240 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2de8007d80 tx=0x7f2de800e4b0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.225+0000 7f2df55ca640 1 -- 172.21.15.29:0/1495037186 shutdown_connections 2024-01-25T15:04:52.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.225+0000 7f2df55ca640 1 --2- 172.21.15.29:0/1495037186 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2dd006aed0 0x7f2dd006d390 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.225+0000 7f2df55ca640 1 --2- 172.21.15.29:0/1495037186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2df00c5a70 0x7f2df01ea240 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.225+0000 7f2df55ca640 1 --2- 172.21.15.29:0/1495037186 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2df00af6c0 0x7f2df014e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.225+0000 7f2df55ca640 1 --2- 172.21.15.29:0/1495037186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df006d560 0x7f2df014ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.225+0000 7f2df55ca640 1 -- 172.21.15.29:0/1495037186 >> 172.21.15.29:0/1495037186 conn(0x7f2df00c6ca0 msgr2=0x7f2df00a9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:52.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.225+0000 7f2df55ca640 1 -- 172.21.15.29:0/1495037186 shutdown_connections 2024-01-25T15:04:52.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.225+0000 7f2df55ca640 1 -- 172.21.15.29:0/1495037186 wait complete. 2024-01-25T15:04:52.237 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:04:52.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.340+0000 7fbc2ca9b640 1 Processor -- start 2024-01-25T15:04:52.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.340+0000 7fbc2ca9b640 1 -- start start 2024-01-25T15:04:52.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.341+0000 7fbc2ca9b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbc280af6c0 0x7fbc280c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.341+0000 7fbc2ca9b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbc280c5a70 0x7fbc2806b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.341+0000 7fbc2ca9b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc280afaa0 con 0x7fbc2806d560 2024-01-25T15:04:52.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.341+0000 7fbc2ca9b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2806c480 con 0x7fbc280af6c0 2024-01-25T15:04:52.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.341+0000 7fbc2ca9b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc28155290 con 0x7fbc280c5a70 2024-01-25T15:04:52.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.341+0000 7fbc25d9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbc2806d560 0x7fbc2806b220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59080/0 (socket says 172.21.15.29:59080) 2024-01-25T15:04:52.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.341+0000 7fbc25d9b640 1 -- 172.21.15.29:0/3513278327 learned_addr learned my addr 172.21.15.29:0/3513278327 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:52.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.341+0000 7fbc2659c640 1 --2- 172.21.15.29:0/3513278327 >> v2:172.21.15.52:3300/0 conn(0x7fbc280af6c0 0x7fbc280c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.341+0000 7fbc26d9d640 1 --2- 172.21.15.29:0/3513278327 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbc280c5a70 0x7fbc2806b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.341+0000 7fbc2559a640 1 -- 172.21.15.29:0/3513278327 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473180211 0 0) 0x7fbc280afaa0 con 0x7fbc2806d560 2024-01-25T15:04:52.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.341+0000 7fbc2559a640 1 -- 172.21.15.29:0/3513278327 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc14003520 con 0x7fbc2806d560 2024-01-25T15:04:52.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.342+0000 7fbc2659c640 1 -- 172.21.15.29:0/3513278327 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbc280c5a70 msgr2=0x7fbc2806b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:52.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.342+0000 7fbc2659c640 1 --2- 172.21.15.29:0/3513278327 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbc280c5a70 0x7fbc2806b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.342+0000 7fbc2659c640 1 -- 172.21.15.29:0/3513278327 >> v1:172.21.15.29:6789/0 conn(0x7fbc2806d560 legacy=0x7fbc2806b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:52.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.342+0000 7fbc2659c640 1 -- 172.21.15.29:0/3513278327 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc280c6060 con 0x7fbc280af6c0 2024-01-25T15:04:52.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.342+0000 7fbc2659c640 1 --2- 172.21.15.29:0/3513278327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc280af6c0 0x7fbc280c5530 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbc200097a0 tx=0x7fbc2002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94a1c3e33e026e44 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:52.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.343+0000 7fbc2559a640 1 -- 172.21.15.29:0/3513278327 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc20031830 con 0x7fbc280af6c0 2024-01-25T15:04:52.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.343+0000 7fbc2559a640 1 -- 172.21.15.29:0/3513278327 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc20031990 con 0x7fbc280af6c0 2024-01-25T15:04:52.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.343+0000 7fbc2559a640 1 -- 172.21.15.29:0/3513278327 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc20031d20 con 0x7fbc280af6c0 2024-01-25T15:04:52.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.343+0000 7fbc2ca9b640 1 -- 172.21.15.29:0/3513278327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc280af6c0 msgr2=0x7fbc280c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:52.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.343+0000 7fbc2ca9b640 1 --2- 172.21.15.29:0/3513278327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc280af6c0 0x7fbc280c5530 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbc200097a0 tx=0x7fbc2002b8d0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.343+0000 7fbc2ca9b640 1 -- 172.21.15.29:0/3513278327 shutdown_connections 2024-01-25T15:04:52.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.343+0000 7fbc2ca9b640 1 --2- 172.21.15.29:0/3513278327 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbc280c5a70 0x7fbc2806b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.343+0000 7fbc2ca9b640 1 --2- 172.21.15.29:0/3513278327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc280af6c0 0x7fbc280c5530 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.343+0000 7fbc2ca9b640 1 -- 172.21.15.29:0/3513278327 >> 172.21.15.29:0/3513278327 conn(0x7fbc280c6ca0 msgr2=0x7fbc280c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:52.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.343+0000 7fbc2ca9b640 1 -- 172.21.15.29:0/3513278327 shutdown_connections 2024-01-25T15:04:52.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.343+0000 7fbc2ca9b640 1 -- 172.21.15.29:0/3513278327 wait complete. 2024-01-25T15:04:52.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.344+0000 7fbc2ca9b640 1 Processor -- start 2024-01-25T15:04:52.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.344+0000 7fbc2ca9b640 1 -- start start 2024-01-25T15:04:52.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.345+0000 7fbc2ca9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc2806d560 0x7fbc280c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.345+0000 7fbc2ca9b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbc280af6c0 0x7fbc281ea190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.345+0000 7fbc2ca9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc280c5a70 0x7fbc281ea6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.345+0000 7fbc2ca9b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc281ee380 con 0x7fbc2806d560 2024-01-25T15:04:52.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.345+0000 7fbc2ca9b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc281ed700 con 0x7fbc280c5a70 2024-01-25T15:04:52.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.345+0000 7fbc2ca9b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc281ed9e0 con 0x7fbc280af6c0 2024-01-25T15:04:52.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.345+0000 7fbc2659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc2806d560 0x7fbc280c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.345+0000 7fbc2659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc2806d560 0x7fbc280c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44976/0 (socket says 172.21.15.29:44976) 2024-01-25T15:04:52.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.345+0000 7fbc2659c640 1 -- 172.21.15.29:0/1009968475 learned_addr learned my addr 172.21.15.29:0/1009968475 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:52.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.345+0000 7fbc26d9d640 1 --2- 172.21.15.29:0/1009968475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc280c5a70 0x7fbc281ea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.345+0000 7fbc25d9b640 1 --2- 172.21.15.29:0/1009968475 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbc280af6c0 0x7fbc281ea190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.346+0000 7fbc2659c640 1 -- 172.21.15.29:0/1009968475 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbc280af6c0 msgr2=0x7fbc281ea190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:52.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.346+0000 7fbc2659c640 1 --2- 172.21.15.29:0/1009968475 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbc280af6c0 0x7fbc281ea190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.346+0000 7fbc2659c640 1 -- 172.21.15.29:0/1009968475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc280c5a70 msgr2=0x7fbc281ea6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:52.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.346+0000 7fbc2659c640 1 --2- 172.21.15.29:0/1009968475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc280c5a70 0x7fbc281ea6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.346+0000 7fbc2659c640 1 -- 172.21.15.29:0/1009968475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc20009400 con 0x7fbc2806d560 2024-01-25T15:04:52.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.346+0000 7fbc2659c640 1 --2- 172.21.15.29:0/1009968475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc2806d560 0x7fbc280c8b50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbc2002bee0 tx=0x7fbc200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:52.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.346+0000 7fbc1effd640 1 -- 172.21.15.29:0/1009968475 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2003a630 con 0x7fbc2806d560 2024-01-25T15:04:52.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.346+0000 7fbc1effd640 1 -- 172.21.15.29:0/1009968475 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2003a7b0 con 0x7fbc2806d560 2024-01-25T15:04:52.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.346+0000 7fbc1effd640 1 -- 172.21.15.29:0/1009968475 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2003ab60 con 0x7fbc2806d560 2024-01-25T15:04:52.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.346+0000 7fbc2ca9b640 1 -- 172.21.15.29:0/1009968475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc281edcc0 con 0x7fbc2806d560 2024-01-25T15:04:52.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.346+0000 7fbc2ca9b640 1 -- 172.21.15.29:0/1009968475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc280c9090 con 0x7fbc2806d560 2024-01-25T15:04:52.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.347+0000 7fbc2ca9b640 1 -- 172.21.15.29:0/1009968475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc28074010 con 0x7fbc2806d560 2024-01-25T15:04:52.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.347+0000 7fbc1effd640 1 -- 172.21.15.29:0/1009968475 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fbc2003acc0 con 0x7fbc2806d560 2024-01-25T15:04:52.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.348+0000 7fbc1effd640 1 --2- 172.21.15.29:0/1009968475 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbc0806aed0 0x7fbc0806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.348+0000 7fbc1effd640 1 -- 172.21.15.29:0/1009968475 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbc200ab1e0 con 0x7fbc2806d560 2024-01-25T15:04:52.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.348+0000 7fbc25d9b640 1 --2- 172.21.15.29:0/1009968475 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbc0806aed0 0x7fbc0806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.348+0000 7fbc25d9b640 1 --2- 172.21.15.29:0/1009968475 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbc0806aed0 0x7fbc0806d390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbc10005880 tx=0x7fbc10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:52.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.352+0000 7fbc1effd640 1 -- 172.21.15.29:0/1009968475 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fbc20075e50 con 0x7fbc2806d560 2024-01-25T15:04:52.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.531+0000 7fbc2ca9b640 1 -- 172.21.15.29:0/1009968475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc281ee5f0 con 0x7fbc2806d560 2024-01-25T15:04:52.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.532+0000 7fbc1effd640 1 -- 172.21.15.29:0/1009968475 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbc20079470 con 0x7fbc2806d560 2024-01-25T15:04:52.533 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:04:52.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.533+0000 7fbc2ca9b640 1 -- 172.21.15.29:0/1009968475 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbc0806aed0 msgr2=0x7fbc0806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:52.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.533+0000 7fbc2ca9b640 1 --2- 172.21.15.29:0/1009968475 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbc0806aed0 0x7fbc0806d390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbc10005880 tx=0x7fbc10009040 comp rx=0 tx=0).stop 2024-01-25T15:04:52.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.533+0000 7fbc2ca9b640 1 -- 172.21.15.29:0/1009968475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc2806d560 msgr2=0x7fbc280c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:52.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.533+0000 7fbc2ca9b640 1 --2- 172.21.15.29:0/1009968475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc2806d560 0x7fbc280c8b50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbc2002bee0 tx=0x7fbc200046c0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.534+0000 7fbc2ca9b640 1 -- 172.21.15.29:0/1009968475 shutdown_connections 2024-01-25T15:04:52.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.534+0000 7fbc2ca9b640 1 --2- 172.21.15.29:0/1009968475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc280c5a70 0x7fbc281ea6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.534+0000 7fbc2ca9b640 1 --2- 172.21.15.29:0/1009968475 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbc280af6c0 0x7fbc281ea190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.534+0000 7fbc2ca9b640 1 --2- 172.21.15.29:0/1009968475 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbc0806aed0 0x7fbc0806d390 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.534+0000 7fbc2ca9b640 1 --2- 172.21.15.29:0/1009968475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc2806d560 0x7fbc280c8b50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.534+0000 7fbc2ca9b640 1 -- 172.21.15.29:0/1009968475 >> 172.21.15.29:0/1009968475 conn(0x7fbc280c6ca0 msgr2=0x7fbc280abcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:52.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.534+0000 7fbc2ca9b640 1 -- 172.21.15.29:0/1009968475 shutdown_connections 2024-01-25T15:04:52.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.534+0000 7fbc2ca9b640 1 -- 172.21.15.29:0/1009968475 wait complete. 2024-01-25T15:04:52.545 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:04:52.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.649+0000 7f0ebd9dc640 1 Processor -- start 2024-01-25T15:04:52.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.649+0000 7f0ebd9dc640 1 -- start start 2024-01-25T15:04:52.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.649+0000 7f0ebd9dc640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0eb806d560 0x7f0eb806b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.649+0000 7f0ebd9dc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0eb80c4fe0 0x7f0eb806b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.649+0000 7f0ebd9dc640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb80afaa0 con 0x7f0eb80af6c0 2024-01-25T15:04:52.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.649+0000 7f0ebd9dc640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb806c480 con 0x7f0eb80c4fe0 2024-01-25T15:04:52.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.649+0000 7f0ebd9dc640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb8155290 con 0x7f0eb806d560 2024-01-25T15:04:52.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.650+0000 7f0eb6ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0eb80af6c0 0x7f0eb80c5530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59094/0 (socket says 172.21.15.29:59094) 2024-01-25T15:04:52.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.650+0000 7f0eb6ffd640 1 -- 172.21.15.29:0/1159106875 learned_addr learned my addr 172.21.15.29:0/1159106875 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:52.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.650+0000 7f0eb77fe640 1 --2- 172.21.15.29:0/1159106875 >> v2:172.21.15.52:3300/0 conn(0x7f0eb80c4fe0 0x7f0eb806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.650+0000 7f0eb67fc640 1 --2- 172.21.15.29:0/1159106875 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0eb806d560 0x7f0eb806b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.650+0000 7f0eb5ffb640 1 -- 172.21.15.29:0/1159106875 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021237074 0 0) 0x7f0eb80afaa0 con 0x7f0eb80af6c0 2024-01-25T15:04:52.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.650+0000 7f0eb5ffb640 1 -- 172.21.15.29:0/1159106875 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ea0003520 con 0x7f0eb80af6c0 2024-01-25T15:04:52.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.650+0000 7f0eb5ffb640 1 -- 172.21.15.29:0/1159106875 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1617497538 0 0) 0x7f0ea0003520 con 0x7f0eb80af6c0 2024-01-25T15:04:52.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.650+0000 7f0eb77fe640 1 -- 172.21.15.29:0/1159106875 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0eb806d560 msgr2=0x7f0eb806b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:52.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.650+0000 7f0eb77fe640 1 --2- 172.21.15.29:0/1159106875 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0eb806d560 0x7f0eb806b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.650+0000 7f0eb77fe640 1 -- 172.21.15.29:0/1159106875 >> v1:172.21.15.29:6789/0 conn(0x7f0eb80af6c0 legacy=0x7f0eb80c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:52.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.650+0000 7f0eb77fe640 1 -- 172.21.15.29:0/1159106875 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb80c6060 con 0x7f0eb80c4fe0 2024-01-25T15:04:52.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.651+0000 7f0eb77fe640 1 --2- 172.21.15.29:0/1159106875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb80c4fe0 0x7f0eb806b760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0009d90 tx=0x7f0eb002bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2913bec4fa54a161 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:52.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.651+0000 7f0eb5ffb640 1 -- 172.21.15.29:0/1159106875 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8001670 con 0x7f0eb80c4fe0 2024-01-25T15:04:52.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.651+0000 7f0eb5ffb640 1 -- 172.21.15.29:0/1159106875 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb002c8a0 con 0x7f0eb80c4fe0 2024-01-25T15:04:52.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.651+0000 7f0eb5ffb640 1 -- 172.21.15.29:0/1159106875 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb002cc30 con 0x7f0eb80c4fe0 2024-01-25T15:04:52.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.651+0000 7f0ebd9dc640 1 -- 172.21.15.29:0/1159106875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb80c4fe0 msgr2=0x7f0eb806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:52.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.651+0000 7f0ebd9dc640 1 --2- 172.21.15.29:0/1159106875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb80c4fe0 0x7f0eb806b760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0009d90 tx=0x7f0eb002bd70 comp rx=0 tx=0).stop 2024-01-25T15:04:52.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.652+0000 7f0ebd9dc640 1 -- 172.21.15.29:0/1159106875 shutdown_connections 2024-01-25T15:04:52.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.652+0000 7f0ebd9dc640 1 --2- 172.21.15.29:0/1159106875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb80c4fe0 0x7f0eb806b760 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.652+0000 7f0ebd9dc640 1 --2- 172.21.15.29:0/1159106875 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0eb806d560 0x7f0eb806b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.652+0000 7f0ebd9dc640 1 -- 172.21.15.29:0/1159106875 >> 172.21.15.29:0/1159106875 conn(0x7f0eb80c6ca0 msgr2=0x7f0eb80c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:52.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.652+0000 7f0ebd9dc640 1 -- 172.21.15.29:0/1159106875 shutdown_connections 2024-01-25T15:04:52.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.652+0000 7f0ebd9dc640 1 -- 172.21.15.29:0/1159106875 wait complete. 2024-01-25T15:04:52.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.653+0000 7f0ebd9dc640 1 Processor -- start 2024-01-25T15:04:52.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.653+0000 7f0ebd9dc640 1 -- start start 2024-01-25T15:04:52.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.653+0000 7f0ebd9dc640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0eb806d560 0x7f0eb80bdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.653+0000 7f0ebd9dc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb80af6c0 0x7f0eb80c2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.653+0000 7f0ebd9dc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eb80c4fe0 0x7f0eb81ed890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.654+0000 7f0ebd9dc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80bfd60 con 0x7f0eb80c4fe0 2024-01-25T15:04:52.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.654+0000 7f0ebd9dc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80c0d30 con 0x7f0eb80af6c0 2024-01-25T15:04:52.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.654+0000 7f0ebd9dc640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80c3860 con 0x7f0eb806d560 2024-01-25T15:04:52.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.654+0000 7f0eb77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eb80c4fe0 0x7f0eb81ed890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.654+0000 7f0eb77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eb80c4fe0 0x7f0eb81ed890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44988/0 (socket says 172.21.15.29:44988) 2024-01-25T15:04:52.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.654+0000 7f0eb77fe640 1 -- 172.21.15.29:0/497448409 learned_addr learned my addr 172.21.15.29:0/497448409 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:52.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.654+0000 7f0eb67fc640 1 --2- 172.21.15.29:0/497448409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb80af6c0 0x7f0eb80c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.654+0000 7f0eb6ffd640 1 --2- 172.21.15.29:0/497448409 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0eb806d560 0x7f0eb80bdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.654+0000 7f0eb77fe640 1 -- 172.21.15.29:0/497448409 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0eb806d560 msgr2=0x7f0eb80bdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:52.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.654+0000 7f0eb77fe640 1 --2- 172.21.15.29:0/497448409 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0eb806d560 0x7f0eb80bdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.654+0000 7f0eb77fe640 1 -- 172.21.15.29:0/497448409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb80af6c0 msgr2=0x7f0eb80c2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:52.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.654+0000 7f0eb77fe640 1 --2- 172.21.15.29:0/497448409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb80af6c0 0x7f0eb80c2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.654+0000 7f0eb77fe640 1 -- 172.21.15.29:0/497448409 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb0009a70 con 0x7f0eb80c4fe0 2024-01-25T15:04:52.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.654+0000 7f0eb77fe640 1 --2- 172.21.15.29:0/497448409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eb80c4fe0 0x7f0eb81ed890 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0037040 tx=0x7f0eb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:52.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.654+0000 7f0e9ffff640 1 -- 172.21.15.29:0/497448409 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0034e50 con 0x7f0eb80c4fe0 2024-01-25T15:04:52.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.654+0000 7f0e9ffff640 1 -- 172.21.15.29:0/497448409 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb002ce90 con 0x7f0eb80c4fe0 2024-01-25T15:04:52.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.654+0000 7f0e9ffff640 1 -- 172.21.15.29:0/497448409 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb003e650 con 0x7f0eb80c4fe0 2024-01-25T15:04:52.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.654+0000 7f0ebd9dc640 1 -- 172.21.15.29:0/497448409 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb80c3b40 con 0x7f0eb80c4fe0 2024-01-25T15:04:52.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.654+0000 7f0ebd9dc640 1 -- 172.21.15.29:0/497448409 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb80c1d10 con 0x7f0eb80c4fe0 2024-01-25T15:04:52.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.655+0000 7f0ebd9dc640 1 -- 172.21.15.29:0/497448409 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb80c2230 con 0x7f0eb80c4fe0 2024-01-25T15:04:52.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.656+0000 7f0e9ffff640 1 -- 172.21.15.29:0/497448409 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0eb003b050 con 0x7f0eb80c4fe0 2024-01-25T15:04:52.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.656+0000 7f0e9ffff640 1 --2- 172.21.15.29:0/497448409 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0ea406aed0 0x7f0ea406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.656+0000 7f0e9ffff640 1 -- 172.21.15.29:0/497448409 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0eb00abdd0 con 0x7f0eb80c4fe0 2024-01-25T15:04:52.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.656+0000 7f0eb6ffd640 1 --2- 172.21.15.29:0/497448409 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0ea406aed0 0x7f0ea406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.657+0000 7f0eb6ffd640 1 --2- 172.21.15.29:0/497448409 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0ea406aed0 0x7f0ea406d390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8006b50 tx=0x7f0ea8001dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:52.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.661+0000 7f0e9ffff640 1 -- 172.21.15.29:0/497448409 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f0eb80c2230 con 0x7f0eb80c4fe0 2024-01-25T15:04:52.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.839+0000 7f0ebd9dc640 1 -- 172.21.15.29:0/497448409 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0eb80c2230 con 0x7f0eb80c4fe0 2024-01-25T15:04:52.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.839+0000 7f0e9ffff640 1 -- 172.21.15.29:0/497448409 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0eb00ad020 con 0x7f0eb80c4fe0 2024-01-25T15:04:52.840 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-25T15:04:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.841+0000 7f0ebd9dc640 1 -- 172.21.15.29:0/497448409 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0ea406aed0 msgr2=0x7f0ea406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.841+0000 7f0ebd9dc640 1 --2- 172.21.15.29:0/497448409 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0ea406aed0 0x7f0ea406d390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8006b50 tx=0x7f0ea8001dc0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.841+0000 7f0ebd9dc640 1 -- 172.21.15.29:0/497448409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eb80c4fe0 msgr2=0x7f0eb81ed890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.841+0000 7f0ebd9dc640 1 --2- 172.21.15.29:0/497448409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eb80c4fe0 0x7f0eb81ed890 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0037040 tx=0x7f0eb0004a40 comp rx=0 tx=0).stop 2024-01-25T15:04:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.841+0000 7f0ebd9dc640 1 -- 172.21.15.29:0/497448409 shutdown_connections 2024-01-25T15:04:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.841+0000 7f0ebd9dc640 1 --2- 172.21.15.29:0/497448409 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0ea406aed0 0x7f0ea406d390 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.841+0000 7f0ebd9dc640 1 --2- 172.21.15.29:0/497448409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eb80c4fe0 0x7f0eb81ed890 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.841+0000 7f0ebd9dc640 1 --2- 172.21.15.29:0/497448409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eb80af6c0 0x7f0eb80c2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.841+0000 7f0ebd9dc640 1 --2- 172.21.15.29:0/497448409 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0eb806d560 0x7f0eb80bdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.841+0000 7f0ebd9dc640 1 -- 172.21.15.29:0/497448409 >> 172.21.15.29:0/497448409 conn(0x7f0eb80c6ca0 msgr2=0x7f0eb80c7080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:52.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.841+0000 7f0ebd9dc640 1 -- 172.21.15.29:0/497448409 shutdown_connections 2024-01-25T15:04:52.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.841+0000 7f0ebd9dc640 1 -- 172.21.15.29:0/497448409 wait complete. 2024-01-25T15:04:52.852 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-25T15:04:52.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.956+0000 7f24ee383640 1 Processor -- start 2024-01-25T15:04:52.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.956+0000 7f24ee383640 1 -- start start 2024-01-25T15:04:52.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.957+0000 7f24ee383640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f24e814eb20 0x7f24e806bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.957+0000 7f24ee383640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f24e80c1920 0x7f24e80c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.957+0000 7f24ee383640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e81557e0 con 0x7f24e81519c0 2024-01-25T15:04:52.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.957+0000 7f24ee383640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e80a92d0 con 0x7f24e80c1920 2024-01-25T15:04:52.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.957+0000 7f24ee383640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e806e1a0 con 0x7f24e814eb20 2024-01-25T15:04:52.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.957+0000 7f24e77fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f24e80c1920 0x7f24e80c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.957+0000 7f24e77fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f24e80c1920 0x7f24e80c1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44992/0 (socket says 172.21.15.29:44992) 2024-01-25T15:04:52.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.957+0000 7f24e77fe640 1 -- 172.21.15.29:0/4276623303 learned_addr learned my addr 172.21.15.29:0/4276623303 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:52.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.957+0000 7f24e7fff640 1 --2- 172.21.15.29:0/4276623303 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f24e814eb20 0x7f24e806bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.957+0000 7f24e77fe640 1 -- 172.21.15.29:0/4276623303 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f24e814eb20 msgr2=0x7f24e806bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:52.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.957+0000 7f24e77fe640 1 --2- 172.21.15.29:0/4276623303 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f24e814eb20 0x7f24e806bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.957+0000 7f24e77fe640 1 -- 172.21.15.29:0/4276623303 >> v1:172.21.15.52:6789/0 conn(0x7f24e81519c0 legacy=0x7f24e8071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:52.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.957+0000 7f24e77fe640 1 -- 172.21.15.29:0/4276623303 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e806e480 con 0x7f24e80c1920 2024-01-25T15:04:52.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.958+0000 7f24e77fe640 1 --2- 172.21.15.29:0/4276623303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e80c1920 0x7f24e80c1d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f24d000bb10 tx=0x7f24d002e030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d99e1234cb09ec7 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:52.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.958+0000 7f24e6ffd640 1 -- 172.21.15.29:0/4276623303 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d002ede0 con 0x7f24e80c1920 2024-01-25T15:04:52.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.958+0000 7f24e6ffd640 1 -- 172.21.15.29:0/4276623303 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d0036440 con 0x7f24e80c1920 2024-01-25T15:04:52.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.958+0000 7f24e6ffd640 1 -- 172.21.15.29:0/4276623303 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d00367d0 con 0x7f24e80c1920 2024-01-25T15:04:52.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.959+0000 7f24ee383640 1 -- 172.21.15.29:0/4276623303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e80c1920 msgr2=0x7f24e80c1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:52.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.959+0000 7f24ee383640 1 --2- 172.21.15.29:0/4276623303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e80c1920 0x7f24e80c1d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f24d000bb10 tx=0x7f24d002e030 comp rx=0 tx=0).stop 2024-01-25T15:04:52.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.959+0000 7f24ee383640 1 -- 172.21.15.29:0/4276623303 shutdown_connections 2024-01-25T15:04:52.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.959+0000 7f24ee383640 1 --2- 172.21.15.29:0/4276623303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e80c1920 0x7f24e80c1d80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.959+0000 7f24ee383640 1 --2- 172.21.15.29:0/4276623303 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f24e814eb20 0x7f24e806bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.959+0000 7f24ee383640 1 -- 172.21.15.29:0/4276623303 >> 172.21.15.29:0/4276623303 conn(0x7f24e80c2a10 msgr2=0x7f24e80c2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:52.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.959+0000 7f24ee383640 1 -- 172.21.15.29:0/4276623303 shutdown_connections 2024-01-25T15:04:52.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.959+0000 7f24ee383640 1 -- 172.21.15.29:0/4276623303 wait complete. 2024-01-25T15:04:52.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.960+0000 7f24ee383640 1 Processor -- start 2024-01-25T15:04:52.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.960+0000 7f24ee383640 1 -- start start 2024-01-25T15:04:52.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.961+0000 7f24ee383640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e80c1920 0x7f24e814b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.961+0000 7f24ee383640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24e814eb20 0x7f24e8149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.961+0000 7f24ee383640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f24e81519c0 0x7f24e80c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.961+0000 7f24ee383640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e814bc70 con 0x7f24e80c1920 2024-01-25T15:04:52.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.961+0000 7f24ee383640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e80c42b0 con 0x7f24e814eb20 2024-01-25T15:04:52.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.961+0000 7f24ee383640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e8147610 con 0x7f24e81519c0 2024-01-25T15:04:52.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.961+0000 7f24e7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e80c1920 0x7f24e814b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.961+0000 7f24e7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e80c1920 0x7f24e814b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44998/0 (socket says 172.21.15.29:44998) 2024-01-25T15:04:52.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.961+0000 7f24e7fff640 1 -- 172.21.15.29:0/3131983934 learned_addr learned my addr 172.21.15.29:0/3131983934 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:52.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.961+0000 7f24e77fe640 1 --2- 172.21.15.29:0/3131983934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24e814eb20 0x7f24e8149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.961+0000 7f24e7fff640 1 -- 172.21.15.29:0/3131983934 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f24e81519c0 msgr2=0x7f24e80c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:52.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.961+0000 7f24ec920640 1 --2- 172.21.15.29:0/3131983934 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f24e81519c0 0x7f24e80c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.961+0000 7f24e7fff640 1 --2- 172.21.15.29:0/3131983934 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f24e81519c0 0x7f24e80c4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.961+0000 7f24e7fff640 1 -- 172.21.15.29:0/3131983934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24e814eb20 msgr2=0x7f24e8149030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:52.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.961+0000 7f24e7fff640 1 --2- 172.21.15.29:0/3131983934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24e814eb20 0x7f24e8149030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:52.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.961+0000 7f24e7fff640 1 -- 172.21.15.29:0/3131983934 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d000b770 con 0x7f24e80c1920 2024-01-25T15:04:52.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.961+0000 7f24e77fe640 1 --2- 172.21.15.29:0/3131983934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24e814eb20 0x7f24e8149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:52.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.961+0000 7f24ec920640 1 --2- 172.21.15.29:0/3131983934 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f24e81519c0 0x7f24e80c4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:52.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.961+0000 7f24e7fff640 1 --2- 172.21.15.29:0/3131983934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e80c1920 0x7f24e814b080 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f24d800d800 tx=0x7f24d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:52.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.962+0000 7f24e4ff9640 1 -- 172.21.15.29:0/3131983934 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d800b6c0 con 0x7f24e80c1920 2024-01-25T15:04:52.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.962+0000 7f24e4ff9640 1 -- 172.21.15.29:0/3131983934 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d800b820 con 0x7f24e80c1920 2024-01-25T15:04:52.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.962+0000 7f24ee383640 1 -- 172.21.15.29:0/3131983934 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e8147870 con 0x7f24e80c1920 2024-01-25T15:04:52.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.962+0000 7f24e4ff9640 1 -- 172.21.15.29:0/3131983934 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d800bbb0 con 0x7f24e80c1920 2024-01-25T15:04:52.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.962+0000 7f24ee383640 1 -- 172.21.15.29:0/3131983934 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e80c47e0 con 0x7f24e80c1920 2024-01-25T15:04:52.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.963+0000 7f24ee383640 1 -- 172.21.15.29:0/3131983934 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e80c4970 con 0x7f24e80c1920 2024-01-25T15:04:52.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.963+0000 7f24e4ff9640 1 -- 172.21.15.29:0/3131983934 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f24d800bd10 con 0x7f24e80c1920 2024-01-25T15:04:52.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.963+0000 7f24e4ff9640 1 --2- 172.21.15.29:0/3131983934 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f24c806aed0 0x7f24c806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:52.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.963+0000 7f24e4ff9640 1 -- 172.21.15.29:0/3131983934 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f24d8089e50 con 0x7f24e80c1920 2024-01-25T15:04:52.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.963+0000 7f24e77fe640 1 --2- 172.21.15.29:0/3131983934 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f24c806aed0 0x7f24c806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:52.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.964+0000 7f24e77fe640 1 --2- 172.21.15.29:0/3131983934 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f24c806aed0 0x7f24c806d390 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f24d0038000 tx=0x7f24d0032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:52.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:52.967+0000 7f24e4ff9640 1 -- 172.21.15.29:0/3131983934 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f24d8054ac0 con 0x7f24e80c1920 2024-01-25T15:04:53.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.145+0000 7f24ee383640 1 -- 172.21.15.29:0/3131983934 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f24e8074010 con 0x7f24e80c1920 2024-01-25T15:04:53.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.145+0000 7f24e4ff9640 1 -- 172.21.15.29:0/3131983934 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f24d80580e0 con 0x7f24e80c1920 2024-01-25T15:04:53.146 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:04:53.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.147+0000 7f24ee383640 1 -- 172.21.15.29:0/3131983934 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f24c806aed0 msgr2=0x7f24c806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:53.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.147+0000 7f24ee383640 1 --2- 172.21.15.29:0/3131983934 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f24c806aed0 0x7f24c806d390 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f24d0038000 tx=0x7f24d0032000 comp rx=0 tx=0).stop 2024-01-25T15:04:53.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.147+0000 7f24ee383640 1 -- 172.21.15.29:0/3131983934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e80c1920 msgr2=0x7f24e814b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:53.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.147+0000 7f24ee383640 1 --2- 172.21.15.29:0/3131983934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e80c1920 0x7f24e814b080 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f24d800d800 tx=0x7f24d800dcc0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.147+0000 7f24ee383640 1 -- 172.21.15.29:0/3131983934 shutdown_connections 2024-01-25T15:04:53.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.147+0000 7f24ee383640 1 --2- 172.21.15.29:0/3131983934 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f24e81519c0 0x7f24e80c4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.147+0000 7f24ee383640 1 --2- 172.21.15.29:0/3131983934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24e814eb20 0x7f24e8149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.147+0000 7f24ee383640 1 --2- 172.21.15.29:0/3131983934 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f24c806aed0 0x7f24c806d390 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.147+0000 7f24ee383640 1 --2- 172.21.15.29:0/3131983934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e80c1920 0x7f24e814b080 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.147+0000 7f24ee383640 1 -- 172.21.15.29:0/3131983934 >> 172.21.15.29:0/3131983934 conn(0x7f24e80c2a10 msgr2=0x7f24e806d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:53.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.147+0000 7f24ee383640 1 -- 172.21.15.29:0/3131983934 shutdown_connections 2024-01-25T15:04:53.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.147+0000 7f24ee383640 1 -- 172.21.15.29:0/3131983934 wait complete. 2024-01-25T15:04:53.159 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:04:53.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.259+0000 7febf6ab4640 1 Processor -- start 2024-01-25T15:04:53.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.259+0000 7febf6ab4640 1 -- start start 2024-01-25T15:04:53.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.260+0000 7febf6ab4640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf014c6f0 0x7febf01530b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:53.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.260+0000 7febf6ab4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7febf00c6980 0x7febf00c29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:53.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.260+0000 7febf6ab4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7febf00c3c30 0x7febf00c8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:53.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.260+0000 7febf6ab4640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf00c41d0 con 0x7febf00c3c30 2024-01-25T15:04:53.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.260+0000 7febf6ab4640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf01525d0 con 0x7febf00c6980 2024-01-25T15:04:53.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.260+0000 7febf6ab4640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf01528b0 con 0x7febf014c6f0 2024-01-25T15:04:53.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.260+0000 7febf5051640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7febf00c3c30 0x7febf00c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:53.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.260+0000 7febf5051640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7febf00c3c30 0x7febf00c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45014/0 (socket says 172.21.15.29:45014) 2024-01-25T15:04:53.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.260+0000 7febf5051640 1 -- 172.21.15.29:0/31278079 learned_addr learned my addr 172.21.15.29:0/31278079 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:53.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.260+0000 7febeffff640 1 --2- 172.21.15.29:0/31278079 >> v2:172.21.15.52:3300/0 conn(0x7febf00c6980 0x7febf00c29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:53.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.260+0000 7febf4850640 1 --2- 172.21.15.29:0/31278079 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf014c6f0 0x7febf01530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:53.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.261+0000 7febf5051640 1 -- 172.21.15.29:0/31278079 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf014c6f0 msgr2=0x7febf01530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:53.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.261+0000 7febf5051640 1 --2- 172.21.15.29:0/31278079 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf014c6f0 0x7febf01530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.261+0000 7febf5051640 1 -- 172.21.15.29:0/31278079 >> v2:172.21.15.52:3300/0 conn(0x7febf00c6980 msgr2=0x7febf00c29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:53.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.261+0000 7febf5051640 1 --2- 172.21.15.29:0/31278079 >> v2:172.21.15.52:3300/0 conn(0x7febf00c6980 0x7febf00c29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.261+0000 7febf5051640 1 -- 172.21.15.29:0/31278079 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf0152b90 con 0x7febf00c3c30 2024-01-25T15:04:53.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.261+0000 7febf5051640 1 --2- 172.21.15.29:0/31278079 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febf00c3c30 0x7febf00c8360 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7febf00c5b50 tx=0x7febe802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238c8383adeaf646 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:53.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.262+0000 7febef7fe640 1 -- 172.21.15.29:0/31278079 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe802c9e0 con 0x7febf00c3c30 2024-01-25T15:04:53.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.262+0000 7febef7fe640 1 -- 172.21.15.29:0/31278079 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe802cb40 con 0x7febf00c3c30 2024-01-25T15:04:53.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.262+0000 7febef7fe640 1 -- 172.21.15.29:0/31278079 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe80343f0 con 0x7febf00c3c30 2024-01-25T15:04:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.262+0000 7febf6ab4640 1 -- 172.21.15.29:0/31278079 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febf00c3c30 msgr2=0x7febf00c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.262+0000 7febf6ab4640 1 --2- 172.21.15.29:0/31278079 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febf00c3c30 0x7febf00c8360 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7febf00c5b50 tx=0x7febe802be40 comp rx=0 tx=0).stop 2024-01-25T15:04:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.262+0000 7febf6ab4640 1 -- 172.21.15.29:0/31278079 shutdown_connections 2024-01-25T15:04:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.262+0000 7febf6ab4640 1 --2- 172.21.15.29:0/31278079 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febf00c3c30 0x7febf00c8360 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.262+0000 7febf6ab4640 1 --2- 172.21.15.29:0/31278079 >> v2:172.21.15.52:3300/0 conn(0x7febf00c6980 0x7febf00c29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.262+0000 7febf6ab4640 1 --2- 172.21.15.29:0/31278079 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf014c6f0 0x7febf01530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.262+0000 7febf6ab4640 1 -- 172.21.15.29:0/31278079 >> 172.21.15.29:0/31278079 conn(0x7febf006a8a0 msgr2=0x7febf006acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.262+0000 7febf6ab4640 1 -- 172.21.15.29:0/31278079 shutdown_connections 2024-01-25T15:04:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.262+0000 7febf6ab4640 1 -- 172.21.15.29:0/31278079 wait complete. 2024-01-25T15:04:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.263+0000 7febf6ab4640 1 Processor -- start 2024-01-25T15:04:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.263+0000 7febf6ab4640 1 -- start start 2024-01-25T15:04:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.264+0000 7febf6ab4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febf00c3c30 0x7febf0145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.264+0000 7febf6ab4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febf00c6980 0x7febf0148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:53.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.264+0000 7febf6ab4640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf014c6f0 0x7febf006e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:53.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.264+0000 7febf6ab4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf00706a0 con 0x7febf00c6980 2024-01-25T15:04:53.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.264+0000 7febf6ab4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf01e8b30 con 0x7febf00c3c30 2024-01-25T15:04:53.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.264+0000 7febf6ab4640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf014f5c0 con 0x7febf014c6f0 2024-01-25T15:04:53.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.264+0000 7febeffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febf00c6980 0x7febf0148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:53.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.264+0000 7febeffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febf00c6980 0x7febf0148580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45028/0 (socket says 172.21.15.29:45028) 2024-01-25T15:04:53.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.264+0000 7febeffff640 1 -- 172.21.15.29:0/2491057000 learned_addr learned my addr 172.21.15.29:0/2491057000 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:53.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.265+0000 7febf4850640 1 --2- 172.21.15.29:0/2491057000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febf00c3c30 0x7febf0145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:53.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.265+0000 7febf5051640 1 --2- 172.21.15.29:0/2491057000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf014c6f0 0x7febf006e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:53.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.265+0000 7febeffff640 1 -- 172.21.15.29:0/2491057000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf014c6f0 msgr2=0x7febf006e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:53.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.265+0000 7febeffff640 1 --2- 172.21.15.29:0/2491057000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf014c6f0 0x7febf006e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.265+0000 7febeffff640 1 -- 172.21.15.29:0/2491057000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febf00c3c30 msgr2=0x7febf0145fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:53.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.265+0000 7febeffff640 1 --2- 172.21.15.29:0/2491057000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febf00c3c30 0x7febf0145fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.265+0000 7febeffff640 1 -- 172.21.15.29:0/2491057000 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe8009b30 con 0x7febf00c6980 2024-01-25T15:04:53.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.265+0000 7febf4850640 1 --2- 172.21.15.29:0/2491057000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febf00c3c30 0x7febf0145fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:53.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.265+0000 7febeffff640 1 --2- 172.21.15.29:0/2491057000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febf00c6980 0x7febf0148580 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7febe400e990 tx=0x7febe400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:53.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.265+0000 7febed7fa640 1 -- 172.21.15.29:0/2491057000 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe400c980 con 0x7febf00c6980 2024-01-25T15:04:53.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.265+0000 7febed7fa640 1 -- 172.21.15.29:0/2491057000 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe400cae0 con 0x7febf00c6980 2024-01-25T15:04:53.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.265+0000 7febf6ab4640 1 -- 172.21.15.29:0/2491057000 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf0070170 con 0x7febf00c6980 2024-01-25T15:04:53.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.265+0000 7febed7fa640 1 -- 172.21.15.29:0/2491057000 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe400ce70 con 0x7febf00c6980 2024-01-25T15:04:53.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.265+0000 7febf6ab4640 1 -- 172.21.15.29:0/2491057000 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf01e9090 con 0x7febf00c6980 2024-01-25T15:04:53.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.266+0000 7febf6ab4640 1 -- 172.21.15.29:0/2491057000 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf01464e0 con 0x7febf00c6980 2024-01-25T15:04:53.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.267+0000 7febed7fa640 1 -- 172.21.15.29:0/2491057000 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7febe4013650 con 0x7febf00c6980 2024-01-25T15:04:53.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.267+0000 7febed7fa640 1 --2- 172.21.15.29:0/2491057000 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7febdc06aed0 0x7febdc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:53.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.267+0000 7febed7fa640 1 -- 172.21.15.29:0/2491057000 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7febe408d970 con 0x7febf00c6980 2024-01-25T15:04:53.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.267+0000 7febf4850640 1 --2- 172.21.15.29:0/2491057000 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7febdc06aed0 0x7febdc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:53.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.268+0000 7febf4850640 1 --2- 172.21.15.29:0/2491057000 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7febdc06aed0 0x7febdc06d390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7febe0009b10 tx=0x7febe0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:53.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.271+0000 7febed7fa640 1 -- 172.21.15.29:0/2491057000 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7febe40585e0 con 0x7febf00c6980 2024-01-25T15:04:53.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.491+0000 7febf6ab4640 1 -- 172.21.15.29:0/2491057000 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febf0074080 con 0x7febf00c6980 2024-01-25T15:04:53.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.492+0000 7febed7fa640 1 -- 172.21.15.29:0/2491057000 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4931 (secure 0 0 0) 0x7febe4020090 con 0x7febf00c6980 2024-01-25T15:04:53.493 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:53.493 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6836/2584242962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2584242962},{"type":"v1","addr":"172.21.15.52:6836","nonce":2584242962}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1800543981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1800543981},{"type":"v1","addr":"172.21.15.29:6834","nonce":1800543981}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3686497601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3686497601},{"type":"v1","addr":"172.21.15.29:6835","nonce":3686497601}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:04:26.896909+0000","modified":"2024-01-25T15:04:42.952775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6837/417879912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6835","nonce":417879912},{"type":"v1","addr":"172.21.15.52:6837","nonce":417879912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-25T15:04:53.493 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-01-25T15:04:53.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.494+0000 7febf6ab4640 1 -- 172.21.15.29:0/2491057000 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7febdc06aed0 msgr2=0x7febdc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:53.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.494+0000 7febf6ab4640 1 --2- 172.21.15.29:0/2491057000 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7febdc06aed0 0x7febdc06d390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7febe0009b10 tx=0x7febe0008040 comp rx=0 tx=0).stop 2024-01-25T15:04:53.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.494+0000 7febf6ab4640 1 -- 172.21.15.29:0/2491057000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febf00c6980 msgr2=0x7febf0148580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:53.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.494+0000 7febf6ab4640 1 --2- 172.21.15.29:0/2491057000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febf00c6980 0x7febf0148580 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7febe400e990 tx=0x7febe400ee50 comp rx=0 tx=0).stop 2024-01-25T15:04:53.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.494+0000 7febf6ab4640 1 -- 172.21.15.29:0/2491057000 shutdown_connections 2024-01-25T15:04:53.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.494+0000 7febf6ab4640 1 --2- 172.21.15.29:0/2491057000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febf014c6f0 0x7febf006e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.494+0000 7febf6ab4640 1 --2- 172.21.15.29:0/2491057000 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7febdc06aed0 0x7febdc06d390 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.494+0000 7febf6ab4640 1 --2- 172.21.15.29:0/2491057000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febf00c6980 0x7febf0148580 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.494+0000 7febf6ab4640 1 --2- 172.21.15.29:0/2491057000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febf00c3c30 0x7febf0145fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.494+0000 7febf6ab4640 1 -- 172.21.15.29:0/2491057000 >> 172.21.15.29:0/2491057000 conn(0x7febf006a8a0 msgr2=0x7febf014a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:53.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.494+0000 7febf6ab4640 1 -- 172.21.15.29:0/2491057000 shutdown_connections 2024-01-25T15:04:53.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.494+0000 7febf6ab4640 1 -- 172.21.15.29:0/2491057000 wait complete. 2024-01-25T15:04:53.505 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:04:53.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.606+0000 7f726611d640 1 Processor -- start 2024-01-25T15:04:53.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.606+0000 7f726611d640 1 -- start start 2024-01-25T15:04:53.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.606+0000 7f726611d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f72600c4990 0x7f726006bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:53.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.606+0000 7f726611d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f72600c7f10 0x7f72600c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:53.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.606+0000 7f726611d640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7260155430 con 0x7f7260152160 2024-01-25T15:04:53.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.606+0000 7f726611d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7260154b40 con 0x7f72600c4990 2024-01-25T15:04:53.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.606+0000 7f726611d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7260152540 con 0x7f72600c7f10 2024-01-25T15:04:53.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.607+0000 7f725f7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7260152160 0x7f72600c4ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59110/0 (socket says 172.21.15.29:59110) 2024-01-25T15:04:53.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.607+0000 7f725f7fe640 1 -- 172.21.15.29:0/348070127 learned_addr learned my addr 172.21.15.29:0/348070127 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:53.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.607+0000 7f725ffff640 1 --2- 172.21.15.29:0/348070127 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f72600c7f10 0x7f72600c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:53.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.607+0000 7f725effd640 1 --2- 172.21.15.29:0/348070127 >> v2:172.21.15.52:3300/0 conn(0x7f72600c4990 0x7f726006bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:53.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.607+0000 7f725e7fc640 1 -- 172.21.15.29:0/348070127 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687568952 0 0) 0x7f7260155430 con 0x7f7260152160 2024-01-25T15:04:53.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.607+0000 7f725e7fc640 1 -- 172.21.15.29:0/348070127 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f724c003520 con 0x7f7260152160 2024-01-25T15:04:53.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.607+0000 7f725ffff640 1 -- 172.21.15.29:0/348070127 >> v2:172.21.15.52:3300/0 conn(0x7f72600c4990 msgr2=0x7f726006bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:53.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.607+0000 7f725ffff640 1 --2- 172.21.15.29:0/348070127 >> v2:172.21.15.52:3300/0 conn(0x7f72600c4990 0x7f726006bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.607+0000 7f725ffff640 1 -- 172.21.15.29:0/348070127 >> v1:172.21.15.29:6789/0 conn(0x7f7260152160 legacy=0x7f72600c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:53.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.607+0000 7f725ffff640 1 -- 172.21.15.29:0/348070127 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72600c64b0 con 0x7f72600c7f10 2024-01-25T15:04:53.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.607+0000 7f725effd640 1 --2- 172.21.15.29:0/348070127 >> v2:172.21.15.52:3300/0 conn(0x7f72600c4990 0x7f726006bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:53.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.608+0000 7f725ffff640 1 --2- 172.21.15.29:0/348070127 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f72600c7f10 0x7f72600c83c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7258009d90 tx=0x7f725802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3727c2bf4a2705bb server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:53.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.608+0000 7f725e7fc640 1 -- 172.21.15.29:0/348070127 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725802cbc0 con 0x7f72600c7f10 2024-01-25T15:04:53.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.608+0000 7f725e7fc640 1 -- 172.21.15.29:0/348070127 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725802cd20 con 0x7f72600c7f10 2024-01-25T15:04:53.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.608+0000 7f725e7fc640 1 -- 172.21.15.29:0/348070127 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258034660 con 0x7f72600c7f10 2024-01-25T15:04:53.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.608+0000 7f726611d640 1 -- 172.21.15.29:0/348070127 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f72600c7f10 msgr2=0x7f72600c83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:53.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.608+0000 7f726611d640 1 --2- 172.21.15.29:0/348070127 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f72600c7f10 0x7f72600c83c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7258009d90 tx=0x7f725802be10 comp rx=0 tx=0).stop 2024-01-25T15:04:53.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.609+0000 7f726611d640 1 -- 172.21.15.29:0/348070127 shutdown_connections 2024-01-25T15:04:53.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.609+0000 7f726611d640 1 --2- 172.21.15.29:0/348070127 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f72600c7f10 0x7f72600c83c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.609+0000 7f726611d640 1 --2- 172.21.15.29:0/348070127 >> v2:172.21.15.52:3300/0 conn(0x7f72600c4990 0x7f726006bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.609+0000 7f726611d640 1 -- 172.21.15.29:0/348070127 >> 172.21.15.29:0/348070127 conn(0x7f72600ca1f0 msgr2=0x7f72600ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:53.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.609+0000 7f726611d640 1 -- 172.21.15.29:0/348070127 shutdown_connections 2024-01-25T15:04:53.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.609+0000 7f726611d640 1 -- 172.21.15.29:0/348070127 wait complete. 2024-01-25T15:04:53.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.610+0000 7f726611d640 1 Processor -- start 2024-01-25T15:04:53.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.610+0000 7f726611d640 1 -- start start 2024-01-25T15:04:53.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.610+0000 7f726611d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72600c4990 0x7f72600c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:53.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.610+0000 7f726611d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f72600c7f10 0x7f72601ea750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:53.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.610+0000 7f726611d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7260152160 0x7f72600c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:53.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.610+0000 7f726611d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72600c0520 con 0x7f72600c4990 2024-01-25T15:04:53.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.610+0000 7f726611d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72601eac90 con 0x7f7260152160 2024-01-25T15:04:53.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.610+0000 7f726611d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72601e9d00 con 0x7f72600c7f10 2024-01-25T15:04:53.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.611+0000 7f725f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72600c4990 0x7f72600c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:53.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.611+0000 7f725f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72600c4990 0x7f72600c4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45030/0 (socket says 172.21.15.29:45030) 2024-01-25T15:04:53.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.611+0000 7f725f7fe640 1 -- 172.21.15.29:0/1889413292 learned_addr learned my addr 172.21.15.29:0/1889413292 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:53.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.611+0000 7f725effd640 1 --2- 172.21.15.29:0/1889413292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f72600c7f10 0x7f72601ea750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:53.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.611+0000 7f725ffff640 1 --2- 172.21.15.29:0/1889413292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7260152160 0x7f72600c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:53.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.611+0000 7f725f7fe640 1 -- 172.21.15.29:0/1889413292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f72600c7f10 msgr2=0x7f72601ea750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:53.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.611+0000 7f725f7fe640 1 --2- 172.21.15.29:0/1889413292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f72600c7f10 0x7f72601ea750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.611+0000 7f725f7fe640 1 -- 172.21.15.29:0/1889413292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7260152160 msgr2=0x7f72600c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:53.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.611+0000 7f725f7fe640 1 --2- 172.21.15.29:0/1889413292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7260152160 0x7f72600c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.611+0000 7f725f7fe640 1 -- 172.21.15.29:0/1889413292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7248009400 con 0x7f72600c4990 2024-01-25T15:04:53.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.611+0000 7f725effd640 1 --2- 172.21.15.29:0/1889413292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f72600c7f10 0x7f72601ea750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:53.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.611+0000 7f725ffff640 1 --2- 172.21.15.29:0/1889413292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7260152160 0x7f72600c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:53.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.611+0000 7f725f7fe640 1 --2- 172.21.15.29:0/1889413292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72600c4990 0x7f72600c4070 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f725000c3c0 tx=0x7f725000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:53.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.611+0000 7f7257fff640 1 -- 172.21.15.29:0/1889413292 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250005ce0 con 0x7f72600c4990 2024-01-25T15:04:53.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.611+0000 7f7257fff640 1 -- 172.21.15.29:0/1889413292 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7250005e40 con 0x7f72600c4990 2024-01-25T15:04:53.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.611+0000 7f726611d640 1 -- 172.21.15.29:0/1889413292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7258009a70 con 0x7f72600c4990 2024-01-25T15:04:53.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.611+0000 7f7257fff640 1 -- 172.21.15.29:0/1889413292 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72500072f0 con 0x7f72600c4990 2024-01-25T15:04:53.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.611+0000 7f726611d640 1 -- 172.21.15.29:0/1889413292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72601ea2c0 con 0x7f72600c4990 2024-01-25T15:04:53.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.612+0000 7f726611d640 1 -- 172.21.15.29:0/1889413292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7260068580 con 0x7f72600c4990 2024-01-25T15:04:53.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.613+0000 7f7257fff640 1 -- 172.21.15.29:0/1889413292 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7250007450 con 0x7f72600c4990 2024-01-25T15:04:53.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.613+0000 7f7257fff640 1 --2- 172.21.15.29:0/1889413292 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f724006aed0 0x7f724006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:53.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.613+0000 7f7257fff640 1 -- 172.21.15.29:0/1889413292 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7250088ed0 con 0x7f72600c4990 2024-01-25T15:04:53.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.613+0000 7f725effd640 1 --2- 172.21.15.29:0/1889413292 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f724006aed0 0x7f724006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:53.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.614+0000 7f725effd640 1 --2- 172.21.15.29:0/1889413292 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f724006aed0 0x7f724006d390 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f72601e7b40 tx=0x7f7248008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:53.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.617+0000 7f7257fff640 1 -- 172.21.15.29:0/1889413292 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7260068580 con 0x7f72600c4990 2024-01-25T15:04:53.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.798+0000 7f726611d640 1 -- 172.21.15.29:0/1889413292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7260068580 con 0x7f72600c4990 2024-01-25T15:04:53.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.799+0000 7f7257fff640 1 -- 172.21.15.29:0/1889413292 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18311 (secure 0 0 0) 0x7f7260068580 con 0x7f72600c4990 2024-01-25T15:04:53.800 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:53.800 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:31.978871+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:04:53.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.801+0000 7f726611d640 1 -- 172.21.15.29:0/1889413292 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f724006aed0 msgr2=0x7f724006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:53.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.801+0000 7f726611d640 1 --2- 172.21.15.29:0/1889413292 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f724006aed0 0x7f724006d390 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f72601e7b40 tx=0x7f7248008040 comp rx=0 tx=0).stop 2024-01-25T15:04:53.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.801+0000 7f726611d640 1 -- 172.21.15.29:0/1889413292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72600c4990 msgr2=0x7f72600c4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:53.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.801+0000 7f726611d640 1 --2- 172.21.15.29:0/1889413292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72600c4990 0x7f72600c4070 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f725000c3c0 tx=0x7f725000c880 comp rx=0 tx=0).stop 2024-01-25T15:04:53.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.801+0000 7f726611d640 1 -- 172.21.15.29:0/1889413292 shutdown_connections 2024-01-25T15:04:53.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.801+0000 7f726611d640 1 --2- 172.21.15.29:0/1889413292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7260152160 0x7f72600c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.801+0000 7f726611d640 1 --2- 172.21.15.29:0/1889413292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f72600c7f10 0x7f72601ea750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.801+0000 7f726611d640 1 --2- 172.21.15.29:0/1889413292 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f724006aed0 0x7f724006d390 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.801+0000 7f726611d640 1 --2- 172.21.15.29:0/1889413292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72600c4990 0x7f72600c4070 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.801+0000 7f726611d640 1 -- 172.21.15.29:0/1889413292 >> 172.21.15.29:0/1889413292 conn(0x7f72600ca1f0 msgr2=0x7f7260151430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:53.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.801+0000 7f726611d640 1 -- 172.21.15.29:0/1889413292 shutdown_connections 2024-01-25T15:04:53.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.801+0000 7f726611d640 1 -- 172.21.15.29:0/1889413292 wait complete. 2024-01-25T15:04:53.813 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:04:53.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.913+0000 7f921f408640 1 Processor -- start 2024-01-25T15:04:53.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.913+0000 7f921f408640 1 -- start start 2024-01-25T15:04:53.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.914+0000 7f921f408640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f92181520b0 0x7f9218155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:53.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.914+0000 7f921f408640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f92180c55e0 0x7f92180c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:53.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.914+0000 7f921f408640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92180c66c0 con 0x7f92180c4f00 2024-01-25T15:04:53.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.914+0000 7f921f408640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921806cfc0 con 0x7f92180c55e0 2024-01-25T15:04:53.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.914+0000 7f921f408640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9218152490 con 0x7f92181520b0 2024-01-25T15:04:53.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.914+0000 7f921c9a3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f92180c55e0 0x7f92180c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:53.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.914+0000 7f921c9a3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f92180c55e0 0x7f92180c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45034/0 (socket says 172.21.15.29:45034) 2024-01-25T15:04:53.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.914+0000 7f921c9a3640 1 -- 172.21.15.29:0/2693915348 learned_addr learned my addr 172.21.15.29:0/2693915348 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:53.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.914+0000 7f921d1a4640 1 --2- 172.21.15.29:0/2693915348 >> v2:172.21.15.52:3300/0 conn(0x7f92181520b0 0x7f9218155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:53.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.915+0000 7f921c9a3640 1 -- 172.21.15.29:0/2693915348 >> v2:172.21.15.52:3300/0 conn(0x7f92181520b0 msgr2=0x7f9218155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:53.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.915+0000 7f921c9a3640 1 --2- 172.21.15.29:0/2693915348 >> v2:172.21.15.52:3300/0 conn(0x7f92181520b0 0x7f9218155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.915+0000 7f921c9a3640 1 -- 172.21.15.29:0/2693915348 >> v1:172.21.15.52:6789/0 conn(0x7f92180c4f00 legacy=0x7f92180c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:53.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.915+0000 7f921c9a3640 1 -- 172.21.15.29:0/2693915348 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92180c6910 con 0x7f92180c55e0 2024-01-25T15:04:53.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.915+0000 7f921c9a3640 1 --2- 172.21.15.29:0/2693915348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92180c55e0 0x7f92180c8120 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f921808bbe0 tx=0x7f920c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2650d33a6f74a903 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:53.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.915+0000 7f9217fff640 1 -- 172.21.15.29:0/2693915348 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c031870 con 0x7f92180c55e0 2024-01-25T15:04:53.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.915+0000 7f9217fff640 1 -- 172.21.15.29:0/2693915348 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920c0319d0 con 0x7f92180c55e0 2024-01-25T15:04:53.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.916+0000 7f9217fff640 1 -- 172.21.15.29:0/2693915348 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c031d60 con 0x7f92180c55e0 2024-01-25T15:04:53.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.916+0000 7f921f408640 1 -- 172.21.15.29:0/2693915348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92180c55e0 msgr2=0x7f92180c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:53.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.916+0000 7f921f408640 1 --2- 172.21.15.29:0/2693915348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92180c55e0 0x7f92180c8120 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f921808bbe0 tx=0x7f920c02b910 comp rx=0 tx=0).stop 2024-01-25T15:04:53.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.916+0000 7f921f408640 1 -- 172.21.15.29:0/2693915348 shutdown_connections 2024-01-25T15:04:53.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.916+0000 7f921f408640 1 --2- 172.21.15.29:0/2693915348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92180c55e0 0x7f92180c8120 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.916+0000 7f921f408640 1 --2- 172.21.15.29:0/2693915348 >> v2:172.21.15.52:3300/0 conn(0x7f92181520b0 0x7f9218155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.916+0000 7f921f408640 1 -- 172.21.15.29:0/2693915348 >> 172.21.15.29:0/2693915348 conn(0x7f92180ca220 msgr2=0x7f92180ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:53.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.916+0000 7f921f408640 1 -- 172.21.15.29:0/2693915348 shutdown_connections 2024-01-25T15:04:53.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.916+0000 7f921f408640 1 -- 172.21.15.29:0/2693915348 wait complete. 2024-01-25T15:04:53.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.917+0000 7f921f408640 1 Processor -- start 2024-01-25T15:04:53.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.917+0000 7f921f408640 1 -- start start 2024-01-25T15:04:53.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.918+0000 7f921f408640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92180c4f00 0x7f92181ea130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:53.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.918+0000 7f921f408640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92181520b0 0x7f92181ea670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:53.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.918+0000 7f921f408640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f92181e7030 0x7f92181e74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:53.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.918+0000 7f921f408640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921814dc10 con 0x7f92181520b0 2024-01-25T15:04:53.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.918+0000 7f921f408640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92181eabb0 con 0x7f92180c4f00 2024-01-25T15:04:53.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.918+0000 7f921f408640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921814cd20 con 0x7f92181e7030 2024-01-25T15:04:53.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.918+0000 7f921c9a3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92181520b0 0x7f92181ea670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:53.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.918+0000 7f921c9a3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92181520b0 0x7f92181ea670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45046/0 (socket says 172.21.15.29:45046) 2024-01-25T15:04:53.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.918+0000 7f921c9a3640 1 -- 172.21.15.29:0/681742624 learned_addr learned my addr 172.21.15.29:0/681742624 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:53.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.918+0000 7f921d1a4640 1 --2- 172.21.15.29:0/681742624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92180c4f00 0x7f92181ea130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:53.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.918+0000 7f921d9a5640 1 --2- 172.21.15.29:0/681742624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f92181e7030 0x7f92181e74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:53.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.918+0000 7f921c9a3640 1 -- 172.21.15.29:0/681742624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f92181e7030 msgr2=0x7f92181e74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:53.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.918+0000 7f921c9a3640 1 --2- 172.21.15.29:0/681742624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f92181e7030 0x7f92181e74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.918+0000 7f921c9a3640 1 -- 172.21.15.29:0/681742624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92180c4f00 msgr2=0x7f92181ea130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:53.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.918+0000 7f921c9a3640 1 --2- 172.21.15.29:0/681742624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92180c4f00 0x7f92181ea130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:53.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.918+0000 7f921c9a3640 1 -- 172.21.15.29:0/681742624 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920c0094d0 con 0x7f92181520b0 2024-01-25T15:04:53.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.918+0000 7f921d1a4640 1 --2- 172.21.15.29:0/681742624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92180c4f00 0x7f92181ea130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:53.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.919+0000 7f921c9a3640 1 --2- 172.21.15.29:0/681742624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92181520b0 0x7f92181ea670 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f920c02b950 tx=0x7f920c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:53.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.919+0000 7f9215ffb640 1 -- 172.21.15.29:0/681742624 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c03abe0 con 0x7f92181520b0 2024-01-25T15:04:53.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.919+0000 7f9215ffb640 1 -- 172.21.15.29:0/681742624 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920c03ad60 con 0x7f92181520b0 2024-01-25T15:04:53.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.919+0000 7f921f408640 1 -- 172.21.15.29:0/681742624 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921814d000 con 0x7f92181520b0 2024-01-25T15:04:53.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.919+0000 7f9215ffb640 1 -- 172.21.15.29:0/681742624 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c044630 con 0x7f92181520b0 2024-01-25T15:04:53.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.919+0000 7f921f408640 1 -- 172.21.15.29:0/681742624 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921814d5c0 con 0x7f92181520b0 2024-01-25T15:04:53.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.920+0000 7f921f408640 1 -- 172.21.15.29:0/681742624 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9218074080 con 0x7f92181520b0 2024-01-25T15:04:53.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.920+0000 7f9215ffb640 1 -- 172.21.15.29:0/681742624 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f920c04d450 con 0x7f92181520b0 2024-01-25T15:04:53.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.921+0000 7f9215ffb640 1 --2- 172.21.15.29:0/681742624 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f920406aed0 0x7f920406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:53.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.921+0000 7f9215ffb640 1 -- 172.21.15.29:0/681742624 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f920c02d040 con 0x7f92181520b0 2024-01-25T15:04:53.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.921+0000 7f921d1a4640 1 --2- 172.21.15.29:0/681742624 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f920406aed0 0x7f920406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:53.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.921+0000 7f921d1a4640 1 --2- 172.21.15.29:0/681742624 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f920406aed0 0x7f920406d390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f92080074c0 tx=0x7f920800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:53.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:53.925+0000 7f9215ffb640 1 -- 172.21.15.29:0/681742624 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f920c076a20 con 0x7f92181520b0 2024-01-25T15:04:54.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.140+0000 7f921f408640 1 -- 172.21.15.29:0/681742624 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92180c4ce0 con 0x7f92181520b0 2024-01-25T15:04:54.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.141+0000 7f9215ffb640 1 -- 172.21.15.29:0/681742624 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4931 (secure 0 0 0) 0x7f920c07a040 con 0x7f92181520b0 2024-01-25T15:04:54.142 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:54.142 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6836/2584242962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2584242962},{"type":"v1","addr":"172.21.15.52:6836","nonce":2584242962}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1800543981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1800543981},{"type":"v1","addr":"172.21.15.29:6834","nonce":1800543981}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3686497601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3686497601},{"type":"v1","addr":"172.21.15.29:6835","nonce":3686497601}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:04:26.896909+0000","modified":"2024-01-25T15:04:42.952775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6837/417879912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6835","nonce":417879912},{"type":"v1","addr":"172.21.15.52:6837","nonce":417879912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-25T15:04:54.142 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-01-25T15:04:54.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.142+0000 7f921f408640 1 -- 172.21.15.29:0/681742624 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f920406aed0 msgr2=0x7f920406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:54.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.142+0000 7f921f408640 1 --2- 172.21.15.29:0/681742624 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f920406aed0 0x7f920406d390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f92080074c0 tx=0x7f920800b040 comp rx=0 tx=0).stop 2024-01-25T15:04:54.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.142+0000 7f921f408640 1 -- 172.21.15.29:0/681742624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92181520b0 msgr2=0x7f92181ea670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:54.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.142+0000 7f921f408640 1 --2- 172.21.15.29:0/681742624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92181520b0 0x7f92181ea670 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f920c02b950 tx=0x7f920c0046c0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.143+0000 7f921f408640 1 -- 172.21.15.29:0/681742624 shutdown_connections 2024-01-25T15:04:54.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.143+0000 7f921f408640 1 --2- 172.21.15.29:0/681742624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f92181e7030 0x7f92181e74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.143+0000 7f921f408640 1 --2- 172.21.15.29:0/681742624 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f920406aed0 0x7f920406d390 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.143+0000 7f921f408640 1 --2- 172.21.15.29:0/681742624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92181520b0 0x7f92181ea670 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.143+0000 7f921f408640 1 --2- 172.21.15.29:0/681742624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92180c4f00 0x7f92181ea130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.143+0000 7f921f408640 1 -- 172.21.15.29:0/681742624 >> 172.21.15.29:0/681742624 conn(0x7f92180ca220 msgr2=0x7f92180730a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:54.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.143+0000 7f921f408640 1 -- 172.21.15.29:0/681742624 shutdown_connections 2024-01-25T15:04:54.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.143+0000 7f921f408640 1 -- 172.21.15.29:0/681742624 wait complete. 2024-01-25T15:04:54.556 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-25T15:04:26.896909+0000', 'modified': '2024-01-25T15:04:42.952775+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.52:6837/417879912', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6835', 'nonce': 417879912}, {'type': 'v1', 'addr': '172.21.15.52:6837', 'nonce': 417879912}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-25T15:04:54.557 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-25T15:04:54.557 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-01-25T15:04:54.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.661+0000 7f2eba45c640 1 Processor -- start 2024-01-25T15:04:54.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.661+0000 7f2eba45c640 1 -- start start 2024-01-25T15:04:54.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.662+0000 7f2eba45c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2eb4151d80 0x7f2eb40c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:54.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.662+0000 7f2eba45c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2eb406c370 0x7f2eb40c4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:54.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.662+0000 7f2eba45c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb406bee0 con 0x7f2eb4155210 2024-01-25T15:04:54.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.662+0000 7f2eba45c640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb40c7400 con 0x7f2eb4151d80 2024-01-25T15:04:54.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.662+0000 7f2eba45c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb406b8d0 con 0x7f2eb406c370 2024-01-25T15:04:54.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.662+0000 7f2eb37fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2eb4155210 0x7f2eb40c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59118/0 (socket says 172.21.15.29:59118) 2024-01-25T15:04:54.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.662+0000 7f2eb37fe640 1 -- 172.21.15.29:0/1771684814 learned_addr learned my addr 172.21.15.29:0/1771684814 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:54.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.662+0000 7f2eb3fff640 1 --2- 172.21.15.29:0/1771684814 >> v2:172.21.15.52:3300/0 conn(0x7f2eb4151d80 0x7f2eb40c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:54.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.662+0000 7f2eb89f9640 1 --2- 172.21.15.29:0/1771684814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2eb406c370 0x7f2eb40c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:54.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.663+0000 7f2eb2ffd640 1 -- 172.21.15.29:0/1771684814 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416423166 0 0) 0x7f2eb406bee0 con 0x7f2eb4155210 2024-01-25T15:04:54.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.663+0000 7f2eb2ffd640 1 -- 172.21.15.29:0/1771684814 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e9c003520 con 0x7f2eb4155210 2024-01-25T15:04:54.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.663+0000 7f2eb89f9640 1 -- 172.21.15.29:0/1771684814 >> v2:172.21.15.52:3300/0 conn(0x7f2eb4151d80 msgr2=0x7f2eb40c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:54.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.663+0000 7f2eb89f9640 1 --2- 172.21.15.29:0/1771684814 >> v2:172.21.15.52:3300/0 conn(0x7f2eb4151d80 0x7f2eb40c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.663+0000 7f2eb2ffd640 1 -- 172.21.15.29:0/1771684814 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2730104760 0 0) 0x7f2e9c003520 con 0x7f2eb4155210 2024-01-25T15:04:54.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.663+0000 7f2eb89f9640 1 -- 172.21.15.29:0/1771684814 >> v1:172.21.15.29:6789/0 conn(0x7f2eb4155210 legacy=0x7f2eb40c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:54.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.663+0000 7f2eb89f9640 1 -- 172.21.15.29:0/1771684814 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb40c7120 con 0x7f2eb406c370 2024-01-25T15:04:54.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.663+0000 7f2eb3fff640 1 --2- 172.21.15.29:0/1771684814 >> v2:172.21.15.52:3300/0 conn(0x7f2eb4151d80 0x7f2eb40c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:54.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.664+0000 7f2eb89f9640 1 --2- 172.21.15.29:0/1771684814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2eb406c370 0x7f2eb40c4990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009d90 tx=0x7f2eac02bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d24c5160d7b7913e server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:54.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.664+0000 7f2eb2ffd640 1 -- 172.21.15.29:0/1771684814 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8001670 con 0x7f2eb406c370 2024-01-25T15:04:54.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.664+0000 7f2eb2ffd640 1 -- 172.21.15.29:0/1771684814 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac02c810 con 0x7f2eb406c370 2024-01-25T15:04:54.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.664+0000 7f2eb2ffd640 1 -- 172.21.15.29:0/1771684814 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac02cba0 con 0x7f2eb406c370 2024-01-25T15:04:54.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.664+0000 7f2eba45c640 1 -- 172.21.15.29:0/1771684814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2eb406c370 msgr2=0x7f2eb40c4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:54.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.664+0000 7f2eba45c640 1 --2- 172.21.15.29:0/1771684814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2eb406c370 0x7f2eb40c4990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009d90 tx=0x7f2eac02bce0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.664+0000 7f2eba45c640 1 -- 172.21.15.29:0/1771684814 shutdown_connections 2024-01-25T15:04:54.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.664+0000 7f2eba45c640 1 --2- 172.21.15.29:0/1771684814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2eb406c370 0x7f2eb40c4990 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.664+0000 7f2eba45c640 1 --2- 172.21.15.29:0/1771684814 >> v2:172.21.15.52:3300/0 conn(0x7f2eb4151d80 0x7f2eb40c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.664+0000 7f2eba45c640 1 -- 172.21.15.29:0/1771684814 >> 172.21.15.29:0/1771684814 conn(0x7f2eb40abd80 msgr2=0x7f2eb40ac190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:54.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.664+0000 7f2eba45c640 1 -- 172.21.15.29:0/1771684814 shutdown_connections 2024-01-25T15:04:54.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.664+0000 7f2eba45c640 1 -- 172.21.15.29:0/1771684814 wait complete. 2024-01-25T15:04:54.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.666+0000 7f2eba45c640 1 Processor -- start 2024-01-25T15:04:54.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.666+0000 7f2eba45c640 1 -- start start 2024-01-25T15:04:54.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.666+0000 7f2eba45c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2eb406c370 0x7f2eb40aade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:54.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.666+0000 7f2eba45c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eb4151d80 0x7f2eb40af440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:54.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.666+0000 7f2eba45c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2eb4155210 0x7f2eb414b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:54.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.666+0000 7f2eba45c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb40c2130 con 0x7f2eb4155210 2024-01-25T15:04:54.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.666+0000 7f2eba45c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb4158630 con 0x7f2eb4151d80 2024-01-25T15:04:54.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.666+0000 7f2eba45c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb41ee0a0 con 0x7f2eb406c370 2024-01-25T15:04:54.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.666+0000 7f2eb89f9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2eb4155210 0x7f2eb414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:54.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.667+0000 7f2eb89f9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2eb4155210 0x7f2eb414b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45058/0 (socket says 172.21.15.29:45058) 2024-01-25T15:04:54.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.667+0000 7f2eb89f9640 1 -- 172.21.15.29:0/2479193205 learned_addr learned my addr 172.21.15.29:0/2479193205 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:54.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.667+0000 7f2eb3fff640 1 --2- 172.21.15.29:0/2479193205 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2eb406c370 0x7f2eb40aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:54.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.667+0000 7f2eb37fe640 1 --2- 172.21.15.29:0/2479193205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eb4151d80 0x7f2eb40af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:54.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.667+0000 7f2eb89f9640 1 -- 172.21.15.29:0/2479193205 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2eb406c370 msgr2=0x7f2eb40aade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:54.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.667+0000 7f2eb89f9640 1 --2- 172.21.15.29:0/2479193205 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2eb406c370 0x7f2eb40aade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.667+0000 7f2eb89f9640 1 -- 172.21.15.29:0/2479193205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eb4151d80 msgr2=0x7f2eb40af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:54.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.667+0000 7f2eb89f9640 1 --2- 172.21.15.29:0/2479193205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eb4151d80 0x7f2eb40af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.667+0000 7f2eb89f9640 1 -- 172.21.15.29:0/2479193205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea4009400 con 0x7f2eb4155210 2024-01-25T15:04:54.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.667+0000 7f2eb89f9640 1 --2- 172.21.15.29:0/2479193205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2eb4155210 0x7f2eb414b330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009d90 tx=0x7f2eac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:54.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.667+0000 7f2eb0ff9640 1 -- 172.21.15.29:0/2479193205 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac009450 con 0x7f2eb4155210 2024-01-25T15:04:54.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.667+0000 7f2eb0ff9640 1 -- 172.21.15.29:0/2479193205 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac034c50 con 0x7f2eb4155210 2024-01-25T15:04:54.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.667+0000 7f2eba45c640 1 -- 172.21.15.29:0/2479193205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eac009a70 con 0x7f2eb4155210 2024-01-25T15:04:54.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.667+0000 7f2eb0ff9640 1 -- 172.21.15.29:0/2479193205 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac040450 con 0x7f2eb4155210 2024-01-25T15:04:54.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.667+0000 7f2eba45c640 1 -- 172.21.15.29:0/2479193205 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb40ab320 con 0x7f2eb4155210 2024-01-25T15:04:54.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.669+0000 7f2eb0ff9640 1 -- 172.21.15.29:0/2479193205 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2eac0405b0 con 0x7f2eb4155210 2024-01-25T15:04:54.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.669+0000 7f2eb0ff9640 1 --2- 172.21.15.29:0/2479193205 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2ea006aed0 0x7f2ea006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:54.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.669+0000 7f2eb0ff9640 1 -- 172.21.15.29:0/2479193205 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2eac0ac130 con 0x7f2eb4155210 2024-01-25T15:04:54.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.669+0000 7f2eb3fff640 1 --2- 172.21.15.29:0/2479193205 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2ea006aed0 0x7f2ea006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:54.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.670+0000 7f2eb3fff640 1 --2- 172.21.15.29:0/2479193205 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2ea006aed0 0x7f2ea006d390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2eb40bd370 tx=0x7f2ea4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:54.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.670+0000 7f2ebd029740 1 Processor -- start 2024-01-25T15:04:54.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.670+0000 7f2ebd029740 1 -- start start 2024-01-25T15:04:54.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.671+0000 7f2ebd029740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf1fef0 0x555fccf202d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:54.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.671+0000 7f2ebd029740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fccf21200 0x555fccf5c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:54.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.671+0000 7f2ebd029740 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x555fccf5c580 0x555fccf5a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:54.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.671+0000 7f2ebd029740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fcce8e030 con 0x555fccf1fef0 2024-01-25T15:04:54.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.671+0000 7f2ebd029740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fcce8b720 con 0x555fccf21200 2024-01-25T15:04:54.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.671+0000 7f2ebd029740 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x555fcce87010 con 0x555fccf5c580 2024-01-25T15:04:54.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.671+0000 7f2eb3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf1fef0 0x555fccf202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:54.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.671+0000 7f2eb3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf1fef0 0x555fccf202d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45070/0 (socket says 172.21.15.29:45070) 2024-01-25T15:04:54.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.671+0000 7f2eb3fff640 1 -- 172.21.15.29:0/3850101140 learned_addr learned my addr 172.21.15.29:0/3850101140 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:54.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.671+0000 7f2eb37fe640 1 --2- 172.21.15.29:0/3850101140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fccf21200 0x555fccf5c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:54.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.671+0000 7f2eb89f9640 1 --2- 172.21.15.29:0/3850101140 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x555fccf5c580 0x555fccf5a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:54.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.671+0000 7f2eb3fff640 1 -- 172.21.15.29:0/3850101140 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x555fccf5c580 msgr2=0x555fccf5a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:54.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.671+0000 7f2eb3fff640 1 --2- 172.21.15.29:0/3850101140 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x555fccf5c580 0x555fccf5a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.671+0000 7f2eb3fff640 1 -- 172.21.15.29:0/3850101140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fccf21200 msgr2=0x555fccf5c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:54.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.671+0000 7f2eb3fff640 1 --2- 172.21.15.29:0/3850101140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fccf21200 0x555fccf5c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.671+0000 7f2eb3fff640 1 -- 172.21.15.29:0/3850101140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fcce49680 con 0x555fccf1fef0 2024-01-25T15:04:54.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.671+0000 7f2eb3fff640 1 --2- 172.21.15.29:0/3850101140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf1fef0 0x555fccf202d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4014440 tx=0x7f2ea4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277166ab6e521bd5 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:54.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.671+0000 7f2e99ffb640 1 -- 172.21.15.29:0/3850101140 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4014d80 con 0x555fccf1fef0 2024-01-25T15:04:54.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.671+0000 7f2e99ffb640 1 -- 172.21.15.29:0/3850101140 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea40213f0 con 0x555fccf1fef0 2024-01-25T15:04:54.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.672+0000 7f2e99ffb640 1 -- 172.21.15.29:0/3850101140 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4021780 con 0x555fccf1fef0 2024-01-25T15:04:54.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.672+0000 7f2ebd029740 1 -- 172.21.15.29:0/3850101140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf1fef0 msgr2=0x555fccf202d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:54.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.672+0000 7f2ebd029740 1 --2- 172.21.15.29:0/3850101140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf1fef0 0x555fccf202d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4014440 tx=0x7f2ea4014000 comp rx=0 tx=0).stop 2024-01-25T15:04:54.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.672+0000 7f2ebd029740 1 -- 172.21.15.29:0/3850101140 shutdown_connections 2024-01-25T15:04:54.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.672+0000 7f2ebd029740 1 --2- 172.21.15.29:0/3850101140 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x555fccf5c580 0x555fccf5a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.672+0000 7f2ebd029740 1 --2- 172.21.15.29:0/3850101140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fccf21200 0x555fccf5c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.672+0000 7f2ebd029740 1 --2- 172.21.15.29:0/3850101140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf1fef0 0x555fccf202d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.672+0000 7f2ebd029740 1 -- 172.21.15.29:0/3850101140 >> 172.21.15.29:0/3850101140 conn(0x555fccf1c840 msgr2=0x555fccf41250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:54.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.672+0000 7f2ebd029740 1 -- 172.21.15.29:0/3850101140 shutdown_connections 2024-01-25T15:04:54.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.672+0000 7f2ebd029740 1 -- 172.21.15.29:0/3850101140 wait complete. 2024-01-25T15:04:54.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.673+0000 7f2ebd029740 1 -- start start 2024-01-25T15:04:54.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.673+0000 7f2ebd029740 1 Processor -- start 2024-01-25T15:04:54.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.673+0000 7f2ebd029740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fccf21200 0x555fccf61720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:54.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.673+0000 7f2ebd029740 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x555fccf5c580 0x555fccf5aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:54.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2ebd029740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf609c0 0x555fccf6ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:54.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2ebd029740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fcce405f0 con 0x555fccf609c0 2024-01-25T15:04:54.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2ebd029740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fcce40290 con 0x555fccf21200 2024-01-25T15:04:54.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2ebd029740 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x555fcce05300 con 0x555fccf5c580 2024-01-25T15:04:54.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2ebd029740 10 client.0 _ll_register_callbacks cb 0x555fcce3b260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:54.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2eb89f9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf609c0 0x555fccf6ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:54.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2eb89f9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf609c0 0x555fccf6ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45074/0 (socket says 172.21.15.29:45074) 2024-01-25T15:04:54.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2eb89f9640 1 -- 172.21.15.29:0/2852550108 learned_addr learned my addr 172.21.15.29:0/2852550108 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:54.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2eb3fff640 1 --2- 172.21.15.29:0/2852550108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fccf21200 0x555fccf61720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:54.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2eb37fe640 1 --2- 172.21.15.29:0/2852550108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x555fccf5c580 0x555fccf5aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:54.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2eb89f9640 1 -- 172.21.15.29:0/2852550108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x555fccf5c580 msgr2=0x555fccf5aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:54.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2eb89f9640 1 --2- 172.21.15.29:0/2852550108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x555fccf5c580 0x555fccf5aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2eb89f9640 1 -- 172.21.15.29:0/2852550108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fccf21200 msgr2=0x555fccf61720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:54.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2eb89f9640 1 --2- 172.21.15.29:0/2852550108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fccf21200 0x555fccf61720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2eb89f9640 1 -- 172.21.15.29:0/2852550108 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea4009cd0 con 0x555fccf609c0 2024-01-25T15:04:54.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2eb89f9640 1 --2- 172.21.15.29:0/2852550108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf609c0 0x555fccf6ca80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2eac07a810 tx=0x7f2eac07ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74f5a38781db6a4 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:54.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2e92ffd640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-01-25T15:04:54.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2e92ffd640 1 -- 172.21.15.29:0/2852550108 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac07af80 con 0x555fccf609c0 2024-01-25T15:04:54.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2e92ffd640 1 -- 172.21.15.29:0/2852550108 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2eac07a000 con 0x555fccf609c0 2024-01-25T15:04:54.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2ebd029740 1 -- 172.21.15.29:0/2852550108 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555fcce7fea0 con 0x555fccf609c0 2024-01-25T15:04:54.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2e92ffd640 1 -- 172.21.15.29:0/2852550108 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2eac07a1c0 con 0x555fccf609c0 2024-01-25T15:04:54.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2ebd029740 10 client.4833 fetch_fsmap learned FSMap version 9 2024-01-25T15:04:54.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.674+0000 7f2ebd029740 1 -- 172.21.15.29:0/2852550108 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x555fcce85690 con 0x555fccf609c0 2024-01-25T15:04:54.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.675+0000 7f2e92ffd640 1 -- 172.21.15.29:0/2852550108 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555fcce7fea0 con 0x555fccf609c0 2024-01-25T15:04:54.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.675+0000 7f2e92ffd640 1 -- 172.21.15.29:0/2852550108 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f2eac050020 con 0x555fccf609c0 2024-01-25T15:04:54.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.675+0000 7f2ebd029740 10 client.4833 fetch_fsmap finished waiting for FSMap version 9 2024-01-25T15:04:54.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.675+0000 7f2ebd029740 10 client.4833 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-25T15:04:54.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.675+0000 7f2ebd029740 20 client.4833 populate_metadata read hostname 'smithi029' 2024-01-25T15:04:54.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.675+0000 7f2ebd029740 1 --2- 172.21.15.29:0/2852550108 >> [v2:172.21.15.52:6835/417879912,v1:172.21.15.52:6837/417879912] conn(0x555fccf3f690 0x555fccf3fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:54.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.675+0000 7f2ebd029740 4 client.4833 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:04:54.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.675+0000 7f2ebd029740 1 -- 172.21.15.29:0/2852550108 --> [v2:172.21.15.52:6835/417879912,v1:172.21.15.52:6837/417879912] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555fcce7fbc0 con 0x555fccf3f690 2024-01-25T15:04:54.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.675+0000 7f2eb3fff640 1 --2- 172.21.15.29:0/2852550108 >> [v2:172.21.15.52:6835/417879912,v1:172.21.15.52:6837/417879912] conn(0x555fccf3f690 0x555fccf3fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:54.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.675+0000 7f2e92ffd640 10 client.4833 ms_handle_connect on v2:172.21.15.52:6835/417879912 2024-01-25T15:04:54.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.675+0000 7f2eb3fff640 1 --2- 172.21.15.29:0/2852550108 >> [v2:172.21.15.52:6835/417879912,v1:172.21.15.52:6837/417879912] conn(0x555fccf3f690 0x555fccf3fa70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd968bee572354b2 server_cookie=6e185c304a3930b2 in_seq=0 out_seq=0 2024-01-25T15:04:54.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.676+0000 7f2e92ffd640 1 -- 172.21.15.29:0/2852550108 <== mds.0 v2:172.21.15.52:6835/417879912 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555fcce7fbc0 con 0x555fccf3f690 2024-01-25T15:04:54.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.676+0000 7f2e92ffd640 10 client.4833 handle_command_reply: tid=0 2024-01-25T15:04:54.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.676+0000 7f2ebd029740 1 client.4833 shutdown 2024-01-25T15:04:54.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.676+0000 7f2ebd029740 1 -- 172.21.15.29:0/2852550108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf609c0 msgr2=0x555fccf6ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:54.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.676+0000 7f2ebd029740 1 --2- 172.21.15.29:0/2852550108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf609c0 0x555fccf6ca80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2eac07a810 tx=0x7f2eac07ecf0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.676+0000 7f2ebd029740 1 -- 172.21.15.29:0/2852550108 shutdown_connections 2024-01-25T15:04:54.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.676+0000 7f2ebd029740 1 --2- 172.21.15.29:0/2852550108 >> [v2:172.21.15.52:6835/417879912,v1:172.21.15.52:6837/417879912] conn(0x555fccf3f690 0x555fccf3fa70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.676+0000 7f2ebd029740 1 --2- 172.21.15.29:0/2852550108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf609c0 0x555fccf6ca80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.676+0000 7f2ebd029740 1 --2- 172.21.15.29:0/2852550108 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x555fccf5c580 0x555fccf5aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.676+0000 7f2ebd029740 1 --2- 172.21.15.29:0/2852550108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fccf21200 0x555fccf61720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.676+0000 7f2ebd029740 1 -- 172.21.15.29:0/2852550108 >> 172.21.15.29:0/2852550108 conn(0x555fccf1fef0 msgr2=0x555fccf5f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:54.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.676+0000 7f2e92ffd640 0 client.4833 ms_handle_reset on v2:172.21.15.52:6835/417879912 2024-01-25T15:04:54.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.677+0000 7f2ebd029740 1 -- 172.21.15.29:0/2852550108 shutdown_connections 2024-01-25T15:04:54.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.677+0000 7f2ebd029740 1 -- 172.21.15.29:0/2852550108 wait complete. 2024-01-25T15:04:54.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.677+0000 7f2ebd029740 20 client.4833 trim_cache size 0 max 16384 2024-01-25T15:04:54.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.692+0000 7f2ebd029740 1 Processor -- start 2024-01-25T15:04:54.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.692+0000 7f2ebd029740 1 -- start start 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.693+0000 7f2ebd029740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf21200 0x555fccf3cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.693+0000 7f2ebd029740 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x555fccf5c580 0x555fccf3d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.693+0000 7f2ebd029740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fccf609c0 0x555fccf2d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.693+0000 7f2ebd029740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fccf6c090 con 0x555fccf21200 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.693+0000 7f2ebd029740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fccf1d860 con 0x555fccf609c0 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.693+0000 7f2ebd029740 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x555fcce27c20 con 0x555fccf5c580 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.693+0000 7f2eb3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf21200 0x555fccf3cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.693+0000 7f2eb3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf21200 0x555fccf3cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45090/0 (socket says 172.21.15.29:45090) 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.693+0000 7f2eb3fff640 1 -- 172.21.15.29:0/308334800 learned_addr learned my addr 172.21.15.29:0/308334800 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.693+0000 7f2eb89f9640 1 --2- 172.21.15.29:0/308334800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fccf609c0 0x555fccf2d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.693+0000 7f2eb37fe640 1 --2- 172.21.15.29:0/308334800 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x555fccf5c580 0x555fccf3d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.693+0000 7f2eb3fff640 1 -- 172.21.15.29:0/308334800 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x555fccf5c580 msgr2=0x555fccf3d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.693+0000 7f2eb3fff640 1 --2- 172.21.15.29:0/308334800 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x555fccf5c580 0x555fccf3d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.693+0000 7f2eb3fff640 1 -- 172.21.15.29:0/308334800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fccf609c0 msgr2=0x555fccf2d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.693+0000 7f2eb3fff640 1 --2- 172.21.15.29:0/308334800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fccf609c0 0x555fccf2d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.693+0000 7f2eb3fff640 1 -- 172.21.15.29:0/308334800 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fccf5a210 con 0x555fccf21200 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.693+0000 7f2eb89f9640 1 --2- 172.21.15.29:0/308334800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fccf609c0 0x555fccf2d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.693+0000 7f2eb37fe640 1 --2- 172.21.15.29:0/308334800 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x555fccf5c580 0x555fccf3d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.693+0000 7f2eb3fff640 1 --2- 172.21.15.29:0/308334800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf21200 0x555fccf3cb70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4012010 tx=0x7f2ea4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b1698a264bdcc1 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.694+0000 7f2e997fa640 1 -- 172.21.15.29:0/308334800 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4030070 con 0x555fccf21200 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.694+0000 7f2e997fa640 1 -- 172.21.15.29:0/308334800 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea4031040 con 0x555fccf21200 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.694+0000 7f2e997fa640 1 -- 172.21.15.29:0/308334800 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4034a90 con 0x555fccf21200 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.694+0000 7f2ebd029740 1 -- 172.21.15.29:0/308334800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf21200 msgr2=0x555fccf3cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.694+0000 7f2ebd029740 1 --2- 172.21.15.29:0/308334800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf21200 0x555fccf3cb70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4012010 tx=0x7f2ea4016000 comp rx=0 tx=0).stop 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.694+0000 7f2ebd029740 1 -- 172.21.15.29:0/308334800 shutdown_connections 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.694+0000 7f2ebd029740 1 --2- 172.21.15.29:0/308334800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fccf609c0 0x555fccf2d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.694+0000 7f2ebd029740 1 --2- 172.21.15.29:0/308334800 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x555fccf5c580 0x555fccf3d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.694+0000 7f2ebd029740 1 --2- 172.21.15.29:0/308334800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf21200 0x555fccf3cb70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.694+0000 7f2ebd029740 1 -- 172.21.15.29:0/308334800 >> 172.21.15.29:0/308334800 conn(0x555fccf1fef0 msgr2=0x555fccf7ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.694+0000 7f2ebd029740 1 -- 172.21.15.29:0/308334800 shutdown_connections 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.694+0000 7f2ebd029740 1 -- 172.21.15.29:0/308334800 wait complete. 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.695+0000 7f2ebd029740 1 -- start start 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.695+0000 7f2ebd029740 1 Processor -- start 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.695+0000 7f2ebd029740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fccf21200 0x555fccfc74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2ebd029740 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x555fccf5c580 0x555fccf5d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2ebd029740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf609c0 0x555fccfca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2ebd029740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fccf577f0 con 0x555fccf609c0 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2ebd029740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fccfc7010 con 0x555fccf21200 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2ebd029740 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x555fccf57320 con 0x555fccf5c580 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2ebd029740 10 client.0 _ll_register_callbacks cb 0x7f2ea4009320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2eb89f9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf609c0 0x555fccfca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2eb89f9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf609c0 0x555fccfca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45100/0 (socket says 172.21.15.29:45100) 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2eb89f9640 1 -- 172.21.15.29:0/2308699430 learned_addr learned my addr 172.21.15.29:0/2308699430 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2eb3fff640 1 --2- 172.21.15.29:0/2308699430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fccf21200 0x555fccfc74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2eb37fe640 1 --2- 172.21.15.29:0/2308699430 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x555fccf5c580 0x555fccf5d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2eb89f9640 1 -- 172.21.15.29:0/2308699430 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x555fccf5c580 msgr2=0x555fccf5d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2eb89f9640 1 --2- 172.21.15.29:0/2308699430 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x555fccf5c580 0x555fccf5d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2eb89f9640 1 -- 172.21.15.29:0/2308699430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fccf21200 msgr2=0x555fccfc74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2eb89f9640 1 --2- 172.21.15.29:0/2308699430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fccf21200 0x555fccfc74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2eb89f9640 1 -- 172.21.15.29:0/2308699430 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555fcce49680 con 0x555fccf609c0 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2eb37fe640 1 --2- 172.21.15.29:0/2308699430 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x555fccf5c580 0x555fccf5d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2eb89f9640 1 --2- 172.21.15.29:0/2308699430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf609c0 0x555fccfca100 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2eac02bd20 tx=0x7f2eac0aa2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e355ad2691056f server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2e92ffd640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2e92ffd640 1 -- 172.21.15.29:0/2308699430 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac07af80 con 0x555fccf609c0 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2e92ffd640 1 -- 172.21.15.29:0/2308699430 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2eac07ab10 con 0x555fccf609c0 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2ebd029740 1 -- 172.21.15.29:0/2308699430 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2ea40213f0 con 0x555fccf609c0 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2e92ffd640 1 -- 172.21.15.29:0/2308699430 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2eac07a000 con 0x555fccf609c0 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2ebd029740 10 client.4839 fetch_fsmap learned FSMap version 9 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.696+0000 7f2ebd029740 1 -- 172.21.15.29:0/2308699430 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x555fcce22390 con 0x555fccf609c0 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.697+0000 7f2e92ffd640 1 -- 172.21.15.29:0/2308699430 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea40213f0 con 0x555fccf609c0 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.697+0000 7f2e92ffd640 1 -- 172.21.15.29:0/2308699430 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f2eac050070 con 0x555fccf609c0 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.697+0000 7f2ebd029740 10 client.4839 fetch_fsmap finished waiting for FSMap version 9 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.697+0000 7f2ebd029740 10 client.4839 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.697+0000 7f2ebd029740 20 client.4839 populate_metadata read hostname 'smithi029' 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.697+0000 7f2ebd029740 1 --2- 172.21.15.29:0/2308699430 >> [v2:172.21.15.52:6835/417879912,v1:172.21.15.52:6837/417879912] conn(0x555fccfca640 0x555fccfcaa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:54.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.697+0000 7f2ebd029740 4 client.4839 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-25T15:04:54.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.697+0000 7f2ebd029740 1 -- 172.21.15.29:0/2308699430 --> [v2:172.21.15.52:6835/417879912,v1:172.21.15.52:6837/417879912] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555fccb866c0 con 0x555fccfca640 2024-01-25T15:04:54.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.697+0000 7f2eb3fff640 1 --2- 172.21.15.29:0/2308699430 >> [v2:172.21.15.52:6835/417879912,v1:172.21.15.52:6837/417879912] conn(0x555fccfca640 0x555fccfcaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:54.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.697+0000 7f2e92ffd640 10 client.4839 ms_handle_connect on v2:172.21.15.52:6835/417879912 2024-01-25T15:04:54.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.697+0000 7f2eb3fff640 1 --2- 172.21.15.29:0/2308699430 >> [v2:172.21.15.52:6835/417879912,v1:172.21.15.52:6837/417879912] conn(0x555fccfca640 0x555fccfcaa20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56ac007d11f97aa2 server_cookie=beb1fb05b2e97288 in_seq=0 out_seq=0 2024-01-25T15:04:54.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.697+0000 7f2e92ffd640 1 -- 172.21.15.29:0/2308699430 <== mds.0 v2:172.21.15.52:6835/417879912 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x555fccb866c0 con 0x555fccfca640 2024-01-25T15:04:54.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.697+0000 7f2e92ffd640 10 client.4839 handle_command_reply: tid=0 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.697+0000 7f2ebd029740 1 client.4839 shutdown 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2ebd029740 1 -- 172.21.15.29:0/2308699430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf609c0 msgr2=0x555fccfca100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2ebd029740 1 --2- 172.21.15.29:0/2308699430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf609c0 0x555fccfca100 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2eac02bd20 tx=0x7f2eac0aa2d0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2ebd029740 1 -- 172.21.15.29:0/2308699430 shutdown_connections 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2ebd029740 1 --2- 172.21.15.29:0/2308699430 >> [v2:172.21.15.52:6835/417879912,v1:172.21.15.52:6837/417879912] conn(0x555fccfca640 0x555fccfcaa20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2ebd029740 1 --2- 172.21.15.29:0/2308699430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555fccf609c0 0x555fccfca100 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2ebd029740 1 --2- 172.21.15.29:0/2308699430 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x555fccf5c580 0x555fccf5d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2e92ffd640 0 client.4839 ms_handle_reset on v2:172.21.15.52:6835/417879912 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2ebd029740 1 --2- 172.21.15.29:0/2308699430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fccf21200 0x555fccfc74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2ebd029740 1 -- 172.21.15.29:0/2308699430 >> 172.21.15.29:0/2308699430 conn(0x555fccf1fef0 msgr2=0x555fccf6c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2ebd029740 1 -- 172.21.15.29:0/2308699430 shutdown_connections 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2ebd029740 1 -- 172.21.15.29:0/2308699430 wait complete. 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2ebd029740 20 client.4839 trim_cache size 0 max 16384 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "3f65c5fb-9e8c-471f-b2c4-a9841e901c7a", 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4285, 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 27.152257617, 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 9, 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 24, 2024-01-25T15:04:54.711 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 24, 2024-01-25T15:04:54.711 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 34.188839336000001 2024-01-25T15:04:54.711 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-25T15:04:54.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2eba45c640 1 -- 172.21.15.29:0/2479193205 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2ea006aed0 msgr2=0x7f2ea006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:54.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2eba45c640 1 --2- 172.21.15.29:0/2479193205 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2ea006aed0 0x7f2ea006d390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2eb40bd370 tx=0x7f2ea4009190 comp rx=0 tx=0).stop 2024-01-25T15:04:54.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2eba45c640 1 -- 172.21.15.29:0/2479193205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2eb4155210 msgr2=0x7f2eb414b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:54.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2eba45c640 1 --2- 172.21.15.29:0/2479193205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2eb4155210 0x7f2eb414b330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009d90 tx=0x7f2eac004a40 comp rx=0 tx=0).stop 2024-01-25T15:04:54.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2eba45c640 1 -- 172.21.15.29:0/2479193205 shutdown_connections 2024-01-25T15:04:54.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2eba45c640 1 --2- 172.21.15.29:0/2479193205 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2ea006aed0 0x7f2ea006d390 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2eba45c640 1 --2- 172.21.15.29:0/2479193205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2eb4155210 0x7f2eb414b330 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2eba45c640 1 --2- 172.21.15.29:0/2479193205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eb4151d80 0x7f2eb40af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2eba45c640 1 --2- 172.21.15.29:0/2479193205 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2eb406c370 0x7f2eb40aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:54.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2eba45c640 1 -- 172.21.15.29:0/2479193205 >> 172.21.15.29:0/2479193205 conn(0x7f2eb40abd80 msgr2=0x7f2eb414e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:54.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.698+0000 7f2eba45c640 1 -- 172.21.15.29:0/2479193205 shutdown_connections 2024-01-25T15:04:54.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:54.699+0000 7f2eba45c640 1 -- 172.21.15.29:0/2479193205 wait complete. 2024-01-25T15:04:54.713 INFO:teuthology.run_tasks:Running task kclient... 2024-01-25T15:04:54.727 INFO:tasks.kclient:Mounting kernel clients... 2024-01-25T15:04:54.727 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-01-25T15:04:54.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:54.727 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-01-25T15:04:54.742 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-01-25T15:04:54.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:54.743 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-25T15:04:54.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:54.810 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2024-01-25T15:04:54.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:54.908 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-01-25T15:04:54.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:54.928 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2024-01-25T15:04:55.002 INFO:teuthology.orchestra.run.smithi052.stderr:Cannot find device "ceph-brx" 2024-01-25T15:04:55.004 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T15:04:55.004 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-01-25T15:04:55.004 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-25T15:04:55.004 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-25T15:04:55.005 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-25T15:04:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.107+0000 7f24911e3640 1 Processor -- start 2024-01-25T15:04:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.107+0000 7f24911e3640 1 -- start start 2024-01-25T15:04:55.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.107+0000 7f24911e3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f248c0c55e0 0x7f248c155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:55.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.107+0000 7f24911e3640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f248c0c4f00 0x7f248c0c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:55.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.107+0000 7f24911e3640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f248c0c66c0 con 0x7f248c1520b0 2024-01-25T15:04:55.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.107+0000 7f24911e3640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f248c06cfc0 con 0x7f248c0c55e0 2024-01-25T15:04:55.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.107+0000 7f24911e3640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248c152490 con 0x7f248c0c4f00 2024-01-25T15:04:55.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.108+0000 7f248b59e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f248c0c4f00 0x7f248c0c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:55.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.108+0000 7f2483fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f248c0c55e0 0x7f248c155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:55.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.108+0000 7f2483fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f248c0c55e0 0x7f248c155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:34024/0 (socket says 172.21.15.29:34024) 2024-01-25T15:04:55.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.108+0000 7f248b59e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f248c0c4f00 0x7f248c0c5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:41022/0 (socket says 172.21.15.29:41022) 2024-01-25T15:04:55.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.108+0000 7f248ad9d640 1 --1- 172.21.15.29:0/1314998526 >> v1:172.21.15.52:6789/0 conn(0x7f248c1520b0 0x7f248c0c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:49892/0 (socket says 172.21.15.29:49892) 2024-01-25T15:04:55.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.108+0000 7f2483fff640 1 -- 172.21.15.29:0/1314998526 learned_addr learned my addr 172.21.15.29:0/1314998526 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:55.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.108+0000 7f2483fff640 1 -- 172.21.15.29:0/1314998526 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f248c0c4f00 msgr2=0x7f248c0c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:55.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.108+0000 7f2483fff640 1 --2- 172.21.15.29:0/1314998526 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f248c0c4f00 0x7f248c0c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:55.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.108+0000 7f2483fff640 1 -- 172.21.15.29:0/1314998526 >> v1:172.21.15.52:6789/0 conn(0x7f248c1520b0 legacy=0x7f248c0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:55.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.108+0000 7f2483fff640 1 -- 172.21.15.29:0/1314998526 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248c0c8830 con 0x7f248c0c55e0 2024-01-25T15:04:55.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.108+0000 7f248b59e640 1 --2- 172.21.15.29:0/1314998526 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f248c0c4f00 0x7f248c0c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:55.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.109+0000 7f2483fff640 1 --2- 172.21.15.29:0/1314998526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f248c0c55e0 0x7f248c155570 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2474009870 tx=0x7f247402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46b2d74473db966b server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:55.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.109+0000 7f248a59c640 1 -- 172.21.15.29:0/1314998526 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474031640 con 0x7f248c0c55e0 2024-01-25T15:04:55.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.109+0000 7f248a59c640 1 -- 172.21.15.29:0/1314998526 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24740317a0 con 0x7f248c0c55e0 2024-01-25T15:04:55.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.109+0000 7f248a59c640 1 -- 172.21.15.29:0/1314998526 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474031b30 con 0x7f248c0c55e0 2024-01-25T15:04:55.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.110+0000 7f24911e3640 1 -- 172.21.15.29:0/1314998526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f248c0c55e0 msgr2=0x7f248c155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:55.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.110+0000 7f24911e3640 1 --2- 172.21.15.29:0/1314998526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f248c0c55e0 0x7f248c155570 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2474009870 tx=0x7f247402b8f0 comp rx=0 tx=0).stop 2024-01-25T15:04:55.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.110+0000 7f24911e3640 1 -- 172.21.15.29:0/1314998526 shutdown_connections 2024-01-25T15:04:55.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.110+0000 7f24911e3640 1 --2- 172.21.15.29:0/1314998526 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f248c0c4f00 0x7f248c0c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:55.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.110+0000 7f24911e3640 1 --2- 172.21.15.29:0/1314998526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f248c0c55e0 0x7f248c155570 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:55.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.110+0000 7f24911e3640 1 -- 172.21.15.29:0/1314998526 >> 172.21.15.29:0/1314998526 conn(0x7f248c0ca220 msgr2=0x7f248c0ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:55.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.110+0000 7f24911e3640 1 -- 172.21.15.29:0/1314998526 shutdown_connections 2024-01-25T15:04:55.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.110+0000 7f24911e3640 1 -- 172.21.15.29:0/1314998526 wait complete. 2024-01-25T15:04:55.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.111+0000 7f24911e3640 1 Processor -- start 2024-01-25T15:04:55.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.111+0000 7f24911e3640 1 -- start start 2024-01-25T15:04:55.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.112+0000 7f24911e3640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f248c0c4f00 0x7f248c1eac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:55.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.112+0000 7f24911e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f248c1520b0 0x7f248c0ab060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:55.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.112+0000 7f24911e3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f248c0c1cb0 0x7f248c1ed7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:55.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.112+0000 7f24911e3640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c1ea800 con 0x7f248c0c1cb0 2024-01-25T15:04:55.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.112+0000 7f24911e3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c150740 con 0x7f248c1520b0 2024-01-25T15:04:55.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.112+0000 7f24911e3640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248c1ea1d0 con 0x7f248c0c4f00 2024-01-25T15:04:55.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.112+0000 7f248b59e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f248c0c1cb0 0x7f248c1ed7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:55.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.112+0000 7f248ad9d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f248c0c4f00 0x7f248c1eac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:55.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.112+0000 7f248b59e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f248c0c1cb0 0x7f248c1ed7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45114/0 (socket says 172.21.15.29:45114) 2024-01-25T15:04:55.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.112+0000 7f248b59e640 1 -- 172.21.15.29:0/2986273261 learned_addr learned my addr 172.21.15.29:0/2986273261 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:55.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.112+0000 7f2483fff640 1 --2- 172.21.15.29:0/2986273261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f248c1520b0 0x7f248c0ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:55.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.112+0000 7f248ad9d640 1 -- 172.21.15.29:0/2986273261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f248c1520b0 msgr2=0x7f248c0ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:55.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.112+0000 7f248ad9d640 1 --2- 172.21.15.29:0/2986273261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f248c1520b0 0x7f248c0ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:55.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.112+0000 7f248ad9d640 1 -- 172.21.15.29:0/2986273261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f248c0c1cb0 msgr2=0x7f248c1ed7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:55.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.112+0000 7f248ad9d640 1 --2- 172.21.15.29:0/2986273261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f248c0c1cb0 0x7f248c1ed7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:55.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.112+0000 7f248ad9d640 1 -- 172.21.15.29:0/2986273261 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2484009a70 con 0x7f248c0c4f00 2024-01-25T15:04:55.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.112+0000 7f248b59e640 1 --2- 172.21.15.29:0/2986273261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f248c0c1cb0 0x7f248c1ed7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:55.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.112+0000 7f2483fff640 1 --2- 172.21.15.29:0/2986273261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f248c1520b0 0x7f248c0ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:55.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.112+0000 7f248ad9d640 1 --2- 172.21.15.29:0/2986273261 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f248c0c4f00 0x7f248c1eac90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f247c000f60 tx=0x7f247c00c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:55.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.113+0000 7f24837fe640 1 -- 172.21.15.29:0/2986273261 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c0074e0 con 0x7f248c0c4f00 2024-01-25T15:04:55.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.113+0000 7f24837fe640 1 -- 172.21.15.29:0/2986273261 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247c007660 con 0x7f248c0c4f00 2024-01-25T15:04:55.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.113+0000 7f24911e3640 1 -- 172.21.15.29:0/2986273261 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24740094d0 con 0x7f248c0c4f00 2024-01-25T15:04:55.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.113+0000 7f24837fe640 1 -- 172.21.15.29:0/2986273261 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c004a20 con 0x7f248c0c4f00 2024-01-25T15:04:55.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.113+0000 7f24911e3640 1 -- 172.21.15.29:0/2986273261 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f248c1ea490 con 0x7f248c0c4f00 2024-01-25T15:04:55.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.114+0000 7f24911e3640 1 -- 172.21.15.29:0/2986273261 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f248c06d280 con 0x7f248c0c4f00 2024-01-25T15:04:55.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.114+0000 7f24837fe640 1 -- 172.21.15.29:0/2986273261 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f247c004b80 con 0x7f248c0c4f00 2024-01-25T15:04:55.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.115+0000 7f24837fe640 1 --2- 172.21.15.29:0/2986273261 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f246c06af00 0x7f246c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:55.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.115+0000 7f24837fe640 1 -- 172.21.15.29:0/2986273261 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f247c035e40 con 0x7f248c0c4f00 2024-01-25T15:04:55.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.115+0000 7f2483fff640 1 --2- 172.21.15.29:0/2986273261 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f246c06af00 0x7f246c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:55.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.115+0000 7f2483fff640 1 --2- 172.21.15.29:0/2986273261 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f246c06af00 0x7f246c06d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2474036000 tx=0x7f247403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:55.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.119+0000 7f24837fe640 1 -- 172.21.15.29:0/2986273261 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f247c054100 con 0x7f248c0c4f00 2024-01-25T15:04:55.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.341+0000 7f24911e3640 1 -- 172.21.15.29:0/2986273261 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f248c1ea620 con 0x7f248c0c4f00 2024-01-25T15:04:55.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.342+0000 7f24837fe640 1 -- 172.21.15.29:0/2986273261 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f247c057720 con 0x7f248c0c4f00 2024-01-25T15:04:55.342 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-25T15:04:55.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.344+0000 7f24911e3640 1 -- 172.21.15.29:0/2986273261 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f246c06af00 msgr2=0x7f246c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:55.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.344+0000 7f24911e3640 1 --2- 172.21.15.29:0/2986273261 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f246c06af00 0x7f246c06d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2474036000 tx=0x7f247403c040 comp rx=0 tx=0).stop 2024-01-25T15:04:55.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.344+0000 7f24911e3640 1 -- 172.21.15.29:0/2986273261 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f248c0c4f00 msgr2=0x7f248c1eac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:55.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.344+0000 7f24911e3640 1 --2- 172.21.15.29:0/2986273261 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f248c0c4f00 0x7f248c1eac90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f247c000f60 tx=0x7f247c00c760 comp rx=0 tx=0).stop 2024-01-25T15:04:55.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.344+0000 7f24911e3640 1 -- 172.21.15.29:0/2986273261 shutdown_connections 2024-01-25T15:04:55.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.344+0000 7f24911e3640 1 --2- 172.21.15.29:0/2986273261 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f246c06af00 0x7f246c06d3c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:55.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.344+0000 7f24911e3640 1 --2- 172.21.15.29:0/2986273261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f248c0c1cb0 0x7f248c1ed7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:55.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.344+0000 7f24911e3640 1 --2- 172.21.15.29:0/2986273261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f248c1520b0 0x7f248c0ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:55.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.344+0000 7f24911e3640 1 --2- 172.21.15.29:0/2986273261 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f248c0c4f00 0x7f248c1eac90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:55.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.344+0000 7f24911e3640 1 -- 172.21.15.29:0/2986273261 >> 172.21.15.29:0/2986273261 conn(0x7f248c0ca220 msgr2=0x7f248c1553c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:55.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.344+0000 7f24911e3640 1 -- 172.21.15.29:0/2986273261 shutdown_connections 2024-01-25T15:04:55.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:55.344+0000 7f24911e3640 1 -- 172.21.15.29:0/2986273261 wait complete. 2024-01-25T15:04:55.355 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-25T15:04:55.355 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-25T15:04:55.355 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-01-25T15:04:55.355 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-25T15:04:55.355 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-25T15:04:55.355 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-25T15:04:55.355 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-25T15:04:55.356 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-25T15:04:55.356 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-25T15:04:55.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:55.356 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-01-25T15:04:55.370 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-25T15:04:55.370 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-25T15:04:55.370 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-01-25T15:04:55.370 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:04:55.370 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-01-25T15:04:55.371 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:04:55.371 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:04:55.371 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-01-25T15:04:55.371 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2024-01-25T15:04:55.371 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:04:55.371 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-01-25T15:04:55.371 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2024-01-25T15:04:55.371 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-25T15:04:55.371 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-01-25T15:04:55.371 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2024-01-25T15:04:55.371 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-01-25T15:04:55.371 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42692sec preferred_lft 42692sec 2024-01-25T15:04:55.371 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link noprefixroute 2024-01-25T15:04:55.372 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:04:55.372 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:04:55.372 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-01-25T15:04:55.372 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2024-01-25T15:04:55.372 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-25T15:04:55.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:55.372 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-25T15:04:55.372 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-25T15:04:55.372 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add name ceph-brx type bridge 2024-01-25T15:04:55.372 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr flush dev ceph-brx 2024-01-25T15:04:55.372 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set ceph-brx up 2024-01-25T15:04:55.373 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-25T15:04:55.373 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-25T15:04:55.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:55.478 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-25T15:04:55.503 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-01-25T15:04:55.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:55.505 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-01-25T15:04:55.561 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-01-25T15:04:55.561 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-25T15:04:55.561 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-01-25T15:04:55.561 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-01-25T15:04:55.561 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-25T15:04:55.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:55.562 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-25T15:04:55.562 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-25T15:04:55.562 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-25T15:04:55.562 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-25T15:04:55.562 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-25T15:04:55.562 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-25T15:04:55.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:55.659 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-01-25T15:04:55.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:55.673 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2024-01-25T15:04:55.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:55.728 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-25T15:04:55.728 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-25T15:04:55.728 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-25T15:04:55.728 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-25T15:04:55.728 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-25T15:04:55.811 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-25T15:04:55.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:55.811 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-25T15:04:55.811 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-25T15:04:55.811 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-25T15:04:55.811 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-25T15:04:55.811 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-25T15:04:55.811 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-25T15:04:55.811 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-25T15:04:55.811 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-25T15:04:55.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:55.935 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-25T15:04:55.936 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-25T15:04:55.936 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2024-01-25T15:04:55.936 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.0 master ceph-brx 2024-01-25T15:04:55.936 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-25T15:04:55.976 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-25T15:04:55.977 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-25T15:04:56.032 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-25T15:04:56.032 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-25T15:04:56.032 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-25T15:04:56.086 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-01-25T15:04:56.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:56.086 DEBUG:teuthology.orchestra.run.smithi029:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-25T15:04:56.170 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-25T15:04:56.170 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-25T15:04:56.309 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-25T15:04:56.309 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-25T15:04:56.309 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.52:3300,172.21.15.52:3301" 2024-01-25T15:04:56.309 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with new device syntax: 0@3f65c5fb-9e8c-471f-b2c4-a9841e901c7a.cephfs=/ 2024-01-25T15:04:56.309 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.29:3300/172.21.15.52:3300/172.21.15.52:3301" will pass to kernel 2024-01-25T15:04:56.312 INFO:teuthology.orchestra.run.smithi029.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-01-25T15:04:56.312 INFO:teuthology.orchestra.run.smithi029.stdout: You just mounted a file system that supports labels which does not 2024-01-25T15:04:56.312 INFO:teuthology.orchestra.run.smithi029.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-25T15:04:56.312 INFO:teuthology.orchestra.run.smithi029.stdout: applications will generate AVC messages and not be allowed access to 2024-01-25T15:04:56.312 INFO:teuthology.orchestra.run.smithi029.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-25T15:04:56.312 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-25T15:04:56.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:56.312 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-25T15:04:56.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:56.382 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-25T15:04:56.438 INFO:teuthology.orchestra.run.smithi029.stdout:client4783 2024-01-25T15:04:56.438 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:04:56.438 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:04:56.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:56.493 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-25T15:04:56.549 INFO:teuthology.orchestra.run.smithi029.stdout:client4783 2024-01-25T15:04:56.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:56.549 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-25T15:04:56.605 INFO:teuthology.orchestra.run.smithi029.stdout:client4783 2024-01-25T15:04:56.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:56.606 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/3f65c5fb-9e8c-471f-b2c4-a9841e901c7a.client4783/status') 2024-01-25T15:04:56.672 INFO:teuthology.orchestra.run.smithi029.stdout:instance: client.4783 (3)172.21.15.29:0/318818282 2024-01-25T15:04:56.672 INFO:teuthology.orchestra.run.smithi029.stdout:blocklisted: false 2024-01-25T15:04:56.672 INFO:teuthology.orchestra.run.smithi029.stderr:0+1 records in 2024-01-25T15:04:56.672 INFO:teuthology.orchestra.run.smithi029.stderr:0+1 records out 2024-01-25T15:04:56.672 INFO:teuthology.orchestra.run.smithi029.stderr:69 bytes copied, 2.0755e-05 s, 3.3 MB/s 2024-01-25T15:04:56.673 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-01-25T15:04:56.673 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-25T15:04:56.674 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-25T15:04:56.674 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-25T15:04:56.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.815+0000 7f0100e09640 1 Processor -- start 2024-01-25T15:04:56.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.815+0000 7f0100e09640 1 -- start start 2024-01-25T15:04:56.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.815+0000 7f0100e09640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f00fc152160 0x7f00fc06bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:56.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.815+0000 7f0100e09640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f00fc0c4990 0x7f00fc0c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:56.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.815+0000 7f0100e09640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00fc155430 con 0x7f00fc0c53e0 2024-01-25T15:04:56.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.815+0000 7f0100e09640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00fc154b40 con 0x7f00fc152160 2024-01-25T15:04:56.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.815+0000 7f0100e09640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00fc152540 con 0x7f00fc0c4990 2024-01-25T15:04:56.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.815+0000 7f00fa59c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f00fc152160 0x7f00fc06bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:56.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.816+0000 7f00fa59c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f00fc152160 0x7f00fc06bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40602/0 (socket says 172.21.15.29:40602) 2024-01-25T15:04:56.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.816+0000 7f00fa59c640 1 -- 172.21.15.29:0/1216274819 learned_addr learned my addr 172.21.15.29:0/1216274819 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:56.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.816+0000 7f00f3fff640 1 --2- 172.21.15.29:0/1216274819 >> v2:172.21.15.52:3300/0 conn(0x7f00fc0c4990 0x7f00fc0c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:56.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.816+0000 7f00fa59c640 1 -- 172.21.15.29:0/1216274819 >> v2:172.21.15.52:3300/0 conn(0x7f00fc0c4990 msgr2=0x7f00fc0c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:56.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.816+0000 7f00fa59c640 1 --2- 172.21.15.29:0/1216274819 >> v2:172.21.15.52:3300/0 conn(0x7f00fc0c4990 0x7f00fc0c4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:56.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.816+0000 7f00fa59c640 1 -- 172.21.15.29:0/1216274819 >> v1:172.21.15.52:6789/0 conn(0x7f00fc0c53e0 legacy=0x7f00fc0c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:56.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.816+0000 7f00fa59c640 1 -- 172.21.15.29:0/1216274819 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00fc0c64b0 con 0x7f00fc152160 2024-01-25T15:04:56.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.817+0000 7f00fa59c640 1 --2- 172.21.15.29:0/1216274819 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00fc152160 0x7f00fc06bc00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0acaf0 tx=0x7f00ec02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70505211916bb2c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:56.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.817+0000 7f00f9d9b640 1 -- 172.21.15.29:0/1216274819 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec031870 con 0x7f00fc152160 2024-01-25T15:04:56.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.817+0000 7f00f9d9b640 1 -- 172.21.15.29:0/1216274819 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec0319d0 con 0x7f00fc152160 2024-01-25T15:04:56.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.817+0000 7f00f9d9b640 1 -- 172.21.15.29:0/1216274819 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec031d60 con 0x7f00fc152160 2024-01-25T15:04:56.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.817+0000 7f0100e09640 1 -- 172.21.15.29:0/1216274819 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00fc152160 msgr2=0x7f00fc06bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:56.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.817+0000 7f0100e09640 1 --2- 172.21.15.29:0/1216274819 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00fc152160 0x7f00fc06bc00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0acaf0 tx=0x7f00ec02b910 comp rx=0 tx=0).stop 2024-01-25T15:04:56.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.817+0000 7f0100e09640 1 -- 172.21.15.29:0/1216274819 shutdown_connections 2024-01-25T15:04:56.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.817+0000 7f0100e09640 1 --2- 172.21.15.29:0/1216274819 >> v2:172.21.15.52:3300/0 conn(0x7f00fc0c4990 0x7f00fc0c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:56.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.817+0000 7f0100e09640 1 --2- 172.21.15.29:0/1216274819 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00fc152160 0x7f00fc06bc00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:56.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.817+0000 7f0100e09640 1 -- 172.21.15.29:0/1216274819 >> 172.21.15.29:0/1216274819 conn(0x7f00fc0ca1f0 msgr2=0x7f00fc0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:56.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.817+0000 7f0100e09640 1 -- 172.21.15.29:0/1216274819 shutdown_connections 2024-01-25T15:04:56.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.817+0000 7f0100e09640 1 -- 172.21.15.29:0/1216274819 wait complete. 2024-01-25T15:04:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.819+0000 7f0100e09640 1 Processor -- start 2024-01-25T15:04:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.819+0000 7f0100e09640 1 -- start start 2024-01-25T15:04:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.820+0000 7f0100e09640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00fc0c4990 0x7f00fc14da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.820+0000 7f0100e09640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00fc0c53e0 0x7f00fc1562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.820+0000 7f0100e09640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00fc152160 0x7f00fc1ea360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.820+0000 7f0100e09640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc157fa0 con 0x7f00fc0c53e0 2024-01-25T15:04:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.820+0000 7f0100e09640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc14df90 con 0x7f00fc0c4990 2024-01-25T15:04:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.820+0000 7f0100e09640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc14d5c0 con 0x7f00fc152160 2024-01-25T15:04:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.820+0000 7f00f3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00fc0c53e0 0x7f00fc1562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.820+0000 7f00f3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00fc0c53e0 0x7f00fc1562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40608/0 (socket says 172.21.15.29:40608) 2024-01-25T15:04:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.820+0000 7f00f3fff640 1 -- 172.21.15.29:0/3336562103 learned_addr learned my addr 172.21.15.29:0/3336562103 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.820+0000 7f00fa59c640 1 --2- 172.21.15.29:0/3336562103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00fc0c4990 0x7f00fc14da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.820+0000 7f00fad9d640 1 --2- 172.21.15.29:0/3336562103 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00fc152160 0x7f00fc1ea360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.820+0000 7f00f3fff640 1 -- 172.21.15.29:0/3336562103 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00fc152160 msgr2=0x7f00fc1ea360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.820+0000 7f00f3fff640 1 --2- 172.21.15.29:0/3336562103 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00fc152160 0x7f00fc1ea360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.820+0000 7f00f3fff640 1 -- 172.21.15.29:0/3336562103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00fc0c4990 msgr2=0x7f00fc14da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.820+0000 7f00f3fff640 1 --2- 172.21.15.29:0/3336562103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00fc0c4990 0x7f00fc14da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.820+0000 7f00f3fff640 1 -- 172.21.15.29:0/3336562103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec0094d0 con 0x7f00fc0c53e0 2024-01-25T15:04:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.820+0000 7f00f3fff640 1 --2- 172.21.15.29:0/3336562103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00fc0c53e0 0x7f00fc1562b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f00e400e980 tx=0x7f00e400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.820+0000 7f00f2ffd640 1 -- 172.21.15.29:0/3336562103 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e4009670 con 0x7f00fc0c53e0 2024-01-25T15:04:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.820+0000 7f00f2ffd640 1 -- 172.21.15.29:0/3336562103 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e400ca00 con 0x7f00fc0c53e0 2024-01-25T15:04:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.820+0000 7f0100e09640 1 -- 172.21.15.29:0/3336562103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00fc14ff30 con 0x7f00fc0c53e0 2024-01-25T15:04:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.820+0000 7f00f2ffd640 1 -- 172.21.15.29:0/3336562103 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e400cd90 con 0x7f00fc0c53e0 2024-01-25T15:04:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.820+0000 7f0100e09640 1 -- 172.21.15.29:0/3336562103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00fc14eb50 con 0x7f00fc0c53e0 2024-01-25T15:04:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.821+0000 7f0100e09640 1 -- 172.21.15.29:0/3336562103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00fc1558a0 con 0x7f00fc0c53e0 2024-01-25T15:04:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.822+0000 7f00f2ffd640 1 -- 172.21.15.29:0/3336562103 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f00e4013470 con 0x7f00fc0c53e0 2024-01-25T15:04:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.822+0000 7f00f2ffd640 1 --2- 172.21.15.29:0/3336562103 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f00dc06af00 0x7f00dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.822+0000 7f00f2ffd640 1 -- 172.21.15.29:0/3336562103 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f00e40899b0 con 0x7f00fc0c53e0 2024-01-25T15:04:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.822+0000 7f00fa59c640 1 --2- 172.21.15.29:0/3336562103 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f00dc06af00 0x7f00dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:56.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.823+0000 7f00fa59c640 1 --2- 172.21.15.29:0/3336562103 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f00dc06af00 0x7f00dc06d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f00ec036000 tx=0x7f00ec03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:56.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:56.827+0000 7f00f2ffd640 1 -- 172.21.15.29:0/3336562103 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f00fc1558a0 con 0x7f00fc0c53e0 2024-01-25T15:04:57.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:57.043+0000 7f0100e09640 1 -- 172.21.15.29:0/3336562103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f00fc1558a0 con 0x7f00fc0c53e0 2024-01-25T15:04:57.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:57.044+0000 7f00f2ffd640 1 -- 172.21.15.29:0/3336562103 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f00e4021070 con 0x7f00fc0c53e0 2024-01-25T15:04:57.045 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-25T15:04:57.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:57.045+0000 7f0100e09640 1 -- 172.21.15.29:0/3336562103 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f00dc06af00 msgr2=0x7f00dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:57.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:57.045+0000 7f0100e09640 1 --2- 172.21.15.29:0/3336562103 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f00dc06af00 0x7f00dc06d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f00ec036000 tx=0x7f00ec03c040 comp rx=0 tx=0).stop 2024-01-25T15:04:57.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:57.045+0000 7f0100e09640 1 -- 172.21.15.29:0/3336562103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00fc0c53e0 msgr2=0x7f00fc1562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:57.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:57.045+0000 7f0100e09640 1 --2- 172.21.15.29:0/3336562103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00fc0c53e0 0x7f00fc1562b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f00e400e980 tx=0x7f00e400ee40 comp rx=0 tx=0).stop 2024-01-25T15:04:57.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:57.046+0000 7f0100e09640 1 -- 172.21.15.29:0/3336562103 shutdown_connections 2024-01-25T15:04:57.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:57.046+0000 7f0100e09640 1 --2- 172.21.15.29:0/3336562103 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00fc152160 0x7f00fc1ea360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:57.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:57.046+0000 7f0100e09640 1 --2- 172.21.15.29:0/3336562103 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f00dc06af00 0x7f00dc06d3c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:57.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:57.046+0000 7f0100e09640 1 --2- 172.21.15.29:0/3336562103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00fc0c53e0 0x7f00fc1562b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:57.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:57.046+0000 7f0100e09640 1 --2- 172.21.15.29:0/3336562103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00fc0c4990 0x7f00fc14da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:57.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:57.046+0000 7f0100e09640 1 -- 172.21.15.29:0/3336562103 >> 172.21.15.29:0/3336562103 conn(0x7f00fc0ca1f0 msgr2=0x7f00fc0c86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:57.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:57.046+0000 7f0100e09640 1 -- 172.21.15.29:0/3336562103 shutdown_connections 2024-01-25T15:04:57.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:57.046+0000 7f0100e09640 1 -- 172.21.15.29:0/3336562103 wait complete. 2024-01-25T15:04:57.057 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-25T15:04:57.057 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-25T15:04:57.057 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-01-25T15:04:57.057 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-25T15:04:57.057 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-25T15:04:57.057 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-25T15:04:57.057 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-25T15:04:57.057 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-25T15:04:57.057 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-25T15:04:57.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:57.058 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-01-25T15:04:57.076 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-25T15:04:57.076 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-25T15:04:57.076 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-01-25T15:04:57.076 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:04:57.076 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-01-25T15:04:57.076 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:04:57.076 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:04:57.076 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-01-25T15:04:57.076 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-01-25T15:04:57.077 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:04:57.077 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-01-25T15:04:57.077 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-01-25T15:04:57.077 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-25T15:04:57.077 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-01-25T15:04:57.077 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-01-25T15:04:57.077 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-01-25T15:04:57.077 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42680sec preferred_lft 42680sec 2024-01-25T15:04:57.077 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link noprefixroute 2024-01-25T15:04:57.077 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:04:57.077 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:04:57.077 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-01-25T15:04:57.077 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-01-25T15:04:57.078 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-25T15:04:57.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:57.078 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2024-01-25T15:04:57.078 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-01-25T15:04:57.078 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add name ceph-brx type bridge 2024-01-25T15:04:57.078 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr flush dev ceph-brx 2024-01-25T15:04:57.078 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set ceph-brx up 2024-01-25T15:04:57.078 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-25T15:04:57.078 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-01-25T15:04:57.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:57.255 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-25T15:04:57.286 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-01-25T15:04:57.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:57.288 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-01-25T15:04:57.363 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-01-25T15:04:57.363 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-25T15:04:57.363 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-01-25T15:04:57.363 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-01-25T15:04:57.363 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-25T15:04:57.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:57.364 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2024-01-25T15:04:57.364 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-01-25T15:04:57.364 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-25T15:04:57.364 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-25T15:04:57.364 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-25T15:04:57.364 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-01-25T15:04:57.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:57.648 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-01-25T15:04:57.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:57.663 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list-id 2024-01-25T15:04:57.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:57.718 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2024-01-25T15:04:57.718 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-01-25T15:04:57.718 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-25T15:04:57.718 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-01-25T15:04:57.718 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-01-25T15:04:57.802 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-01-25T15:04:57.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:57.802 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2024-01-25T15:04:57.802 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-01-25T15:04:57.802 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-01-25T15:04:57.803 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-25T15:04:57.803 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-01-25T15:04:57.803 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-01-25T15:04:57.803 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-01-25T15:04:57.803 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-01-25T15:04:57.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:57.939 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2024-01-25T15:04:57.939 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-01-25T15:04:57.939 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-01-25T15:04:57.939 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set dev brx.0 master ceph-brx 2024-01-25T15:04:57.939 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-01-25T15:04:57.981 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-25T15:04:57.982 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-25T15:04:58.036 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-25T15:04:58.037 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-25T15:04:58.037 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-25T15:04:58.090 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-01-25T15:04:58.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:58.090 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-25T15:04:58.184 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-25T15:04:58.184 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-25T15:04:58.297 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-25T15:04:58.297 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-25T15:04:58.297 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.52:3300,172.21.15.52:3301" 2024-01-25T15:04:58.297 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with new device syntax: 1@3f65c5fb-9e8c-471f-b2c4-a9841e901c7a.cephfs=/ 2024-01-25T15:04:58.297 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.29:3300/172.21.15.52:3300/172.21.15.52:3301" will pass to kernel 2024-01-25T15:04:58.298 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-01-25T15:04:58.298 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-01-25T15:04:58.298 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-25T15:04:58.298 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-01-25T15:04:58.298 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-25T15:04:58.300 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-25T15:04:58.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:58.300 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-25T15:04:58.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:58.331 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-25T15:04:58.387 INFO:teuthology.orchestra.run.smithi052.stdout:client4610 2024-01-25T15:04:58.387 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:04:58.387 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:04:58.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:58.442 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-25T15:04:58.497 INFO:teuthology.orchestra.run.smithi052.stdout:client4610 2024-01-25T15:04:58.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:58.498 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-25T15:04:58.554 INFO:teuthology.orchestra.run.smithi052.stdout:client4610 2024-01-25T15:04:58.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:04:58.554 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/3f65c5fb-9e8c-471f-b2c4-a9841e901c7a.client4610/status') 2024-01-25T15:04:58.620 INFO:teuthology.orchestra.run.smithi052.stdout:instance: client.4610 (3)192.168.0.1:0/1199234492 2024-01-25T15:04:58.620 INFO:teuthology.orchestra.run.smithi052.stdout:blocklisted: false 2024-01-25T15:04:58.621 INFO:teuthology.orchestra.run.smithi052.stderr:0+1 records in 2024-01-25T15:04:58.621 INFO:teuthology.orchestra.run.smithi052.stderr:0+1 records out 2024-01-25T15:04:58.621 INFO:teuthology.orchestra.run.smithi052.stderr:69 bytes copied, 2.226e-05 s, 3.1 MB/s 2024-01-25T15:04:58.622 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-01-25T15:04:58.643 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:04:58.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.756+0000 7fb00e01d640 1 Processor -- start 2024-01-25T15:04:58.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.756+0000 7fb00e01d640 1 -- start start 2024-01-25T15:04:58.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.757+0000 7fb00e01d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb0080c6fb0 0x7fb0080c7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:58.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.757+0000 7fb00e01d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb008155a90 0x7fb008155f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:58.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.757+0000 7fb00e01d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb008152fc0 con 0x7fb00814fd20 2024-01-25T15:04:58.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.757+0000 7fb00e01d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0080c7b20 con 0x7fb008155a90 2024-01-25T15:04:58.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.757+0000 7fb00e01d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0080ad500 con 0x7fb0080c6fb0 2024-01-25T15:04:58.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.757+0000 7fb007fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb008155a90 0x7fb008155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:58.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.757+0000 7fb007fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb008155a90 0x7fb008155f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40622/0 (socket says 172.21.15.29:40622) 2024-01-25T15:04:58.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.757+0000 7fb007fff640 1 -- 172.21.15.29:0/411356626 learned_addr learned my addr 172.21.15.29:0/411356626 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:58.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.757+0000 7fb006ffd640 1 --2- 172.21.15.29:0/411356626 >> v2:172.21.15.52:3300/0 conn(0x7fb0080c6fb0 0x7fb0080c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:58.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.758+0000 7fb007fff640 1 -- 172.21.15.29:0/411356626 >> v2:172.21.15.52:3300/0 conn(0x7fb0080c6fb0 msgr2=0x7fb0080c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:58.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.758+0000 7fb007fff640 1 --2- 172.21.15.29:0/411356626 >> v2:172.21.15.52:3300/0 conn(0x7fb0080c6fb0 0x7fb0080c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:58.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.758+0000 7fb007fff640 1 -- 172.21.15.29:0/411356626 >> v1:172.21.15.52:6789/0 conn(0x7fb00814fd20 legacy=0x7fb008070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:58.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.758+0000 7fb007fff640 1 -- 172.21.15.29:0/411356626 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb008153450 con 0x7fb008155a90 2024-01-25T15:04:58.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.758+0000 7fb007fff640 1 --2- 172.21.15.29:0/411356626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb008155a90 0x7fb008155f00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb00804fa90 tx=0x7fb00002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e6c15729a7782a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:58.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.759+0000 7fb0067fc640 1 -- 172.21.15.29:0/411356626 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00002c9f0 con 0x7fb008155a90 2024-01-25T15:04:58.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.759+0000 7fb0067fc640 1 -- 172.21.15.29:0/411356626 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00002cb50 con 0x7fb008155a90 2024-01-25T15:04:58.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.759+0000 7fb0067fc640 1 -- 172.21.15.29:0/411356626 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0000343f0 con 0x7fb008155a90 2024-01-25T15:04:58.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.759+0000 7fb00e01d640 1 -- 172.21.15.29:0/411356626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb008155a90 msgr2=0x7fb008155f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:58.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.759+0000 7fb00e01d640 1 --2- 172.21.15.29:0/411356626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb008155a90 0x7fb008155f00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb00804fa90 tx=0x7fb00002be50 comp rx=0 tx=0).stop 2024-01-25T15:04:58.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.759+0000 7fb00e01d640 1 -- 172.21.15.29:0/411356626 shutdown_connections 2024-01-25T15:04:58.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.759+0000 7fb00e01d640 1 --2- 172.21.15.29:0/411356626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb008155a90 0x7fb008155f00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:58.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.759+0000 7fb00e01d640 1 --2- 172.21.15.29:0/411356626 >> v2:172.21.15.52:3300/0 conn(0x7fb0080c6fb0 0x7fb0080c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:58.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.759+0000 7fb00e01d640 1 -- 172.21.15.29:0/411356626 >> 172.21.15.29:0/411356626 conn(0x7fb0080c7f80 msgr2=0x7fb0080c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:58.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.759+0000 7fb00e01d640 1 -- 172.21.15.29:0/411356626 shutdown_connections 2024-01-25T15:04:58.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.759+0000 7fb00e01d640 1 -- 172.21.15.29:0/411356626 wait complete. 2024-01-25T15:04:58.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.760+0000 7fb00e01d640 1 Processor -- start 2024-01-25T15:04:58.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.761+0000 7fb00e01d640 1 -- start start 2024-01-25T15:04:58.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.761+0000 7fb00e01d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0080c6fb0 0x7fb0081df230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:58.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.761+0000 7fb00e01d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb00814fd20 0x7fb0081e9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:58.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.761+0000 7fb00e01d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb008155a90 0x7fb00806ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:58.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.761+0000 7fb00e01d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0081e9b90 con 0x7fb0080c6fb0 2024-01-25T15:04:58.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.761+0000 7fb00e01d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0081e9840 con 0x7fb008155a90 2024-01-25T15:04:58.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.761+0000 7fb00e01d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb008144dd0 con 0x7fb00814fd20 2024-01-25T15:04:58.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.761+0000 7fb0077fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0080c6fb0 0x7fb0081df230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:58.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.761+0000 7fb0077fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0080c6fb0 0x7fb0081df230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40624/0 (socket says 172.21.15.29:40624) 2024-01-25T15:04:58.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.761+0000 7fb0077fe640 1 -- 172.21.15.29:0/1487011451 learned_addr learned my addr 172.21.15.29:0/1487011451 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:58.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.761+0000 7fb006ffd640 1 --2- 172.21.15.29:0/1487011451 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb00814fd20 0x7fb0081e9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:58.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.761+0000 7fb007fff640 1 --2- 172.21.15.29:0/1487011451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb008155a90 0x7fb00806ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:58.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.762+0000 7fb0077fe640 1 -- 172.21.15.29:0/1487011451 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb00814fd20 msgr2=0x7fb0081e9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:58.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.762+0000 7fb0077fe640 1 --2- 172.21.15.29:0/1487011451 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb00814fd20 0x7fb0081e9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:58.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.762+0000 7fb0077fe640 1 -- 172.21.15.29:0/1487011451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb008155a90 msgr2=0x7fb00806ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:58.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.762+0000 7fb0077fe640 1 --2- 172.21.15.29:0/1487011451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb008155a90 0x7fb00806ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:58.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.762+0000 7fb0077fe640 1 -- 172.21.15.29:0/1487011451 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb000009b30 con 0x7fb0080c6fb0 2024-01-25T15:04:58.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.762+0000 7fb0077fe640 1 --2- 172.21.15.29:0/1487011451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0080c6fb0 0x7fb0081df230 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faff800c460 tx=0x7faff800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:58.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.762+0000 7fafeffff640 1 -- 172.21.15.29:0/1487011451 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff8012830 con 0x7fb0080c6fb0 2024-01-25T15:04:58.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.762+0000 7fafeffff640 1 -- 172.21.15.29:0/1487011451 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff80129d0 con 0x7fb0080c6fb0 2024-01-25T15:04:58.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.762+0000 7fb00e01d640 1 -- 172.21.15.29:0/1487011451 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00806f4e0 con 0x7fb0080c6fb0 2024-01-25T15:04:58.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.762+0000 7fafeffff640 1 -- 172.21.15.29:0/1487011451 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff8012d80 con 0x7fb0080c6fb0 2024-01-25T15:04:58.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.762+0000 7fb00e01d640 1 -- 172.21.15.29:0/1487011451 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0081df770 con 0x7fb0080c6fb0 2024-01-25T15:04:58.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.763+0000 7fb00e01d640 1 -- 172.21.15.29:0/1487011451 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb00806f700 con 0x7fb0080c6fb0 2024-01-25T15:04:58.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.764+0000 7fafeffff640 1 -- 172.21.15.29:0/1487011451 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7faff801a3b0 con 0x7fb0080c6fb0 2024-01-25T15:04:58.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.764+0000 7fafeffff640 1 --2- 172.21.15.29:0/1487011451 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faff406aed0 0x7faff406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:58.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.764+0000 7fafeffff640 1 -- 172.21.15.29:0/1487011451 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faff80893a0 con 0x7fb0080c6fb0 2024-01-25T15:04:58.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.764+0000 7fb006ffd640 1 --2- 172.21.15.29:0/1487011451 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faff406aed0 0x7faff406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:58.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.765+0000 7fb006ffd640 1 --2- 172.21.15.29:0/1487011451 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faff406aed0 0x7faff406d390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb0080c2200 tx=0x7faffc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:58.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.768+0000 7fafeffff640 1 -- 172.21.15.29:0/1487011451 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fb00806f700 con 0x7fb0080c6fb0 2024-01-25T15:04:58.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.950+0000 7fb00e01d640 1 -- 172.21.15.29:0/1487011451 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0081e9cd0 con 0x7fb0080c6fb0 2024-01-25T15:04:58.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.951+0000 7fafeffff640 1 -- 172.21.15.29:0/1487011451 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18311 (secure 0 0 0) 0x7fb0081e9cd0 con 0x7fb0080c6fb0 2024-01-25T15:04:58.951 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:04:58.952 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:31.978871+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:04:58.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.952+0000 7fb00e01d640 1 -- 172.21.15.29:0/1487011451 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faff406aed0 msgr2=0x7faff406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:58.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.952+0000 7fb00e01d640 1 --2- 172.21.15.29:0/1487011451 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faff406aed0 0x7faff406d390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb0080c2200 tx=0x7faffc008040 comp rx=0 tx=0).stop 2024-01-25T15:04:58.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.952+0000 7fb00e01d640 1 -- 172.21.15.29:0/1487011451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0080c6fb0 msgr2=0x7fb0081df230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:58.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.952+0000 7fb00e01d640 1 --2- 172.21.15.29:0/1487011451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0080c6fb0 0x7fb0081df230 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faff800c460 tx=0x7faff800c920 comp rx=0 tx=0).stop 2024-01-25T15:04:58.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.953+0000 7fb00e01d640 1 -- 172.21.15.29:0/1487011451 shutdown_connections 2024-01-25T15:04:58.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.953+0000 7fb00e01d640 1 --2- 172.21.15.29:0/1487011451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb008155a90 0x7fb00806ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:58.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.953+0000 7fb00e01d640 1 --2- 172.21.15.29:0/1487011451 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb00814fd20 0x7fb0081e9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:58.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.953+0000 7fb00e01d640 1 --2- 172.21.15.29:0/1487011451 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faff406aed0 0x7faff406d390 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:58.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.953+0000 7fb00e01d640 1 --2- 172.21.15.29:0/1487011451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0080c6fb0 0x7fb0081df230 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:58.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.953+0000 7fb00e01d640 1 -- 172.21.15.29:0/1487011451 >> 172.21.15.29:0/1487011451 conn(0x7fb0080c7f80 msgr2=0x7fb0080c2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:58.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.953+0000 7fb00e01d640 1 -- 172.21.15.29:0/1487011451 shutdown_connections 2024-01-25T15:04:58.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:58.953+0000 7fb00e01d640 1 -- 172.21.15.29:0/1487011451 wait complete. 2024-01-25T15:04:58.965 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T15:04:14.955791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T15:04:24.986626+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T15:04:25.873673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-25T15:04:29.578261+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-25T15:04:58.966 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:04:59.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.070+0000 7f8b2f1a4640 1 Processor -- start 2024-01-25T15:04:59.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.070+0000 7f8b2f1a4640 1 -- start start 2024-01-25T15:04:59.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.070+0000 7f8b2f1a4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8b2806b490 0x7f8b280c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:59.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.070+0000 7f8b2f1a4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8b280c8620 0x7f8b28151c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.070+0000 7f8b2f1a4640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b280c6770 con 0x7f8b28158b80 2024-01-25T15:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.070+0000 7f8b2f1a4640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b28154f10 con 0x7f8b280c8620 2024-01-25T15:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.070+0000 7f8b2f1a4640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b281551f0 con 0x7f8b2806b490 2024-01-25T15:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.071+0000 7f8b2d741640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8b280c8620 0x7f8b28151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.071+0000 7f8b27fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8b28158b80 0x7f8b280c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49324/0 (socket says 172.21.15.29:49324) 2024-01-25T15:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.071+0000 7f8b27fff640 1 -- 172.21.15.29:0/3719177148 learned_addr learned my addr 172.21.15.29:0/3719177148 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.071+0000 7f8b2cf40640 1 --2- 172.21.15.29:0/3719177148 >> v2:172.21.15.52:3300/0 conn(0x7f8b2806b490 0x7f8b280c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.071+0000 7f8b277fe640 1 -- 172.21.15.29:0/3719177148 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131847279 0 0) 0x7f8b280c6770 con 0x7f8b28158b80 2024-01-25T15:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.071+0000 7f8b277fe640 1 -- 172.21.15.29:0/3719177148 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b18003520 con 0x7f8b28158b80 2024-01-25T15:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.071+0000 7f8b2d741640 1 -- 172.21.15.29:0/3719177148 >> v2:172.21.15.52:3300/0 conn(0x7f8b2806b490 msgr2=0x7f8b280c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.071+0000 7f8b2d741640 1 --2- 172.21.15.29:0/3719177148 >> v2:172.21.15.52:3300/0 conn(0x7f8b2806b490 0x7f8b280c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.071+0000 7f8b2d741640 1 -- 172.21.15.29:0/3719177148 >> v1:172.21.15.29:6789/0 conn(0x7f8b28158b80 legacy=0x7f8b280c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.071+0000 7f8b2d741640 1 -- 172.21.15.29:0/3719177148 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b281554d0 con 0x7f8b280c8620 2024-01-25T15:04:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.072+0000 7f8b2d741640 1 --2- 172.21.15.29:0/3719177148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b280c8620 0x7f8b28151c30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8b280c7b60 tx=0x7f8b2002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57b5bf375b8e5d2 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:59.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.072+0000 7f8b277fe640 1 -- 172.21.15.29:0/3719177148 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2002cbf0 con 0x7f8b280c8620 2024-01-25T15:04:59.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.072+0000 7f8b277fe640 1 -- 172.21.15.29:0/3719177148 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2002cd50 con 0x7f8b280c8620 2024-01-25T15:04:59.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.072+0000 7f8b277fe640 1 -- 172.21.15.29:0/3719177148 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20034660 con 0x7f8b280c8620 2024-01-25T15:04:59.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.072+0000 7f8b2f1a4640 1 -- 172.21.15.29:0/3719177148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b280c8620 msgr2=0x7f8b28151c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:59.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.072+0000 7f8b2f1a4640 1 --2- 172.21.15.29:0/3719177148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b280c8620 0x7f8b28151c30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8b280c7b60 tx=0x7f8b2002be40 comp rx=0 tx=0).stop 2024-01-25T15:04:59.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.072+0000 7f8b2f1a4640 1 -- 172.21.15.29:0/3719177148 shutdown_connections 2024-01-25T15:04:59.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.072+0000 7f8b2f1a4640 1 --2- 172.21.15.29:0/3719177148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b280c8620 0x7f8b28151c30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.072+0000 7f8b2f1a4640 1 --2- 172.21.15.29:0/3719177148 >> v2:172.21.15.52:3300/0 conn(0x7f8b2806b490 0x7f8b280c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.072+0000 7f8b2f1a4640 1 -- 172.21.15.29:0/3719177148 >> 172.21.15.29:0/3719177148 conn(0x7f8b280ca010 msgr2=0x7f8b280ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:59.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.072+0000 7f8b2f1a4640 1 -- 172.21.15.29:0/3719177148 shutdown_connections 2024-01-25T15:04:59.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.073+0000 7f8b2f1a4640 1 -- 172.21.15.29:0/3719177148 wait complete. 2024-01-25T15:04:59.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.074+0000 7f8b2f1a4640 1 Processor -- start 2024-01-25T15:04:59.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.074+0000 7f8b2f1a4640 1 -- start start 2024-01-25T15:04:59.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.074+0000 7f8b2f1a4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b2806b490 0x7f8b280aa330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:59.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.074+0000 7f8b2f1a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b280c8620 0x7f8b28143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:59.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.074+0000 7f8b2f1a4640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8b28158b80 0x7f8b28143660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.074+0000 7f8b2f1a4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b280ab420 con 0x7f8b280c8620 2024-01-25T15:04:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.074+0000 7f8b2f1a4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b280aab60 con 0x7f8b2806b490 2024-01-25T15:04:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.074+0000 7f8b2f1a4640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b28149720 con 0x7f8b28158b80 2024-01-25T15:04:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.074+0000 7f8b27fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b280c8620 0x7f8b28143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.075+0000 7f8b27fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b280c8620 0x7f8b28143120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40640/0 (socket says 172.21.15.29:40640) 2024-01-25T15:04:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.075+0000 7f8b27fff640 1 -- 172.21.15.29:0/413441045 learned_addr learned my addr 172.21.15.29:0/413441045 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.075+0000 7f8b2cf40640 1 --2- 172.21.15.29:0/413441045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b2806b490 0x7f8b280aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.075+0000 7f8b2d741640 1 --2- 172.21.15.29:0/413441045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8b28158b80 0x7f8b28143660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.075+0000 7f8b27fff640 1 -- 172.21.15.29:0/413441045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8b28158b80 msgr2=0x7f8b28143660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.075+0000 7f8b27fff640 1 --2- 172.21.15.29:0/413441045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8b28158b80 0x7f8b28143660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.075+0000 7f8b27fff640 1 -- 172.21.15.29:0/413441045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b2806b490 msgr2=0x7f8b280aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:59.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.075+0000 7f8b27fff640 1 --2- 172.21.15.29:0/413441045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b2806b490 0x7f8b280aa330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.075+0000 7f8b27fff640 1 -- 172.21.15.29:0/413441045 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b20009a70 con 0x7f8b280c8620 2024-01-25T15:04:59.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.075+0000 7f8b27fff640 1 --2- 172.21.15.29:0/413441045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b280c8620 0x7f8b28143120 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400c410 tx=0x7f8b1400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:59.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.075+0000 7f8b257fa640 1 -- 172.21.15.29:0/413441045 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b14005ce0 con 0x7f8b280c8620 2024-01-25T15:04:59.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.075+0000 7f8b257fa640 1 -- 172.21.15.29:0/413441045 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b14005e40 con 0x7f8b280c8620 2024-01-25T15:04:59.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.075+0000 7f8b2f1a4640 1 -- 172.21.15.29:0/413441045 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b28155b70 con 0x7f8b280c8620 2024-01-25T15:04:59.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.075+0000 7f8b257fa640 1 -- 172.21.15.29:0/413441045 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b140072f0 con 0x7f8b280c8620 2024-01-25T15:04:59.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.075+0000 7f8b2f1a4640 1 -- 172.21.15.29:0/413441045 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b280aad50 con 0x7f8b280c8620 2024-01-25T15:04:59.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.076+0000 7f8b2f1a4640 1 -- 172.21.15.29:0/413441045 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b28067be0 con 0x7f8b280c8620 2024-01-25T15:04:59.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.077+0000 7f8b257fa640 1 -- 172.21.15.29:0/413441045 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8b14007450 con 0x7f8b280c8620 2024-01-25T15:04:59.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.077+0000 7f8b257fa640 1 --2- 172.21.15.29:0/413441045 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8b0c06af00 0x7f8b0c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:59.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.077+0000 7f8b257fa640 1 -- 172.21.15.29:0/413441045 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8b14088d80 con 0x7f8b280c8620 2024-01-25T15:04:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.077+0000 7f8b2cf40640 1 --2- 172.21.15.29:0/413441045 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8b0c06af00 0x7f8b0c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.078+0000 7f8b2cf40640 1 --2- 172.21.15.29:0/413441045 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8b0c06af00 0x7f8b0c06d3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c006fd0 tx=0x7f8b1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:59.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.081+0000 7f8b257fa640 1 -- 172.21.15.29:0/413441045 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8b14053b60 con 0x7f8b280c8620 2024-01-25T15:04:59.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.258+0000 7f8b2f1a4640 1 -- 172.21.15.29:0/413441045 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8b280a97d0 con 0x7f8b280c8620 2024-01-25T15:04:59.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.259+0000 7f8b257fa640 1 -- 172.21.15.29:0/413441045 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8b140170a0 con 0x7f8b280c8620 2024-01-25T15:04:59.260 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-25T15:04:59.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.260+0000 7f8b2f1a4640 1 -- 172.21.15.29:0/413441045 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8b0c06af00 msgr2=0x7f8b0c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:59.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.260+0000 7f8b2f1a4640 1 --2- 172.21.15.29:0/413441045 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8b0c06af00 0x7f8b0c06d3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c006fd0 tx=0x7f8b1c008040 comp rx=0 tx=0).stop 2024-01-25T15:04:59.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.260+0000 7f8b2f1a4640 1 -- 172.21.15.29:0/413441045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b280c8620 msgr2=0x7f8b28143120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:59.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.260+0000 7f8b2f1a4640 1 --2- 172.21.15.29:0/413441045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b280c8620 0x7f8b28143120 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400c410 tx=0x7f8b1400c8d0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.261+0000 7f8b2f1a4640 1 -- 172.21.15.29:0/413441045 shutdown_connections 2024-01-25T15:04:59.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.261+0000 7f8b2f1a4640 1 --2- 172.21.15.29:0/413441045 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8b28158b80 0x7f8b28143660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.261+0000 7f8b2f1a4640 1 --2- 172.21.15.29:0/413441045 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8b0c06af00 0x7f8b0c06d3c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.261+0000 7f8b2f1a4640 1 --2- 172.21.15.29:0/413441045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b280c8620 0x7f8b28143120 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.261+0000 7f8b2f1a4640 1 --2- 172.21.15.29:0/413441045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b2806b490 0x7f8b280aa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.261+0000 7f8b2f1a4640 1 -- 172.21.15.29:0/413441045 >> 172.21.15.29:0/413441045 conn(0x7f8b280ca010 msgr2=0x7f8b281dea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:59.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.261+0000 7f8b2f1a4640 1 -- 172.21.15.29:0/413441045 shutdown_connections 2024-01-25T15:04:59.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.261+0000 7f8b2f1a4640 1 -- 172.21.15.29:0/413441045 wait complete. 2024-01-25T15:04:59.272 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:04:59.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.375+0000 7f649ec1c640 1 Processor -- start 2024-01-25T15:04:59.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.375+0000 7f649ec1c640 1 -- start start 2024-01-25T15:04:59.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.376+0000 7f649ec1c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f64980af6c0 0x7f64980c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:59.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.376+0000 7f649ec1c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f649806d560 0x7f649806b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:59.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.376+0000 7f649ec1c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64980afaa0 con 0x7f64980c5a70 2024-01-25T15:04:59.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.376+0000 7f649ec1c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f649806c480 con 0x7f649806d560 2024-01-25T15:04:59.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.376+0000 7f649ec1c640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6498155290 con 0x7f64980af6c0 2024-01-25T15:04:59.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.376+0000 7f6497fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f649806d560 0x7f649806b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:59.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.376+0000 7f649d1b9640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f64980c5a70 0x7f649806b760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49334/0 (socket says 172.21.15.29:49334) 2024-01-25T15:04:59.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.376+0000 7f649d1b9640 1 -- 172.21.15.29:0/630775534 learned_addr learned my addr 172.21.15.29:0/630775534 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:59.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.376+0000 7f649c9b8640 1 --2- 172.21.15.29:0/630775534 >> v2:172.21.15.52:3300/0 conn(0x7f64980af6c0 0x7f64980c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:59.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.377+0000 7f6497fff640 1 -- 172.21.15.29:0/630775534 >> v2:172.21.15.52:3300/0 conn(0x7f64980af6c0 msgr2=0x7f64980c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:59.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.377+0000 7f6497fff640 1 --2- 172.21.15.29:0/630775534 >> v2:172.21.15.52:3300/0 conn(0x7f64980af6c0 0x7f64980c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.377+0000 7f6497fff640 1 -- 172.21.15.29:0/630775534 >> v1:172.21.15.29:6789/0 conn(0x7f64980c5a70 legacy=0x7f649806b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:59.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.377+0000 7f6497fff640 1 -- 172.21.15.29:0/630775534 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64980c6060 con 0x7f649806d560 2024-01-25T15:04:59.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.377+0000 7f64977fe640 1 -- 172.21.15.29:0/630775534 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008253808 0 0) 0x7f64980afaa0 con 0x7f64980c5a70 2024-01-25T15:04:59.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.377+0000 7f6497fff640 1 --2- 172.21.15.29:0/630775534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f649806d560 0x7f649806b220 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f649808b4b0 tx=0x7f648c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06838c8933269b8 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:59.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.377+0000 7f64977fe640 1 -- 172.21.15.29:0/630775534 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c031830 con 0x7f649806d560 2024-01-25T15:04:59.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.377+0000 7f64977fe640 1 -- 172.21.15.29:0/630775534 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648c031990 con 0x7f649806d560 2024-01-25T15:04:59.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.377+0000 7f64977fe640 1 -- 172.21.15.29:0/630775534 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c031d20 con 0x7f649806d560 2024-01-25T15:04:59.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.378+0000 7f649ec1c640 1 -- 172.21.15.29:0/630775534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f649806d560 msgr2=0x7f649806b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:59.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.378+0000 7f649ec1c640 1 --2- 172.21.15.29:0/630775534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f649806d560 0x7f649806b220 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f649808b4b0 tx=0x7f648c02b8d0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.378+0000 7f649ec1c640 1 -- 172.21.15.29:0/630775534 shutdown_connections 2024-01-25T15:04:59.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.378+0000 7f649ec1c640 1 --2- 172.21.15.29:0/630775534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f649806d560 0x7f649806b220 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.378+0000 7f649ec1c640 1 --2- 172.21.15.29:0/630775534 >> v2:172.21.15.52:3300/0 conn(0x7f64980af6c0 0x7f64980c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.378+0000 7f649ec1c640 1 -- 172.21.15.29:0/630775534 >> 172.21.15.29:0/630775534 conn(0x7f64980c6ca0 msgr2=0x7f64980c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:59.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.378+0000 7f649ec1c640 1 -- 172.21.15.29:0/630775534 shutdown_connections 2024-01-25T15:04:59.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.378+0000 7f649ec1c640 1 -- 172.21.15.29:0/630775534 wait complete. 2024-01-25T15:04:59.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.379+0000 7f649ec1c640 1 Processor -- start 2024-01-25T15:04:59.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.379+0000 7f649ec1c640 1 -- start start 2024-01-25T15:04:59.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.380+0000 7f649ec1c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f649806d560 0x7f649814c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:59.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.380+0000 7f649ec1c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64980af6c0 0x7f64980ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:59.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.380+0000 7f649ec1c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64980c5a70 0x7f64981ea660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:59.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.380+0000 7f649ec1c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64980c3750 con 0x7f64980af6c0 2024-01-25T15:04:59.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.380+0000 7f649ec1c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64980c3a30 con 0x7f64980c5a70 2024-01-25T15:04:59.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.380+0000 7f649ec1c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64980c3d10 con 0x7f649806d560 2024-01-25T15:04:59.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.380+0000 7f6497fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64980af6c0 0x7f64980ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:59.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.380+0000 7f6497fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64980af6c0 0x7f64980ae790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40654/0 (socket says 172.21.15.29:40654) 2024-01-25T15:04:59.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.380+0000 7f6497fff640 1 -- 172.21.15.29:0/2816589907 learned_addr learned my addr 172.21.15.29:0/2816589907 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:59.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.380+0000 7f649c9b8640 1 --2- 172.21.15.29:0/2816589907 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f649806d560 0x7f649814c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:59.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.380+0000 7f6497fff640 1 -- 172.21.15.29:0/2816589907 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f649806d560 msgr2=0x7f649814c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:59.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.380+0000 7f6497fff640 1 --2- 172.21.15.29:0/2816589907 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f649806d560 0x7f649814c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.380+0000 7f649d1b9640 1 --2- 172.21.15.29:0/2816589907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64980c5a70 0x7f64981ea660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:59.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.380+0000 7f6497fff640 1 -- 172.21.15.29:0/2816589907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64980c5a70 msgr2=0x7f64981ea660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:59.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.380+0000 7f6497fff640 1 --2- 172.21.15.29:0/2816589907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64980c5a70 0x7f64981ea660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.380+0000 7f6497fff640 1 -- 172.21.15.29:0/2816589907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c009400 con 0x7f64980af6c0 2024-01-25T15:04:59.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.380+0000 7f649d1b9640 1 --2- 172.21.15.29:0/2816589907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64980c5a70 0x7f64981ea660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:59.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.381+0000 7f6497fff640 1 --2- 172.21.15.29:0/2816589907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64980af6c0 0x7f64980ae790 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f648c009890 tx=0x7f648c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:59.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.381+0000 7f64957fa640 1 -- 172.21.15.29:0/2816589907 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c03ba70 con 0x7f64980af6c0 2024-01-25T15:04:59.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.381+0000 7f64957fa640 1 -- 172.21.15.29:0/2816589907 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648c03bbf0 con 0x7f64980af6c0 2024-01-25T15:04:59.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.381+0000 7f64957fa640 1 -- 172.21.15.29:0/2816589907 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c045400 con 0x7f64980af6c0 2024-01-25T15:04:59.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.381+0000 7f649ec1c640 1 -- 172.21.15.29:0/2816589907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64981ea140 con 0x7f64980af6c0 2024-01-25T15:04:59.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.381+0000 7f649ec1c640 1 -- 172.21.15.29:0/2816589907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64980c3ff0 con 0x7f64980af6c0 2024-01-25T15:04:59.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.382+0000 7f649ec1c640 1 -- 172.21.15.29:0/2816589907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64981ea330 con 0x7f64980af6c0 2024-01-25T15:04:59.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.382+0000 7f64957fa640 1 -- 172.21.15.29:0/2816589907 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f648c04e440 con 0x7f64980af6c0 2024-01-25T15:04:59.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.383+0000 7f64957fa640 1 --2- 172.21.15.29:0/2816589907 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f648406aed0 0x7f648406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:59.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.383+0000 7f64957fa640 1 -- 172.21.15.29:0/2816589907 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f648c0abcb0 con 0x7f64980af6c0 2024-01-25T15:04:59.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.383+0000 7f649c9b8640 1 --2- 172.21.15.29:0/2816589907 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f648406aed0 0x7f648406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:59.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.384+0000 7f649c9b8640 1 --2- 172.21.15.29:0/2816589907 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f648406aed0 0x7f648406d390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6490009f30 tx=0x7f649000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:59.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.387+0000 7f64957fa640 1 -- 172.21.15.29:0/2816589907 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f648c0769a0 con 0x7f64980af6c0 2024-01-25T15:04:59.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.568+0000 7f649ec1c640 1 -- 172.21.15.29:0/2816589907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64981ea330 con 0x7f64980af6c0 2024-01-25T15:04:59.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.569+0000 7f64957fa640 1 -- 172.21.15.29:0/2816589907 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f648c035020 con 0x7f64980af6c0 2024-01-25T15:04:59.569 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:04:59.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.571+0000 7f649ec1c640 1 -- 172.21.15.29:0/2816589907 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f648406aed0 msgr2=0x7f648406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:59.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.571+0000 7f649ec1c640 1 --2- 172.21.15.29:0/2816589907 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f648406aed0 0x7f648406d390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6490009f30 tx=0x7f649000b040 comp rx=0 tx=0).stop 2024-01-25T15:04:59.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.571+0000 7f649ec1c640 1 -- 172.21.15.29:0/2816589907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64980af6c0 msgr2=0x7f64980ae790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:59.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.571+0000 7f649ec1c640 1 --2- 172.21.15.29:0/2816589907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64980af6c0 0x7f64980ae790 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f648c009890 tx=0x7f648c0046c0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.571+0000 7f649ec1c640 1 -- 172.21.15.29:0/2816589907 shutdown_connections 2024-01-25T15:04:59.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.571+0000 7f649ec1c640 1 --2- 172.21.15.29:0/2816589907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64980c5a70 0x7f64981ea660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.571+0000 7f649ec1c640 1 --2- 172.21.15.29:0/2816589907 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f648406aed0 0x7f648406d390 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.571+0000 7f649ec1c640 1 --2- 172.21.15.29:0/2816589907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64980af6c0 0x7f64980ae790 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.571+0000 7f649ec1c640 1 --2- 172.21.15.29:0/2816589907 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f649806d560 0x7f649814c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.571+0000 7f649ec1c640 1 -- 172.21.15.29:0/2816589907 >> 172.21.15.29:0/2816589907 conn(0x7f64980c6ca0 msgr2=0x7f64980c7080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:59.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.571+0000 7f649ec1c640 1 -- 172.21.15.29:0/2816589907 shutdown_connections 2024-01-25T15:04:59.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.571+0000 7f649ec1c640 1 -- 172.21.15.29:0/2816589907 wait complete. 2024-01-25T15:04:59.582 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:04:59.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.686+0000 7f4a64394640 1 Processor -- start 2024-01-25T15:04:59.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.686+0000 7f4a64394640 1 -- start start 2024-01-25T15:04:59.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.687+0000 7f4a64394640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4a5c0af6c0 0x7f4a5c0c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:59.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.687+0000 7f4a64394640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a5c0c5a70 0x7f4a5c06b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:59.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.687+0000 7f4a64394640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5c0afaa0 con 0x7f4a5c06d560 2024-01-25T15:04:59.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.687+0000 7f4a64394640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5c06c480 con 0x7f4a5c0af6c0 2024-01-25T15:04:59.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.687+0000 7f4a64394640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c155290 con 0x7f4a5c0c5a70 2024-01-25T15:04:59.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.687+0000 7f4a62130640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4a5c0af6c0 0x7f4a5c0c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:59.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.687+0000 7f4a6192f640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4a5c06d560 0x7f4a5c06b220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49336/0 (socket says 172.21.15.29:49336) 2024-01-25T15:04:59.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.687+0000 7f4a6192f640 1 -- 172.21.15.29:0/1004394595 learned_addr learned my addr 172.21.15.29:0/1004394595 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:04:59.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.688+0000 7f4a62931640 1 --2- 172.21.15.29:0/1004394595 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a5c0c5a70 0x7f4a5c06b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:59.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.688+0000 7f4a62130640 1 -- 172.21.15.29:0/1004394595 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a5c0c5a70 msgr2=0x7f4a5c06b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:59.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.688+0000 7f4a62130640 1 --2- 172.21.15.29:0/1004394595 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a5c0c5a70 0x7f4a5c06b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.688+0000 7f4a62130640 1 -- 172.21.15.29:0/1004394595 >> v1:172.21.15.29:6789/0 conn(0x7f4a5c06d560 legacy=0x7f4a5c06b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:59.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.688+0000 7f4a6112e640 1 -- 172.21.15.29:0/1004394595 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187997765 0 0) 0x7f4a5c0afaa0 con 0x7f4a5c06d560 2024-01-25T15:04:59.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.688+0000 7f4a62130640 1 -- 172.21.15.29:0/1004394595 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5c0c6060 con 0x7f4a5c0af6c0 2024-01-25T15:04:59.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.689+0000 7f4a62130640 1 --2- 172.21.15.29:0/1004394595 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a5c0af6c0 0x7f4a5c0c5530 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4a580097a0 tx=0x7f4a5802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf7fefc732ebe0e server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:59.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.689+0000 7f4a6112e640 1 -- 172.21.15.29:0/1004394595 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a58031830 con 0x7f4a5c0af6c0 2024-01-25T15:04:59.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.689+0000 7f4a6112e640 1 -- 172.21.15.29:0/1004394595 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a58031990 con 0x7f4a5c0af6c0 2024-01-25T15:04:59.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.689+0000 7f4a6112e640 1 -- 172.21.15.29:0/1004394595 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a58031d20 con 0x7f4a5c0af6c0 2024-01-25T15:04:59.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.689+0000 7f4a64394640 1 -- 172.21.15.29:0/1004394595 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a5c0af6c0 msgr2=0x7f4a5c0c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:59.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.689+0000 7f4a64394640 1 --2- 172.21.15.29:0/1004394595 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a5c0af6c0 0x7f4a5c0c5530 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4a580097a0 tx=0x7f4a5802b8d0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.689+0000 7f4a64394640 1 -- 172.21.15.29:0/1004394595 shutdown_connections 2024-01-25T15:04:59.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.689+0000 7f4a64394640 1 --2- 172.21.15.29:0/1004394595 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a5c0c5a70 0x7f4a5c06b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.689+0000 7f4a64394640 1 --2- 172.21.15.29:0/1004394595 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a5c0af6c0 0x7f4a5c0c5530 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.689+0000 7f4a64394640 1 -- 172.21.15.29:0/1004394595 >> 172.21.15.29:0/1004394595 conn(0x7f4a5c0c6ca0 msgr2=0x7f4a5c0c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:59.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.689+0000 7f4a64394640 1 -- 172.21.15.29:0/1004394595 shutdown_connections 2024-01-25T15:04:59.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.689+0000 7f4a64394640 1 -- 172.21.15.29:0/1004394595 wait complete. 2024-01-25T15:04:59.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.690+0000 7f4a64394640 1 Processor -- start 2024-01-25T15:04:59.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.690+0000 7f4a64394640 1 -- start start 2024-01-25T15:04:59.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.691+0000 7f4a64394640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a5c06d560 0x7f4a5c14ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:59.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.691+0000 7f4a64394640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a5c0af6c0 0x7f4a5c158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:59.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.691+0000 7f4a64394640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a5c0c5a70 0x7f4a5c14e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:59.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.691+0000 7f4a64394640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c1eae20 con 0x7f4a5c0c5a70 2024-01-25T15:04:59.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.691+0000 7f4a64394640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c14ec60 con 0x7f4a5c06d560 2024-01-25T15:04:59.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.691+0000 7f4a64394640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c1eb0e0 con 0x7f4a5c0af6c0 2024-01-25T15:04:59.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.691+0000 7f4a62931640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a5c0c5a70 0x7f4a5c14e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:59.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.691+0000 7f4a62931640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a5c0c5a70 0x7f4a5c14e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40676/0 (socket says 172.21.15.29:40676) 2024-01-25T15:04:59.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.691+0000 7f4a62931640 1 -- 172.21.15.29:0/497883524 learned_addr learned my addr 172.21.15.29:0/497883524 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:59.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.691+0000 7f4a6192f640 1 --2- 172.21.15.29:0/497883524 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a5c0af6c0 0x7f4a5c158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:59.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.691+0000 7f4a62130640 1 --2- 172.21.15.29:0/497883524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a5c06d560 0x7f4a5c14ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:59.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.691+0000 7f4a62931640 1 -- 172.21.15.29:0/497883524 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a5c0af6c0 msgr2=0x7f4a5c158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:59.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.691+0000 7f4a62931640 1 --2- 172.21.15.29:0/497883524 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a5c0af6c0 0x7f4a5c158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.691+0000 7f4a62931640 1 -- 172.21.15.29:0/497883524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a5c06d560 msgr2=0x7f4a5c14ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:59.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.692+0000 7f4a62931640 1 --2- 172.21.15.29:0/497883524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a5c06d560 0x7f4a5c14ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.692+0000 7f4a62931640 1 -- 172.21.15.29:0/497883524 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a58009400 con 0x7f4a5c0c5a70 2024-01-25T15:04:59.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.692+0000 7f4a6192f640 1 --2- 172.21.15.29:0/497883524 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a5c0af6c0 0x7f4a5c158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:59.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.692+0000 7f4a62931640 1 --2- 172.21.15.29:0/497883524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a5c0c5a70 0x7f4a5c14e020 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009fd0 tx=0x7f4a5400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:59.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.692+0000 7f4a52ffd640 1 -- 172.21.15.29:0/497883524 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a54014420 con 0x7f4a5c0c5a70 2024-01-25T15:04:59.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.692+0000 7f4a52ffd640 1 -- 172.21.15.29:0/497883524 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a54014580 con 0x7f4a5c0c5a70 2024-01-25T15:04:59.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.692+0000 7f4a64394640 1 -- 172.21.15.29:0/497883524 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5c155c70 con 0x7f4a5c0c5a70 2024-01-25T15:04:59.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.692+0000 7f4a52ffd640 1 -- 172.21.15.29:0/497883524 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a54014930 con 0x7f4a5c0c5a70 2024-01-25T15:04:59.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.692+0000 7f4a64394640 1 -- 172.21.15.29:0/497883524 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5c157680 con 0x7f4a5c0c5a70 2024-01-25T15:04:59.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.693+0000 7f4a64394640 1 -- 172.21.15.29:0/497883524 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5c153b90 con 0x7f4a5c0c5a70 2024-01-25T15:04:59.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.693+0000 7f4a52ffd640 1 -- 172.21.15.29:0/497883524 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4a54014a90 con 0x7f4a5c0c5a70 2024-01-25T15:04:59.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.694+0000 7f4a52ffd640 1 --2- 172.21.15.29:0/497883524 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4a4006aed0 0x7f4a4006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:59.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.694+0000 7f4a52ffd640 1 -- 172.21.15.29:0/497883524 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4a5408a240 con 0x7f4a5c0c5a70 2024-01-25T15:04:59.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.694+0000 7f4a62130640 1 --2- 172.21.15.29:0/497883524 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4a4006aed0 0x7f4a4006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:59.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.694+0000 7f4a62130640 1 --2- 172.21.15.29:0/497883524 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4a4006aed0 0x7f4a4006d390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4a58036000 tx=0x7f4a58008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:59.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.698+0000 7f4a52ffd640 1 -- 172.21.15.29:0/497883524 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4a54054e10 con 0x7f4a5c0c5a70 2024-01-25T15:04:59.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.877+0000 7f4a64394640 1 -- 172.21.15.29:0/497883524 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4a5c074010 con 0x7f4a5c0c5a70 2024-01-25T15:04:59.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.878+0000 7f4a52ffd640 1 -- 172.21.15.29:0/497883524 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4a54058430 con 0x7f4a5c0c5a70 2024-01-25T15:04:59.879 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-25T15:04:59.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.880+0000 7f4a64394640 1 -- 172.21.15.29:0/497883524 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4a4006aed0 msgr2=0x7f4a4006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:59.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.880+0000 7f4a64394640 1 --2- 172.21.15.29:0/497883524 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4a4006aed0 0x7f4a4006d390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4a58036000 tx=0x7f4a58008030 comp rx=0 tx=0).stop 2024-01-25T15:04:59.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.880+0000 7f4a64394640 1 -- 172.21.15.29:0/497883524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a5c0c5a70 msgr2=0x7f4a5c14e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:59.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.880+0000 7f4a64394640 1 --2- 172.21.15.29:0/497883524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a5c0c5a70 0x7f4a5c14e020 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009fd0 tx=0x7f4a5400e4b0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.880+0000 7f4a64394640 1 -- 172.21.15.29:0/497883524 shutdown_connections 2024-01-25T15:04:59.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.880+0000 7f4a64394640 1 --2- 172.21.15.29:0/497883524 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4a4006aed0 0x7f4a4006d390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.880+0000 7f4a64394640 1 --2- 172.21.15.29:0/497883524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a5c0c5a70 0x7f4a5c14e020 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.880+0000 7f4a64394640 1 --2- 172.21.15.29:0/497883524 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4a5c0af6c0 0x7f4a5c158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.880+0000 7f4a64394640 1 --2- 172.21.15.29:0/497883524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a5c06d560 0x7f4a5c14ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.880+0000 7f4a64394640 1 -- 172.21.15.29:0/497883524 >> 172.21.15.29:0/497883524 conn(0x7f4a5c0c6ca0 msgr2=0x7f4a5c153480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:59.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.880+0000 7f4a64394640 1 -- 172.21.15.29:0/497883524 shutdown_connections 2024-01-25T15:04:59.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.880+0000 7f4a64394640 1 -- 172.21.15.29:0/497883524 wait complete. 2024-01-25T15:04:59.892 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-25T15:04:59.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.995+0000 7fe8b95a4640 1 Processor -- start 2024-01-25T15:04:59.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.995+0000 7fe8b95a4640 1 -- start start 2024-01-25T15:04:59.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.996+0000 7fe8b95a4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe8b40af6c0 0x7fe8b40c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:59.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.996+0000 7fe8b95a4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe8b406d560 0x7fe8b406b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:59.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.996+0000 7fe8b95a4640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8b40c5a70 0x7fe8b406b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:59.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.996+0000 7fe8b95a4640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b406c480 con 0x7fe8b406d560 2024-01-25T15:04:59.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.996+0000 7fe8b95a4640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b4155290 con 0x7fe8b40af6c0 2024-01-25T15:04:59.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.996+0000 7fe8b95a4640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b406bff0 con 0x7fe8b40c5a70 2024-01-25T15:04:59.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.996+0000 7fe8b27fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe8b406d560 0x7fe8b406b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:59.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.996+0000 7fe8b27fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe8b406d560 0x7fe8b406b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40684/0 (socket says 172.21.15.29:40684) 2024-01-25T15:04:59.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.996+0000 7fe8b27fc640 1 -- 172.21.15.29:0/1564453497 learned_addr learned my addr 172.21.15.29:0/1564453497 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:04:59.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.996+0000 7fe8b2ffd640 1 --2- 172.21.15.29:0/1564453497 >> v2:172.21.15.52:3300/0 conn(0x7fe8b40af6c0 0x7fe8b40c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:59.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.996+0000 7fe8b37fe640 1 --2- 172.21.15.29:0/1564453497 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8b40c5a70 0x7fe8b406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:59.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.996+0000 7fe8b27fc640 1 -- 172.21.15.29:0/1564453497 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8b40c5a70 msgr2=0x7fe8b406b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:59.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.996+0000 7fe8b27fc640 1 --2- 172.21.15.29:0/1564453497 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8b40c5a70 0x7fe8b406b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.996+0000 7fe8b27fc640 1 -- 172.21.15.29:0/1564453497 >> v2:172.21.15.52:3300/0 conn(0x7fe8b40af6c0 msgr2=0x7fe8b40c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:59.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.996+0000 7fe8b27fc640 1 --2- 172.21.15.29:0/1564453497 >> v2:172.21.15.52:3300/0 conn(0x7fe8b40af6c0 0x7fe8b40c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:59.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.996+0000 7fe8b27fc640 1 -- 172.21.15.29:0/1564453497 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b40afaa0 con 0x7fe8b406d560 2024-01-25T15:04:59.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.997+0000 7fe8b27fc640 1 --2- 172.21.15.29:0/1564453497 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8b406d560 0x7fe8b406b220 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe8b408b4b0 tx=0x7fe89c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e5962cd2377994 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:59.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.997+0000 7fe8b1ffb640 1 -- 172.21.15.29:0/1564453497 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c031640 con 0x7fe8b406d560 2024-01-25T15:04:59.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.997+0000 7fe8b1ffb640 1 -- 172.21.15.29:0/1564453497 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c0317a0 con 0x7fe8b406d560 2024-01-25T15:04:59.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.997+0000 7fe8b1ffb640 1 -- 172.21.15.29:0/1564453497 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c031b30 con 0x7fe8b406d560 2024-01-25T15:05:00.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.998+0000 7fe8b95a4640 1 -- 172.21.15.29:0/1564453497 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8b406d560 msgr2=0x7fe8b406b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.998+0000 7fe8b95a4640 1 --2- 172.21.15.29:0/1564453497 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8b406d560 0x7fe8b406b220 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe8b408b4b0 tx=0x7fe89c02b8f0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.998+0000 7fe8b95a4640 1 -- 172.21.15.29:0/1564453497 shutdown_connections 2024-01-25T15:05:00.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.998+0000 7fe8b95a4640 1 --2- 172.21.15.29:0/1564453497 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8b40c5a70 0x7fe8b406b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.998+0000 7fe8b95a4640 1 --2- 172.21.15.29:0/1564453497 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8b406d560 0x7fe8b406b220 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.998+0000 7fe8b95a4640 1 --2- 172.21.15.29:0/1564453497 >> v2:172.21.15.52:3300/0 conn(0x7fe8b40af6c0 0x7fe8b40c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.998+0000 7fe8b95a4640 1 -- 172.21.15.29:0/1564453497 >> 172.21.15.29:0/1564453497 conn(0x7fe8b40c6ca0 msgr2=0x7fe8b40c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:00.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.998+0000 7fe8b95a4640 1 -- 172.21.15.29:0/1564453497 shutdown_connections 2024-01-25T15:05:00.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.998+0000 7fe8b95a4640 1 -- 172.21.15.29:0/1564453497 wait complete. 2024-01-25T15:05:00.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.999+0000 7fe8b95a4640 1 Processor -- start 2024-01-25T15:05:00.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:04:59.999+0000 7fe8b95a4640 1 -- start start 2024-01-25T15:05:00.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.000+0000 7fe8b95a4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8b406d560 0x7fe8b41eacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.000+0000 7fe8b95a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8b40af6c0 0x7fe8b4158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.000+0000 7fe8b95a4640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8b40c5a70 0x7fe8b40ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.000+0000 7fe8b95a4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b40c3c40 con 0x7fe8b40af6c0 2024-01-25T15:05:00.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.000+0000 7fe8b95a4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b41ea840 con 0x7fe8b406d560 2024-01-25T15:05:00.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.000+0000 7fe8b95a4640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b41ea230 con 0x7fe8b40c5a70 2024-01-25T15:05:00.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.000+0000 7fe8b27fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8b40af6c0 0x7fe8b4158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.000+0000 7fe8b27fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8b40af6c0 0x7fe8b4158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40692/0 (socket says 172.21.15.29:40692) 2024-01-25T15:05:00.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.000+0000 7fe8b27fc640 1 -- 172.21.15.29:0/843994326 learned_addr learned my addr 172.21.15.29:0/843994326 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:00.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.000+0000 7fe8b37fe640 1 --2- 172.21.15.29:0/843994326 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8b40c5a70 0x7fe8b40ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.000+0000 7fe8b2ffd640 1 --2- 172.21.15.29:0/843994326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8b406d560 0x7fe8b41eacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.000+0000 7fe8b27fc640 1 -- 172.21.15.29:0/843994326 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8b40c5a70 msgr2=0x7fe8b40ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.000+0000 7fe8b27fc640 1 --2- 172.21.15.29:0/843994326 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8b40c5a70 0x7fe8b40ae1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.000+0000 7fe8b27fc640 1 -- 172.21.15.29:0/843994326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8b406d560 msgr2=0x7fe8b41eacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.000+0000 7fe8b27fc640 1 --2- 172.21.15.29:0/843994326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8b406d560 0x7fe8b41eacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.000+0000 7fe8b27fc640 1 -- 172.21.15.29:0/843994326 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c0094d0 con 0x7fe8b40af6c0 2024-01-25T15:05:00.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.000+0000 7fe8b27fc640 1 --2- 172.21.15.29:0/843994326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8b40af6c0 0x7fe8b4158120 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe89c02b930 tx=0x7fe89c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:00.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.001+0000 7fe8ab7fe640 1 -- 172.21.15.29:0/843994326 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c03ac60 con 0x7fe8b40af6c0 2024-01-25T15:05:00.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.001+0000 7fe8ab7fe640 1 -- 172.21.15.29:0/843994326 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c03adc0 con 0x7fe8b40af6c0 2024-01-25T15:05:00.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.001+0000 7fe8b95a4640 1 -- 172.21.15.29:0/843994326 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b41ee240 con 0x7fe8b40af6c0 2024-01-25T15:05:00.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.001+0000 7fe8ab7fe640 1 -- 172.21.15.29:0/843994326 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c042630 con 0x7fe8b40af6c0 2024-01-25T15:05:00.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.001+0000 7fe8b95a4640 1 -- 172.21.15.29:0/843994326 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b41ee520 con 0x7fe8b40af6c0 2024-01-25T15:05:00.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.002+0000 7fe8b95a4640 1 -- 172.21.15.29:0/843994326 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b40c9050 con 0x7fe8b40af6c0 2024-01-25T15:05:00.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.002+0000 7fe8ab7fe640 1 -- 172.21.15.29:0/843994326 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fe89c02f050 con 0x7fe8b40af6c0 2024-01-25T15:05:00.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.002+0000 7fe8ab7fe640 1 --2- 172.21.15.29:0/843994326 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe89406aed0 0x7fe89406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.003+0000 7fe8ab7fe640 1 -- 172.21.15.29:0/843994326 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe89c0ab420 con 0x7fe8b40af6c0 2024-01-25T15:05:00.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.003+0000 7fe8b2ffd640 1 --2- 172.21.15.29:0/843994326 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe89406aed0 0x7fe89406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.003+0000 7fe8b2ffd640 1 --2- 172.21.15.29:0/843994326 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe89406aed0 0x7fe89406d390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac006fd0 tx=0x7fe8ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:00.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.007+0000 7fe8ab7fe640 1 -- 172.21.15.29:0/843994326 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fe89c076090 con 0x7fe8b40af6c0 2024-01-25T15:05:00.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.187+0000 7fe8b95a4640 1 -- 172.21.15.29:0/843994326 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe8b4074010 con 0x7fe8b40af6c0 2024-01-25T15:05:00.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.187+0000 7fe8ab7fe640 1 -- 172.21.15.29:0/843994326 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe89c031e60 con 0x7fe8b40af6c0 2024-01-25T15:05:00.188 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:00.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.189+0000 7fe8b95a4640 1 -- 172.21.15.29:0/843994326 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe89406aed0 msgr2=0x7fe89406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.189+0000 7fe8b95a4640 1 --2- 172.21.15.29:0/843994326 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe89406aed0 0x7fe89406d390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac006fd0 tx=0x7fe8ac008040 comp rx=0 tx=0).stop 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.189+0000 7fe8b95a4640 1 -- 172.21.15.29:0/843994326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8b40af6c0 msgr2=0x7fe8b4158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.189+0000 7fe8b95a4640 1 --2- 172.21.15.29:0/843994326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8b40af6c0 0x7fe8b4158120 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe89c02b930 tx=0x7fe89c0046c0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.190+0000 7fe8b95a4640 1 -- 172.21.15.29:0/843994326 shutdown_connections 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.190+0000 7fe8b95a4640 1 --2- 172.21.15.29:0/843994326 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8b40c5a70 0x7fe8b40ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.190+0000 7fe8b95a4640 1 --2- 172.21.15.29:0/843994326 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe89406aed0 0x7fe89406d390 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.190+0000 7fe8b95a4640 1 --2- 172.21.15.29:0/843994326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8b40af6c0 0x7fe8b4158120 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.190+0000 7fe8b95a4640 1 --2- 172.21.15.29:0/843994326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8b406d560 0x7fe8b41eacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.190+0000 7fe8b95a4640 1 -- 172.21.15.29:0/843994326 >> 172.21.15.29:0/843994326 conn(0x7fe8b40c6ca0 msgr2=0x7fe8b4154150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.190+0000 7fe8b95a4640 1 -- 172.21.15.29:0/843994326 shutdown_connections 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.190+0000 7fe8b95a4640 1 -- 172.21.15.29:0/843994326 wait complete. 2024-01-25T15:05:00.201 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:00.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.302+0000 7f7f59cd4640 1 Processor -- start 2024-01-25T15:05:00.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.302+0000 7f7f59cd4640 1 -- start start 2024-01-25T15:05:00.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.303+0000 7f7f59cd4640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f540c4d30 0x7f7f54155140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.303+0000 7f7f59cd4640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f540c2750 con 0x7f7f540c29f0 2024-01-25T15:05:00.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.303+0000 7f7f59cd4640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f540c1f40 con 0x7f7f5406cc80 2024-01-25T15:05:00.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.303+0000 7f7f59cd4640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f540c6120 con 0x7f7f540c4d30 2024-01-25T15:05:00.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.303+0000 7f7f52ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7f540c29f0 0x7f7f540c4620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49346/0 (socket says 172.21.15.29:49346) 2024-01-25T15:05:00.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.303+0000 7f7f52ffd640 1 -- 172.21.15.29:0/2479364544 learned_addr learned my addr 172.21.15.29:0/2479364544 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:00.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.303+0000 7f7f53fff640 1 --2- 172.21.15.29:0/2479364544 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f540c4d30 0x7f7f54155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.303+0000 7f7f527fc640 1 -- 172.21.15.29:0/2479364544 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490101781 0 0) 0x7f7f48001110 con 0x7f7f540c29f0 2024-01-25T15:05:00.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.303+0000 7f7f527fc640 1 -- 172.21.15.29:0/2479364544 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f3c003520 con 0x7f7f540c29f0 2024-01-25T15:05:00.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f527fc640 1 -- 172.21.15.29:0/2479364544 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3491306695 0 0) 0x7f7f3c003520 con 0x7f7f540c29f0 2024-01-25T15:05:00.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f527fc640 1 -- 172.21.15.29:0/2479364544 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f540c4d30 msgr2=0x7f7f54155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:00.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f527fc640 1 --2- 172.21.15.29:0/2479364544 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f540c4d30 0x7f7f54155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f527fc640 1 -- 172.21.15.29:0/2479364544 >> v1:172.21.15.52:6789/0 conn(0x7f7f5406cc80 legacy=0x7f7f540c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f527fc640 1 -- 172.21.15.29:0/2479364544 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5406d790 con 0x7f7f540c29f0 2024-01-25T15:05:00.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f527fc640 1 -- 172.21.15.29:0/2479364544 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f7f48001800 con 0x7f7f540c29f0 2024-01-25T15:05:00.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f527fc640 1 -- 172.21.15.29:0/2479364544 >> v1:172.21.15.29:6789/0 conn(0x7f7f540c29f0 legacy=0x7f7f540c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f527fc640 1 --2- 172.21.15.29:0/2479364544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f3c0039a0 0x7f7f3c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f527fc640 1 --2- 172.21.15.29:0/2479364544 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f540c4d30 0x7f7f3c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f527fc640 1 --2- 172.21.15.29:0/2479364544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f3c004d00 0x7f7f3c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f527fc640 1 -- 172.21.15.29:0/2479364544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f540c6120 con 0x7f7f3c0039a0 2024-01-25T15:05:00.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f527fc640 1 -- 172.21.15.29:0/2479364544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c00bb10 con 0x7f7f3c004d00 2024-01-25T15:05:00.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f527fc640 1 -- 172.21.15.29:0/2479364544 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c00bcd0 con 0x7f7f540c4d30 2024-01-25T15:05:00.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f537fe640 1 --2- 172.21.15.29:0/2479364544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f3c0039a0 0x7f7f3c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f52ffd640 1 --2- 172.21.15.29:0/2479364544 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f540c4d30 0x7f7f3c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f53fff640 1 --2- 172.21.15.29:0/2479364544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f3c004d00 0x7f7f3c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f537fe640 1 -- 172.21.15.29:0/2479364544 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f540c4d30 msgr2=0x7f7f3c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:00.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f537fe640 1 --2- 172.21.15.29:0/2479364544 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f540c4d30 0x7f7f3c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f537fe640 1 -- 172.21.15.29:0/2479364544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f3c004d00 msgr2=0x7f7f3c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:00.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f537fe640 1 --2- 172.21.15.29:0/2479364544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f3c004d00 0x7f7f3c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f537fe640 1 -- 172.21.15.29:0/2479364544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c003520 con 0x7f7f3c0039a0 2024-01-25T15:05:00.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f53fff640 1 --2- 172.21.15.29:0/2479364544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f3c004d00 0x7f7f3c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:00.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.304+0000 7f7f52ffd640 1 --2- 172.21.15.29:0/2479364544 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f540c4d30 0x7f7f3c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:00.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.305+0000 7f7f537fe640 1 --2- 172.21.15.29:0/2479364544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f3c0039a0 0x7f7f3c003dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7f44001750 tx=0x7f7f3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa39dab0cfd540 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:00.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.305+0000 7f7f527fc640 1 -- 172.21.15.29:0/2479364544 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f440052d0 con 0x7f7f3c0039a0 2024-01-25T15:05:00.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.305+0000 7f7f527fc640 1 -- 172.21.15.29:0/2479364544 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4402e050 con 0x7f7f3c0039a0 2024-01-25T15:05:00.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.305+0000 7f7f527fc640 1 -- 172.21.15.29:0/2479364544 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f440035f0 con 0x7f7f3c0039a0 2024-01-25T15:05:00.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.305+0000 7f7f59cd4640 1 -- 172.21.15.29:0/2479364544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f3c0039a0 msgr2=0x7f7f3c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.305+0000 7f7f59cd4640 1 --2- 172.21.15.29:0/2479364544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f3c0039a0 0x7f7f3c003dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7f44001750 tx=0x7f7f3c0057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.305+0000 7f7f53fff640 1 -- 172.21.15.29:0/2479364544 reap_dead start 2024-01-25T15:05:00.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.306+0000 7f7f59cd4640 1 -- 172.21.15.29:0/2479364544 shutdown_connections 2024-01-25T15:05:00.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.306+0000 7f7f59cd4640 1 -- 172.21.15.29:0/2479364544 >> 172.21.15.29:0/2479364544 conn(0x7f7f5406a8a0 msgr2=0x7f7f5406acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:00.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.306+0000 7f7f59cd4640 1 -- 172.21.15.29:0/2479364544 shutdown_connections 2024-01-25T15:05:00.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.306+0000 7f7f59cd4640 1 -- 172.21.15.29:0/2479364544 wait complete. 2024-01-25T15:05:00.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.307+0000 7f7f59cd4640 1 Processor -- start 2024-01-25T15:05:00.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.307+0000 7f7f59cd4640 1 -- start start 2024-01-25T15:05:00.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.307+0000 7f7f59cd4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f3c0039a0 0x7f7f54146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.308+0000 7f7f59cd4640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f5414d930 0x7f7f541466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.308+0000 7f7f59cd4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f541511e0 0x7f7f54151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.308+0000 7f7f59cd4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f54150d30 con 0x7f7f541511e0 2024-01-25T15:05:00.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.308+0000 7f7f59cd4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f54151bb0 con 0x7f7f3c0039a0 2024-01-25T15:05:00.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.308+0000 7f7f59cd4640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5409a6d0 con 0x7f7f5414d930 2024-01-25T15:05:00.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.308+0000 7f7f53fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f541511e0 0x7f7f54151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.308+0000 7f7f53fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f541511e0 0x7f7f54151670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40718/0 (socket says 172.21.15.29:40718) 2024-01-25T15:05:00.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.308+0000 7f7f53fff640 1 -- 172.21.15.29:0/1806561330 learned_addr learned my addr 172.21.15.29:0/1806561330 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:00.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.308+0000 7f7f537fe640 1 --2- 172.21.15.29:0/1806561330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f3c0039a0 0x7f7f54146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.308+0000 7f7f52ffd640 1 --2- 172.21.15.29:0/1806561330 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f5414d930 0x7f7f541466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.308+0000 7f7f53fff640 1 -- 172.21.15.29:0/1806561330 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f5414d930 msgr2=0x7f7f541466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.308+0000 7f7f53fff640 1 --2- 172.21.15.29:0/1806561330 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f5414d930 0x7f7f541466c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.308+0000 7f7f53fff640 1 -- 172.21.15.29:0/1806561330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f3c0039a0 msgr2=0x7f7f54146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.308+0000 7f7f53fff640 1 --2- 172.21.15.29:0/1806561330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f3c0039a0 0x7f7f54146180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.308+0000 7f7f53fff640 1 -- 172.21.15.29:0/1806561330 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5409a9b0 con 0x7f7f541511e0 2024-01-25T15:05:00.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.308+0000 7f7f53fff640 1 --2- 172.21.15.29:0/1806561330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f541511e0 0x7f7f54151670 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7f540c5110 tx=0x7f7f4c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:00.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.308+0000 7f7f3bfff640 1 -- 172.21.15.29:0/1806561330 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c00e050 con 0x7f7f541511e0 2024-01-25T15:05:00.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.308+0000 7f7f3bfff640 1 -- 172.21.15.29:0/1806561330 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4c00f040 con 0x7f7f541511e0 2024-01-25T15:05:00.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.308+0000 7f7f3bfff640 1 -- 172.21.15.29:0/1806561330 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c003990 con 0x7f7f541511e0 2024-01-25T15:05:00.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.308+0000 7f7f59cd4640 1 -- 172.21.15.29:0/1806561330 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5409ac90 con 0x7f7f541511e0 2024-01-25T15:05:00.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.308+0000 7f7f59cd4640 1 -- 172.21.15.29:0/1806561330 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5409e4d0 con 0x7f7f541511e0 2024-01-25T15:05:00.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.309+0000 7f7f59cd4640 1 -- 172.21.15.29:0/1806561330 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f54150f00 con 0x7f7f541511e0 2024-01-25T15:05:00.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.310+0000 7f7f3bfff640 1 -- 172.21.15.29:0/1806561330 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7f4c015440 con 0x7f7f541511e0 2024-01-25T15:05:00.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.310+0000 7f7f3bfff640 1 --2- 172.21.15.29:0/1806561330 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7f4006af00 0x7f7f4006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.310+0000 7f7f3bfff640 1 -- 172.21.15.29:0/1806561330 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7f4c089c60 con 0x7f7f541511e0 2024-01-25T15:05:00.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.310+0000 7f7f537fe640 1 --2- 172.21.15.29:0/1806561330 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7f4006af00 0x7f7f4006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.311+0000 7f7f537fe640 1 --2- 172.21.15.29:0/1806561330 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7f4006af00 0x7f7f4006d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7f44033000 tx=0x7f7f44009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:00.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.314+0000 7f7f3bfff640 1 -- 172.21.15.29:0/1806561330 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7f54150f00 con 0x7f7f541511e0 2024-01-25T15:05:00.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.493+0000 7f7f59cd4640 1 -- 172.21.15.29:0/1806561330 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f54074080 con 0x7f7f541511e0 2024-01-25T15:05:00.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.495+0000 7f7f3bfff640 1 -- 172.21.15.29:0/1806561330 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18311 (secure 0 0 0) 0x7f7f4c054980 con 0x7f7f541511e0 2024-01-25T15:05:00.495 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:00.496 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:31.978871+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:00.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.497+0000 7f7f59cd4640 1 -- 172.21.15.29:0/1806561330 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7f4006af00 msgr2=0x7f7f4006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.497+0000 7f7f59cd4640 1 --2- 172.21.15.29:0/1806561330 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7f4006af00 0x7f7f4006d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7f44033000 tx=0x7f7f44009030 comp rx=0 tx=0).stop 2024-01-25T15:05:00.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.497+0000 7f7f59cd4640 1 -- 172.21.15.29:0/1806561330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f541511e0 msgr2=0x7f7f54151670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.497+0000 7f7f59cd4640 1 --2- 172.21.15.29:0/1806561330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f541511e0 0x7f7f54151670 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7f540c5110 tx=0x7f7f4c010590 comp rx=0 tx=0).stop 2024-01-25T15:05:00.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.497+0000 7f7f59cd4640 1 -- 172.21.15.29:0/1806561330 shutdown_connections 2024-01-25T15:05:00.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.497+0000 7f7f59cd4640 1 --2- 172.21.15.29:0/1806561330 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7f4006af00 0x7f7f4006d3c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.497+0000 7f7f59cd4640 1 --2- 172.21.15.29:0/1806561330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f541511e0 0x7f7f54151670 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.497+0000 7f7f59cd4640 1 --2- 172.21.15.29:0/1806561330 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7f5414d930 0x7f7f541466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.497+0000 7f7f59cd4640 1 --2- 172.21.15.29:0/1806561330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f3c0039a0 0x7f7f54146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.497+0000 7f7f59cd4640 1 -- 172.21.15.29:0/1806561330 >> 172.21.15.29:0/1806561330 conn(0x7f7f5406a8a0 msgr2=0x7f7f540c6730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:00.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.497+0000 7f7f59cd4640 1 -- 172.21.15.29:0/1806561330 shutdown_connections 2024-01-25T15:05:00.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.497+0000 7f7f59cd4640 1 -- 172.21.15.29:0/1806561330 wait complete. 2024-01-25T15:05:00.509 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T15:04:14.955791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T15:04:24.986626+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T15:04:25.873673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-25T15:04:29.578261+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-25T15:05:00.509 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:05:00.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.613+0000 7faa4e78b640 1 Processor -- start 2024-01-25T15:05:00.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.613+0000 7faa4e78b640 1 -- start start 2024-01-25T15:05:00.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.613+0000 7faa4e78b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faa480c5ef0 0x7faa48154860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.613+0000 7faa4e78b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa48157db0 con 0x7faa48151ff0 2024-01-25T15:05:00.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.613+0000 7faa4e78b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa48158090 con 0x7faa480c6e10 2024-01-25T15:05:00.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.613+0000 7faa4e78b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa480c7390 con 0x7faa480c5ef0 2024-01-25T15:05:00.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.613+0000 7faa47fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7faa48151ff0 0x7faa48158520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49362/0 (socket says 172.21.15.29:49362) 2024-01-25T15:05:00.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.613+0000 7faa47fff640 1 -- 172.21.15.29:0/4260607619 learned_addr learned my addr 172.21.15.29:0/4260607619 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:00.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa477fe640 1 --2- 172.21.15.29:0/4260607619 >> v2:172.21.15.52:3300/0 conn(0x7faa480c5ef0 0x7faa48154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa46ffd640 1 -- 172.21.15.29:0/4260607619 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951056153 0 0) 0x7faa48157db0 con 0x7faa48151ff0 2024-01-25T15:05:00.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa46ffd640 1 -- 172.21.15.29:0/4260607619 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa30003520 con 0x7faa48151ff0 2024-01-25T15:05:00.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa46ffd640 1 -- 172.21.15.29:0/4260607619 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 334126646 0 0) 0x7faa30003520 con 0x7faa48151ff0 2024-01-25T15:05:00.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa46ffd640 1 -- 172.21.15.29:0/4260607619 >> v2:172.21.15.52:3300/0 conn(0x7faa480c5ef0 msgr2=0x7faa48154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:00.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa46ffd640 1 --2- 172.21.15.29:0/4260607619 >> v2:172.21.15.52:3300/0 conn(0x7faa480c5ef0 0x7faa48154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa46ffd640 1 -- 172.21.15.29:0/4260607619 >> v1:172.21.15.52:6789/0 conn(0x7faa480c6e10 legacy=0x7faa480c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa46ffd640 1 -- 172.21.15.29:0/4260607619 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa48158c30 con 0x7faa48151ff0 2024-01-25T15:05:00.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa46ffd640 1 -- 172.21.15.29:0/4260607619 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7faa38001670 con 0x7faa48151ff0 2024-01-25T15:05:00.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa46ffd640 1 -- 172.21.15.29:0/4260607619 >> v1:172.21.15.29:6789/0 conn(0x7faa48151ff0 legacy=0x7faa48158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa46ffd640 1 --2- 172.21.15.29:0/4260607619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa300039e0 0x7faa30003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa46ffd640 1 --2- 172.21.15.29:0/4260607619 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faa300047c0 0x7faa30004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa46ffd640 1 --2- 172.21.15.29:0/4260607619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa30005280 0x7faa3000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa46ffd640 1 -- 172.21.15.29:0/4260607619 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa480c7390 con 0x7faa300039e0 2024-01-25T15:05:00.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa46ffd640 1 -- 172.21.15.29:0/4260607619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3000c1c0 con 0x7faa30005280 2024-01-25T15:05:00.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa46ffd640 1 -- 172.21.15.29:0/4260607619 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa3000c380 con 0x7faa300047c0 2024-01-25T15:05:00.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa47fff640 1 --2- 172.21.15.29:0/4260607619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa300039e0 0x7faa30003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa477fe640 1 --2- 172.21.15.29:0/4260607619 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faa300047c0 0x7faa30004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa4cd28640 1 --2- 172.21.15.29:0/4260607619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa30005280 0x7faa3000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa47fff640 1 -- 172.21.15.29:0/4260607619 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faa300047c0 msgr2=0x7faa30004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:00.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa47fff640 1 --2- 172.21.15.29:0/4260607619 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faa300047c0 0x7faa30004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa47fff640 1 -- 172.21.15.29:0/4260607619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa30005280 msgr2=0x7faa3000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:00.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa47fff640 1 --2- 172.21.15.29:0/4260607619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa30005280 0x7faa3000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa47fff640 1 -- 172.21.15.29:0/4260607619 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa30003520 con 0x7faa300039e0 2024-01-25T15:05:00.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa4cd28640 1 -- 172.21.15.29:0/4260607619 reap_dead start 2024-01-25T15:05:00.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.614+0000 7faa477fe640 1 --2- 172.21.15.29:0/4260607619 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faa300047c0 0x7faa30004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:00.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.615+0000 7faa47fff640 1 --2- 172.21.15.29:0/4260607619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa300039e0 0x7faa30003e00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faa3800c190 tx=0x7faa300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e64245ea78f91b3 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:00.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.615+0000 7faa46ffd640 1 -- 172.21.15.29:0/4260607619 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38005ad0 con 0x7faa300039e0 2024-01-25T15:05:00.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.615+0000 7faa46ffd640 1 -- 172.21.15.29:0/4260607619 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa38005c30 con 0x7faa300039e0 2024-01-25T15:05:00.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.615+0000 7faa46ffd640 1 -- 172.21.15.29:0/4260607619 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3802cae0 con 0x7faa300039e0 2024-01-25T15:05:00.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.616+0000 7faa4e78b640 1 -- 172.21.15.29:0/4260607619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa300039e0 msgr2=0x7faa30003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.616+0000 7faa4e78b640 1 --2- 172.21.15.29:0/4260607619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa300039e0 0x7faa30003e00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faa3800c190 tx=0x7faa300057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.616+0000 7faa4e78b640 1 -- 172.21.15.29:0/4260607619 shutdown_connections 2024-01-25T15:05:00.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.616+0000 7faa4e78b640 1 --2- 172.21.15.29:0/4260607619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa300039e0 0x7faa30003e00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.616+0000 7faa4e78b640 1 -- 172.21.15.29:0/4260607619 >> 172.21.15.29:0/4260607619 conn(0x7faa480c7f80 msgr2=0x7faa480c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:00.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.616+0000 7faa4e78b640 1 -- 172.21.15.29:0/4260607619 shutdown_connections 2024-01-25T15:05:00.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.616+0000 7faa4e78b640 1 -- 172.21.15.29:0/4260607619 wait complete. 2024-01-25T15:05:00.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.617+0000 7faa4e78b640 1 Processor -- start 2024-01-25T15:05:00.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.617+0000 7faa4e78b640 1 -- start start 2024-01-25T15:05:00.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.618+0000 7faa4e78b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faa300039e0 0x7faa480c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.618+0000 7faa4e78b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa480702a0 0x7faa481ed4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.618+0000 7faa4e78b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa481eda30 0x7faa4814cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.618+0000 7faa4e78b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa480ab210 con 0x7faa480702a0 2024-01-25T15:05:00.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.618+0000 7faa4e78b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4806f6f0 con 0x7faa481eda30 2024-01-25T15:05:00.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.618+0000 7faa4e78b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa48099e30 con 0x7faa300039e0 2024-01-25T15:05:00.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.618+0000 7faa477fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa480702a0 0x7faa481ed4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.618+0000 7faa477fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa480702a0 0x7faa481ed4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40728/0 (socket says 172.21.15.29:40728) 2024-01-25T15:05:00.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.618+0000 7faa477fe640 1 -- 172.21.15.29:0/1409320066 learned_addr learned my addr 172.21.15.29:0/1409320066 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:00.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.618+0000 7faa4cd28640 1 --2- 172.21.15.29:0/1409320066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa481eda30 0x7faa4814cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.618+0000 7faa47fff640 1 --2- 172.21.15.29:0/1409320066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faa300039e0 0x7faa480c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.618+0000 7faa477fe640 1 -- 172.21.15.29:0/1409320066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faa300039e0 msgr2=0x7faa480c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.618+0000 7faa477fe640 1 --2- 172.21.15.29:0/1409320066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faa300039e0 0x7faa480c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.618+0000 7faa477fe640 1 -- 172.21.15.29:0/1409320066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa481eda30 msgr2=0x7faa4814cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.618+0000 7faa477fe640 1 --2- 172.21.15.29:0/1409320066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa481eda30 0x7faa4814cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.618+0000 7faa477fe640 1 -- 172.21.15.29:0/1409320066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa480aaf30 con 0x7faa480702a0 2024-01-25T15:05:00.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.618+0000 7faa47fff640 1 --2- 172.21.15.29:0/1409320066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faa300039e0 0x7faa480c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:00.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.618+0000 7faa477fe640 1 --2- 172.21.15.29:0/1409320066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa480702a0 0x7faa481ed4f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faa3c0114e0 tx=0x7faa3c0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:00.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.619+0000 7faa44ff9640 1 -- 172.21.15.29:0/1409320066 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c015870 con 0x7faa480702a0 2024-01-25T15:05:00.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.619+0000 7faa44ff9640 1 -- 172.21.15.29:0/1409320066 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c0159d0 con 0x7faa480702a0 2024-01-25T15:05:00.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.619+0000 7faa4e78b640 1 -- 172.21.15.29:0/1409320066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa481ea900 con 0x7faa480702a0 2024-01-25T15:05:00.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.619+0000 7faa44ff9640 1 -- 172.21.15.29:0/1409320066 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c015d80 con 0x7faa480702a0 2024-01-25T15:05:00.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.619+0000 7faa4e78b640 1 -- 172.21.15.29:0/1409320066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa480c6b40 con 0x7faa480702a0 2024-01-25T15:05:00.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.620+0000 7faa4e78b640 1 -- 172.21.15.29:0/1409320066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa481ea760 con 0x7faa480702a0 2024-01-25T15:05:00.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.620+0000 7faa44ff9640 1 -- 172.21.15.29:0/1409320066 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7faa3c01d400 con 0x7faa480702a0 2024-01-25T15:05:00.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.620+0000 7faa44ff9640 1 --2- 172.21.15.29:0/1409320066 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faa3406af00 0x7faa3406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.621+0000 7faa44ff9640 1 -- 172.21.15.29:0/1409320066 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faa3c089ef0 con 0x7faa480702a0 2024-01-25T15:05:00.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.621+0000 7faa47fff640 1 --2- 172.21.15.29:0/1409320066 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faa3406af00 0x7faa3406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.621+0000 7faa47fff640 1 --2- 172.21.15.29:0/1409320066 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faa3406af00 0x7faa3406d3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faa38034000 tx=0x7faa38009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:00.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.625+0000 7faa44ff9640 1 -- 172.21.15.29:0/1409320066 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7faa481ea760 con 0x7faa480702a0 2024-01-25T15:05:00.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.805+0000 7faa4e78b640 1 -- 172.21.15.29:0/1409320066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa481ea760 con 0x7faa480702a0 2024-01-25T15:05:00.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.806+0000 7faa44ff9640 1 -- 172.21.15.29:0/1409320066 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa481ea760 con 0x7faa480702a0 2024-01-25T15:05:00.807 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-25T15:05:00.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.808+0000 7faa4e78b640 1 -- 172.21.15.29:0/1409320066 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faa3406af00 msgr2=0x7faa3406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.808+0000 7faa4e78b640 1 --2- 172.21.15.29:0/1409320066 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faa3406af00 0x7faa3406d3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faa38034000 tx=0x7faa38009030 comp rx=0 tx=0).stop 2024-01-25T15:05:00.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.808+0000 7faa4e78b640 1 -- 172.21.15.29:0/1409320066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa480702a0 msgr2=0x7faa481ed4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.808+0000 7faa4e78b640 1 --2- 172.21.15.29:0/1409320066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa480702a0 0x7faa481ed4f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faa3c0114e0 tx=0x7faa3c0119a0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.808+0000 7faa4e78b640 1 -- 172.21.15.29:0/1409320066 shutdown_connections 2024-01-25T15:05:00.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.808+0000 7faa4e78b640 1 --2- 172.21.15.29:0/1409320066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa481eda30 0x7faa4814cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.808+0000 7faa4e78b640 1 --2- 172.21.15.29:0/1409320066 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faa3406af00 0x7faa3406d3c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.808+0000 7faa4e78b640 1 --2- 172.21.15.29:0/1409320066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa480702a0 0x7faa481ed4f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.808+0000 7faa4e78b640 1 --2- 172.21.15.29:0/1409320066 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faa300039e0 0x7faa480c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.808+0000 7faa4e78b640 1 -- 172.21.15.29:0/1409320066 >> 172.21.15.29:0/1409320066 conn(0x7faa480c7f80 msgr2=0x7faa480730a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:00.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.808+0000 7faa4e78b640 1 -- 172.21.15.29:0/1409320066 shutdown_connections 2024-01-25T15:05:00.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.808+0000 7faa4e78b640 1 -- 172.21.15.29:0/1409320066 wait complete. 2024-01-25T15:05:00.820 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:05:00.845 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-25T15:05:00.865 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-25T15:05:00.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.924+0000 7f8f24c2b640 1 Processor -- start 2024-01-25T15:05:00.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.924+0000 7f8f24c2b640 1 -- start start 2024-01-25T15:05:00.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.925+0000 7f8f24c2b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f2006cf10 0x7f8f201546c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.925+0000 7f8f24c2b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f200c30d0 con 0x7f8f20151d30 2024-01-25T15:05:00.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.925+0000 7f8f24c2b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f20155310 con 0x7f8f2006d3a0 2024-01-25T15:05:00.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.925+0000 7f8f24c2b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2006ef80 con 0x7f8f2006cf10 2024-01-25T15:05:00.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.925+0000 7f8f1e59c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8f20151d30 0x7f8f2006a6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49372/0 (socket says 172.21.15.29:49372) 2024-01-25T15:05:00.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.925+0000 7f8f1e59c640 1 -- 172.21.15.29:0/3528068777 learned_addr learned my addr 172.21.15.29:0/3528068777 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:00.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.925+0000 7f8f1dd9b640 1 -- 172.21.15.29:0/3528068777 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015491679 0 0) 0x7f8f200c30d0 con 0x7f8f20151d30 2024-01-25T15:05:00.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.925+0000 7f8f1dd9b640 1 -- 172.21.15.29:0/3528068777 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f0c003520 con 0x7f8f20151d30 2024-01-25T15:05:00.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.925+0000 7f8f17fff640 1 --2- 172.21.15.29:0/3528068777 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f2006cf10 0x7f8f201546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.925+0000 7f8f1dd9b640 1 -- 172.21.15.29:0/3528068777 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2377374903 0 0) 0x7f8f0c003520 con 0x7f8f20151d30 2024-01-25T15:05:00.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.925+0000 7f8f1dd9b640 1 -- 172.21.15.29:0/3528068777 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f2006cf10 msgr2=0x7f8f201546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:00.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.925+0000 7f8f1dd9b640 1 --2- 172.21.15.29:0/3528068777 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f2006cf10 0x7f8f201546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.925+0000 7f8f1dd9b640 1 -- 172.21.15.29:0/3528068777 >> v1:172.21.15.52:6789/0 conn(0x7f8f2006d3a0 legacy=0x7f8f20154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.925+0000 7f8f1dd9b640 1 -- 172.21.15.29:0/3528068777 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f20152110 con 0x7f8f20151d30 2024-01-25T15:05:00.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.925+0000 7f8f1dd9b640 1 -- 172.21.15.29:0/3528068777 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f8f10001670 con 0x7f8f20151d30 2024-01-25T15:05:00.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.925+0000 7f8f1dd9b640 1 -- 172.21.15.29:0/3528068777 >> v1:172.21.15.29:6789/0 conn(0x7f8f20151d30 legacy=0x7f8f2006a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.925+0000 7f8f1dd9b640 1 --2- 172.21.15.29:0/3528068777 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f2006cf10 0x7f8f0c003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.925+0000 7f8f1dd9b640 1 --2- 172.21.15.29:0/3528068777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f0c004040 0x7f8f0c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.925+0000 7f8f1dd9b640 1 --2- 172.21.15.29:0/3528068777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f0c004e20 0x7f8f0c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.926+0000 7f8f1dd9b640 1 -- 172.21.15.29:0/3528068777 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2006ef80 con 0x7f8f0c004e20 2024-01-25T15:05:00.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.926+0000 7f8f1dd9b640 1 -- 172.21.15.29:0/3528068777 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c005640 con 0x7f8f0c004040 2024-01-25T15:05:00.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.926+0000 7f8f1dd9b640 1 -- 172.21.15.29:0/3528068777 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c00bec0 con 0x7f8f2006cf10 2024-01-25T15:05:00.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.926+0000 7f8f1ed9d640 1 --2- 172.21.15.29:0/3528068777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f0c004e20 0x7f8f0c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.926+0000 7f8f1e59c640 1 --2- 172.21.15.29:0/3528068777 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f2006cf10 0x7f8f0c003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.926+0000 7f8f17fff640 1 --2- 172.21.15.29:0/3528068777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f0c004040 0x7f8f0c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.926+0000 7f8f1ed9d640 1 -- 172.21.15.29:0/3528068777 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f2006cf10 msgr2=0x7f8f0c003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.926+0000 7f8f1ed9d640 1 --2- 172.21.15.29:0/3528068777 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f2006cf10 0x7f8f0c003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.926+0000 7f8f1ed9d640 1 -- 172.21.15.29:0/3528068777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f0c004040 msgr2=0x7f8f0c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.926+0000 7f8f1ed9d640 1 --2- 172.21.15.29:0/3528068777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f0c004040 0x7f8f0c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.926+0000 7f8f1ed9d640 1 -- 172.21.15.29:0/3528068777 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0c003520 con 0x7f8f0c004e20 2024-01-25T15:05:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.927+0000 7f8f1ed9d640 1 --2- 172.21.15.29:0/3528068777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f0c004e20 0x7f8f0c00b980 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8f18001e80 tx=0x7f8f0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e5b4d9ebf23b7d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.927+0000 7f8f1dd9b640 1 -- 172.21.15.29:0/3528068777 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f18003b70 con 0x7f8f0c004e20 2024-01-25T15:05:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.927+0000 7f8f1dd9b640 1 -- 172.21.15.29:0/3528068777 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f18003cd0 con 0x7f8f0c004e20 2024-01-25T15:05:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.927+0000 7f8f1dd9b640 1 -- 172.21.15.29:0/3528068777 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f18005310 con 0x7f8f0c004e20 2024-01-25T15:05:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.927+0000 7f8f24c2b640 1 -- 172.21.15.29:0/3528068777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f0c004e20 msgr2=0x7f8f0c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.927+0000 7f8f24c2b640 1 --2- 172.21.15.29:0/3528068777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f0c004e20 0x7f8f0c00b980 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8f18001e80 tx=0x7f8f0c0057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.927+0000 7f8f1ed9d640 1 -- 172.21.15.29:0/3528068777 reap_dead start 2024-01-25T15:05:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.927+0000 7f8f24c2b640 1 -- 172.21.15.29:0/3528068777 shutdown_connections 2024-01-25T15:05:00.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.927+0000 7f8f24c2b640 1 -- 172.21.15.29:0/3528068777 >> 172.21.15.29:0/3528068777 conn(0x7f8f200c39b0 msgr2=0x7f8f200c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:00.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.927+0000 7f8f24c2b640 1 -- 172.21.15.29:0/3528068777 shutdown_connections 2024-01-25T15:05:00.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.927+0000 7f8f24c2b640 1 -- 172.21.15.29:0/3528068777 wait complete. 2024-01-25T15:05:00.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.929+0000 7f8f24c2b640 1 Processor -- start 2024-01-25T15:05:00.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.929+0000 7f8f24c2b640 1 -- start start 2024-01-25T15:05:00.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.929+0000 7f8f24c2b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f0c004e20 0x7f8f20071440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.929+0000 7f8f24c2b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f201e18a0 0x7f8f201ea060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.929+0000 7f8f24c2b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f201ea5a0 0x7f8f201ed5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.929+0000 7f8f24c2b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2014c4f0 con 0x7f8f201e18a0 2024-01-25T15:05:00.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.929+0000 7f8f24c2b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2014c380 con 0x7f8f0c004e20 2024-01-25T15:05:00.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.929+0000 7f8f24c2b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f201dffb0 con 0x7f8f201ea5a0 2024-01-25T15:05:00.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.929+0000 7f8f17fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f201e18a0 0x7f8f201ea060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.929+0000 7f8f17fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f201e18a0 0x7f8f201ea060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40746/0 (socket says 172.21.15.29:40746) 2024-01-25T15:05:00.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.929+0000 7f8f17fff640 1 -- 172.21.15.29:0/2037748404 learned_addr learned my addr 172.21.15.29:0/2037748404 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:00.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.930+0000 7f8f1e59c640 1 --2- 172.21.15.29:0/2037748404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f0c004e20 0x7f8f20071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.930+0000 7f8f1ed9d640 1 --2- 172.21.15.29:0/2037748404 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f201ea5a0 0x7f8f201ed5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.930+0000 7f8f17fff640 1 -- 172.21.15.29:0/2037748404 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f201ea5a0 msgr2=0x7f8f201ed5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.930+0000 7f8f17fff640 1 --2- 172.21.15.29:0/2037748404 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f201ea5a0 0x7f8f201ed5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.930+0000 7f8f17fff640 1 -- 172.21.15.29:0/2037748404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f0c004e20 msgr2=0x7f8f20071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:00.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.930+0000 7f8f17fff640 1 --2- 172.21.15.29:0/2037748404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f0c004e20 0x7f8f20071440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:00.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.930+0000 7f8f17fff640 1 -- 172.21.15.29:0/2037748404 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f200bfa50 con 0x7f8f201e18a0 2024-01-25T15:05:00.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.930+0000 7f8f17fff640 1 --2- 172.21.15.29:0/2037748404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f201e18a0 0x7f8f201ea060 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800b770 tx=0x7f8f0800bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:00.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.930+0000 7f8f16ffd640 1 -- 172.21.15.29:0/2037748404 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f08010730 con 0x7f8f201e18a0 2024-01-25T15:05:00.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.930+0000 7f8f16ffd640 1 -- 172.21.15.29:0/2037748404 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f08010890 con 0x7f8f201e18a0 2024-01-25T15:05:00.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.930+0000 7f8f24c2b640 1 -- 172.21.15.29:0/2037748404 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2014c6d0 con 0x7f8f201e18a0 2024-01-25T15:05:00.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.930+0000 7f8f16ffd640 1 -- 172.21.15.29:0/2037748404 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f08010c40 con 0x7f8f201e18a0 2024-01-25T15:05:00.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.930+0000 7f8f24c2b640 1 -- 172.21.15.29:0/2037748404 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f201e1380 con 0x7f8f201e18a0 2024-01-25T15:05:00.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.931+0000 7f8f24c2b640 1 -- 172.21.15.29:0/2037748404 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f20074010 con 0x7f8f201e18a0 2024-01-25T15:05:00.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.932+0000 7f8f16ffd640 1 -- 172.21.15.29:0/2037748404 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8f08014430 con 0x7f8f201e18a0 2024-01-25T15:05:00.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.932+0000 7f8f16ffd640 1 --2- 172.21.15.29:0/2037748404 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8f0006aed0 0x7f8f0006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:00.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.932+0000 7f8f16ffd640 1 -- 172.21.15.29:0/2037748404 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8f08089d20 con 0x7f8f201e18a0 2024-01-25T15:05:00.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.932+0000 7f8f1e59c640 1 --2- 172.21.15.29:0/2037748404 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8f0006aed0 0x7f8f0006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:00.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.933+0000 7f8f1e59c640 1 --2- 172.21.15.29:0/2037748404 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8f0006aed0 0x7f8f0006d390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8f100017a0 tx=0x7f8f100015d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:00.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:00.936+0000 7f8f16ffd640 1 -- 172.21.15.29:0/2037748404 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8f08054a40 con 0x7f8f201e18a0 2024-01-25T15:05:01.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.118+0000 7f8f24c2b640 1 -- 172.21.15.29:0/2037748404 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8f200c6ba0 con 0x7f8f201e18a0 2024-01-25T15:05:01.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.118+0000 7f8f16ffd640 1 -- 172.21.15.29:0/2037748404 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8f08058060 con 0x7f8f201e18a0 2024-01-25T15:05:01.119 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:01.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.120+0000 7f8f24c2b640 1 -- 172.21.15.29:0/2037748404 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8f0006aed0 msgr2=0x7f8f0006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:01.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.120+0000 7f8f24c2b640 1 --2- 172.21.15.29:0/2037748404 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8f0006aed0 0x7f8f0006d390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8f100017a0 tx=0x7f8f100015d0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.120+0000 7f8f24c2b640 1 -- 172.21.15.29:0/2037748404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f201e18a0 msgr2=0x7f8f201ea060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:01.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.120+0000 7f8f24c2b640 1 --2- 172.21.15.29:0/2037748404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f201e18a0 0x7f8f201ea060 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800b770 tx=0x7f8f0800bc30 comp rx=0 tx=0).stop 2024-01-25T15:05:01.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.120+0000 7f8f24c2b640 1 -- 172.21.15.29:0/2037748404 shutdown_connections 2024-01-25T15:05:01.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.120+0000 7f8f24c2b640 1 --2- 172.21.15.29:0/2037748404 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f201ea5a0 0x7f8f201ed5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.120+0000 7f8f24c2b640 1 --2- 172.21.15.29:0/2037748404 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8f0006aed0 0x7f8f0006d390 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.120+0000 7f8f24c2b640 1 --2- 172.21.15.29:0/2037748404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f201e18a0 0x7f8f201ea060 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.120+0000 7f8f24c2b640 1 --2- 172.21.15.29:0/2037748404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f0c004e20 0x7f8f20071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.120+0000 7f8f24c2b640 1 -- 172.21.15.29:0/2037748404 >> 172.21.15.29:0/2037748404 conn(0x7f8f200c39b0 msgr2=0x7f8f20150490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:01.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.120+0000 7f8f24c2b640 1 -- 172.21.15.29:0/2037748404 shutdown_connections 2024-01-25T15:05:01.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.120+0000 7f8f24c2b640 1 -- 172.21.15.29:0/2037748404 wait complete. 2024-01-25T15:05:01.132 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:05:01.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.236+0000 7f59dab89640 1 Processor -- start 2024-01-25T15:05:01.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.236+0000 7f59dab89640 1 -- start start 2024-01-25T15:05:01.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.237+0000 7f59dab89640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f59d4151cd0 0x7f59d40c29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:01.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.237+0000 7f59dab89640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d406aad0 con 0x7f59d406af60 2024-01-25T15:05:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.237+0000 7f59dab89640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d4155380 con 0x7f59d40c1060 2024-01-25T15:05:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.237+0000 7f59dab89640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d40c2fd0 con 0x7f59d4151cd0 2024-01-25T15:05:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.237+0000 7f59d8925640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f59d4151cd0 0x7f59d40c29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.237+0000 7f59d9126640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f59d406af60 0x7f59d406b3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49386/0 (socket says 172.21.15.29:49386) 2024-01-25T15:05:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.237+0000 7f59d9126640 1 -- 172.21.15.29:0/190020644 learned_addr learned my addr 172.21.15.29:0/190020644 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.237+0000 7f59d8925640 1 -- 172.21.15.29:0/190020644 >> v1:172.21.15.52:6789/0 conn(0x7f59d40c1060 legacy=0x7f59d40bfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.237+0000 7f59d8925640 1 -- 172.21.15.29:0/190020644 >> v1:172.21.15.29:6789/0 conn(0x7f59d406af60 legacy=0x7f59d406b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.237+0000 7f59d8925640 1 -- 172.21.15.29:0/190020644 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d4155660 con 0x7f59d4151cd0 2024-01-25T15:05:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.237+0000 7f59d37fe640 1 -- 172.21.15.29:0/190020644 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695754690 0 0) 0x7f59d406aad0 con 0x7f59d406af60 2024-01-25T15:05:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.238+0000 7f59d8925640 1 --2- 172.21.15.29:0/190020644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59d4151cd0 0x7f59d40c29d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f59c80097a0 tx=0x7f59c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a627f91a7c10355 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.238+0000 7f59d37fe640 1 -- 172.21.15.29:0/190020644 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c8031830 con 0x7f59d4151cd0 2024-01-25T15:05:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.238+0000 7f59d37fe640 1 -- 172.21.15.29:0/190020644 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c8031990 con 0x7f59d4151cd0 2024-01-25T15:05:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.238+0000 7f59d37fe640 1 -- 172.21.15.29:0/190020644 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c8031d20 con 0x7f59d4151cd0 2024-01-25T15:05:01.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.238+0000 7f59dab89640 1 -- 172.21.15.29:0/190020644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59d4151cd0 msgr2=0x7f59d40c29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:01.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.238+0000 7f59dab89640 1 --2- 172.21.15.29:0/190020644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59d4151cd0 0x7f59d40c29d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f59c80097a0 tx=0x7f59c802b8d0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.238+0000 7f59dab89640 1 -- 172.21.15.29:0/190020644 shutdown_connections 2024-01-25T15:05:01.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.238+0000 7f59dab89640 1 --2- 172.21.15.29:0/190020644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59d4151cd0 0x7f59d40c29d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.238+0000 7f59dab89640 1 -- 172.21.15.29:0/190020644 >> 172.21.15.29:0/190020644 conn(0x7f59d40a8410 msgr2=0x7f59d40a87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:01.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.238+0000 7f59dab89640 1 -- 172.21.15.29:0/190020644 shutdown_connections 2024-01-25T15:05:01.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.238+0000 7f59dab89640 1 -- 172.21.15.29:0/190020644 wait complete. 2024-01-25T15:05:01.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.240+0000 7f59dab89640 1 Processor -- start 2024-01-25T15:05:01.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.240+0000 7f59dab89640 1 -- start start 2024-01-25T15:05:01.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.240+0000 7f59dab89640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59d406af60 0x7f59d414e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:01.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.240+0000 7f59dab89640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59d40c1060 0x7f59d41ed9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:01.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.240+0000 7f59dab89640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d4151cd0 0x7f59d40a9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:01.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.240+0000 7f59dab89640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d4153510 con 0x7f59d40c1060 2024-01-25T15:05:01.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.240+0000 7f59dab89640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d4155bf0 con 0x7f59d406af60 2024-01-25T15:05:01.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.240+0000 7f59dab89640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d414dff0 con 0x7f59d4151cd0 2024-01-25T15:05:01.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.240+0000 7f59d3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59d40c1060 0x7f59d41ed9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:01.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.241+0000 7f59d3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59d40c1060 0x7f59d41ed9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40768/0 (socket says 172.21.15.29:40768) 2024-01-25T15:05:01.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.241+0000 7f59d3fff640 1 -- 172.21.15.29:0/858340141 learned_addr learned my addr 172.21.15.29:0/858340141 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:01.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.241+0000 7f59d8925640 1 --2- 172.21.15.29:0/858340141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59d406af60 0x7f59d414e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:01.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.241+0000 7f59d9126640 1 --2- 172.21.15.29:0/858340141 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d4151cd0 0x7f59d40a9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:01.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.241+0000 7f59d3fff640 1 -- 172.21.15.29:0/858340141 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d4151cd0 msgr2=0x7f59d40a9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:01.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.241+0000 7f59d3fff640 1 --2- 172.21.15.29:0/858340141 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d4151cd0 0x7f59d40a9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.241+0000 7f59d3fff640 1 -- 172.21.15.29:0/858340141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59d406af60 msgr2=0x7f59d414e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:01.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.241+0000 7f59d3fff640 1 --2- 172.21.15.29:0/858340141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59d406af60 0x7f59d414e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.241+0000 7f59d3fff640 1 -- 172.21.15.29:0/858340141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c8009400 con 0x7f59d40c1060 2024-01-25T15:05:01.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.241+0000 7f59d3fff640 1 --2- 172.21.15.29:0/858340141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59d40c1060 0x7f59d41ed9e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f59c000c450 tx=0x7f59c000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:01.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.241+0000 7f59d17fa640 1 -- 172.21.15.29:0/858340141 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c00052d0 con 0x7f59d40c1060 2024-01-25T15:05:01.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.241+0000 7f59d17fa640 1 -- 172.21.15.29:0/858340141 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c0005430 con 0x7f59d40c1060 2024-01-25T15:05:01.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.241+0000 7f59dab89640 1 -- 172.21.15.29:0/858340141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d41ee300 con 0x7f59d40c1060 2024-01-25T15:05:01.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.241+0000 7f59d17fa640 1 -- 172.21.15.29:0/858340141 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c0012870 con 0x7f59d40c1060 2024-01-25T15:05:01.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.241+0000 7f59dab89640 1 -- 172.21.15.29:0/858340141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d414e960 con 0x7f59d40c1060 2024-01-25T15:05:01.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.242+0000 7f59dab89640 1 -- 172.21.15.29:0/858340141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d40c1d50 con 0x7f59d40c1060 2024-01-25T15:05:01.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.243+0000 7f59d17fa640 1 -- 172.21.15.29:0/858340141 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f59c00129d0 con 0x7f59d40c1060 2024-01-25T15:05:01.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.243+0000 7f59d17fa640 1 --2- 172.21.15.29:0/858340141 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f59b806aed0 0x7f59b806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:01.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.243+0000 7f59d17fa640 1 -- 172.21.15.29:0/858340141 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f59c00893f0 con 0x7f59d40c1060 2024-01-25T15:05:01.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.243+0000 7f59d8925640 1 --2- 172.21.15.29:0/858340141 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f59b806aed0 0x7f59b806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:01.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.244+0000 7f59d8925640 1 --2- 172.21.15.29:0/858340141 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f59b806aed0 0x7f59b806d390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f59c8036000 tx=0x7f59c803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:01.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.247+0000 7f59d17fa640 1 -- 172.21.15.29:0/858340141 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f59c0054060 con 0x7f59d40c1060 2024-01-25T15:05:01.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.425+0000 7f59dab89640 1 -- 172.21.15.29:0/858340141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f59d4067be0 con 0x7f59d40c1060 2024-01-25T15:05:01.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.426+0000 7f59d17fa640 1 -- 172.21.15.29:0/858340141 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f59c0057680 con 0x7f59d40c1060 2024-01-25T15:05:01.427 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-25T15:05:01.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.428+0000 7f59dab89640 1 -- 172.21.15.29:0/858340141 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f59b806aed0 msgr2=0x7f59b806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:01.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.428+0000 7f59dab89640 1 --2- 172.21.15.29:0/858340141 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f59b806aed0 0x7f59b806d390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f59c8036000 tx=0x7f59c803c040 comp rx=0 tx=0).stop 2024-01-25T15:05:01.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.428+0000 7f59dab89640 1 -- 172.21.15.29:0/858340141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59d40c1060 msgr2=0x7f59d41ed9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:01.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.428+0000 7f59dab89640 1 --2- 172.21.15.29:0/858340141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59d40c1060 0x7f59d41ed9e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f59c000c450 tx=0x7f59c000c910 comp rx=0 tx=0).stop 2024-01-25T15:05:01.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.428+0000 7f59dab89640 1 -- 172.21.15.29:0/858340141 shutdown_connections 2024-01-25T15:05:01.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.428+0000 7f59dab89640 1 --2- 172.21.15.29:0/858340141 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f59d4151cd0 0x7f59d40a9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.428+0000 7f59dab89640 1 --2- 172.21.15.29:0/858340141 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f59b806aed0 0x7f59b806d390 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.428+0000 7f59dab89640 1 --2- 172.21.15.29:0/858340141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59d40c1060 0x7f59d41ed9e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.428+0000 7f59dab89640 1 --2- 172.21.15.29:0/858340141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59d406af60 0x7f59d414e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.428+0000 7f59dab89640 1 -- 172.21.15.29:0/858340141 >> 172.21.15.29:0/858340141 conn(0x7f59d40a8410 msgr2=0x7f59d406d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:01.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.428+0000 7f59dab89640 1 -- 172.21.15.29:0/858340141 shutdown_connections 2024-01-25T15:05:01.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.428+0000 7f59dab89640 1 -- 172.21.15.29:0/858340141 wait complete. 2024-01-25T15:05:01.439 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-25T15:05:01.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.543+0000 7f0a21c75640 1 Processor -- start 2024-01-25T15:05:01.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.543+0000 7f0a21c75640 1 -- start start 2024-01-25T15:05:01.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.544+0000 7f0a21c75640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0a1c06bf00 0x7f0a1c1519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:01.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.544+0000 7f0a21c75640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1c06c360 con 0x7f0a1c14eb20 2024-01-25T15:05:01.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.544+0000 7f0a21c75640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1c152310 con 0x7f0a1c151f00 2024-01-25T15:05:01.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.544+0000 7f0a21c75640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0a92d0 con 0x7f0a1c06bf00 2024-01-25T15:05:01.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.544+0000 7f0a1b7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0a1c14eb20 0x7f0a1c0c1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49398/0 (socket says 172.21.15.29:49398) 2024-01-25T15:05:01.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.544+0000 7f0a1b7fe640 1 -- 172.21.15.29:0/3093155749 learned_addr learned my addr 172.21.15.29:0/3093155749 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:01.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1a7fc640 1 -- 172.21.15.29:0/3093155749 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195174740 0 0) 0x7f0a0c001110 con 0x7f0a1c14eb20 2024-01-25T15:05:01.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1a7fc640 1 -- 172.21.15.29:0/3093155749 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a04003520 con 0x7f0a1c14eb20 2024-01-25T15:05:01.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1affd640 1 --2- 172.21.15.29:0/3093155749 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0a1c06bf00 0x7f0a1c1519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:01.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1a7fc640 1 -- 172.21.15.29:0/3093155749 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3250698771 0 0) 0x7f0a04003520 con 0x7f0a1c14eb20 2024-01-25T15:05:01.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1a7fc640 1 -- 172.21.15.29:0/3093155749 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0a1c06bf00 msgr2=0x7f0a1c1519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:01.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1a7fc640 1 --2- 172.21.15.29:0/3093155749 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0a1c06bf00 0x7f0a1c1519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1a7fc640 1 -- 172.21.15.29:0/3093155749 >> v1:172.21.15.52:6789/0 conn(0x7f0a1c151f00 legacy=0x7f0a1c15bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:01.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1a7fc640 1 -- 172.21.15.29:0/3093155749 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1c1557e0 con 0x7f0a1c14eb20 2024-01-25T15:05:01.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1a7fc640 1 -- 172.21.15.29:0/3093155749 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f0a0c001800 con 0x7f0a1c14eb20 2024-01-25T15:05:01.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1a7fc640 1 -- 172.21.15.29:0/3093155749 >> v1:172.21.15.29:6789/0 conn(0x7f0a1c14eb20 legacy=0x7f0a1c0c1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:01.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1a7fc640 1 --2- 172.21.15.29:0/3093155749 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0a1c06bf00 0x7f0a04003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:01.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1a7fc640 1 --2- 172.21.15.29:0/3093155749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a04003f90 0x7f0a040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:01.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1a7fc640 1 --2- 172.21.15.29:0/3093155749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a04004d00 0x7f0a04005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:01.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1a7fc640 1 -- 172.21.15.29:0/3093155749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0a92d0 con 0x7f0a04003f90 2024-01-25T15:05:01.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1a7fc640 1 -- 172.21.15.29:0/3093155749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0400bc10 con 0x7f0a04004d00 2024-01-25T15:05:01.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1a7fc640 1 -- 172.21.15.29:0/3093155749 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0400bdd0 con 0x7f0a1c06bf00 2024-01-25T15:05:01.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1affd640 1 --2- 172.21.15.29:0/3093155749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a04003f90 0x7f0a040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:01.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1b7fe640 1 --2- 172.21.15.29:0/3093155749 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0a1c06bf00 0x7f0a04003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:01.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1bfff640 1 --2- 172.21.15.29:0/3093155749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a04004d00 0x7f0a04005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:01.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1affd640 1 -- 172.21.15.29:0/3093155749 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0a1c06bf00 msgr2=0x7f0a04003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:01.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1affd640 1 --2- 172.21.15.29:0/3093155749 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0a1c06bf00 0x7f0a04003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1affd640 1 -- 172.21.15.29:0/3093155749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a04004d00 msgr2=0x7f0a04005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:01.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1affd640 1 --2- 172.21.15.29:0/3093155749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a04004d00 0x7f0a04005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.545+0000 7f0a1affd640 1 -- 172.21.15.29:0/3093155749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a04003520 con 0x7f0a04003f90 2024-01-25T15:05:01.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.546+0000 7f0a1affd640 1 --2- 172.21.15.29:0/3093155749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a04003f90 0x7f0a040047c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0a10009ac0 tx=0x7f0a040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783af31aeb72da60 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:01.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.546+0000 7f0a1a7fc640 1 -- 172.21.15.29:0/3093155749 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1002c6b0 con 0x7f0a04003f90 2024-01-25T15:05:01.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.546+0000 7f0a1a7fc640 1 -- 172.21.15.29:0/3093155749 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1002c810 con 0x7f0a04003f90 2024-01-25T15:05:01.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.546+0000 7f0a1a7fc640 1 -- 172.21.15.29:0/3093155749 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1002cba0 con 0x7f0a04003f90 2024-01-25T15:05:01.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.547+0000 7f0a21c75640 1 -- 172.21.15.29:0/3093155749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a04003f90 msgr2=0x7f0a040047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:01.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.547+0000 7f0a21c75640 1 --2- 172.21.15.29:0/3093155749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a04003f90 0x7f0a040047c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0a10009ac0 tx=0x7f0a040057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.547+0000 7f0a1bfff640 1 -- 172.21.15.29:0/3093155749 reap_dead start 2024-01-25T15:05:01.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.547+0000 7f0a21c75640 1 -- 172.21.15.29:0/3093155749 shutdown_connections 2024-01-25T15:05:01.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.547+0000 7f0a21c75640 1 -- 172.21.15.29:0/3093155749 >> 172.21.15.29:0/3093155749 conn(0x7f0a1c0c2a10 msgr2=0x7f0a1c0c2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:01.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.547+0000 7f0a21c75640 1 -- 172.21.15.29:0/3093155749 shutdown_connections 2024-01-25T15:05:01.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.547+0000 7f0a21c75640 1 -- 172.21.15.29:0/3093155749 wait complete. 2024-01-25T15:05:01.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.548+0000 7f0a21c75640 1 Processor -- start 2024-01-25T15:05:01.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.548+0000 7f0a21c75640 1 -- start start 2024-01-25T15:05:01.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.549+0000 7f0a21c75640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a04003f90 0x7f0a1c145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:01.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.549+0000 7f0a21c75640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0a1c1446a0 0x7f0a1c144b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:01.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.549+0000 7f0a21c75640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a1c143a80 0x7f0a1c143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:01.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.549+0000 7f0a21c75640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0aa4a0 con 0x7f0a1c143a80 2024-01-25T15:05:01.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.549+0000 7f0a21c75640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c147c90 con 0x7f0a04003f90 2024-01-25T15:05:01.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.549+0000 7f0a21c75640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c144450 con 0x7f0a1c1446a0 2024-01-25T15:05:01.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.549+0000 7f0a1bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a1c143a80 0x7f0a1c143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:01.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.549+0000 7f0a1bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a1c143a80 0x7f0a1c143f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40784/0 (socket says 172.21.15.29:40784) 2024-01-25T15:05:01.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.549+0000 7f0a1bfff640 1 -- 172.21.15.29:0/2122754287 learned_addr learned my addr 172.21.15.29:0/2122754287 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:01.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.549+0000 7f0a1b7fe640 1 --2- 172.21.15.29:0/2122754287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a04003f90 0x7f0a1c145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:01.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.549+0000 7f0a1affd640 1 --2- 172.21.15.29:0/2122754287 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0a1c1446a0 0x7f0a1c144b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:01.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.549+0000 7f0a1bfff640 1 -- 172.21.15.29:0/2122754287 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0a1c1446a0 msgr2=0x7f0a1c144b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:01.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.549+0000 7f0a1bfff640 1 --2- 172.21.15.29:0/2122754287 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0a1c1446a0 0x7f0a1c144b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.549+0000 7f0a1bfff640 1 -- 172.21.15.29:0/2122754287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a04003f90 msgr2=0x7f0a1c145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:01.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.549+0000 7f0a1bfff640 1 --2- 172.21.15.29:0/2122754287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a04003f90 0x7f0a1c145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.549+0000 7f0a1bfff640 1 -- 172.21.15.29:0/2122754287 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1c1463d0 con 0x7f0a1c143a80 2024-01-25T15:05:01.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.549+0000 7f0a1bfff640 1 --2- 172.21.15.29:0/2122754287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a1c143a80 0x7f0a1c143f10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c1522e0 tx=0x7f0a1400fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:01.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.550+0000 7f0a03fff640 1 -- 172.21.15.29:0/2122754287 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1400fed0 con 0x7f0a1c143a80 2024-01-25T15:05:01.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.550+0000 7f0a03fff640 1 -- 172.21.15.29:0/2122754287 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a14006d60 con 0x7f0a1c143a80 2024-01-25T15:05:01.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.550+0000 7f0a21c75640 1 -- 172.21.15.29:0/2122754287 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1c1e8a00 con 0x7f0a1c143a80 2024-01-25T15:05:01.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.550+0000 7f0a03fff640 1 -- 172.21.15.29:0/2122754287 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14003b90 con 0x7f0a1c143a80 2024-01-25T15:05:01.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.550+0000 7f0a21c75640 1 -- 172.21.15.29:0/2122754287 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1c0aa010 con 0x7f0a1c143a80 2024-01-25T15:05:01.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.550+0000 7f0a21c75640 1 -- 172.21.15.29:0/2122754287 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1c067be0 con 0x7f0a1c143a80 2024-01-25T15:05:01.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.551+0000 7f0a03fff640 1 -- 172.21.15.29:0/2122754287 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0a14003cf0 con 0x7f0a1c143a80 2024-01-25T15:05:01.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.551+0000 7f0a03fff640 1 --2- 172.21.15.29:0/2122754287 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0a0806af00 0x7f0a0806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:01.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.551+0000 7f0a03fff640 1 -- 172.21.15.29:0/2122754287 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0a14088f30 con 0x7f0a1c143a80 2024-01-25T15:05:01.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.552+0000 7f0a1b7fe640 1 --2- 172.21.15.29:0/2122754287 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0a0806af00 0x7f0a0806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:01.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.552+0000 7f0a1b7fe640 1 --2- 172.21.15.29:0/2122754287 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0a0806af00 0x7f0a0806d3c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0c3710 tx=0x7f0a0c007a70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:01.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.556+0000 7f0a03fff640 1 -- 172.21.15.29:0/2122754287 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f0a14053bc0 con 0x7f0a1c143a80 2024-01-25T15:05:01.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.735+0000 7f0a21c75640 1 -- 172.21.15.29:0/2122754287 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0a1c151460 con 0x7f0a1c143a80 2024-01-25T15:05:01.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.735+0000 7f0a03fff640 1 -- 172.21.15.29:0/2122754287 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0a140571e0 con 0x7f0a1c143a80 2024-01-25T15:05:01.736 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.737+0000 7f0a21c75640 1 -- 172.21.15.29:0/2122754287 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0a0806af00 msgr2=0x7f0a0806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.737+0000 7f0a21c75640 1 --2- 172.21.15.29:0/2122754287 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0a0806af00 0x7f0a0806d3c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0c3710 tx=0x7f0a0c007a70 comp rx=0 tx=0).stop 2024-01-25T15:05:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.737+0000 7f0a21c75640 1 -- 172.21.15.29:0/2122754287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a1c143a80 msgr2=0x7f0a1c143f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.737+0000 7f0a21c75640 1 --2- 172.21.15.29:0/2122754287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a1c143a80 0x7f0a1c143f10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c1522e0 tx=0x7f0a1400fc80 comp rx=0 tx=0).stop 2024-01-25T15:05:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.737+0000 7f0a21c75640 1 -- 172.21.15.29:0/2122754287 shutdown_connections 2024-01-25T15:05:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.737+0000 7f0a21c75640 1 --2- 172.21.15.29:0/2122754287 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0a0806af00 0x7f0a0806d3c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.737+0000 7f0a21c75640 1 --2- 172.21.15.29:0/2122754287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a1c143a80 0x7f0a1c143f10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.737+0000 7f0a21c75640 1 --2- 172.21.15.29:0/2122754287 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0a1c1446a0 0x7f0a1c144b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.737+0000 7f0a21c75640 1 --2- 172.21.15.29:0/2122754287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a04003f90 0x7f0a1c145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.737+0000 7f0a21c75640 1 -- 172.21.15.29:0/2122754287 >> 172.21.15.29:0/2122754287 conn(0x7f0a1c0c2a10 msgr2=0x7f0a1c154bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.737+0000 7f0a21c75640 1 -- 172.21.15.29:0/2122754287 shutdown_connections 2024-01-25T15:05:01.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.737+0000 7f0a21c75640 1 -- 172.21.15.29:0/2122754287 wait complete. 2024-01-25T15:05:01.748 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:01.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.849+0000 7f8d40373640 1 Processor -- start 2024-01-25T15:05:01.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.849+0000 7f8d40373640 1 -- start start 2024-01-25T15:05:01.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.849+0000 7f8d40373640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8d38152160 0x7f8d3806bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:01.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.850+0000 7f8d40373640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d380c4990 0x7f8d380c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:01.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.850+0000 7f8d40373640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8d380c53e0 0x7f8d380c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:01.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.850+0000 7f8d40373640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d38155430 con 0x7f8d38152160 2024-01-25T15:05:01.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.850+0000 7f8d40373640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d38154b40 con 0x7f8d380c53e0 2024-01-25T15:05:01.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.850+0000 7f8d40373640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d38152540 con 0x7f8d380c4990 2024-01-25T15:05:01.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.850+0000 7f8d3e10f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8d38152160 0x7f8d3806bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:01.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.850+0000 7f8d3e10f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8d38152160 0x7f8d3806bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40800/0 (socket says 172.21.15.29:40800) 2024-01-25T15:05:01.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.850+0000 7f8d3e10f640 1 -- 172.21.15.29:0/177596200 learned_addr learned my addr 172.21.15.29:0/177596200 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:01.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.850+0000 7f8d3d90e640 1 --2- 172.21.15.29:0/177596200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d380c4990 0x7f8d380c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:01.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.850+0000 7f8d3e910640 1 --2- 172.21.15.29:0/177596200 >> v2:172.21.15.52:3300/0 conn(0x7f8d380c53e0 0x7f8d380c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:01.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.850+0000 7f8d3e10f640 1 -- 172.21.15.29:0/177596200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d380c4990 msgr2=0x7f8d380c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:01.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.850+0000 7f8d3e10f640 1 --2- 172.21.15.29:0/177596200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d380c4990 0x7f8d380c4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.850+0000 7f8d3e10f640 1 -- 172.21.15.29:0/177596200 >> v2:172.21.15.52:3300/0 conn(0x7f8d380c53e0 msgr2=0x7f8d380c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:01.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.850+0000 7f8d3e10f640 1 --2- 172.21.15.29:0/177596200 >> v2:172.21.15.52:3300/0 conn(0x7f8d380c53e0 0x7f8d380c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.850+0000 7f8d3e10f640 1 -- 172.21.15.29:0/177596200 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d380c64b0 con 0x7f8d38152160 2024-01-25T15:05:01.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.851+0000 7f8d3e10f640 1 --2- 172.21.15.29:0/177596200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d38152160 0x7f8d3806bc00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8d380acfa0 tx=0x7f8d3402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c76304914e3775 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:01.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.851+0000 7f8d3d10d640 1 -- 172.21.15.29:0/177596200 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d340317e0 con 0x7f8d38152160 2024-01-25T15:05:01.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.851+0000 7f8d3d10d640 1 -- 172.21.15.29:0/177596200 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d34031940 con 0x7f8d38152160 2024-01-25T15:05:01.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.851+0000 7f8d3d10d640 1 -- 172.21.15.29:0/177596200 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d34031cd0 con 0x7f8d38152160 2024-01-25T15:05:01.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.851+0000 7f8d40373640 1 -- 172.21.15.29:0/177596200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d38152160 msgr2=0x7f8d3806bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:01.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.851+0000 7f8d40373640 1 --2- 172.21.15.29:0/177596200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d38152160 0x7f8d3806bc00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8d380acfa0 tx=0x7f8d3402b880 comp rx=0 tx=0).stop 2024-01-25T15:05:01.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.852+0000 7f8d40373640 1 -- 172.21.15.29:0/177596200 shutdown_connections 2024-01-25T15:05:01.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.852+0000 7f8d40373640 1 --2- 172.21.15.29:0/177596200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d380c4990 0x7f8d380c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.852+0000 7f8d40373640 1 --2- 172.21.15.29:0/177596200 >> v2:172.21.15.52:3300/0 conn(0x7f8d380c53e0 0x7f8d380c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.852+0000 7f8d40373640 1 --2- 172.21.15.29:0/177596200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d38152160 0x7f8d3806bc00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.852+0000 7f8d40373640 1 -- 172.21.15.29:0/177596200 >> 172.21.15.29:0/177596200 conn(0x7f8d380ca1f0 msgr2=0x7f8d380ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:01.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.852+0000 7f8d40373640 1 -- 172.21.15.29:0/177596200 shutdown_connections 2024-01-25T15:05:01.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.852+0000 7f8d40373640 1 -- 172.21.15.29:0/177596200 wait complete. 2024-01-25T15:05:01.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.853+0000 7f8d40373640 1 Processor -- start 2024-01-25T15:05:01.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.853+0000 7f8d40373640 1 -- start start 2024-01-25T15:05:01.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.853+0000 7f8d40373640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d380c4990 0x7f8d381ee030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:01.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.853+0000 7f8d40373640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d380c53e0 0x7f8d380aada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:01.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.853+0000 7f8d40373640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d38152160 0x7f8d380c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:01.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.853+0000 7f8d40373640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d381ed620 con 0x7f8d380c4990 2024-01-25T15:05:01.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.853+0000 7f8d40373640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d381ee570 con 0x7f8d38152160 2024-01-25T15:05:01.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.853+0000 7f8d40373640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d381edba0 con 0x7f8d380c53e0 2024-01-25T15:05:01.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.853+0000 7f8d3e10f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d380c4990 0x7f8d381ee030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:01.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.853+0000 7f8d3e10f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d380c4990 0x7f8d381ee030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40812/0 (socket says 172.21.15.29:40812) 2024-01-25T15:05:01.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.853+0000 7f8d3e10f640 1 -- 172.21.15.29:0/736885510 learned_addr learned my addr 172.21.15.29:0/736885510 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:01.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.854+0000 7f8d3d90e640 1 --2- 172.21.15.29:0/736885510 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d380c53e0 0x7f8d380aada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:01.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.854+0000 7f8d3e910640 1 --2- 172.21.15.29:0/736885510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d38152160 0x7f8d380c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:01.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.854+0000 7f8d3e10f640 1 -- 172.21.15.29:0/736885510 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d380c53e0 msgr2=0x7f8d380aada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:01.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.854+0000 7f8d3e10f640 1 --2- 172.21.15.29:0/736885510 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d380c53e0 0x7f8d380aada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.854+0000 7f8d3e10f640 1 -- 172.21.15.29:0/736885510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d38152160 msgr2=0x7f8d380c1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:01.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.854+0000 7f8d3e10f640 1 --2- 172.21.15.29:0/736885510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d38152160 0x7f8d380c1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:01.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.854+0000 7f8d3e10f640 1 -- 172.21.15.29:0/736885510 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d340094d0 con 0x7f8d380c4990 2024-01-25T15:05:01.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.854+0000 7f8d3e10f640 1 --2- 172.21.15.29:0/736885510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d380c4990 0x7f8d381ee030 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8d3402b8c0 tx=0x7f8d340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:01.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.854+0000 7f8d2effd640 1 -- 172.21.15.29:0/736885510 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d34032880 con 0x7f8d380c4990 2024-01-25T15:05:01.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.854+0000 7f8d2effd640 1 -- 172.21.15.29:0/736885510 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d34032a20 con 0x7f8d380c4990 2024-01-25T15:05:01.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.854+0000 7f8d40373640 1 -- 172.21.15.29:0/736885510 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d38150830 con 0x7f8d380c4990 2024-01-25T15:05:01.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.854+0000 7f8d2effd640 1 -- 172.21.15.29:0/736885510 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d34032dd0 con 0x7f8d380c4990 2024-01-25T15:05:01.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.854+0000 7f8d40373640 1 -- 172.21.15.29:0/736885510 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d380bd730 con 0x7f8d380c4990 2024-01-25T15:05:01.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.855+0000 7f8d40373640 1 -- 172.21.15.29:0/736885510 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d380aa950 con 0x7f8d380c4990 2024-01-25T15:05:01.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.855+0000 7f8d2effd640 1 -- 172.21.15.29:0/736885510 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8d3404e450 con 0x7f8d380c4990 2024-01-25T15:05:01.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.856+0000 7f8d2effd640 1 --2- 172.21.15.29:0/736885510 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8d1c06aed0 0x7f8d1c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:01.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.856+0000 7f8d2effd640 1 -- 172.21.15.29:0/736885510 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8d340aba50 con 0x7f8d380c4990 2024-01-25T15:05:01.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.856+0000 7f8d3d90e640 1 --2- 172.21.15.29:0/736885510 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8d1c06aed0 0x7f8d1c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:01.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.856+0000 7f8d3d90e640 1 --2- 172.21.15.29:0/736885510 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8d1c06aed0 0x7f8d1c06d390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8d28006fd0 tx=0x7f8d28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:01.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:01.860+0000 7f8d2effd640 1 -- 172.21.15.29:0/736885510 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8d340766c0 con 0x7f8d380c4990 2024-01-25T15:05:02.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.037+0000 7f8d40373640 1 -- 172.21.15.29:0/736885510 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d38074080 con 0x7f8d380c4990 2024-01-25T15:05:02.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.038+0000 7f8d2effd640 1 -- 172.21.15.29:0/736885510 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18311 (secure 0 0 0) 0x7f8d34079ce0 con 0x7f8d380c4990 2024-01-25T15:05:02.039 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:02.040 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:31.978871+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:02.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.040+0000 7f8d40373640 1 -- 172.21.15.29:0/736885510 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8d1c06aed0 msgr2=0x7f8d1c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:02.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.040+0000 7f8d40373640 1 --2- 172.21.15.29:0/736885510 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8d1c06aed0 0x7f8d1c06d390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8d28006fd0 tx=0x7f8d28008040 comp rx=0 tx=0).stop 2024-01-25T15:05:02.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.040+0000 7f8d40373640 1 -- 172.21.15.29:0/736885510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d380c4990 msgr2=0x7f8d381ee030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:02.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.040+0000 7f8d40373640 1 --2- 172.21.15.29:0/736885510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d380c4990 0x7f8d381ee030 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8d3402b8c0 tx=0x7f8d340046c0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.040+0000 7f8d40373640 1 -- 172.21.15.29:0/736885510 shutdown_connections 2024-01-25T15:05:02.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.040+0000 7f8d40373640 1 --2- 172.21.15.29:0/736885510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d38152160 0x7f8d380c1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.040+0000 7f8d40373640 1 --2- 172.21.15.29:0/736885510 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d380c53e0 0x7f8d380aada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.040+0000 7f8d40373640 1 --2- 172.21.15.29:0/736885510 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8d1c06aed0 0x7f8d1c06d390 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.040+0000 7f8d40373640 1 --2- 172.21.15.29:0/736885510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d380c4990 0x7f8d381ee030 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.040+0000 7f8d40373640 1 -- 172.21.15.29:0/736885510 >> 172.21.15.29:0/736885510 conn(0x7f8d380ca1f0 msgr2=0x7f8d3806b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:02.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.040+0000 7f8d40373640 1 -- 172.21.15.29:0/736885510 shutdown_connections 2024-01-25T15:05:02.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.040+0000 7f8d40373640 1 -- 172.21.15.29:0/736885510 wait complete. 2024-01-25T15:05:02.052 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T15:04:14.955791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T15:04:24.986626+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T15:04:25.873673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-25T15:04:29.578261+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-25T15:05:02.052 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:05:02.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.157+0000 7f2c24a2d640 1 Processor -- start 2024-01-25T15:05:02.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.157+0000 7f2c24a2d640 1 -- start start 2024-01-25T15:05:02.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.158+0000 7f2c24a2d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2c2006b490 0x7f2c200c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:02.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.158+0000 7f2c24a2d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c20158b80 0x7f2c200c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:02.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.158+0000 7f2c24a2d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c200c88e0 con 0x7f2c200c8450 2024-01-25T15:05:02.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.158+0000 7f2c24a2d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c200c6770 con 0x7f2c2006b490 2024-01-25T15:05:02.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.158+0000 7f2c24a2d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c20154f10 con 0x7f2c20158b80 2024-01-25T15:05:02.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.158+0000 7f2c1e59c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2c2006b490 0x7f2c200c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:02.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.158+0000 7f2c1e59c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2c2006b490 0x7f2c200c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40818/0 (socket says 172.21.15.29:40818) 2024-01-25T15:05:02.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.158+0000 7f2c1e59c640 1 -- 172.21.15.29:0/2840441391 learned_addr learned my addr 172.21.15.29:0/2840441391 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:02.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.158+0000 7f2c17fff640 1 --2- 172.21.15.29:0/2840441391 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c20158b80 0x7f2c200c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:02.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.158+0000 7f2c1e59c640 1 -- 172.21.15.29:0/2840441391 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c20158b80 msgr2=0x7f2c200c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:02.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.158+0000 7f2c1e59c640 1 --2- 172.21.15.29:0/2840441391 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c20158b80 0x7f2c200c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.158+0000 7f2c1e59c640 1 -- 172.21.15.29:0/2840441391 >> v1:172.21.15.52:6789/0 conn(0x7f2c200c8450 legacy=0x7f2c20151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:02.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.158+0000 7f2c1e59c640 1 -- 172.21.15.29:0/2840441391 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c201551f0 con 0x7f2c2006b490 2024-01-25T15:05:02.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.159+0000 7f2c1e59c640 1 --2- 172.21.15.29:0/2840441391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c2006b490 0x7f2c200c6120 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2c10009870 tx=0x7f2c1002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6762882f4e62b57 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:02.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.159+0000 7f2c1dd9b640 1 -- 172.21.15.29:0/2840441391 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c10031640 con 0x7f2c2006b490 2024-01-25T15:05:02.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.159+0000 7f2c1dd9b640 1 -- 172.21.15.29:0/2840441391 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c100317a0 con 0x7f2c2006b490 2024-01-25T15:05:02.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.159+0000 7f2c1dd9b640 1 -- 172.21.15.29:0/2840441391 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c10031b30 con 0x7f2c2006b490 2024-01-25T15:05:02.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.159+0000 7f2c24a2d640 1 -- 172.21.15.29:0/2840441391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c2006b490 msgr2=0x7f2c200c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:02.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.159+0000 7f2c24a2d640 1 --2- 172.21.15.29:0/2840441391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c2006b490 0x7f2c200c6120 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2c10009870 tx=0x7f2c1002b8f0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.160+0000 7f2c24a2d640 1 -- 172.21.15.29:0/2840441391 shutdown_connections 2024-01-25T15:05:02.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.160+0000 7f2c24a2d640 1 --2- 172.21.15.29:0/2840441391 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c20158b80 0x7f2c200c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.160+0000 7f2c24a2d640 1 --2- 172.21.15.29:0/2840441391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c2006b490 0x7f2c200c6120 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.160+0000 7f2c24a2d640 1 -- 172.21.15.29:0/2840441391 >> 172.21.15.29:0/2840441391 conn(0x7f2c200ca010 msgr2=0x7f2c200ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:02.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.160+0000 7f2c24a2d640 1 -- 172.21.15.29:0/2840441391 shutdown_connections 2024-01-25T15:05:02.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.160+0000 7f2c24a2d640 1 -- 172.21.15.29:0/2840441391 wait complete. 2024-01-25T15:05:02.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.161+0000 7f2c24a2d640 1 Processor -- start 2024-01-25T15:05:02.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.161+0000 7f2c24a2d640 1 -- start start 2024-01-25T15:05:02.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.161+0000 7f2c24a2d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c2006b490 0x7f2c200ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:02.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.161+0000 7f2c24a2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c200c8450 0x7f2c200bfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:02.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.161+0000 7f2c24a2d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c20158b80 0x7f2c200c0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:02.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.161+0000 7f2c24a2d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c201570e0 con 0x7f2c2006b490 2024-01-25T15:05:02.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.161+0000 7f2c24a2d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c201ead40 con 0x7f2c200c8450 2024-01-25T15:05:02.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.162+0000 7f2c24a2d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c201eb020 con 0x7f2c20158b80 2024-01-25T15:05:02.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.162+0000 7f2c1e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c2006b490 0x7f2c200ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:02.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.162+0000 7f2c1e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c2006b490 0x7f2c200ab2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40820/0 (socket says 172.21.15.29:40820) 2024-01-25T15:05:02.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.162+0000 7f2c1e59c640 1 -- 172.21.15.29:0/334679724 learned_addr learned my addr 172.21.15.29:0/334679724 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:02.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.162+0000 7f2c17fff640 1 --2- 172.21.15.29:0/334679724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c200c8450 0x7f2c200bfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:02.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.162+0000 7f2c1ed9d640 1 --2- 172.21.15.29:0/334679724 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c20158b80 0x7f2c200c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:02.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.162+0000 7f2c1e59c640 1 -- 172.21.15.29:0/334679724 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c20158b80 msgr2=0x7f2c200c0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:02.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.162+0000 7f2c1e59c640 1 --2- 172.21.15.29:0/334679724 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c20158b80 0x7f2c200c0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.162+0000 7f2c1e59c640 1 -- 172.21.15.29:0/334679724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c200c8450 msgr2=0x7f2c200bfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:02.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.162+0000 7f2c1e59c640 1 --2- 172.21.15.29:0/334679724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c200c8450 0x7f2c200bfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.162+0000 7f2c1e59c640 1 -- 172.21.15.29:0/334679724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c100094d0 con 0x7f2c2006b490 2024-01-25T15:05:02.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.162+0000 7f2c17fff640 1 --2- 172.21.15.29:0/334679724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c200c8450 0x7f2c200bfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:02.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.162+0000 7f2c1e59c640 1 --2- 172.21.15.29:0/334679724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c2006b490 0x7f2c200ab2b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2c10000c00 tx=0x7f2c100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:02.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.162+0000 7f2c16ffd640 1 -- 172.21.15.29:0/334679724 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1003a930 con 0x7f2c2006b490 2024-01-25T15:05:02.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.162+0000 7f2c16ffd640 1 -- 172.21.15.29:0/334679724 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1003aa90 con 0x7f2c2006b490 2024-01-25T15:05:02.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.162+0000 7f2c24a2d640 1 -- 172.21.15.29:0/334679724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c20157350 con 0x7f2c2006b490 2024-01-25T15:05:02.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.162+0000 7f2c16ffd640 1 -- 172.21.15.29:0/334679724 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1003ae40 con 0x7f2c2006b490 2024-01-25T15:05:02.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.162+0000 7f2c24a2d640 1 -- 172.21.15.29:0/334679724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c200ab7f0 con 0x7f2c2006b490 2024-01-25T15:05:02.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.163+0000 7f2c24a2d640 1 -- 172.21.15.29:0/334679724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c200aa950 con 0x7f2c2006b490 2024-01-25T15:05:02.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.164+0000 7f2c16ffd640 1 -- 172.21.15.29:0/334679724 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2c1002f050 con 0x7f2c2006b490 2024-01-25T15:05:02.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.164+0000 7f2c16ffd640 1 --2- 172.21.15.29:0/334679724 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2c0006af00 0x7f2c0006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:02.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.164+0000 7f2c16ffd640 1 -- 172.21.15.29:0/334679724 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2c100ab6c0 con 0x7f2c2006b490 2024-01-25T15:05:02.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.165+0000 7f2c17fff640 1 --2- 172.21.15.29:0/334679724 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2c0006af00 0x7f2c0006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:02.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.165+0000 7f2c17fff640 1 --2- 172.21.15.29:0/334679724 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2c0006af00 0x7f2c0006d3c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2c200ca840 tx=0x7f2c08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:02.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.169+0000 7f2c16ffd640 1 -- 172.21.15.29:0/334679724 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2c10076330 con 0x7f2c2006b490 2024-01-25T15:05:02.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.347+0000 7f2c24a2d640 1 -- 172.21.15.29:0/334679724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c20074010 con 0x7f2c2006b490 2024-01-25T15:05:02.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.348+0000 7f2c16ffd640 1 -- 172.21.15.29:0/334679724 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c10079950 con 0x7f2c2006b490 2024-01-25T15:05:02.348 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-25T15:05:02.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.349+0000 7f2c24a2d640 1 -- 172.21.15.29:0/334679724 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2c0006af00 msgr2=0x7f2c0006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:02.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.349+0000 7f2c24a2d640 1 --2- 172.21.15.29:0/334679724 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2c0006af00 0x7f2c0006d3c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2c200ca840 tx=0x7f2c08008040 comp rx=0 tx=0).stop 2024-01-25T15:05:02.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.349+0000 7f2c24a2d640 1 -- 172.21.15.29:0/334679724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c2006b490 msgr2=0x7f2c200ab2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:02.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.349+0000 7f2c24a2d640 1 --2- 172.21.15.29:0/334679724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c2006b490 0x7f2c200ab2b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2c10000c00 tx=0x7f2c100046c0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.349+0000 7f2c24a2d640 1 -- 172.21.15.29:0/334679724 shutdown_connections 2024-01-25T15:05:02.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.349+0000 7f2c24a2d640 1 --2- 172.21.15.29:0/334679724 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c20158b80 0x7f2c200c0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.349+0000 7f2c24a2d640 1 --2- 172.21.15.29:0/334679724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c200c8450 0x7f2c200bfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.349+0000 7f2c24a2d640 1 --2- 172.21.15.29:0/334679724 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2c0006af00 0x7f2c0006d3c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.349+0000 7f2c24a2d640 1 --2- 172.21.15.29:0/334679724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c2006b490 0x7f2c200ab2b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.350+0000 7f2c24a2d640 1 -- 172.21.15.29:0/334679724 >> 172.21.15.29:0/334679724 conn(0x7f2c200ca010 msgr2=0x7f2c200c8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:02.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.350+0000 7f2c24a2d640 1 -- 172.21.15.29:0/334679724 shutdown_connections 2024-01-25T15:05:02.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.350+0000 7f2c24a2d640 1 -- 172.21.15.29:0/334679724 wait complete. 2024-01-25T15:05:02.361 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:05:02.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.464+0000 7fc60b061640 1 Processor -- start 2024-01-25T15:05:02.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.465+0000 7fc60b061640 1 -- start start 2024-01-25T15:05:02.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.465+0000 7fc60b061640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc60406cf10 0x7fc6041546c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:02.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.465+0000 7fc60b061640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6040c30d0 con 0x7fc60406d3a0 2024-01-25T15:05:02.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.465+0000 7fc60b061640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc604155310 con 0x7fc604151d30 2024-01-25T15:05:02.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.465+0000 7fc60b061640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60406ef80 con 0x7fc60406cf10 2024-01-25T15:05:02.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.465+0000 7fc6095fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc60406d3a0 0x7fc604154c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49414/0 (socket says 172.21.15.29:49414) 2024-01-25T15:05:02.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.465+0000 7fc6095fe640 1 -- 172.21.15.29:0/2248497426 learned_addr learned my addr 172.21.15.29:0/2248497426 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:02.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc6037fe640 1 -- 172.21.15.29:0/2248497426 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616645609 0 0) 0x7fc6040c30d0 con 0x7fc60406d3a0 2024-01-25T15:05:02.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc6037fe640 1 -- 172.21.15.29:0/2248497426 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5ec003520 con 0x7fc60406d3a0 2024-01-25T15:05:02.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc603fff640 1 --2- 172.21.15.29:0/2248497426 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc60406cf10 0x7fc6041546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:02.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc6037fe640 1 -- 172.21.15.29:0/2248497426 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3181707420 0 0) 0x7fc5ec003520 con 0x7fc60406d3a0 2024-01-25T15:05:02.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc6037fe640 1 -- 172.21.15.29:0/2248497426 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc60406cf10 msgr2=0x7fc6041546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:02.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc6037fe640 1 --2- 172.21.15.29:0/2248497426 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc60406cf10 0x7fc6041546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc6037fe640 1 -- 172.21.15.29:0/2248497426 >> v1:172.21.15.52:6789/0 conn(0x7fc604151d30 legacy=0x7fc60406a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:02.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc6037fe640 1 -- 172.21.15.29:0/2248497426 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc604152110 con 0x7fc60406d3a0 2024-01-25T15:05:02.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc6037fe640 1 -- 172.21.15.29:0/2248497426 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7fc5fc0019f0 con 0x7fc60406d3a0 2024-01-25T15:05:02.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc6037fe640 1 -- 172.21.15.29:0/2248497426 >> v1:172.21.15.29:6789/0 conn(0x7fc60406d3a0 legacy=0x7fc604154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:02.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc6037fe640 1 --2- 172.21.15.29:0/2248497426 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc60406cf10 0x7fc5ec003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:02.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc6037fe640 1 --2- 172.21.15.29:0/2248497426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5ec003f90 0x7fc5ec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:02.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc6037fe640 1 --2- 172.21.15.29:0/2248497426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5ec004d00 0x7fc5ec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:02.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc6037fe640 1 -- 172.21.15.29:0/2248497426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60406ef80 con 0x7fc5ec004d00 2024-01-25T15:05:02.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc6037fe640 1 -- 172.21.15.29:0/2248497426 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec00bc10 con 0x7fc5ec003f90 2024-01-25T15:05:02.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc6037fe640 1 -- 172.21.15.29:0/2248497426 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec00bdd0 con 0x7fc60406cf10 2024-01-25T15:05:02.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc6095fe640 1 --2- 172.21.15.29:0/2248497426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5ec004d00 0x7fc5ec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:02.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc608dfd640 1 --2- 172.21.15.29:0/2248497426 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc60406cf10 0x7fc5ec003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:02.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc603fff640 1 --2- 172.21.15.29:0/2248497426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5ec003f90 0x7fc5ec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:02.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc6095fe640 1 -- 172.21.15.29:0/2248497426 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc60406cf10 msgr2=0x7fc5ec003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:02.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc6095fe640 1 --2- 172.21.15.29:0/2248497426 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc60406cf10 0x7fc5ec003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc6095fe640 1 -- 172.21.15.29:0/2248497426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5ec003f90 msgr2=0x7fc5ec0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:02.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc6095fe640 1 --2- 172.21.15.29:0/2248497426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5ec003f90 0x7fc5ec0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.466+0000 7fc6095fe640 1 -- 172.21.15.29:0/2248497426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ec003520 con 0x7fc5ec004d00 2024-01-25T15:05:02.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.467+0000 7fc603fff640 1 --2- 172.21.15.29:0/2248497426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5ec003f90 0x7fc5ec0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:02.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.467+0000 7fc6095fe640 1 --2- 172.21.15.29:0/2248497426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5ec004d00 0x7fc5ec005180 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00a820 tx=0x7fc5ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9582268ad15aaa15 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:02.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.467+0000 7fc6037fe640 1 -- 172.21.15.29:0/2248497426 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc0072d0 con 0x7fc5ec004d00 2024-01-25T15:05:02.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.467+0000 7fc6037fe640 1 -- 172.21.15.29:0/2248497426 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc02f070 con 0x7fc5ec004d00 2024-01-25T15:05:02.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.467+0000 7fc6037fe640 1 -- 172.21.15.29:0/2248497426 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc0076f0 con 0x7fc5ec004d00 2024-01-25T15:05:02.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.468+0000 7fc60b061640 1 -- 172.21.15.29:0/2248497426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5ec004d00 msgr2=0x7fc5ec005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:02.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.468+0000 7fc60b061640 1 --2- 172.21.15.29:0/2248497426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc5ec004d00 0x7fc5ec005180 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00a820 tx=0x7fc5ec0057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.468+0000 7fc6095fe640 1 -- 172.21.15.29:0/2248497426 reap_dead start 2024-01-25T15:05:02.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.468+0000 7fc60b061640 1 -- 172.21.15.29:0/2248497426 shutdown_connections 2024-01-25T15:05:02.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.468+0000 7fc60b061640 1 -- 172.21.15.29:0/2248497426 >> 172.21.15.29:0/2248497426 conn(0x7fc6040c39b0 msgr2=0x7fc6040c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:02.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.468+0000 7fc60b061640 1 -- 172.21.15.29:0/2248497426 shutdown_connections 2024-01-25T15:05:02.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.468+0000 7fc60b061640 1 -- 172.21.15.29:0/2248497426 wait complete. 2024-01-25T15:05:02.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.469+0000 7fc60b061640 1 Processor -- start 2024-01-25T15:05:02.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.469+0000 7fc60b061640 1 -- start start 2024-01-25T15:05:02.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.470+0000 7fc60b061640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6041537f0 0x7fc60414b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:02.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.470+0000 7fc60b061640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6041e0710 0x7fc60414b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:02.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.470+0000 7fc60b061640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc604156610 0x7fc604156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:02.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.470+0000 7fc60b061640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60414bbc0 con 0x7fc6041e0710 2024-01-25T15:05:02.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.470+0000 7fc60b061640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc604156180 con 0x7fc6041537f0 2024-01-25T15:05:02.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.470+0000 7fc60b061640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60414bdd0 con 0x7fc604156610 2024-01-25T15:05:02.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.470+0000 7fc603fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6041e0710 0x7fc60414b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:02.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.470+0000 7fc603fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6041e0710 0x7fc60414b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40842/0 (socket says 172.21.15.29:40842) 2024-01-25T15:05:02.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.470+0000 7fc603fff640 1 -- 172.21.15.29:0/3256062474 learned_addr learned my addr 172.21.15.29:0/3256062474 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:02.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.470+0000 7fc6095fe640 1 --2- 172.21.15.29:0/3256062474 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc604156610 0x7fc604156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:02.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.470+0000 7fc603fff640 1 -- 172.21.15.29:0/3256062474 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc604156610 msgr2=0x7fc604156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:02.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.470+0000 7fc603fff640 1 --2- 172.21.15.29:0/3256062474 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc604156610 0x7fc604156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.470+0000 7fc608dfd640 1 --2- 172.21.15.29:0/3256062474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6041537f0 0x7fc60414b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:02.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.470+0000 7fc603fff640 1 -- 172.21.15.29:0/3256062474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6041537f0 msgr2=0x7fc60414b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:02.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.470+0000 7fc603fff640 1 --2- 172.21.15.29:0/3256062474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6041537f0 0x7fc60414b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.470+0000 7fc603fff640 1 -- 172.21.15.29:0/3256062474 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc604155b30 con 0x7fc6041e0710 2024-01-25T15:05:02.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.471+0000 7fc603fff640 1 --2- 172.21.15.29:0/3256062474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6041e0710 0x7fc60414b570 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8011560 tx=0x7fc5f8011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:02.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.471+0000 7fc6017fa640 1 -- 172.21.15.29:0/3256062474 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8015870 con 0x7fc6041e0710 2024-01-25T15:05:02.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.471+0000 7fc6017fa640 1 -- 172.21.15.29:0/3256062474 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f80159d0 con 0x7fc6041e0710 2024-01-25T15:05:02.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.471+0000 7fc6017fa640 1 -- 172.21.15.29:0/3256062474 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8015d40 con 0x7fc6041e0710 2024-01-25T15:05:02.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.471+0000 7fc60b061640 1 -- 172.21.15.29:0/3256062474 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc604155e10 con 0x7fc6041e0710 2024-01-25T15:05:02.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.471+0000 7fc60b061640 1 -- 172.21.15.29:0/3256062474 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6040c23f0 con 0x7fc6041e0710 2024-01-25T15:05:02.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.472+0000 7fc60b061640 1 -- 172.21.15.29:0/3256062474 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc604074010 con 0x7fc6041e0710 2024-01-25T15:05:02.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.472+0000 7fc6017fa640 1 -- 172.21.15.29:0/3256062474 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fc5f800f460 con 0x7fc6041e0710 2024-01-25T15:05:02.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.473+0000 7fc6017fa640 1 --2- 172.21.15.29:0/3256062474 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc5f006aed0 0x7fc5f006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:02.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.473+0000 7fc6017fa640 1 -- 172.21.15.29:0/3256062474 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc5f808a0d0 con 0x7fc6041e0710 2024-01-25T15:05:02.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.473+0000 7fc608dfd640 1 --2- 172.21.15.29:0/3256062474 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc5f006aed0 0x7fc5f006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:02.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.473+0000 7fc608dfd640 1 --2- 172.21.15.29:0/3256062474 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc5f006aed0 0x7fc5f006d390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4005590 tx=0x7fc5f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:02.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.477+0000 7fc6017fa640 1 -- 172.21.15.29:0/3256062474 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fc5f8054d40 con 0x7fc6041e0710 2024-01-25T15:05:02.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.659+0000 7fc60b061640 1 -- 172.21.15.29:0/3256062474 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc6040aca50 con 0x7fc6041e0710 2024-01-25T15:05:02.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.659+0000 7fc6017fa640 1 -- 172.21.15.29:0/3256062474 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc5f8058360 con 0x7fc6041e0710 2024-01-25T15:05:02.660 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:02.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.661+0000 7fc60b061640 1 -- 172.21.15.29:0/3256062474 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc5f006aed0 msgr2=0x7fc5f006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:02.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.661+0000 7fc60b061640 1 --2- 172.21.15.29:0/3256062474 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc5f006aed0 0x7fc5f006d390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4005590 tx=0x7fc5f4009040 comp rx=0 tx=0).stop 2024-01-25T15:05:02.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.661+0000 7fc60b061640 1 -- 172.21.15.29:0/3256062474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6041e0710 msgr2=0x7fc60414b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:02.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.661+0000 7fc60b061640 1 --2- 172.21.15.29:0/3256062474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6041e0710 0x7fc60414b570 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8011560 tx=0x7fc5f8011a20 comp rx=0 tx=0).stop 2024-01-25T15:05:02.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.661+0000 7fc60b061640 1 -- 172.21.15.29:0/3256062474 shutdown_connections 2024-01-25T15:05:02.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.661+0000 7fc60b061640 1 --2- 172.21.15.29:0/3256062474 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc604156610 0x7fc604156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.661+0000 7fc60b061640 1 --2- 172.21.15.29:0/3256062474 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc5f006aed0 0x7fc5f006d390 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.661+0000 7fc60b061640 1 --2- 172.21.15.29:0/3256062474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6041e0710 0x7fc60414b570 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.661+0000 7fc60b061640 1 --2- 172.21.15.29:0/3256062474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6041537f0 0x7fc60414b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.661+0000 7fc60b061640 1 -- 172.21.15.29:0/3256062474 >> 172.21.15.29:0/3256062474 conn(0x7fc6040c39b0 msgr2=0x7fc60414f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:02.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.661+0000 7fc60b061640 1 -- 172.21.15.29:0/3256062474 shutdown_connections 2024-01-25T15:05:02.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.661+0000 7fc60b061640 1 -- 172.21.15.29:0/3256062474 wait complete. 2024-01-25T15:05:02.673 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:05:02.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.777+0000 7f6f36561640 1 Processor -- start 2024-01-25T15:05:02.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.777+0000 7f6f36561640 1 -- start start 2024-01-25T15:05:02.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.777+0000 7f6f36561640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f300c49a0 0x7f6f300c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:02.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.777+0000 7f6f36561640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f300ad2e0 con 0x7f6f301526a0 2024-01-25T15:05:02.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.777+0000 7f6f36561640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f300c79f0 con 0x7f6f30149190 2024-01-25T15:05:02.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.777+0000 7f6f36561640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f300ac6f0 con 0x7f6f300c49a0 2024-01-25T15:05:02.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.777+0000 7f6f34afe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6f301526a0 0x7f6f30152b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49430/0 (socket says 172.21.15.29:49430) 2024-01-25T15:05:02.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f34afe640 1 -- 172.21.15.29:0/1765116317 learned_addr learned my addr 172.21.15.29:0/1765116317 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:02.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2effd640 1 -- 172.21.15.29:0/1765116317 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826675143 0 0) 0x7f6f300ad2e0 con 0x7f6f301526a0 2024-01-25T15:05:02.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2f7fe640 1 --2- 172.21.15.29:0/1765116317 >> v2:172.21.15.52:3300/0 conn(0x7f6f300c49a0 0x7f6f300c4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:02.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2effd640 1 -- 172.21.15.29:0/1765116317 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f18003520 con 0x7f6f301526a0 2024-01-25T15:05:02.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2effd640 1 -- 172.21.15.29:0/1765116317 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1635549385 0 0) 0x7f6f18003520 con 0x7f6f301526a0 2024-01-25T15:05:02.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2effd640 1 -- 172.21.15.29:0/1765116317 >> v2:172.21.15.52:3300/0 conn(0x7f6f300c49a0 msgr2=0x7f6f300c4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:02.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2effd640 1 --2- 172.21.15.29:0/1765116317 >> v2:172.21.15.52:3300/0 conn(0x7f6f300c49a0 0x7f6f300c4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2effd640 1 -- 172.21.15.29:0/1765116317 >> v1:172.21.15.52:6789/0 conn(0x7f6f30149190 legacy=0x7f6f300c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:02.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2effd640 1 -- 172.21.15.29:0/1765116317 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f300ac9b0 con 0x7f6f301526a0 2024-01-25T15:05:02.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2effd640 1 -- 172.21.15.29:0/1765116317 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f6f280019f0 con 0x7f6f301526a0 2024-01-25T15:05:02.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2effd640 1 -- 172.21.15.29:0/1765116317 >> v1:172.21.15.29:6789/0 conn(0x7f6f301526a0 legacy=0x7f6f30152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2effd640 1 --2- 172.21.15.29:0/1765116317 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f18003a10 0x7f6f18003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2effd640 1 --2- 172.21.15.29:0/1765116317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f180047c0 0x7f6f18004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2effd640 1 --2- 172.21.15.29:0/1765116317 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f180052a0 0x7f6f1800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2effd640 1 -- 172.21.15.29:0/1765116317 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300ac6f0 con 0x7f6f18003a10 2024-01-25T15:05:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2effd640 1 -- 172.21.15.29:0/1765116317 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1800c170 con 0x7f6f180047c0 2024-01-25T15:05:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2effd640 1 -- 172.21.15.29:0/1765116317 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1800c330 con 0x7f6f180052a0 2024-01-25T15:05:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2ffff640 1 --2- 172.21.15.29:0/1765116317 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f18003a10 0x7f6f18003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2f7fe640 1 --2- 172.21.15.29:0/1765116317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f180047c0 0x7f6f18004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f34afe640 1 --2- 172.21.15.29:0/1765116317 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f180052a0 0x7f6f1800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2ffff640 1 -- 172.21.15.29:0/1765116317 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f180052a0 msgr2=0x7f6f1800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2ffff640 1 --2- 172.21.15.29:0/1765116317 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f180052a0 0x7f6f1800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2ffff640 1 -- 172.21.15.29:0/1765116317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f180047c0 msgr2=0x7f6f18004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2ffff640 1 --2- 172.21.15.29:0/1765116317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f180047c0 0x7f6f18004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f2ffff640 1 -- 172.21.15.29:0/1765116317 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f18003520 con 0x7f6f18003a10 2024-01-25T15:05:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.778+0000 7f6f34afe640 1 -- 172.21.15.29:0/1765116317 reap_dead start 2024-01-25T15:05:02.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.779+0000 7f6f2ffff640 1 --2- 172.21.15.29:0/1765116317 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f18003a10 0x7f6f18003e30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6f20001720 tx=0x7f6f180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2f8cd450d1ee10 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:02.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.779+0000 7f6f2effd640 1 -- 172.21.15.29:0/1765116317 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f200052d0 con 0x7f6f18003a10 2024-01-25T15:05:02.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.779+0000 7f6f2effd640 1 -- 172.21.15.29:0/1765116317 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2002e050 con 0x7f6f18003a10 2024-01-25T15:05:02.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.779+0000 7f6f2effd640 1 -- 172.21.15.29:0/1765116317 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f20003830 con 0x7f6f18003a10 2024-01-25T15:05:02.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.780+0000 7f6f36561640 1 -- 172.21.15.29:0/1765116317 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f18003a10 msgr2=0x7f6f18003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:02.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.780+0000 7f6f36561640 1 --2- 172.21.15.29:0/1765116317 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f18003a10 0x7f6f18003e30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6f20001720 tx=0x7f6f180057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.780+0000 7f6f36561640 1 -- 172.21.15.29:0/1765116317 shutdown_connections 2024-01-25T15:05:02.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.780+0000 7f6f36561640 1 --2- 172.21.15.29:0/1765116317 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f18003a10 0x7f6f18003e30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.780+0000 7f6f36561640 1 -- 172.21.15.29:0/1765116317 >> 172.21.15.29:0/1765116317 conn(0x7f6f300c7f10 msgr2=0x7f6f300c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:02.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.780+0000 7f6f36561640 1 -- 172.21.15.29:0/1765116317 shutdown_connections 2024-01-25T15:05:02.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.780+0000 7f6f36561640 1 -- 172.21.15.29:0/1765116317 wait complete. 2024-01-25T15:05:02.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.781+0000 7f6f36561640 1 Processor -- start 2024-01-25T15:05:02.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.781+0000 7f6f36561640 1 -- start start 2024-01-25T15:05:02.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.782+0000 7f6f36561640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f18003a10 0x7f6f300aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:02.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.782+0000 7f6f36561640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f3014f1a0 0x7f6f3014cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:02.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.782+0000 7f6f36561640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f30156720 0x7f6f30142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:02.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.782+0000 7f6f36561640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f301418d0 con 0x7f6f3014f1a0 2024-01-25T15:05:02.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.782+0000 7f6f36561640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f301424a0 con 0x7f6f18003a10 2024-01-25T15:05:02.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.782+0000 7f6f36561640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3014fa60 con 0x7f6f30156720 2024-01-25T15:05:02.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.782+0000 7f6f2f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f3014f1a0 0x7f6f3014cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:02.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.782+0000 7f6f2f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f3014f1a0 0x7f6f3014cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40868/0 (socket says 172.21.15.29:40868) 2024-01-25T15:05:02.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.782+0000 7f6f2f7fe640 1 -- 172.21.15.29:0/325729125 learned_addr learned my addr 172.21.15.29:0/325729125 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:02.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.782+0000 7f6f34afe640 1 --2- 172.21.15.29:0/325729125 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f30156720 0x7f6f30142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:02.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.782+0000 7f6f2f7fe640 1 -- 172.21.15.29:0/325729125 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f30156720 msgr2=0x7f6f30142870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:02.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.782+0000 7f6f2f7fe640 1 --2- 172.21.15.29:0/325729125 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f30156720 0x7f6f30142870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.782+0000 7f6f2ffff640 1 --2- 172.21.15.29:0/325729125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f18003a10 0x7f6f300aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:02.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.782+0000 7f6f2f7fe640 1 -- 172.21.15.29:0/325729125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f18003a10 msgr2=0x7f6f300aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:02.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.782+0000 7f6f2f7fe640 1 --2- 172.21.15.29:0/325729125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f18003a10 0x7f6f300aa490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.782+0000 7f6f2f7fe640 1 -- 172.21.15.29:0/325729125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f30141e20 con 0x7f6f3014f1a0 2024-01-25T15:05:02.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.782+0000 7f6f2f7fe640 1 --2- 172.21.15.29:0/325729125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f3014f1a0 0x7f6f3014cde0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400b820 tx=0x7f6f2400bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:02.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.783+0000 7f6f2cff9640 1 -- 172.21.15.29:0/325729125 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2400be10 con 0x7f6f3014f1a0 2024-01-25T15:05:02.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.783+0000 7f6f2cff9640 1 -- 172.21.15.29:0/325729125 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f24010a40 con 0x7f6f3014f1a0 2024-01-25T15:05:02.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.783+0000 7f6f36561640 1 -- 172.21.15.29:0/325729125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f300aa9d0 con 0x7f6f3014f1a0 2024-01-25T15:05:02.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.783+0000 7f6f2cff9640 1 -- 172.21.15.29:0/325729125 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24010df0 con 0x7f6f3014f1a0 2024-01-25T15:05:02.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.783+0000 7f6f36561640 1 -- 172.21.15.29:0/325729125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f30144f50 con 0x7f6f3014f1a0 2024-01-25T15:05:02.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.784+0000 7f6f36561640 1 -- 172.21.15.29:0/325729125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3004eb10 con 0x7f6f3014f1a0 2024-01-25T15:05:02.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.784+0000 7f6f2cff9640 1 -- 172.21.15.29:0/325729125 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6f24014430 con 0x7f6f3014f1a0 2024-01-25T15:05:02.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.784+0000 7f6f2cff9640 1 --2- 172.21.15.29:0/325729125 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6f1c06af00 0x7f6f1c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:02.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.785+0000 7f6f2cff9640 1 -- 172.21.15.29:0/325729125 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6f24089d50 con 0x7f6f3014f1a0 2024-01-25T15:05:02.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.785+0000 7f6f2ffff640 1 --2- 172.21.15.29:0/325729125 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6f1c06af00 0x7f6f1c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:02.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.785+0000 7f6f2ffff640 1 --2- 172.21.15.29:0/325729125 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6f1c06af00 0x7f6f1c06d3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6f20033000 tx=0x7f6f20009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:02.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.789+0000 7f6f2cff9640 1 -- 172.21.15.29:0/325729125 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6f2408d030 con 0x7f6f3014f1a0 2024-01-25T15:05:02.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.967+0000 7f6f36561640 1 -- 172.21.15.29:0/325729125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6f300ae250 con 0x7f6f3014f1a0 2024-01-25T15:05:02.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.967+0000 7f6f2cff9640 1 -- 172.21.15.29:0/325729125 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6f240549c0 con 0x7f6f3014f1a0 2024-01-25T15:05:02.968 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-25T15:05:02.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.969+0000 7f6f36561640 1 -- 172.21.15.29:0/325729125 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6f1c06af00 msgr2=0x7f6f1c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:02.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.969+0000 7f6f36561640 1 --2- 172.21.15.29:0/325729125 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6f1c06af00 0x7f6f1c06d3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6f20033000 tx=0x7f6f20009030 comp rx=0 tx=0).stop 2024-01-25T15:05:02.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.969+0000 7f6f36561640 1 -- 172.21.15.29:0/325729125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f3014f1a0 msgr2=0x7f6f3014cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:02.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.969+0000 7f6f36561640 1 --2- 172.21.15.29:0/325729125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f3014f1a0 0x7f6f3014cde0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400b820 tx=0x7f6f2400bce0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.969+0000 7f6f36561640 1 -- 172.21.15.29:0/325729125 shutdown_connections 2024-01-25T15:05:02.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.969+0000 7f6f36561640 1 --2- 172.21.15.29:0/325729125 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f30156720 0x7f6f30142870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.969+0000 7f6f36561640 1 --2- 172.21.15.29:0/325729125 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6f1c06af00 0x7f6f1c06d3c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.969+0000 7f6f36561640 1 --2- 172.21.15.29:0/325729125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f3014f1a0 0x7f6f3014cde0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.969+0000 7f6f36561640 1 --2- 172.21.15.29:0/325729125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f18003a10 0x7f6f300aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:02.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.969+0000 7f6f36561640 1 -- 172.21.15.29:0/325729125 >> 172.21.15.29:0/325729125 conn(0x7f6f300c7f10 msgr2=0x7f6f301474a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:02.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.969+0000 7f6f36561640 1 -- 172.21.15.29:0/325729125 shutdown_connections 2024-01-25T15:05:02.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:02.969+0000 7f6f36561640 1 -- 172.21.15.29:0/325729125 wait complete. 2024-01-25T15:05:02.980 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-25T15:05:03.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.084+0000 7ffa23fa2640 1 Processor -- start 2024-01-25T15:05:03.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.084+0000 7ffa23fa2640 1 -- start start 2024-01-25T15:05:03.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.085+0000 7ffa23fa2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffa1c0c48d0 0x7ffa1c0c6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:03.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.085+0000 7ffa23fa2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffa1c155190 0x7ffa1c0c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:03.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.085+0000 7ffa23fa2640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1c158120 con 0x7ffa1c151f80 2024-01-25T15:05:03.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.085+0000 7ffa23fa2640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa1c155640 con 0x7ffa1c0c48d0 2024-01-25T15:05:03.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.085+0000 7ffa23fa2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c0c4db0 con 0x7ffa1c155190 2024-01-25T15:05:03.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.085+0000 7ffa21d3e640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ffa1c151f80 0x7ffa1c1585b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49440/0 (socket says 172.21.15.29:49440) 2024-01-25T15:05:03.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.085+0000 7ffa21d3e640 1 -- 172.21.15.29:0/776292795 learned_addr learned my addr 172.21.15.29:0/776292795 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:03.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.085+0000 7ffa2253f640 1 --2- 172.21.15.29:0/776292795 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffa1c155190 0x7ffa1c0c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:03.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.085+0000 7ffa2153d640 1 --2- 172.21.15.29:0/776292795 >> v2:172.21.15.52:3300/0 conn(0x7ffa1c0c48d0 0x7ffa1c0c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:03.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.085+0000 7ffa20d3c640 1 -- 172.21.15.29:0/776292795 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284054648 0 0) 0x7ffa1c158120 con 0x7ffa1c151f80 2024-01-25T15:05:03.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.085+0000 7ffa20d3c640 1 -- 172.21.15.29:0/776292795 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa08003520 con 0x7ffa1c151f80 2024-01-25T15:05:03.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.085+0000 7ffa20d3c640 1 -- 172.21.15.29:0/776292795 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3954724836 0 0) 0x7ffa08003520 con 0x7ffa1c151f80 2024-01-25T15:05:03.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.085+0000 7ffa2253f640 1 -- 172.21.15.29:0/776292795 >> v2:172.21.15.52:3300/0 conn(0x7ffa1c0c48d0 msgr2=0x7ffa1c0c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:03.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.085+0000 7ffa2253f640 1 --2- 172.21.15.29:0/776292795 >> v2:172.21.15.52:3300/0 conn(0x7ffa1c0c48d0 0x7ffa1c0c6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.085+0000 7ffa2253f640 1 -- 172.21.15.29:0/776292795 >> v1:172.21.15.29:6789/0 conn(0x7ffa1c151f80 legacy=0x7ffa1c1585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:03.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.085+0000 7ffa2253f640 1 -- 172.21.15.29:0/776292795 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c0c5090 con 0x7ffa1c155190 2024-01-25T15:05:03.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.086+0000 7ffa2253f640 1 --2- 172.21.15.29:0/776292795 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffa1c155190 0x7ffa1c0c74f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffa14009d90 tx=0x7ffa1402bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=310d8cb49cebbf4a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:03.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.086+0000 7ffa20d3c640 1 -- 172.21.15.29:0/776292795 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa18001670 con 0x7ffa1c155190 2024-01-25T15:05:03.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.086+0000 7ffa20d3c640 1 -- 172.21.15.29:0/776292795 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1402c8a0 con 0x7ffa1c155190 2024-01-25T15:05:03.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.086+0000 7ffa20d3c640 1 -- 172.21.15.29:0/776292795 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1402cc30 con 0x7ffa1c155190 2024-01-25T15:05:03.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.087+0000 7ffa23fa2640 1 -- 172.21.15.29:0/776292795 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffa1c155190 msgr2=0x7ffa1c0c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:03.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.087+0000 7ffa23fa2640 1 --2- 172.21.15.29:0/776292795 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffa1c155190 0x7ffa1c0c74f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffa14009d90 tx=0x7ffa1402bd70 comp rx=0 tx=0).stop 2024-01-25T15:05:03.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.087+0000 7ffa23fa2640 1 -- 172.21.15.29:0/776292795 shutdown_connections 2024-01-25T15:05:03.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.087+0000 7ffa23fa2640 1 --2- 172.21.15.29:0/776292795 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffa1c155190 0x7ffa1c0c74f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.087+0000 7ffa23fa2640 1 --2- 172.21.15.29:0/776292795 >> v2:172.21.15.52:3300/0 conn(0x7ffa1c0c48d0 0x7ffa1c0c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.087+0000 7ffa23fa2640 1 -- 172.21.15.29:0/776292795 >> 172.21.15.29:0/776292795 conn(0x7ffa1c0c7f10 msgr2=0x7ffa1c0c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:03.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.087+0000 7ffa23fa2640 1 -- 172.21.15.29:0/776292795 shutdown_connections 2024-01-25T15:05:03.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.087+0000 7ffa23fa2640 1 -- 172.21.15.29:0/776292795 wait complete. 2024-01-25T15:05:03.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.088+0000 7ffa23fa2640 1 Processor -- start 2024-01-25T15:05:03.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.088+0000 7ffa23fa2640 1 -- start start 2024-01-25T15:05:03.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.089+0000 7ffa23fa2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa1c0c48d0 0x7ffa1c14ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:03.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.089+0000 7ffa23fa2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1c151f80 0x7ffa1c14d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:03.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.089+0000 7ffa23fa2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffa1c155190 0x7ffa1c152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:03.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.089+0000 7ffa23fa2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c06e1e0 con 0x7ffa1c0c48d0 2024-01-25T15:05:03.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.089+0000 7ffa23fa2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c0aa4d0 con 0x7ffa1c151f80 2024-01-25T15:05:03.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.089+0000 7ffa23fa2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c1ee240 con 0x7ffa1c155190 2024-01-25T15:05:03.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.089+0000 7ffa21d3e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa1c0c48d0 0x7ffa1c14ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:03.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.089+0000 7ffa21d3e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa1c0c48d0 0x7ffa1c14ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40880/0 (socket says 172.21.15.29:40880) 2024-01-25T15:05:03.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.089+0000 7ffa21d3e640 1 -- 172.21.15.29:0/2912804068 learned_addr learned my addr 172.21.15.29:0/2912804068 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:03.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.089+0000 7ffa2253f640 1 --2- 172.21.15.29:0/2912804068 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffa1c155190 0x7ffa1c152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:03.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.089+0000 7ffa21d3e640 1 -- 172.21.15.29:0/2912804068 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffa1c155190 msgr2=0x7ffa1c152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:03.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.089+0000 7ffa2153d640 1 --2- 172.21.15.29:0/2912804068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1c151f80 0x7ffa1c14d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:03.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.089+0000 7ffa21d3e640 1 --2- 172.21.15.29:0/2912804068 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffa1c155190 0x7ffa1c152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.089+0000 7ffa21d3e640 1 -- 172.21.15.29:0/2912804068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1c151f80 msgr2=0x7ffa1c14d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:03.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.089+0000 7ffa21d3e640 1 --2- 172.21.15.29:0/2912804068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1c151f80 0x7ffa1c14d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.089+0000 7ffa21d3e640 1 -- 172.21.15.29:0/2912804068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa14009a70 con 0x7ffa1c0c48d0 2024-01-25T15:05:03.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.089+0000 7ffa2253f640 1 --2- 172.21.15.29:0/2912804068 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffa1c155190 0x7ffa1c152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:03.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.089+0000 7ffa2153d640 1 --2- 172.21.15.29:0/2912804068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1c151f80 0x7ffa1c14d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:03.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.089+0000 7ffa21d3e640 1 --2- 172.21.15.29:0/2912804068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa1c0c48d0 0x7ffa1c14ccc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800c780 tx=0x7ffa1800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:03.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.090+0000 7ffa127fc640 1 -- 172.21.15.29:0/2912804068 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa18005ad0 con 0x7ffa1c0c48d0 2024-01-25T15:05:03.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.090+0000 7ffa127fc640 1 -- 172.21.15.29:0/2912804068 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa18005c50 con 0x7ffa1c0c48d0 2024-01-25T15:05:03.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.090+0000 7ffa23fa2640 1 -- 172.21.15.29:0/2912804068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa1c06e430 con 0x7ffa1c0c48d0 2024-01-25T15:05:03.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.090+0000 7ffa127fc640 1 -- 172.21.15.29:0/2912804068 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa18007070 con 0x7ffa1c0c48d0 2024-01-25T15:05:03.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.090+0000 7ffa23fa2640 1 -- 172.21.15.29:0/2912804068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa1c06c7e0 con 0x7ffa1c0c48d0 2024-01-25T15:05:03.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.091+0000 7ffa23fa2640 1 -- 172.21.15.29:0/2912804068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa1c04eb10 con 0x7ffa1c0c48d0 2024-01-25T15:05:03.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.091+0000 7ffa127fc640 1 -- 172.21.15.29:0/2912804068 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ffa180071d0 con 0x7ffa1c0c48d0 2024-01-25T15:05:03.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.091+0000 7ffa127fc640 1 --2- 172.21.15.29:0/2912804068 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ffa0006aed0 0x7ffa0006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:03.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.091+0000 7ffa127fc640 1 -- 172.21.15.29:0/2912804068 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffa18089600 con 0x7ffa1c0c48d0 2024-01-25T15:05:03.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.092+0000 7ffa2153d640 1 --2- 172.21.15.29:0/2912804068 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ffa0006aed0 0x7ffa0006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:03.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.092+0000 7ffa2153d640 1 --2- 172.21.15.29:0/2912804068 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ffa0006aed0 0x7ffa0006d390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c1587d0 tx=0x7ffa0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:03.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.096+0000 7ffa127fc640 1 -- 172.21.15.29:0/2912804068 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7ffa18054270 con 0x7ffa1c0c48d0 2024-01-25T15:05:03.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.274+0000 7ffa23fa2640 1 -- 172.21.15.29:0/2912804068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ffa1c074010 con 0x7ffa1c0c48d0 2024-01-25T15:05:03.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.275+0000 7ffa127fc640 1 -- 172.21.15.29:0/2912804068 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7ffa18057890 con 0x7ffa1c0c48d0 2024-01-25T15:05:03.275 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:03.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.277+0000 7ffa23fa2640 1 -- 172.21.15.29:0/2912804068 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ffa0006aed0 msgr2=0x7ffa0006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:03.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.277+0000 7ffa23fa2640 1 --2- 172.21.15.29:0/2912804068 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ffa0006aed0 0x7ffa0006d390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c1587d0 tx=0x7ffa0c008040 comp rx=0 tx=0).stop 2024-01-25T15:05:03.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.277+0000 7ffa23fa2640 1 -- 172.21.15.29:0/2912804068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa1c0c48d0 msgr2=0x7ffa1c14ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:03.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.277+0000 7ffa23fa2640 1 --2- 172.21.15.29:0/2912804068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa1c0c48d0 0x7ffa1c14ccc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800c780 tx=0x7ffa1800cc40 comp rx=0 tx=0).stop 2024-01-25T15:05:03.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.277+0000 7ffa23fa2640 1 -- 172.21.15.29:0/2912804068 shutdown_connections 2024-01-25T15:05:03.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.277+0000 7ffa23fa2640 1 --2- 172.21.15.29:0/2912804068 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffa1c155190 0x7ffa1c152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.277+0000 7ffa23fa2640 1 --2- 172.21.15.29:0/2912804068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1c151f80 0x7ffa1c14d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.277+0000 7ffa23fa2640 1 --2- 172.21.15.29:0/2912804068 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ffa0006aed0 0x7ffa0006d390 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.277+0000 7ffa23fa2640 1 --2- 172.21.15.29:0/2912804068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa1c0c48d0 0x7ffa1c14ccc0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.277+0000 7ffa23fa2640 1 -- 172.21.15.29:0/2912804068 >> 172.21.15.29:0/2912804068 conn(0x7ffa1c0c7f10 msgr2=0x7ffa1c0c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:03.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.277+0000 7ffa23fa2640 1 -- 172.21.15.29:0/2912804068 shutdown_connections 2024-01-25T15:05:03.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.277+0000 7ffa23fa2640 1 -- 172.21.15.29:0/2912804068 wait complete. 2024-01-25T15:05:03.288 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:03.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.389+0000 7f37d2046640 1 Processor -- start 2024-01-25T15:05:03.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.389+0000 7f37d2046640 1 -- start start 2024-01-25T15:05:03.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.390+0000 7f37d2046640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f37cc1520b0 0x7f37cc155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:03.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.390+0000 7f37d2046640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37cc0c4f00 0x7f37cc0c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:03.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.390+0000 7f37d2046640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37cc0c66c0 con 0x7f37cc0c55e0 2024-01-25T15:05:03.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.390+0000 7f37d2046640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37cc06cfc0 con 0x7f37cc1520b0 2024-01-25T15:05:03.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.390+0000 7f37d2046640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc152490 con 0x7f37cc0c4f00 2024-01-25T15:05:03.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.390+0000 7f37cb7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f37cc1520b0 0x7f37cc155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:03.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.390+0000 7f37cbfff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37cc0c4f00 0x7f37cc0c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:03.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.390+0000 7f37caffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f37cc0c55e0 0x7f37cc0c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:38278/0 (socket says 172.21.15.29:38278) 2024-01-25T15:05:03.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.390+0000 7f37caffd640 1 -- 172.21.15.29:0/2163936859 learned_addr learned my addr 172.21.15.29:0/2163936859 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:03.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.390+0000 7f37ca7fc640 1 -- 172.21.15.29:0/2163936859 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3623664635 0 0) 0x7f37cc0c66c0 con 0x7f37cc0c55e0 2024-01-25T15:05:03.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.390+0000 7f37ca7fc640 1 -- 172.21.15.29:0/2163936859 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37b4003520 con 0x7f37cc0c55e0 2024-01-25T15:05:03.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.390+0000 7f37cbfff640 1 -- 172.21.15.29:0/2163936859 >> v2:172.21.15.52:3300/0 conn(0x7f37cc1520b0 msgr2=0x7f37cc155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:03.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.390+0000 7f37cbfff640 1 --2- 172.21.15.29:0/2163936859 >> v2:172.21.15.52:3300/0 conn(0x7f37cc1520b0 0x7f37cc155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.390+0000 7f37cbfff640 1 -- 172.21.15.29:0/2163936859 >> v1:172.21.15.52:6789/0 conn(0x7f37cc0c55e0 legacy=0x7f37cc0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:03.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.390+0000 7f37cbfff640 1 -- 172.21.15.29:0/2163936859 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37cc0c8830 con 0x7f37cc0c4f00 2024-01-25T15:05:03.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.390+0000 7f37cb7fe640 1 --2- 172.21.15.29:0/2163936859 >> v2:172.21.15.52:3300/0 conn(0x7f37cc1520b0 0x7f37cc155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:05:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.391+0000 7f37cbfff640 1 --2- 172.21.15.29:0/2163936859 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37cc0c4f00 0x7f37cc0c5b30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f37c4009d90 tx=0x7f37c402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e471ec5454e66b6 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.391+0000 7f37ca7fc640 1 -- 172.21.15.29:0/2163936859 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c402cbc0 con 0x7f37cc0c4f00 2024-01-25T15:05:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.391+0000 7f37ca7fc640 1 -- 172.21.15.29:0/2163936859 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c402cd20 con 0x7f37cc0c4f00 2024-01-25T15:05:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.391+0000 7f37ca7fc640 1 -- 172.21.15.29:0/2163936859 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c4034660 con 0x7f37cc0c4f00 2024-01-25T15:05:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.392+0000 7f37d2046640 1 -- 172.21.15.29:0/2163936859 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37cc0c4f00 msgr2=0x7f37cc0c5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.392+0000 7f37d2046640 1 --2- 172.21.15.29:0/2163936859 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37cc0c4f00 0x7f37cc0c5b30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f37c4009d90 tx=0x7f37c402be10 comp rx=0 tx=0).stop 2024-01-25T15:05:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.392+0000 7f37d2046640 1 -- 172.21.15.29:0/2163936859 shutdown_connections 2024-01-25T15:05:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.392+0000 7f37d2046640 1 --2- 172.21.15.29:0/2163936859 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37cc0c4f00 0x7f37cc0c5b30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.392+0000 7f37d2046640 1 --2- 172.21.15.29:0/2163936859 >> v2:172.21.15.52:3300/0 conn(0x7f37cc1520b0 0x7f37cc155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.392+0000 7f37d2046640 1 -- 172.21.15.29:0/2163936859 >> 172.21.15.29:0/2163936859 conn(0x7f37cc0ca220 msgr2=0x7f37cc0ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.392+0000 7f37d2046640 1 -- 172.21.15.29:0/2163936859 shutdown_connections 2024-01-25T15:05:03.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.392+0000 7f37d2046640 1 -- 172.21.15.29:0/2163936859 wait complete. 2024-01-25T15:05:03.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.393+0000 7f37d2046640 1 Processor -- start 2024-01-25T15:05:03.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.393+0000 7f37d2046640 1 -- start start 2024-01-25T15:05:03.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.394+0000 7f37d2046640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37cc0c4f00 0x7f37cc1eb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:03.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.394+0000 7f37d2046640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37cc1520b0 0x7f37cc1ea6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:03.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.394+0000 7f37d2046640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37cc158530 0x7f37cc0ab060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:03.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.394+0000 7f37d2046640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc0af7c0 con 0x7f37cc0c4f00 2024-01-25T15:05:03.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.394+0000 7f37d2046640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc1545c0 con 0x7f37cc1520b0 2024-01-25T15:05:03.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.394+0000 7f37d2046640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc1573f0 con 0x7f37cc158530 2024-01-25T15:05:03.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.394+0000 7f37cb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37cc0c4f00 0x7f37cc1eb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:03.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.394+0000 7f37cb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37cc0c4f00 0x7f37cc1eb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40884/0 (socket says 172.21.15.29:40884) 2024-01-25T15:05:03.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.394+0000 7f37cb7fe640 1 -- 172.21.15.29:0/2192089590 learned_addr learned my addr 172.21.15.29:0/2192089590 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:03.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.394+0000 7f37cbfff640 1 --2- 172.21.15.29:0/2192089590 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37cc158530 0x7f37cc0ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:03.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.394+0000 7f37caffd640 1 --2- 172.21.15.29:0/2192089590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37cc1520b0 0x7f37cc1ea6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:03.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.394+0000 7f37cb7fe640 1 -- 172.21.15.29:0/2192089590 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37cc158530 msgr2=0x7f37cc0ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:03.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.394+0000 7f37cb7fe640 1 --2- 172.21.15.29:0/2192089590 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37cc158530 0x7f37cc0ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.394+0000 7f37cb7fe640 1 -- 172.21.15.29:0/2192089590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37cc1520b0 msgr2=0x7f37cc1ea6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:03.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.394+0000 7f37cb7fe640 1 --2- 172.21.15.29:0/2192089590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37cc1520b0 0x7f37cc1ea6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.394+0000 7f37cb7fe640 1 -- 172.21.15.29:0/2192089590 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c0009400 con 0x7f37cc0c4f00 2024-01-25T15:05:03.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.394+0000 7f37caffd640 1 --2- 172.21.15.29:0/2192089590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37cc1520b0 0x7f37cc1ea6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:03.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.395+0000 7f37cb7fe640 1 --2- 172.21.15.29:0/2192089590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37cc0c4f00 0x7f37cc1eb110 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f37c000e990 tx=0x7f37c000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:03.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.395+0000 7f37b3fff640 1 -- 172.21.15.29:0/2192089590 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c000c9e0 con 0x7f37cc0c4f00 2024-01-25T15:05:03.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.395+0000 7f37b3fff640 1 -- 172.21.15.29:0/2192089590 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c000cb40 con 0x7f37cc0c4f00 2024-01-25T15:05:03.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.395+0000 7f37d2046640 1 -- 172.21.15.29:0/2192089590 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c4009a70 con 0x7f37cc0c4f00 2024-01-25T15:05:03.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.395+0000 7f37b3fff640 1 -- 172.21.15.29:0/2192089590 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c000ced0 con 0x7f37cc0c4f00 2024-01-25T15:05:03.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.395+0000 7f37d2046640 1 -- 172.21.15.29:0/2192089590 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37cc1eb650 con 0x7f37cc0c4f00 2024-01-25T15:05:03.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.396+0000 7f37d2046640 1 -- 172.21.15.29:0/2192089590 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37cc074080 con 0x7f37cc0c4f00 2024-01-25T15:05:03.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.396+0000 7f37b3fff640 1 -- 172.21.15.29:0/2192089590 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f37c0013470 con 0x7f37cc0c4f00 2024-01-25T15:05:03.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.397+0000 7f37b3fff640 1 --2- 172.21.15.29:0/2192089590 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f37b806aed0 0x7f37b806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:03.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.397+0000 7f37b3fff640 1 -- 172.21.15.29:0/2192089590 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f37c0089af0 con 0x7f37cc0c4f00 2024-01-25T15:05:03.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.397+0000 7f37caffd640 1 --2- 172.21.15.29:0/2192089590 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f37b806aed0 0x7f37b806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:03.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.397+0000 7f37caffd640 1 --2- 172.21.15.29:0/2192089590 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f37b806aed0 0x7f37b806d390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0c10a0 tx=0x7f37bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:03.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.401+0000 7f37b3fff640 1 -- 172.21.15.29:0/2192089590 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f37c0054760 con 0x7f37cc0c4f00 2024-01-25T15:05:03.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.579+0000 7f37d2046640 1 -- 172.21.15.29:0/2192089590 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37cc0c4ce0 con 0x7f37cc0c4f00 2024-01-25T15:05:03.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.580+0000 7f37b3fff640 1 -- 172.21.15.29:0/2192089590 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18311 (secure 0 0 0) 0x7f37c0017090 con 0x7f37cc0c4f00 2024-01-25T15:05:03.582 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:03.582 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:31.978871+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:03.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.582+0000 7f37d2046640 1 -- 172.21.15.29:0/2192089590 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f37b806aed0 msgr2=0x7f37b806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:03.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.582+0000 7f37d2046640 1 --2- 172.21.15.29:0/2192089590 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f37b806aed0 0x7f37b806d390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0c10a0 tx=0x7f37bc009040 comp rx=0 tx=0).stop 2024-01-25T15:05:03.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.582+0000 7f37d2046640 1 -- 172.21.15.29:0/2192089590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37cc0c4f00 msgr2=0x7f37cc1eb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:03.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.582+0000 7f37d2046640 1 --2- 172.21.15.29:0/2192089590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37cc0c4f00 0x7f37cc1eb110 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f37c000e990 tx=0x7f37c000ee50 comp rx=0 tx=0).stop 2024-01-25T15:05:03.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.582+0000 7f37d2046640 1 -- 172.21.15.29:0/2192089590 shutdown_connections 2024-01-25T15:05:03.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.582+0000 7f37d2046640 1 --2- 172.21.15.29:0/2192089590 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f37cc158530 0x7f37cc0ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.582+0000 7f37d2046640 1 --2- 172.21.15.29:0/2192089590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37cc1520b0 0x7f37cc1ea6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.582+0000 7f37d2046640 1 --2- 172.21.15.29:0/2192089590 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f37b806aed0 0x7f37b806d390 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.582+0000 7f37d2046640 1 --2- 172.21.15.29:0/2192089590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37cc0c4f00 0x7f37cc1eb110 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.582+0000 7f37d2046640 1 -- 172.21.15.29:0/2192089590 >> 172.21.15.29:0/2192089590 conn(0x7f37cc0ca220 msgr2=0x7f37cc0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:03.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.583+0000 7f37d2046640 1 -- 172.21.15.29:0/2192089590 shutdown_connections 2024-01-25T15:05:03.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.583+0000 7f37d2046640 1 -- 172.21.15.29:0/2192089590 wait complete. 2024-01-25T15:05:03.595 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T15:04:14.955791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T15:04:24.986626+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T15:04:25.873673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-25T15:04:29.578261+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-25T15:05:03.595 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:05:03.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.700+0000 7f032cbdc640 1 Processor -- start 2024-01-25T15:05:03.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.700+0000 7f032cbdc640 1 -- start start 2024-01-25T15:05:03.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f032cbdc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0328152340 0x7f03280c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:03.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f032cbdc640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03280c6770 con 0x7f03280c8620 2024-01-25T15:05:03.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f032cbdc640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0328154f10 con 0x7f032806b490 2024-01-25T15:05:03.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f032cbdc640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03281551f0 con 0x7f0328152340 2024-01-25T15:05:03.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f031ffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f03280c8620 0x7f0328151c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49446/0 (socket says 172.21.15.29:49446) 2024-01-25T15:05:03.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f031ffff640 1 -- 172.21.15.29:0/4169827452 learned_addr learned my addr 172.21.15.29:0/4169827452 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:03.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f0325d9b640 1 -- 172.21.15.29:0/4169827452 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3841290919 0 0) 0x7f03280c6770 con 0x7f03280c8620 2024-01-25T15:05:03.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f0325d9b640 1 -- 172.21.15.29:0/4169827452 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0314003520 con 0x7f03280c8620 2024-01-25T15:05:03.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f0326d9d640 1 --2- 172.21.15.29:0/4169827452 >> v2:172.21.15.52:3300/0 conn(0x7f0328152340 0x7f03280c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:03.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f0325d9b640 1 -- 172.21.15.29:0/4169827452 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3437667445 0 0) 0x7f0314003520 con 0x7f03280c8620 2024-01-25T15:05:03.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f0325d9b640 1 -- 172.21.15.29:0/4169827452 >> v2:172.21.15.52:3300/0 conn(0x7f0328152340 msgr2=0x7f03280c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:03.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f0325d9b640 1 --2- 172.21.15.29:0/4169827452 >> v2:172.21.15.52:3300/0 conn(0x7f0328152340 0x7f03280c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f0325d9b640 1 -- 172.21.15.29:0/4169827452 >> v1:172.21.15.52:6789/0 conn(0x7f032806b490 legacy=0x7f03280c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:03.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f0325d9b640 1 -- 172.21.15.29:0/4169827452 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03281554d0 con 0x7f03280c8620 2024-01-25T15:05:03.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f0325d9b640 1 -- 172.21.15.29:0/4169827452 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f0310001670 con 0x7f03280c8620 2024-01-25T15:05:03.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f0326d9d640 1 --2- 172.21.15.29:0/4169827452 >> v2:172.21.15.52:3300/0 conn(0x7f0328152340 0x7f03280c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:03.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f0325d9b640 1 -- 172.21.15.29:0/4169827452 >> v1:172.21.15.29:6789/0 conn(0x7f03280c8620 legacy=0x7f0328151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:03.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f0325d9b640 1 --2- 172.21.15.29:0/4169827452 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f03140039e0 0x7f0314003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:03.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f0325d9b640 1 --2- 172.21.15.29:0/4169827452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03140047c0 0x7f0314004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:03.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f0325d9b640 1 --2- 172.21.15.29:0/4169827452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03140052a0 0x7f031400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:03.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f0325d9b640 1 -- 172.21.15.29:0/4169827452 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03281551f0 con 0x7f03140052a0 2024-01-25T15:05:03.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f0325d9b640 1 -- 172.21.15.29:0/4169827452 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031400c1f0 con 0x7f03140047c0 2024-01-25T15:05:03.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.701+0000 7f0325d9b640 1 -- 172.21.15.29:0/4169827452 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031400c3b0 con 0x7f03140039e0 2024-01-25T15:05:03.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.702+0000 7f0326d9d640 1 --2- 172.21.15.29:0/4169827452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03140052a0 0x7f031400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:03.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.702+0000 7f031ffff640 1 --2- 172.21.15.29:0/4169827452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03140047c0 0x7f0314004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:03.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.702+0000 7f032659c640 1 --2- 172.21.15.29:0/4169827452 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f03140039e0 0x7f0314003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:03.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.702+0000 7f0326d9d640 1 -- 172.21.15.29:0/4169827452 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f03140039e0 msgr2=0x7f0314003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:03.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.702+0000 7f0326d9d640 1 --2- 172.21.15.29:0/4169827452 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f03140039e0 0x7f0314003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.702+0000 7f0326d9d640 1 -- 172.21.15.29:0/4169827452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03140047c0 msgr2=0x7f0314004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:03.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.702+0000 7f0326d9d640 1 --2- 172.21.15.29:0/4169827452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03140047c0 0x7f0314004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.702+0000 7f0326d9d640 1 -- 172.21.15.29:0/4169827452 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0314003520 con 0x7f03140052a0 2024-01-25T15:05:03.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.702+0000 7f0326d9d640 1 -- 172.21.15.29:0/4169827452 reap_dead start 2024-01-25T15:05:03.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.702+0000 7f0326d9d640 1 --2- 172.21.15.29:0/4169827452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03140052a0 0x7f031400b980 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f03200073b0 tx=0x7f03140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f470dbf6694602f server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:03.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.703+0000 7f0325d9b640 1 -- 172.21.15.29:0/4169827452 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032002cd90 con 0x7f03140052a0 2024-01-25T15:05:03.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.703+0000 7f0325d9b640 1 -- 172.21.15.29:0/4169827452 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0320034440 con 0x7f03140052a0 2024-01-25T15:05:03.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.703+0000 7f0325d9b640 1 -- 172.21.15.29:0/4169827452 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03200347d0 con 0x7f03140052a0 2024-01-25T15:05:03.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.703+0000 7f032cbdc640 1 -- 172.21.15.29:0/4169827452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03140052a0 msgr2=0x7f031400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:03.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.703+0000 7f032cbdc640 1 --2- 172.21.15.29:0/4169827452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03140052a0 0x7f031400b980 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f03200073b0 tx=0x7f03140057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.703+0000 7f032cbdc640 1 -- 172.21.15.29:0/4169827452 shutdown_connections 2024-01-25T15:05:03.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.703+0000 7f032cbdc640 1 --2- 172.21.15.29:0/4169827452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03140052a0 0x7f031400b980 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.703+0000 7f032cbdc640 1 -- 172.21.15.29:0/4169827452 >> 172.21.15.29:0/4169827452 conn(0x7f03280ca010 msgr2=0x7f03280ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:03.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.703+0000 7f032cbdc640 1 -- 172.21.15.29:0/4169827452 shutdown_connections 2024-01-25T15:05:03.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.703+0000 7f032cbdc640 1 -- 172.21.15.29:0/4169827452 wait complete. 2024-01-25T15:05:03.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.704+0000 7f032cbdc640 1 Processor -- start 2024-01-25T15:05:03.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.704+0000 7f032cbdc640 1 -- start start 2024-01-25T15:05:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.705+0000 7f032cbdc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03140052a0 0x7f03281eab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.705+0000 7f032cbdc640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f032814e310 0x7f0328153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.705+0000 7f032cbdc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f032814cb50 0x7f03281ed690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.705+0000 7f032cbdc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032814dd30 con 0x7f03140052a0 2024-01-25T15:05:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.705+0000 7f032cbdc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03281eb060 con 0x7f032814cb50 2024-01-25T15:05:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.705+0000 7f032cbdc640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03281ea0c0 con 0x7f032814e310 2024-01-25T15:05:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.705+0000 7f032659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03140052a0 0x7f03281eab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.705+0000 7f032659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03140052a0 0x7f03281eab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40912/0 (socket says 172.21.15.29:40912) 2024-01-25T15:05:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.705+0000 7f032659c640 1 -- 172.21.15.29:0/68879714 learned_addr learned my addr 172.21.15.29:0/68879714 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.705+0000 7f032659c640 1 -- 172.21.15.29:0/68879714 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f032814e310 msgr2=0x7f0328153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.705+0000 7f032659c640 1 --2- 172.21.15.29:0/68879714 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f032814e310 0x7f0328153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.705+0000 7f032659c640 1 -- 172.21.15.29:0/68879714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f032814cb50 msgr2=0x7f03281ed690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:03.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.705+0000 7f032659c640 1 --2- 172.21.15.29:0/68879714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f032814cb50 0x7f03281ed690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.705+0000 7f032659c640 1 -- 172.21.15.29:0/68879714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0328155b70 con 0x7f03140052a0 2024-01-25T15:05:03.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.706+0000 7f032659c640 1 --2- 172.21.15.29:0/68879714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03140052a0 0x7f03281eab20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f031800f5f0 tx=0x7f031800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:03.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.706+0000 7f031effd640 1 -- 172.21.15.29:0/68879714 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03180052e0 con 0x7f03140052a0 2024-01-25T15:05:03.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.706+0000 7f031effd640 1 -- 172.21.15.29:0/68879714 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0318005440 con 0x7f03140052a0 2024-01-25T15:05:03.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.706+0000 7f032cbdc640 1 -- 172.21.15.29:0/68879714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0328157c90 con 0x7f03140052a0 2024-01-25T15:05:03.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.706+0000 7f031effd640 1 -- 172.21.15.29:0/68879714 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0318003810 con 0x7f03140052a0 2024-01-25T15:05:03.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.706+0000 7f032cbdc640 1 -- 172.21.15.29:0/68879714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03281ea320 con 0x7f03140052a0 2024-01-25T15:05:03.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.707+0000 7f032cbdc640 1 -- 172.21.15.29:0/68879714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0328074010 con 0x7f03140052a0 2024-01-25T15:05:03.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.707+0000 7f031effd640 1 -- 172.21.15.29:0/68879714 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0318003970 con 0x7f03140052a0 2024-01-25T15:05:03.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.708+0000 7f031effd640 1 --2- 172.21.15.29:0/68879714 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f030806af00 0x7f030806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:03.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.708+0000 7f031effd640 1 -- 172.21.15.29:0/68879714 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0318089750 con 0x7f03140052a0 2024-01-25T15:05:03.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.708+0000 7f031ffff640 1 --2- 172.21.15.29:0/68879714 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f030806af00 0x7f030806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:03.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.708+0000 7f031ffff640 1 --2- 172.21.15.29:0/68879714 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f030806af00 0x7f030806d3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0310000f60 tx=0x7f0310000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:03.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.712+0000 7f031effd640 1 -- 172.21.15.29:0/68879714 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f03180543c0 con 0x7f03140052a0 2024-01-25T15:05:03.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.892+0000 7f032cbdc640 1 -- 172.21.15.29:0/68879714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03280c9d80 con 0x7f03140052a0 2024-01-25T15:05:03.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.893+0000 7f031effd640 1 -- 172.21.15.29:0/68879714 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f03180579e0 con 0x7f03140052a0 2024-01-25T15:05:03.894 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-25T15:05:03.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.895+0000 7f032cbdc640 1 -- 172.21.15.29:0/68879714 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f030806af00 msgr2=0x7f030806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:03.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.895+0000 7f032cbdc640 1 --2- 172.21.15.29:0/68879714 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f030806af00 0x7f030806d3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0310000f60 tx=0x7f0310000ed0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.895+0000 7f032cbdc640 1 -- 172.21.15.29:0/68879714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03140052a0 msgr2=0x7f03281eab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:03.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.895+0000 7f032cbdc640 1 --2- 172.21.15.29:0/68879714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03140052a0 0x7f03281eab20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f031800f5f0 tx=0x7f031800fab0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.895+0000 7f032cbdc640 1 -- 172.21.15.29:0/68879714 shutdown_connections 2024-01-25T15:05:03.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.895+0000 7f032cbdc640 1 --2- 172.21.15.29:0/68879714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f032814cb50 0x7f03281ed690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.895+0000 7f032cbdc640 1 --2- 172.21.15.29:0/68879714 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f032814e310 0x7f0328153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.895+0000 7f032cbdc640 1 --2- 172.21.15.29:0/68879714 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f030806af00 0x7f030806d3c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.895+0000 7f032cbdc640 1 --2- 172.21.15.29:0/68879714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f03140052a0 0x7f03281eab20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:03.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.895+0000 7f032cbdc640 1 -- 172.21.15.29:0/68879714 >> 172.21.15.29:0/68879714 conn(0x7f03280ca010 msgr2=0x7f032814e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:03.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.895+0000 7f032cbdc640 1 -- 172.21.15.29:0/68879714 shutdown_connections 2024-01-25T15:05:03.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:03.895+0000 7f032cbdc640 1 -- 172.21.15.29:0/68879714 wait complete. 2024-01-25T15:05:03.906 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:05:04.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.010+0000 7f601035a640 1 Processor -- start 2024-01-25T15:05:04.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.010+0000 7f601035a640 1 -- start start 2024-01-25T15:05:04.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.011+0000 7f601035a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6008151e90 0x7f6008155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.011+0000 7f601035a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f60080c7f00 0x7f60080c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.011+0000 7f601035a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6008152270 con 0x7f60080c6530 2024-01-25T15:05:04.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.011+0000 7f601035a640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600806c090 con 0x7f60080c7f00 2024-01-25T15:05:04.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.011+0000 7f601035a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6008155780 con 0x7f6008151e90 2024-01-25T15:05:04.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.011+0000 7f600d8f5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f60080c7f00 0x7f60080c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.011+0000 7f600d8f5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f60080c7f00 0x7f60080c5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40916/0 (socket says 172.21.15.29:40916) 2024-01-25T15:05:04.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.011+0000 7f600d8f5640 1 -- 172.21.15.29:0/3589322331 learned_addr learned my addr 172.21.15.29:0/3589322331 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:04.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.011+0000 7f600d8f5640 1 -- 172.21.15.29:0/3589322331 >> v2:172.21.15.52:3300/0 conn(0x7f6008151e90 msgr2=0x7f6008155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:04.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.011+0000 7f600d8f5640 1 --2- 172.21.15.29:0/3589322331 >> v2:172.21.15.52:3300/0 conn(0x7f6008151e90 0x7f6008155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.011+0000 7f600d8f5640 1 -- 172.21.15.29:0/3589322331 >> v1:172.21.15.52:6789/0 conn(0x7f60080c6530 legacy=0x7f60080c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:04.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.011+0000 7f600d8f5640 1 -- 172.21.15.29:0/3589322331 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600806b590 con 0x7f60080c7f00 2024-01-25T15:05:04.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.012+0000 7f600d8f5640 1 --2- 172.21.15.29:0/3589322331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60080c7f00 0x7f60080c5ff0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f600808b800 tx=0x7f5ff802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b9f145f039a6d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:04.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.012+0000 7f600d0f4640 1 -- 172.21.15.29:0/3589322331 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff80317e0 con 0x7f60080c7f00 2024-01-25T15:05:04.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.012+0000 7f600d0f4640 1 -- 172.21.15.29:0/3589322331 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff8031940 con 0x7f60080c7f00 2024-01-25T15:05:04.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.012+0000 7f600d0f4640 1 -- 172.21.15.29:0/3589322331 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8031cd0 con 0x7f60080c7f00 2024-01-25T15:05:04.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.012+0000 7f601035a640 1 -- 172.21.15.29:0/3589322331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60080c7f00 msgr2=0x7f60080c5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:04.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.012+0000 7f601035a640 1 --2- 172.21.15.29:0/3589322331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60080c7f00 0x7f60080c5ff0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f600808b800 tx=0x7f5ff802b880 comp rx=0 tx=0).stop 2024-01-25T15:05:04.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.013+0000 7f601035a640 1 -- 172.21.15.29:0/3589322331 shutdown_connections 2024-01-25T15:05:04.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.013+0000 7f601035a640 1 --2- 172.21.15.29:0/3589322331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60080c7f00 0x7f60080c5ff0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.013+0000 7f601035a640 1 --2- 172.21.15.29:0/3589322331 >> v2:172.21.15.52:3300/0 conn(0x7f6008151e90 0x7f6008155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.013+0000 7f601035a640 1 -- 172.21.15.29:0/3589322331 >> 172.21.15.29:0/3589322331 conn(0x7f60080ca000 msgr2=0x7f60080ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:04.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.013+0000 7f601035a640 1 -- 172.21.15.29:0/3589322331 shutdown_connections 2024-01-25T15:05:04.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.013+0000 7f601035a640 1 -- 172.21.15.29:0/3589322331 wait complete. 2024-01-25T15:05:04.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.014+0000 7f601035a640 1 Processor -- start 2024-01-25T15:05:04.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.014+0000 7f601035a640 1 -- start start 2024-01-25T15:05:04.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.014+0000 7f601035a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60080c6530 0x7f60081edf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.014+0000 7f601035a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f60080c7f00 0x7f60081435f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.014+0000 7f601035a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6008151e90 0x7f6008143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.014+0000 7f601035a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600814ee60 con 0x7f60080c6530 2024-01-25T15:05:04.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.014+0000 7f601035a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6008144070 con 0x7f6008151e90 2024-01-25T15:05:04.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.014+0000 7f601035a640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600814e9d0 con 0x7f60080c7f00 2024-01-25T15:05:04.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.014+0000 7f600e0f6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60080c6530 0x7f60081edf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.014+0000 7f600e0f6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60080c6530 0x7f60081edf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40928/0 (socket says 172.21.15.29:40928) 2024-01-25T15:05:04.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.014+0000 7f600e0f6640 1 -- 172.21.15.29:0/2287980958 learned_addr learned my addr 172.21.15.29:0/2287980958 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:04.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.015+0000 7f600d8f5640 1 --2- 172.21.15.29:0/2287980958 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f60080c7f00 0x7f60081435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.015+0000 7f600e0f6640 1 -- 172.21.15.29:0/2287980958 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f60080c7f00 msgr2=0x7f60081435f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:04.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.015+0000 7f600e8f7640 1 --2- 172.21.15.29:0/2287980958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6008151e90 0x7f6008143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.015+0000 7f600e0f6640 1 --2- 172.21.15.29:0/2287980958 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f60080c7f00 0x7f60081435f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.015+0000 7f600e0f6640 1 -- 172.21.15.29:0/2287980958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6008151e90 msgr2=0x7f6008143b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:04.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.015+0000 7f600e0f6640 1 --2- 172.21.15.29:0/2287980958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6008151e90 0x7f6008143b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.015+0000 7f600e0f6640 1 -- 172.21.15.29:0/2287980958 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff80094d0 con 0x7f60080c6530 2024-01-25T15:05:04.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.015+0000 7f600e0f6640 1 --2- 172.21.15.29:0/2287980958 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60080c6530 0x7f60081edf60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f600400b4d0 tx=0x7f600400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:04.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.015+0000 7f5ffeffd640 1 -- 172.21.15.29:0/2287980958 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6004010870 con 0x7f60080c6530 2024-01-25T15:05:04.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.015+0000 7f5ffeffd640 1 -- 172.21.15.29:0/2287980958 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60040109d0 con 0x7f60080c6530 2024-01-25T15:05:04.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.015+0000 7f601035a640 1 -- 172.21.15.29:0/2287980958 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60081ee830 con 0x7f60080c6530 2024-01-25T15:05:04.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.015+0000 7f5ffeffd640 1 -- 172.21.15.29:0/2287980958 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6004010d80 con 0x7f60080c6530 2024-01-25T15:05:04.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.015+0000 7f601035a640 1 -- 172.21.15.29:0/2287980958 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600814e660 con 0x7f60080c6530 2024-01-25T15:05:04.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.016+0000 7f601035a640 1 -- 172.21.15.29:0/2287980958 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6008068580 con 0x7f60080c6530 2024-01-25T15:05:04.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.016+0000 7f5ffeffd640 1 -- 172.21.15.29:0/2287980958 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f600400f3c0 con 0x7f60080c6530 2024-01-25T15:05:04.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.017+0000 7f5ffeffd640 1 --2- 172.21.15.29:0/2287980958 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5fec06aed0 0x7f5fec06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.017+0000 7f5ffeffd640 1 -- 172.21.15.29:0/2287980958 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6004089860 con 0x7f60080c6530 2024-01-25T15:05:04.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.017+0000 7f600d8f5640 1 --2- 172.21.15.29:0/2287980958 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5fec06aed0 0x7f5fec06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.017+0000 7f600d8f5640 1 --2- 172.21.15.29:0/2287980958 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5fec06aed0 0x7f5fec06d390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8036000 tx=0x7f5ff803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:04.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.021+0000 7f5ffeffd640 1 -- 172.21.15.29:0/2287980958 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f60040544d0 con 0x7f60080c6530 2024-01-25T15:05:04.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.201+0000 7f601035a640 1 -- 172.21.15.29:0/2287980958 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6008074010 con 0x7f60080c6530 2024-01-25T15:05:04.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.201+0000 7f5ffeffd640 1 -- 172.21.15.29:0/2287980958 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6004057af0 con 0x7f60080c6530 2024-01-25T15:05:04.202 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:04.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.203+0000 7f601035a640 1 -- 172.21.15.29:0/2287980958 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5fec06aed0 msgr2=0x7f5fec06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:04.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.203+0000 7f601035a640 1 --2- 172.21.15.29:0/2287980958 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5fec06aed0 0x7f5fec06d390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8036000 tx=0x7f5ff803d040 comp rx=0 tx=0).stop 2024-01-25T15:05:04.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.203+0000 7f601035a640 1 -- 172.21.15.29:0/2287980958 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60080c6530 msgr2=0x7f60081edf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:04.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.203+0000 7f601035a640 1 --2- 172.21.15.29:0/2287980958 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60080c6530 0x7f60081edf60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f600400b4d0 tx=0x7f600400b990 comp rx=0 tx=0).stop 2024-01-25T15:05:04.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.203+0000 7f601035a640 1 -- 172.21.15.29:0/2287980958 shutdown_connections 2024-01-25T15:05:04.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.203+0000 7f601035a640 1 --2- 172.21.15.29:0/2287980958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6008151e90 0x7f6008143b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.203+0000 7f601035a640 1 --2- 172.21.15.29:0/2287980958 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f60080c7f00 0x7f60081435f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.203+0000 7f601035a640 1 --2- 172.21.15.29:0/2287980958 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5fec06aed0 0x7f5fec06d390 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.203+0000 7f601035a640 1 --2- 172.21.15.29:0/2287980958 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60080c6530 0x7f60081edf60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.203+0000 7f601035a640 1 -- 172.21.15.29:0/2287980958 >> 172.21.15.29:0/2287980958 conn(0x7f60080ca000 msgr2=0x7f60080aa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:04.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.203+0000 7f601035a640 1 -- 172.21.15.29:0/2287980958 shutdown_connections 2024-01-25T15:05:04.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.203+0000 7f601035a640 1 -- 172.21.15.29:0/2287980958 wait complete. 2024-01-25T15:05:04.214 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:05:04.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.319+0000 7f4b95872640 1 Processor -- start 2024-01-25T15:05:04.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.319+0000 7f4b95872640 1 -- start start 2024-01-25T15:05:04.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b95872640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b90149190 0x7f4b900ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b95872640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4b90152590 0x7f4b901529e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b95872640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b90070d40 con 0x7f4b90070510 2024-01-25T15:05:04.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b95872640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b90155c00 con 0x7f4b90152590 2024-01-25T15:05:04.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b95872640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b90155ee0 con 0x7f4b90149190 2024-01-25T15:05:04.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b8e7fc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4b90070510 0x7f4b900c7350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49460/0 (socket says 172.21.15.29:49460) 2024-01-25T15:05:04.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b8e7fc640 1 -- 172.21.15.29:0/2928777507 learned_addr learned my addr 172.21.15.29:0/2928777507 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:04.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b8dffb640 1 -- 172.21.15.29:0/2928777507 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000439008 0 0) 0x7f4b90070d40 con 0x7f4b90070510 2024-01-25T15:05:04.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b8dffb640 1 -- 172.21.15.29:0/2928777507 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b7c003520 con 0x7f4b90070510 2024-01-25T15:05:04.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b8f7fe640 1 --2- 172.21.15.29:0/2928777507 >> v2:172.21.15.52:3300/0 conn(0x7f4b90152590 0x7f4b901529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b8effd640 1 --2- 172.21.15.29:0/2928777507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b90149190 0x7f4b900ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b8dffb640 1 -- 172.21.15.29:0/2928777507 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3616600961 0 0) 0x7f4b7c003520 con 0x7f4b90070510 2024-01-25T15:05:04.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b8dffb640 1 -- 172.21.15.29:0/2928777507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b90149190 msgr2=0x7f4b900ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:04.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b8dffb640 1 --2- 172.21.15.29:0/2928777507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b90149190 0x7f4b900ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b8dffb640 1 -- 172.21.15.29:0/2928777507 >> v2:172.21.15.52:3300/0 conn(0x7f4b90152590 msgr2=0x7f4b901529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:04.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b8dffb640 1 --2- 172.21.15.29:0/2928777507 >> v2:172.21.15.52:3300/0 conn(0x7f4b90152590 0x7f4b901529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b8dffb640 1 -- 172.21.15.29:0/2928777507 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b901561c0 con 0x7f4b90070510 2024-01-25T15:05:04.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b8dffb640 1 -- 172.21.15.29:0/2928777507 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f4b78001670 con 0x7f4b90070510 2024-01-25T15:05:04.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b8dffb640 1 -- 172.21.15.29:0/2928777507 >> v1:172.21.15.29:6789/0 conn(0x7f4b90070510 legacy=0x7f4b900c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:04.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b8dffb640 1 --2- 172.21.15.29:0/2928777507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b7c0039e0 0x7f4b7c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b8dffb640 1 --2- 172.21.15.29:0/2928777507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b7c0047c0 0x7f4b7c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b8dffb640 1 --2- 172.21.15.29:0/2928777507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b90149190 0x7f4b7c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b8dffb640 1 -- 172.21.15.29:0/2928777507 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b90155c00 con 0x7f4b7c0039e0 2024-01-25T15:05:04.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b8dffb640 1 -- 172.21.15.29:0/2928777507 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b90155ee0 con 0x7f4b7c0047c0 2024-01-25T15:05:04.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b8dffb640 1 -- 172.21.15.29:0/2928777507 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c00b980 con 0x7f4b90149190 2024-01-25T15:05:04.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.320+0000 7f4b8effd640 1 --2- 172.21.15.29:0/2928777507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b7c0039e0 0x7f4b7c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.321+0000 7f4b8f7fe640 1 --2- 172.21.15.29:0/2928777507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b90149190 0x7f4b7c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.321+0000 7f4b8e7fc640 1 --2- 172.21.15.29:0/2928777507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b7c0047c0 0x7f4b7c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.321+0000 7f4b8effd640 1 -- 172.21.15.29:0/2928777507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b90149190 msgr2=0x7f4b7c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:04.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.321+0000 7f4b8effd640 1 --2- 172.21.15.29:0/2928777507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b90149190 0x7f4b7c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.321+0000 7f4b8effd640 1 -- 172.21.15.29:0/2928777507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b7c0047c0 msgr2=0x7f4b7c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:04.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.321+0000 7f4b8effd640 1 --2- 172.21.15.29:0/2928777507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b7c0047c0 0x7f4b7c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.321+0000 7f4b8effd640 1 -- 172.21.15.29:0/2928777507 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c003520 con 0x7f4b7c0039e0 2024-01-25T15:05:04.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.321+0000 7f4b8effd640 1 --2- 172.21.15.29:0/2928777507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b7c0039e0 0x7f4b7c003e00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4b88009ad0 tx=0x7f4b7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83799134b6742914 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:04.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.322+0000 7f4b8dffb640 1 -- 172.21.15.29:0/2928777507 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8802c6b0 con 0x7f4b7c0039e0 2024-01-25T15:05:04.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.322+0000 7f4b8dffb640 1 -- 172.21.15.29:0/2928777507 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8802c810 con 0x7f4b7c0039e0 2024-01-25T15:05:04.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.322+0000 7f4b8dffb640 1 -- 172.21.15.29:0/2928777507 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8802cbc0 con 0x7f4b7c0039e0 2024-01-25T15:05:04.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.322+0000 7f4b95872640 1 -- 172.21.15.29:0/2928777507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b7c0039e0 msgr2=0x7f4b7c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:04.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.322+0000 7f4b95872640 1 --2- 172.21.15.29:0/2928777507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b7c0039e0 0x7f4b7c003e00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4b88009ad0 tx=0x7f4b7c0057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.322+0000 7f4b8f7fe640 1 -- 172.21.15.29:0/2928777507 reap_dead start 2024-01-25T15:05:04.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.322+0000 7f4b95872640 1 -- 172.21.15.29:0/2928777507 shutdown_connections 2024-01-25T15:05:04.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.322+0000 7f4b95872640 1 -- 172.21.15.29:0/2928777507 >> 172.21.15.29:0/2928777507 conn(0x7f4b900c7f80 msgr2=0x7f4b900c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:04.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.322+0000 7f4b95872640 1 -- 172.21.15.29:0/2928777507 shutdown_connections 2024-01-25T15:05:04.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.322+0000 7f4b95872640 1 -- 172.21.15.29:0/2928777507 wait complete. 2024-01-25T15:05:04.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.323+0000 7f4b95872640 1 Processor -- start 2024-01-25T15:05:04.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.323+0000 7f4b95872640 1 -- start start 2024-01-25T15:05:04.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.324+0000 7f4b95872640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b7c0039e0 0x7f4b9006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.324+0000 7f4b95872640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b900c10c0 0x7f4b901481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.324+0000 7f4b95872640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b900c1540 0x7f4b90148700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.324+0000 7f4b95872640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900bff60 con 0x7f4b900c10c0 2024-01-25T15:05:04.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.324+0000 7f4b95872640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9006ca20 con 0x7f4b900c1540 2024-01-25T15:05:04.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.324+0000 7f4b95872640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9006c460 con 0x7f4b7c0039e0 2024-01-25T15:05:04.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.324+0000 7f4b8e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b900c10c0 0x7f4b901481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.324+0000 7f4b8e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b900c10c0 0x7f4b901481c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40960/0 (socket says 172.21.15.29:40960) 2024-01-25T15:05:04.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.324+0000 7f4b8e7fc640 1 -- 172.21.15.29:0/1031267506 learned_addr learned my addr 172.21.15.29:0/1031267506 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:04.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.324+0000 7f4b8effd640 1 --2- 172.21.15.29:0/1031267506 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b7c0039e0 0x7f4b9006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.324+0000 7f4b8f7fe640 1 --2- 172.21.15.29:0/1031267506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b900c1540 0x7f4b90148700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.324+0000 7f4b8e7fc640 1 -- 172.21.15.29:0/1031267506 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b7c0039e0 msgr2=0x7f4b9006d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:04.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.324+0000 7f4b8e7fc640 1 --2- 172.21.15.29:0/1031267506 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b7c0039e0 0x7f4b9006d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.324+0000 7f4b8e7fc640 1 -- 172.21.15.29:0/1031267506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b900c1540 msgr2=0x7f4b90148700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:04.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.324+0000 7f4b8e7fc640 1 --2- 172.21.15.29:0/1031267506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b900c1540 0x7f4b90148700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.324+0000 7f4b8e7fc640 1 -- 172.21.15.29:0/1031267506 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9006c740 con 0x7f4b900c10c0 2024-01-25T15:05:04.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.325+0000 7f4b8e7fc640 1 --2- 172.21.15.29:0/1031267506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b900c10c0 0x7f4b901481c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800e700 tx=0x7f4b7800ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:04.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.325+0000 7f4b87fff640 1 -- 172.21.15.29:0/1031267506 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7800ee10 con 0x7f4b900c10c0 2024-01-25T15:05:04.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.325+0000 7f4b87fff640 1 -- 172.21.15.29:0/1031267506 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7800c870 con 0x7f4b900c10c0 2024-01-25T15:05:04.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.325+0000 7f4b87fff640 1 -- 172.21.15.29:0/1031267506 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7800cc20 con 0x7f4b900c10c0 2024-01-25T15:05:04.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.325+0000 7f4b95872640 1 -- 172.21.15.29:0/1031267506 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b900bf720 con 0x7f4b900c10c0 2024-01-25T15:05:04.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.325+0000 7f4b95872640 1 -- 172.21.15.29:0/1031267506 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9006b7d0 con 0x7f4b900c10c0 2024-01-25T15:05:04.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.326+0000 7f4b95872640 1 -- 172.21.15.29:0/1031267506 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b900bfc40 con 0x7f4b900c10c0 2024-01-25T15:05:04.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.326+0000 7f4b87fff640 1 -- 172.21.15.29:0/1031267506 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4b7801d460 con 0x7f4b900c10c0 2024-01-25T15:05:04.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.327+0000 7f4b87fff640 1 --2- 172.21.15.29:0/1031267506 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4b7006aed0 0x7f4b7006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.327+0000 7f4b87fff640 1 -- 172.21.15.29:0/1031267506 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4b780897c0 con 0x7f4b900c10c0 2024-01-25T15:05:04.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.327+0000 7f4b8effd640 1 --2- 172.21.15.29:0/1031267506 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4b7006aed0 0x7f4b7006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.327+0000 7f4b8effd640 1 --2- 172.21.15.29:0/1031267506 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4b7006aed0 0x7f4b7006d390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4b88036000 tx=0x7f4b88030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:04.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.331+0000 7f4b87fff640 1 -- 172.21.15.29:0/1031267506 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4b78054430 con 0x7f4b900c10c0 2024-01-25T15:05:04.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.509+0000 7f4b95872640 1 -- 172.21.15.29:0/1031267506 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4b900bf580 con 0x7f4b900c10c0 2024-01-25T15:05:04.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.509+0000 7f4b87fff640 1 -- 172.21.15.29:0/1031267506 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4b900bf580 con 0x7f4b900c10c0 2024-01-25T15:05:04.510 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-25T15:05:04.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.511+0000 7f4b95872640 1 -- 172.21.15.29:0/1031267506 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4b7006aed0 msgr2=0x7f4b7006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:04.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.511+0000 7f4b95872640 1 --2- 172.21.15.29:0/1031267506 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4b7006aed0 0x7f4b7006d390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4b88036000 tx=0x7f4b88030000 comp rx=0 tx=0).stop 2024-01-25T15:05:04.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.511+0000 7f4b95872640 1 -- 172.21.15.29:0/1031267506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b900c10c0 msgr2=0x7f4b901481c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:04.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.511+0000 7f4b95872640 1 --2- 172.21.15.29:0/1031267506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b900c10c0 0x7f4b901481c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800e700 tx=0x7f4b7800ebc0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.511+0000 7f4b95872640 1 -- 172.21.15.29:0/1031267506 shutdown_connections 2024-01-25T15:05:04.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.511+0000 7f4b95872640 1 --2- 172.21.15.29:0/1031267506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b900c1540 0x7f4b90148700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.511+0000 7f4b95872640 1 --2- 172.21.15.29:0/1031267506 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4b7006aed0 0x7f4b7006d390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.511+0000 7f4b95872640 1 --2- 172.21.15.29:0/1031267506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b900c10c0 0x7f4b901481c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.511+0000 7f4b95872640 1 --2- 172.21.15.29:0/1031267506 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4b7c0039e0 0x7f4b9006d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.511+0000 7f4b95872640 1 -- 172.21.15.29:0/1031267506 >> 172.21.15.29:0/1031267506 conn(0x7f4b900c7f80 msgr2=0x7f4b900c4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:04.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.511+0000 7f4b95872640 1 -- 172.21.15.29:0/1031267506 shutdown_connections 2024-01-25T15:05:04.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.511+0000 7f4b95872640 1 -- 172.21.15.29:0/1031267506 wait complete. 2024-01-25T15:05:04.523 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-25T15:05:04.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.627+0000 7fd5a2e0e640 1 Processor -- start 2024-01-25T15:05:04.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.627+0000 7fd5a2e0e640 1 -- start start 2024-01-25T15:05:04.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.628+0000 7fd5a2e0e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd59c151d80 0x7fd59c155120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.628+0000 7fd5a2e0e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd59c06b2b0 0x7fd59c06b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.628+0000 7fd5a2e0e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd59c0c5d50 0x7fd59c0c6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.628+0000 7fd5a2e0e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59c06c0a0 con 0x7fd59c06b2b0 2024-01-25T15:05:04.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.628+0000 7fd5a2e0e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59c0c7f10 con 0x7fd59c151d80 2024-01-25T15:05:04.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.628+0000 7fd5a2e0e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c152160 con 0x7fd59c0c5d50 2024-01-25T15:05:04.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.628+0000 7fd59bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd59c06b2b0 0x7fd59c06b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.628+0000 7fd59bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd59c06b2b0 0x7fd59c06b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40976/0 (socket says 172.21.15.29:40976) 2024-01-25T15:05:04.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.628+0000 7fd59bfff640 1 -- 172.21.15.29:0/1128187298 learned_addr learned my addr 172.21.15.29:0/1128187298 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:04.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.628+0000 7fd5a13ab640 1 --2- 172.21.15.29:0/1128187298 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd59c0c5d50 0x7fd59c0c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.628+0000 7fd5a0baa640 1 --2- 172.21.15.29:0/1128187298 >> v2:172.21.15.52:3300/0 conn(0x7fd59c151d80 0x7fd59c155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.628+0000 7fd59bfff640 1 -- 172.21.15.29:0/1128187298 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd59c0c5d50 msgr2=0x7fd59c0c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:04.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.628+0000 7fd59bfff640 1 --2- 172.21.15.29:0/1128187298 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd59c0c5d50 0x7fd59c0c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.628+0000 7fd59bfff640 1 -- 172.21.15.29:0/1128187298 >> v2:172.21.15.52:3300/0 conn(0x7fd59c151d80 msgr2=0x7fd59c155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:04.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.628+0000 7fd59bfff640 1 --2- 172.21.15.29:0/1128187298 >> v2:172.21.15.52:3300/0 conn(0x7fd59c151d80 0x7fd59c155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.628+0000 7fd59bfff640 1 -- 172.21.15.29:0/1128187298 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59c0c58c0 con 0x7fd59c06b2b0 2024-01-25T15:05:04.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.629+0000 7fd59bfff640 1 --2- 172.21.15.29:0/1128187298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd59c06b2b0 0x7fd59c06b710 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd59c06d320 tx=0x7fd58802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c7b736407f525d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:04.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.629+0000 7fd59b7fe640 1 -- 172.21.15.29:0/1128187298 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5880317c0 con 0x7fd59c06b2b0 2024-01-25T15:05:04.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.629+0000 7fd59b7fe640 1 -- 172.21.15.29:0/1128187298 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd588031920 con 0x7fd59c06b2b0 2024-01-25T15:05:04.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.629+0000 7fd59b7fe640 1 -- 172.21.15.29:0/1128187298 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd588031cb0 con 0x7fd59c06b2b0 2024-01-25T15:05:04.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.629+0000 7fd5a2e0e640 1 -- 172.21.15.29:0/1128187298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd59c06b2b0 msgr2=0x7fd59c06b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:04.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.629+0000 7fd5a2e0e640 1 --2- 172.21.15.29:0/1128187298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd59c06b2b0 0x7fd59c06b710 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd59c06d320 tx=0x7fd58802b860 comp rx=0 tx=0).stop 2024-01-25T15:05:04.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.629+0000 7fd5a2e0e640 1 -- 172.21.15.29:0/1128187298 shutdown_connections 2024-01-25T15:05:04.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.629+0000 7fd5a2e0e640 1 --2- 172.21.15.29:0/1128187298 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd59c0c5d50 0x7fd59c0c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.629+0000 7fd5a2e0e640 1 --2- 172.21.15.29:0/1128187298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd59c06b2b0 0x7fd59c06b710 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.629+0000 7fd5a2e0e640 1 --2- 172.21.15.29:0/1128187298 >> v2:172.21.15.52:3300/0 conn(0x7fd59c151d80 0x7fd59c155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.629+0000 7fd5a2e0e640 1 -- 172.21.15.29:0/1128187298 >> 172.21.15.29:0/1128187298 conn(0x7fd59c0ca1f0 msgr2=0x7fd59c0ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:04.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.630+0000 7fd5a2e0e640 1 -- 172.21.15.29:0/1128187298 shutdown_connections 2024-01-25T15:05:04.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.630+0000 7fd5a2e0e640 1 -- 172.21.15.29:0/1128187298 wait complete. 2024-01-25T15:05:04.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.631+0000 7fd5a2e0e640 1 Processor -- start 2024-01-25T15:05:04.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.631+0000 7fd5a2e0e640 1 -- start start 2024-01-25T15:05:04.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.631+0000 7fd5a2e0e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd59c06b2b0 0x7fd59c1eb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.631+0000 7fd5a2e0e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd59c0c5d50 0x7fd59c14d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.631+0000 7fd5a2e0e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd59c151d80 0x7fd59c1eaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.631+0000 7fd5a2e0e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c1ea630 con 0x7fd59c06b2b0 2024-01-25T15:05:04.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.631+0000 7fd5a2e0e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c14e010 con 0x7fd59c151d80 2024-01-25T15:05:04.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.631+0000 7fd5a2e0e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c0c2070 con 0x7fd59c0c5d50 2024-01-25T15:05:04.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.631+0000 7fd5a0baa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd59c06b2b0 0x7fd59c1eb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.632+0000 7fd5a0baa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd59c06b2b0 0x7fd59c1eb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40988/0 (socket says 172.21.15.29:40988) 2024-01-25T15:05:04.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.632+0000 7fd5a0baa640 1 -- 172.21.15.29:0/2671586852 learned_addr learned my addr 172.21.15.29:0/2671586852 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:04.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.632+0000 7fd5a13ab640 1 --2- 172.21.15.29:0/2671586852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd59c151d80 0x7fd59c1eaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.632+0000 7fd59bfff640 1 --2- 172.21.15.29:0/2671586852 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd59c0c5d50 0x7fd59c14d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.632+0000 7fd5a0baa640 1 -- 172.21.15.29:0/2671586852 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd59c0c5d50 msgr2=0x7fd59c14d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:04.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.632+0000 7fd5a0baa640 1 --2- 172.21.15.29:0/2671586852 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd59c0c5d50 0x7fd59c14d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.632+0000 7fd5a0baa640 1 -- 172.21.15.29:0/2671586852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd59c151d80 msgr2=0x7fd59c1eaa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:04.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.632+0000 7fd5a0baa640 1 --2- 172.21.15.29:0/2671586852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd59c151d80 0x7fd59c1eaa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.632+0000 7fd5a0baa640 1 -- 172.21.15.29:0/2671586852 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5880094d0 con 0x7fd59c06b2b0 2024-01-25T15:05:04.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.632+0000 7fd5a0baa640 1 --2- 172.21.15.29:0/2671586852 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd59c06b2b0 0x7fd59c1eb5b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd59000d5f0 tx=0x7fd59000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:04.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.632+0000 7fd5997fa640 1 -- 172.21.15.29:0/2671586852 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5900125f0 con 0x7fd59c06b2b0 2024-01-25T15:05:04.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.632+0000 7fd5997fa640 1 -- 172.21.15.29:0/2671586852 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd590012750 con 0x7fd59c06b2b0 2024-01-25T15:05:04.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.632+0000 7fd5a2e0e640 1 -- 172.21.15.29:0/2671586852 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd59c0c1ab0 con 0x7fd59c06b2b0 2024-01-25T15:05:04.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.632+0000 7fd5997fa640 1 -- 172.21.15.29:0/2671586852 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd590012b00 con 0x7fd59c06b2b0 2024-01-25T15:05:04.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.632+0000 7fd5a2e0e640 1 -- 172.21.15.29:0/2671586852 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd59c1ea250 con 0x7fd59c06b2b0 2024-01-25T15:05:04.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.633+0000 7fd5a2e0e640 1 -- 172.21.15.29:0/2671586852 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59c1ea8a0 con 0x7fd59c06b2b0 2024-01-25T15:05:04.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.634+0000 7fd5997fa640 1 -- 172.21.15.29:0/2671586852 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fd590012c60 con 0x7fd59c06b2b0 2024-01-25T15:05:04.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.634+0000 7fd5997fa640 1 --2- 172.21.15.29:0/2671586852 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd58006aed0 0x7fd58006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.634+0000 7fd5997fa640 1 -- 172.21.15.29:0/2671586852 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd590089d00 con 0x7fd59c06b2b0 2024-01-25T15:05:04.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.634+0000 7fd59bfff640 1 --2- 172.21.15.29:0/2671586852 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd58006aed0 0x7fd58006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.635+0000 7fd59bfff640 1 --2- 172.21.15.29:0/2671586852 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd58006aed0 0x7fd58006d390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd588036000 tx=0x7fd58803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:04.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.638+0000 7fd5997fa640 1 -- 172.21.15.29:0/2671586852 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fd590054970 con 0x7fd59c06b2b0 2024-01-25T15:05:04.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.819+0000 7fd5a2e0e640 1 -- 172.21.15.29:0/2671586852 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd59c067be0 con 0x7fd59c06b2b0 2024-01-25T15:05:04.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.819+0000 7fd5997fa640 1 -- 172.21.15.29:0/2671586852 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd590057f90 con 0x7fd59c06b2b0 2024-01-25T15:05:04.820 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:04.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.821+0000 7fd5a2e0e640 1 -- 172.21.15.29:0/2671586852 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd58006aed0 msgr2=0x7fd58006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:04.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.821+0000 7fd5a2e0e640 1 --2- 172.21.15.29:0/2671586852 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd58006aed0 0x7fd58006d390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd588036000 tx=0x7fd58803d040 comp rx=0 tx=0).stop 2024-01-25T15:05:04.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.821+0000 7fd5a2e0e640 1 -- 172.21.15.29:0/2671586852 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd59c06b2b0 msgr2=0x7fd59c1eb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:04.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.821+0000 7fd5a2e0e640 1 --2- 172.21.15.29:0/2671586852 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd59c06b2b0 0x7fd59c1eb5b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd59000d5f0 tx=0x7fd59000dab0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.821+0000 7fd5a2e0e640 1 -- 172.21.15.29:0/2671586852 shutdown_connections 2024-01-25T15:05:04.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.821+0000 7fd5a2e0e640 1 --2- 172.21.15.29:0/2671586852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd59c151d80 0x7fd59c1eaa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.821+0000 7fd5a2e0e640 1 --2- 172.21.15.29:0/2671586852 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd59c0c5d50 0x7fd59c14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.821+0000 7fd5a2e0e640 1 --2- 172.21.15.29:0/2671586852 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd58006aed0 0x7fd58006d390 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.821+0000 7fd5a2e0e640 1 --2- 172.21.15.29:0/2671586852 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd59c06b2b0 0x7fd59c1eb5b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.821+0000 7fd5a2e0e640 1 -- 172.21.15.29:0/2671586852 >> 172.21.15.29:0/2671586852 conn(0x7fd59c0ca1f0 msgr2=0x7fd59c0c8060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:04.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.821+0000 7fd5a2e0e640 1 -- 172.21.15.29:0/2671586852 shutdown_connections 2024-01-25T15:05:04.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.821+0000 7fd5a2e0e640 1 -- 172.21.15.29:0/2671586852 wait complete. 2024-01-25T15:05:04.852 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2024-01-25T15:05:04.852 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:04.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.953+0000 7fdc980c9640 1 Processor -- start 2024-01-25T15:05:04.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.953+0000 7fdc980c9640 1 -- start start 2024-01-25T15:05:04.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.954+0000 7fdc980c9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdc900c4990 0x7fdc9006bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.954+0000 7fdc980c9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdc900c7f10 0x7fdc900c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.954+0000 7fdc980c9640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc90155430 con 0x7fdc90152160 2024-01-25T15:05:04.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.954+0000 7fdc980c9640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc90154b40 con 0x7fdc900c4990 2024-01-25T15:05:04.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.954+0000 7fdc980c9640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc90152540 con 0x7fdc900c7f10 2024-01-25T15:05:04.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.954+0000 7fdc95664640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdc900c4990 0x7fdc9006bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.954+0000 7fdc95e65640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fdc90152160 0x7fdc900c4ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49476/0 (socket says 172.21.15.29:49476) 2024-01-25T15:05:04.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.954+0000 7fdc95664640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdc900c4990 0x7fdc9006bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40996/0 (socket says 172.21.15.29:40996) 2024-01-25T15:05:04.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.954+0000 7fdc95e65640 1 -- 172.21.15.29:0/1962518204 learned_addr learned my addr 172.21.15.29:0/1962518204 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:04.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.954+0000 7fdc95664640 1 -- 172.21.15.29:0/1962518204 >> v2:172.21.15.52:3300/0 conn(0x7fdc900c7f10 msgr2=0x7fdc900c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:04.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.954+0000 7fdc96666640 1 --2- 172.21.15.29:0/1962518204 >> v2:172.21.15.52:3300/0 conn(0x7fdc900c7f10 0x7fdc900c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.954+0000 7fdc95664640 1 --2- 172.21.15.29:0/1962518204 >> v2:172.21.15.52:3300/0 conn(0x7fdc900c7f10 0x7fdc900c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.954+0000 7fdc94e63640 1 -- 172.21.15.29:0/1962518204 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073555048 0 0) 0x7fdc90155430 con 0x7fdc90152160 2024-01-25T15:05:04.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.954+0000 7fdc95664640 1 -- 172.21.15.29:0/1962518204 >> v1:172.21.15.29:6789/0 conn(0x7fdc90152160 legacy=0x7fdc900c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:04.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.954+0000 7fdc95664640 1 -- 172.21.15.29:0/1962518204 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc900c64b0 con 0x7fdc900c4990 2024-01-25T15:05:04.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.954+0000 7fdc96666640 1 --2- 172.21.15.29:0/1962518204 >> v2:172.21.15.52:3300/0 conn(0x7fdc900c7f10 0x7fdc900c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:04.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.955+0000 7fdc95664640 1 --2- 172.21.15.29:0/1962518204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc900c4990 0x7fdc9006bc00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdc900c5940 tx=0x7fdc8402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b5e152d6e41a2f server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:04.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.955+0000 7fdc94e63640 1 -- 172.21.15.29:0/1962518204 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8402e070 con 0x7fdc900c4990 2024-01-25T15:05:04.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.955+0000 7fdc94e63640 1 -- 172.21.15.29:0/1962518204 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc840315a0 con 0x7fdc900c4990 2024-01-25T15:05:04.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.955+0000 7fdc94e63640 1 -- 172.21.15.29:0/1962518204 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc84031930 con 0x7fdc900c4990 2024-01-25T15:05:04.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.956+0000 7fdc980c9640 1 -- 172.21.15.29:0/1962518204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc900c4990 msgr2=0x7fdc9006bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:04.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.956+0000 7fdc980c9640 1 --2- 172.21.15.29:0/1962518204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc900c4990 0x7fdc9006bc00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdc900c5940 tx=0x7fdc8402b840 comp rx=0 tx=0).stop 2024-01-25T15:05:04.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.956+0000 7fdc980c9640 1 -- 172.21.15.29:0/1962518204 shutdown_connections 2024-01-25T15:05:04.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.956+0000 7fdc980c9640 1 --2- 172.21.15.29:0/1962518204 >> v2:172.21.15.52:3300/0 conn(0x7fdc900c7f10 0x7fdc900c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.956+0000 7fdc980c9640 1 --2- 172.21.15.29:0/1962518204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc900c4990 0x7fdc9006bc00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.956+0000 7fdc980c9640 1 -- 172.21.15.29:0/1962518204 >> 172.21.15.29:0/1962518204 conn(0x7fdc900ca1f0 msgr2=0x7fdc900ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:04.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.956+0000 7fdc980c9640 1 -- 172.21.15.29:0/1962518204 shutdown_connections 2024-01-25T15:05:04.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.956+0000 7fdc980c9640 1 -- 172.21.15.29:0/1962518204 wait complete. 2024-01-25T15:05:04.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.957+0000 7fdc980c9640 1 Processor -- start 2024-01-25T15:05:04.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.957+0000 7fdc980c9640 1 -- start start 2024-01-25T15:05:04.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.958+0000 7fdc980c9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc900c4990 0x7fdc900bf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.958+0000 7fdc980c9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc900c7f10 0x7fdc90153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.958+0000 7fdc980c9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdc90152160 0x7fdc901580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.958+0000 7fdc980c9640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc90154250 con 0x7fdc900c4990 2024-01-25T15:05:04.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.958+0000 7fdc980c9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc900c09c0 con 0x7fdc900c7f10 2024-01-25T15:05:04.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.958+0000 7fdc980c9640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc901eabc0 con 0x7fdc90152160 2024-01-25T15:05:04.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.958+0000 7fdc95e65640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc900c4990 0x7fdc900bf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.958+0000 7fdc95e65640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc900c4990 0x7fdc900bf270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41006/0 (socket says 172.21.15.29:41006) 2024-01-25T15:05:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.958+0000 7fdc95e65640 1 -- 172.21.15.29:0/3393500869 learned_addr learned my addr 172.21.15.29:0/3393500869 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.958+0000 7fdc96666640 1 --2- 172.21.15.29:0/3393500869 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdc90152160 0x7fdc901580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.958+0000 7fdc95664640 1 --2- 172.21.15.29:0/3393500869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc900c7f10 0x7fdc90153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.958+0000 7fdc95e65640 1 -- 172.21.15.29:0/3393500869 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdc90152160 msgr2=0x7fdc901580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.958+0000 7fdc95e65640 1 --2- 172.21.15.29:0/3393500869 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdc90152160 0x7fdc901580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.958+0000 7fdc95e65640 1 -- 172.21.15.29:0/3393500869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc900c7f10 msgr2=0x7fdc90153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.958+0000 7fdc95e65640 1 --2- 172.21.15.29:0/3393500869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc900c7f10 0x7fdc90153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.958+0000 7fdc95e65640 1 -- 172.21.15.29:0/3393500869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc84009400 con 0x7fdc900c4990 2024-01-25T15:05:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.958+0000 7fdc95e65640 1 --2- 172.21.15.29:0/3393500869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc900c4990 0x7fdc900bf270 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdc8800c460 tx=0x7fdc8800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.958+0000 7fdc8e7fc640 1 -- 172.21.15.29:0/3393500869 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc880074e0 con 0x7fdc900c4990 2024-01-25T15:05:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.958+0000 7fdc8e7fc640 1 -- 172.21.15.29:0/3393500869 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc88007660 con 0x7fdc900c4990 2024-01-25T15:05:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.958+0000 7fdc980c9640 1 -- 172.21.15.29:0/3393500869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc900bfa30 con 0x7fdc900c4990 2024-01-25T15:05:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.959+0000 7fdc8e7fc640 1 -- 172.21.15.29:0/3393500869 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc88004a20 con 0x7fdc900c4990 2024-01-25T15:05:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.959+0000 7fdc980c9640 1 -- 172.21.15.29:0/3393500869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc901eb050 con 0x7fdc900c4990 2024-01-25T15:05:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.960+0000 7fdc980c9640 1 -- 172.21.15.29:0/3393500869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc900737f0 con 0x7fdc900c4990 2024-01-25T15:05:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.960+0000 7fdc8e7fc640 1 -- 172.21.15.29:0/3393500869 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fdc88004b80 con 0x7fdc900c4990 2024-01-25T15:05:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.960+0000 7fdc8e7fc640 1 --2- 172.21.15.29:0/3393500869 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdc7c06aed0 0x7fdc7c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:04.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.960+0000 7fdc8e7fc640 1 -- 172.21.15.29:0/3393500869 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdc88088dc0 con 0x7fdc900c4990 2024-01-25T15:05:04.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.961+0000 7fdc95664640 1 --2- 172.21.15.29:0/3393500869 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdc7c06aed0 0x7fdc7c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:04.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.961+0000 7fdc95664640 1 --2- 172.21.15.29:0/3393500869 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdc7c06aed0 0x7fdc7c06d390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdc84036000 tx=0x7fdc8403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:04.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:04.965+0000 7fdc8e7fc640 1 -- 172.21.15.29:0/3393500869 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fdc880539a0 con 0x7fdc900c4990 2024-01-25T15:05:05.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.144+0000 7fdc980c9640 1 -- 172.21.15.29:0/3393500869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc900a97d0 con 0x7fdc900c4990 2024-01-25T15:05:05.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.146+0000 7fdc8e7fc640 1 -- 172.21.15.29:0/3393500869 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18311 (secure 0 0 0) 0x7fdc88018020 con 0x7fdc900c4990 2024-01-25T15:05:05.147 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:05.147 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:04:31.978871+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:05.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.147+0000 7fdc980c9640 1 -- 172.21.15.29:0/3393500869 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdc7c06aed0 msgr2=0x7fdc7c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:05.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.147+0000 7fdc980c9640 1 --2- 172.21.15.29:0/3393500869 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdc7c06aed0 0x7fdc7c06d390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdc84036000 tx=0x7fdc8403d040 comp rx=0 tx=0).stop 2024-01-25T15:05:05.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.147+0000 7fdc980c9640 1 -- 172.21.15.29:0/3393500869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc900c4990 msgr2=0x7fdc900bf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:05.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.147+0000 7fdc980c9640 1 --2- 172.21.15.29:0/3393500869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc900c4990 0x7fdc900bf270 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdc8800c460 tx=0x7fdc8800c920 comp rx=0 tx=0).stop 2024-01-25T15:05:05.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.147+0000 7fdc980c9640 1 -- 172.21.15.29:0/3393500869 shutdown_connections 2024-01-25T15:05:05.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.147+0000 7fdc980c9640 1 --2- 172.21.15.29:0/3393500869 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdc90152160 0x7fdc901580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.147+0000 7fdc980c9640 1 --2- 172.21.15.29:0/3393500869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc900c7f10 0x7fdc90153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.147+0000 7fdc980c9640 1 --2- 172.21.15.29:0/3393500869 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdc7c06aed0 0x7fdc7c06d390 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.148+0000 7fdc980c9640 1 --2- 172.21.15.29:0/3393500869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc900c4990 0x7fdc900bf270 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.148+0000 7fdc980c9640 1 -- 172.21.15.29:0/3393500869 >> 172.21.15.29:0/3393500869 conn(0x7fdc900ca1f0 msgr2=0x7fdc9006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:05.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.148+0000 7fdc980c9640 1 -- 172.21.15.29:0/3393500869 shutdown_connections 2024-01-25T15:05:05.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.148+0000 7fdc980c9640 1 -- 172.21.15.29:0/3393500869 wait complete. 2024-01-25T15:05:05.160 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T15:04:14.955791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T15:04:24.986626+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T15:04:25.873673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-25T15:04:29.578261+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-25T15:05:05.160 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:05:05.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.264+0000 7fe05f497640 1 Processor -- start 2024-01-25T15:05:05.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.264+0000 7fe05f497640 1 -- start start 2024-01-25T15:05:05.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.265+0000 7fe05f497640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe05806d560 0x7fe05806b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.265+0000 7fe05f497640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0580c4fe0 0x7fe05806b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.265+0000 7fe05f497640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0580afaa0 con 0x7fe0580af6c0 2024-01-25T15:05:05.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.265+0000 7fe05f497640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe05806c480 con 0x7fe05806d560 2024-01-25T15:05:05.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.265+0000 7fe05f497640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe058155290 con 0x7fe0580c4fe0 2024-01-25T15:05:05.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.265+0000 7fe05d233640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe0580af6c0 0x7fe0580c5530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49482/0 (socket says 172.21.15.29:49482) 2024-01-25T15:05:05.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.265+0000 7fe05d233640 1 -- 172.21.15.29:0/1346551568 learned_addr learned my addr 172.21.15.29:0/1346551568 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:05.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.265+0000 7fe05ca32640 1 --2- 172.21.15.29:0/1346551568 >> v2:172.21.15.52:3300/0 conn(0x7fe05806d560 0x7fe05806b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.265+0000 7fe05da34640 1 --2- 172.21.15.29:0/1346551568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0580c4fe0 0x7fe05806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.265+0000 7fe057fff640 1 -- 172.21.15.29:0/1346551568 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050991388 0 0) 0x7fe0580afaa0 con 0x7fe0580af6c0 2024-01-25T15:05:05.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.265+0000 7fe057fff640 1 -- 172.21.15.29:0/1346551568 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe040003520 con 0x7fe0580af6c0 2024-01-25T15:05:05.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe057fff640 1 -- 172.21.15.29:0/1346551568 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4164290886 0 0) 0x7fe040003520 con 0x7fe0580af6c0 2024-01-25T15:05:05.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe057fff640 1 -- 172.21.15.29:0/1346551568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0580c4fe0 msgr2=0x7fe05806b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:05.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe057fff640 1 --2- 172.21.15.29:0/1346551568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0580c4fe0 0x7fe05806b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe057fff640 1 -- 172.21.15.29:0/1346551568 >> v2:172.21.15.52:3300/0 conn(0x7fe05806d560 msgr2=0x7fe05806b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:05.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe057fff640 1 --2- 172.21.15.29:0/1346551568 >> v2:172.21.15.52:3300/0 conn(0x7fe05806d560 0x7fe05806b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe057fff640 1 -- 172.21.15.29:0/1346551568 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0580c6060 con 0x7fe0580af6c0 2024-01-25T15:05:05.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe057fff640 1 -- 172.21.15.29:0/1346551568 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7fe050001670 con 0x7fe0580af6c0 2024-01-25T15:05:05.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe057fff640 1 -- 172.21.15.29:0/1346551568 >> v1:172.21.15.29:6789/0 conn(0x7fe0580af6c0 legacy=0x7fe0580c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:05.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe057fff640 1 --2- 172.21.15.29:0/1346551568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0580c4fe0 0x7fe0400039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe057fff640 1 --2- 172.21.15.29:0/1346551568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe040003f60 0x7fe0400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe057fff640 1 --2- 172.21.15.29:0/1346551568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe040004d00 0x7fe040005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe057fff640 1 -- 172.21.15.29:0/1346551568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05806c480 con 0x7fe040003f60 2024-01-25T15:05:05.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe057fff640 1 -- 172.21.15.29:0/1346551568 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04000b980 con 0x7fe040004d00 2024-01-25T15:05:05.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe057fff640 1 -- 172.21.15.29:0/1346551568 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04000baf0 con 0x7fe0580c4fe0 2024-01-25T15:05:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe05ca32640 1 --2- 172.21.15.29:0/1346551568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe040003f60 0x7fe0400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe05d233640 1 --2- 172.21.15.29:0/1346551568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0580c4fe0 0x7fe0400039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe05da34640 1 --2- 172.21.15.29:0/1346551568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe040004d00 0x7fe040005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe05ca32640 1 -- 172.21.15.29:0/1346551568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0580c4fe0 msgr2=0x7fe0400039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe05ca32640 1 --2- 172.21.15.29:0/1346551568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0580c4fe0 0x7fe0400039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe05ca32640 1 -- 172.21.15.29:0/1346551568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe040004d00 msgr2=0x7fe040005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe05ca32640 1 --2- 172.21.15.29:0/1346551568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe040004d00 0x7fe040005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe05ca32640 1 -- 172.21.15.29:0/1346551568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe040003520 con 0x7fe040003f60 2024-01-25T15:05:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.266+0000 7fe05da34640 1 --2- 172.21.15.29:0/1346551568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe040004d00 0x7fe040005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.267+0000 7fe05ca32640 1 --2- 172.21.15.29:0/1346551568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe040003f60 0x7fe0400047c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009ac0 tx=0x7fe0400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eba0c94b6395a3f server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.267+0000 7fe057fff640 1 -- 172.21.15.29:0/1346551568 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c02c710 con 0x7fe040003f60 2024-01-25T15:05:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.267+0000 7fe057fff640 1 -- 172.21.15.29:0/1346551568 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c02c870 con 0x7fe040003f60 2024-01-25T15:05:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.267+0000 7fe057fff640 1 -- 172.21.15.29:0/1346551568 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c02cc00 con 0x7fe040003f60 2024-01-25T15:05:05.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.268+0000 7fe05f497640 1 -- 172.21.15.29:0/1346551568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe040003f60 msgr2=0x7fe0400047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:05.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.268+0000 7fe05f497640 1 --2- 172.21.15.29:0/1346551568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe040003f60 0x7fe0400047c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009ac0 tx=0x7fe0400057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.268+0000 7fe05da34640 1 -- 172.21.15.29:0/1346551568 reap_dead start 2024-01-25T15:05:05.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.268+0000 7fe05f497640 1 -- 172.21.15.29:0/1346551568 shutdown_connections 2024-01-25T15:05:05.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.268+0000 7fe05f497640 1 -- 172.21.15.29:0/1346551568 >> 172.21.15.29:0/1346551568 conn(0x7fe0580c6ca0 msgr2=0x7fe0580c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:05.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.268+0000 7fe05f497640 1 -- 172.21.15.29:0/1346551568 shutdown_connections 2024-01-25T15:05:05.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.268+0000 7fe05f497640 1 -- 172.21.15.29:0/1346551568 wait complete. 2024-01-25T15:05:05.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.269+0000 7fe05f497640 1 Processor -- start 2024-01-25T15:05:05.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.269+0000 7fe05f497640 1 -- start start 2024-01-25T15:05:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.269+0000 7fe05f497640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe040003f60 0x7fe0581570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.269+0000 7fe05f497640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0580be200 0x7fe0581ed6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.269+0000 7fe05f497640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0580c0d70 0x7fe0580be830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.269+0000 7fe05f497640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe058158c70 con 0x7fe0580be200 2024-01-25T15:05:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.269+0000 7fe05f497640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0581575e0 con 0x7fe040003f60 2024-01-25T15:05:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.269+0000 7fe05f497640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe058156620 con 0x7fe0580c0d70 2024-01-25T15:05:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.270+0000 7fe05ca32640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0580be200 0x7fe0581ed6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.270+0000 7fe05ca32640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0580be200 0x7fe0581ed6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41024/0 (socket says 172.21.15.29:41024) 2024-01-25T15:05:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.270+0000 7fe05ca32640 1 -- 172.21.15.29:0/3892083656 learned_addr learned my addr 172.21.15.29:0/3892083656 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.270+0000 7fe05d233640 1 --2- 172.21.15.29:0/3892083656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe040003f60 0x7fe0581570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.270+0000 7fe05da34640 1 --2- 172.21.15.29:0/3892083656 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0580c0d70 0x7fe0580be830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.270+0000 7fe05ca32640 1 -- 172.21.15.29:0/3892083656 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0580c0d70 msgr2=0x7fe0580be830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:05.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.270+0000 7fe05ca32640 1 --2- 172.21.15.29:0/3892083656 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0580c0d70 0x7fe0580be830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.270+0000 7fe05ca32640 1 -- 172.21.15.29:0/3892083656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe040003f60 msgr2=0x7fe0581570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:05.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.270+0000 7fe05ca32640 1 --2- 172.21.15.29:0/3892083656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe040003f60 0x7fe0581570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.270+0000 7fe05ca32640 1 -- 172.21.15.29:0/3892083656 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0581edfe0 con 0x7fe0580be200 2024-01-25T15:05:05.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.270+0000 7fe05d233640 1 --2- 172.21.15.29:0/3892083656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe040003f60 0x7fe0581570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:05.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.270+0000 7fe05ca32640 1 --2- 172.21.15.29:0/3892083656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0580be200 0x7fe0581ed6a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009ac0 tx=0x7fe04c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:05.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.270+0000 7fe055ffb640 1 -- 172.21.15.29:0/3892083656 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c003810 con 0x7fe0580be200 2024-01-25T15:05:05.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.270+0000 7fe055ffb640 1 -- 172.21.15.29:0/3892083656 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c003970 con 0x7fe0580be200 2024-01-25T15:05:05.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.270+0000 7fe05f497640 1 -- 172.21.15.29:0/3892083656 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0581568a0 con 0x7fe0580be200 2024-01-25T15:05:05.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.270+0000 7fe055ffb640 1 -- 172.21.15.29:0/3892083656 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c003d20 con 0x7fe0580be200 2024-01-25T15:05:05.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.270+0000 7fe05f497640 1 -- 172.21.15.29:0/3892083656 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe058157ce0 con 0x7fe0580be200 2024-01-25T15:05:05.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.271+0000 7fe05f497640 1 -- 172.21.15.29:0/3892083656 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe058068a90 con 0x7fe0580be200 2024-01-25T15:05:05.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.272+0000 7fe055ffb640 1 -- 172.21.15.29:0/3892083656 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fe04c040450 con 0x7fe0580be200 2024-01-25T15:05:05.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.272+0000 7fe055ffb640 1 --2- 172.21.15.29:0/3892083656 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe04406aed0 0x7fe04406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.272+0000 7fe055ffb640 1 -- 172.21.15.29:0/3892083656 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe04c0ab970 con 0x7fe0580be200 2024-01-25T15:05:05.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.272+0000 7fe05d233640 1 --2- 172.21.15.29:0/3892083656 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe04406aed0 0x7fe04406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.273+0000 7fe05d233640 1 --2- 172.21.15.29:0/3892083656 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe04406aed0 0x7fe04406d390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe050001eb0 tx=0x7fe050009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:05.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.276+0000 7fe055ffb640 1 -- 172.21.15.29:0/3892083656 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fe04c076540 con 0x7fe0580be200 2024-01-25T15:05:05.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.454+0000 7fe05f497640 1 -- 172.21.15.29:0/3892083656 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe058074010 con 0x7fe0580be200 2024-01-25T15:05:05.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.455+0000 7fe055ffb640 1 -- 172.21.15.29:0/3892083656 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe04c079b60 con 0x7fe0580be200 2024-01-25T15:05:05.456 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-25T15:05:05.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.456+0000 7fe05f497640 1 -- 172.21.15.29:0/3892083656 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe04406aed0 msgr2=0x7fe04406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:05.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.456+0000 7fe05f497640 1 --2- 172.21.15.29:0/3892083656 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe04406aed0 0x7fe04406d390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe050001eb0 tx=0x7fe050009040 comp rx=0 tx=0).stop 2024-01-25T15:05:05.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.456+0000 7fe05f497640 1 -- 172.21.15.29:0/3892083656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0580be200 msgr2=0x7fe0581ed6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:05.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.456+0000 7fe05f497640 1 --2- 172.21.15.29:0/3892083656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0580be200 0x7fe0581ed6a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009ac0 tx=0x7fe04c004730 comp rx=0 tx=0).stop 2024-01-25T15:05:05.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.457+0000 7fe05f497640 1 -- 172.21.15.29:0/3892083656 shutdown_connections 2024-01-25T15:05:05.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.457+0000 7fe05f497640 1 --2- 172.21.15.29:0/3892083656 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0580c0d70 0x7fe0580be830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.457+0000 7fe05f497640 1 --2- 172.21.15.29:0/3892083656 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe04406aed0 0x7fe04406d390 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.457+0000 7fe05f497640 1 --2- 172.21.15.29:0/3892083656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0580be200 0x7fe0581ed6a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.457+0000 7fe05f497640 1 --2- 172.21.15.29:0/3892083656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe040003f60 0x7fe0581570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.457+0000 7fe05f497640 1 -- 172.21.15.29:0/3892083656 >> 172.21.15.29:0/3892083656 conn(0x7fe0580c6ca0 msgr2=0x7fe05806ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:05.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.457+0000 7fe05f497640 1 -- 172.21.15.29:0/3892083656 shutdown_connections 2024-01-25T15:05:05.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.457+0000 7fe05f497640 1 -- 172.21.15.29:0/3892083656 wait complete. 2024-01-25T15:05:05.469 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:05:05.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.573+0000 7f7d9de90640 1 Processor -- start 2024-01-25T15:05:05.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.573+0000 7f7d9de90640 1 -- start start 2024-01-25T15:05:05.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d9de90640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7d98149190 0x7f7d980c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d9de90640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d981526a0 0x7f7d98152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d9de90640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d980ad2e0 con 0x7f7d980c7820 2024-01-25T15:05:05.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d9de90640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d980ac6f0 con 0x7f7d98149190 2024-01-25T15:05:05.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d9de90640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d980ac9b0 con 0x7f7d981526a0 2024-01-25T15:05:05.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d8ffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7d980c7820 0x7f7d980c49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34578/0 (socket says 172.21.15.29:34578) 2024-01-25T15:05:05.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d8ffff640 1 -- 172.21.15.29:0/636771890 learned_addr learned my addr 172.21.15.29:0/636771890 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:05.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d977fe640 1 --2- 172.21.15.29:0/636771890 >> v2:172.21.15.52:3300/0 conn(0x7f7d98149190 0x7f7d980c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d97fff640 1 --2- 172.21.15.29:0/636771890 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d981526a0 0x7f7d98152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d96ffd640 1 -- 172.21.15.29:0/636771890 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334750477 0 0) 0x7f7d980ad2e0 con 0x7f7d980c7820 2024-01-25T15:05:05.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d96ffd640 1 -- 172.21.15.29:0/636771890 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d84003520 con 0x7f7d980c7820 2024-01-25T15:05:05.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d96ffd640 1 -- 172.21.15.29:0/636771890 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1327320033 0 0) 0x7f7d84003520 con 0x7f7d980c7820 2024-01-25T15:05:05.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d96ffd640 1 -- 172.21.15.29:0/636771890 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d981526a0 msgr2=0x7f7d98152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:05.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d96ffd640 1 --2- 172.21.15.29:0/636771890 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d981526a0 0x7f7d98152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d96ffd640 1 -- 172.21.15.29:0/636771890 >> v2:172.21.15.52:3300/0 conn(0x7f7d98149190 msgr2=0x7f7d980c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d96ffd640 1 --2- 172.21.15.29:0/636771890 >> v2:172.21.15.52:3300/0 conn(0x7f7d98149190 0x7f7d980c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d96ffd640 1 -- 172.21.15.29:0/636771890 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d980acc90 con 0x7f7d980c7820 2024-01-25T15:05:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d977fe640 1 --2- 172.21.15.29:0/636771890 >> v2:172.21.15.52:3300/0 conn(0x7f7d98149190 0x7f7d980c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:05:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d96ffd640 1 -- 172.21.15.29:0/636771890 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f7d80001670 con 0x7f7d980c7820 2024-01-25T15:05:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d97fff640 1 --2- 172.21.15.29:0/636771890 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d981526a0 0x7f7d98152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:05:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d96ffd640 1 -- 172.21.15.29:0/636771890 >> v1:172.21.15.29:6789/0 conn(0x7f7d980c7820 legacy=0x7f7d980c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d96ffd640 1 --2- 172.21.15.29:0/636771890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d840039e0 0x7f7d84003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d96ffd640 1 --2- 172.21.15.29:0/636771890 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d981526a0 0x7f7d840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.574+0000 7f7d96ffd640 1 --2- 172.21.15.29:0/636771890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d84004d00 0x7f7d84005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.575+0000 7f7d96ffd640 1 -- 172.21.15.29:0/636771890 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d980ac6f0 con 0x7f7d840039e0 2024-01-25T15:05:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.575+0000 7f7d96ffd640 1 -- 172.21.15.29:0/636771890 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d980ac9b0 con 0x7f7d84004d00 2024-01-25T15:05:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.575+0000 7f7d96ffd640 1 -- 172.21.15.29:0/636771890 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8400b980 con 0x7f7d981526a0 2024-01-25T15:05:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.575+0000 7f7d977fe640 1 --2- 172.21.15.29:0/636771890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d840039e0 0x7f7d84003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.575+0000 7f7d8ffff640 1 --2- 172.21.15.29:0/636771890 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d981526a0 0x7f7d840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.575+0000 7f7d97fff640 1 --2- 172.21.15.29:0/636771890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d84004d00 0x7f7d84005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.575+0000 7f7d977fe640 1 -- 172.21.15.29:0/636771890 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d981526a0 msgr2=0x7f7d840047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.575+0000 7f7d977fe640 1 --2- 172.21.15.29:0/636771890 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d981526a0 0x7f7d840047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.575+0000 7f7d977fe640 1 -- 172.21.15.29:0/636771890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d84004d00 msgr2=0x7f7d84005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.575+0000 7f7d977fe640 1 --2- 172.21.15.29:0/636771890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d84004d00 0x7f7d84005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.575+0000 7f7d977fe640 1 -- 172.21.15.29:0/636771890 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d90009a70 con 0x7f7d840039e0 2024-01-25T15:05:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.575+0000 7f7d97fff640 1 --2- 172.21.15.29:0/636771890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d84004d00 0x7f7d84005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.576+0000 7f7d977fe640 1 --2- 172.21.15.29:0/636771890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d840039e0 0x7f7d84003e00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009cc0 tx=0x7f7d840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a7ac19058c576 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.576+0000 7f7d96ffd640 1 -- 172.21.15.29:0/636771890 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8802c960 con 0x7f7d840039e0 2024-01-25T15:05:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.576+0000 7f7d96ffd640 1 -- 172.21.15.29:0/636771890 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8802cac0 con 0x7f7d840039e0 2024-01-25T15:05:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.576+0000 7f7d96ffd640 1 -- 172.21.15.29:0/636771890 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8802ce70 con 0x7f7d840039e0 2024-01-25T15:05:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.576+0000 7f7d9de90640 1 -- 172.21.15.29:0/636771890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d840039e0 msgr2=0x7f7d84003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:05.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.576+0000 7f7d9de90640 1 --2- 172.21.15.29:0/636771890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d840039e0 0x7f7d84003e00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009cc0 tx=0x7f7d840057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.576+0000 7f7d97fff640 1 -- 172.21.15.29:0/636771890 reap_dead start 2024-01-25T15:05:05.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.576+0000 7f7d9de90640 1 -- 172.21.15.29:0/636771890 shutdown_connections 2024-01-25T15:05:05.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.576+0000 7f7d9de90640 1 -- 172.21.15.29:0/636771890 >> 172.21.15.29:0/636771890 conn(0x7f7d980c7f10 msgr2=0x7f7d980c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:05.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.576+0000 7f7d9de90640 1 -- 172.21.15.29:0/636771890 shutdown_connections 2024-01-25T15:05:05.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.576+0000 7f7d9de90640 1 -- 172.21.15.29:0/636771890 wait complete. 2024-01-25T15:05:05.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.577+0000 7f7d9de90640 1 Processor -- start 2024-01-25T15:05:05.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.577+0000 7f7d9de90640 1 -- start start 2024-01-25T15:05:05.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.578+0000 7f7d9de90640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d840039e0 0x7f7d981ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.578+0000 7f7d9de90640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d9814fd80 0x7f7d9814f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.578+0000 7f7d9de90640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d9806d590 0x7f7d980c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.578+0000 7f7d9de90640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d98155d80 con 0x7f7d9814fd80 2024-01-25T15:05:05.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.578+0000 7f7d9de90640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9806cb40 con 0x7f7d9806d590 2024-01-25T15:05:05.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.578+0000 7f7d9de90640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d981569d0 con 0x7f7d840039e0 2024-01-25T15:05:05.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.578+0000 7f7d8ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d9814fd80 0x7f7d9814f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.578+0000 7f7d8ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d9814fd80 0x7f7d9814f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55504/0 (socket says 172.21.15.29:55504) 2024-01-25T15:05:05.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.578+0000 7f7d8ffff640 1 -- 172.21.15.29:0/352742384 learned_addr learned my addr 172.21.15.29:0/352742384 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:05.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.578+0000 7f7d977fe640 1 --2- 172.21.15.29:0/352742384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d840039e0 0x7f7d981ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.578+0000 7f7d97fff640 1 --2- 172.21.15.29:0/352742384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d9806d590 0x7f7d980c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.578+0000 7f7d8ffff640 1 -- 172.21.15.29:0/352742384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d840039e0 msgr2=0x7f7d981ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.578+0000 7f7d8ffff640 1 --2- 172.21.15.29:0/352742384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d840039e0 0x7f7d981ed7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.578+0000 7f7d8ffff640 1 -- 172.21.15.29:0/352742384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d9806d590 msgr2=0x7f7d980c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.578+0000 7f7d8ffff640 1 --2- 172.21.15.29:0/352742384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d9806d590 0x7f7d980c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.578+0000 7f7d8ffff640 1 -- 172.21.15.29:0/352742384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d981ee020 con 0x7f7d9814fd80 2024-01-25T15:05:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.578+0000 7f7d97fff640 1 --2- 172.21.15.29:0/352742384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d9806d590 0x7f7d980c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.579+0000 7f7d8ffff640 1 --2- 172.21.15.29:0/352742384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d9814fd80 0x7f7d9814f170 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7d80007340 tx=0x7f7d80007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.579+0000 7f7d94ff9640 1 -- 172.21.15.29:0/352742384 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8000f8c0 con 0x7f7d9814fd80 2024-01-25T15:05:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.579+0000 7f7d94ff9640 1 -- 172.21.15.29:0/352742384 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8000fa60 con 0x7f7d9814fd80 2024-01-25T15:05:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.579+0000 7f7d9de90640 1 -- 172.21.15.29:0/352742384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9806c460 con 0x7f7d9814fd80 2024-01-25T15:05:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.579+0000 7f7d94ff9640 1 -- 172.21.15.29:0/352742384 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8000fe10 con 0x7f7d9814fd80 2024-01-25T15:05:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.579+0000 7f7d9de90640 1 -- 172.21.15.29:0/352742384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9806cd90 con 0x7f7d9814fd80 2024-01-25T15:05:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.580+0000 7f7d9de90640 1 -- 172.21.15.29:0/352742384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d9806c980 con 0x7f7d9814fd80 2024-01-25T15:05:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.580+0000 7f7d94ff9640 1 -- 172.21.15.29:0/352742384 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7d8001d460 con 0x7f7d9814fd80 2024-01-25T15:05:05.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.581+0000 7f7d94ff9640 1 --2- 172.21.15.29:0/352742384 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7d7806af00 0x7f7d7806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.581+0000 7f7d94ff9640 1 -- 172.21.15.29:0/352742384 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7d80089a70 con 0x7f7d9814fd80 2024-01-25T15:05:05.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.581+0000 7f7d977fe640 1 --2- 172.21.15.29:0/352742384 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7d7806af00 0x7f7d7806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.582+0000 7f7d977fe640 1 --2- 172.21.15.29:0/352742384 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7d7806af00 0x7f7d7806d3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7d88036000 tx=0x7f7d88030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:05.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.585+0000 7f7d94ff9640 1 -- 172.21.15.29:0/352742384 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7d800545c0 con 0x7f7d9814fd80 2024-01-25T15:05:05.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.764+0000 7f7d9de90640 1 -- 172.21.15.29:0/352742384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7d9804eb10 con 0x7f7d9814fd80 2024-01-25T15:05:05.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.764+0000 7f7d94ff9640 1 -- 172.21.15.29:0/352742384 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7d80057be0 con 0x7f7d9814fd80 2024-01-25T15:05:05.765 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:05.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.767+0000 7f7d9de90640 1 -- 172.21.15.29:0/352742384 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7d7806af00 msgr2=0x7f7d7806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:05.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.767+0000 7f7d9de90640 1 --2- 172.21.15.29:0/352742384 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7d7806af00 0x7f7d7806d3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7d88036000 tx=0x7f7d88030000 comp rx=0 tx=0).stop 2024-01-25T15:05:05.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.767+0000 7f7d9de90640 1 -- 172.21.15.29:0/352742384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d9814fd80 msgr2=0x7f7d9814f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:05.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.767+0000 7f7d9de90640 1 --2- 172.21.15.29:0/352742384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d9814fd80 0x7f7d9814f170 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7d80007340 tx=0x7f7d80007800 comp rx=0 tx=0).stop 2024-01-25T15:05:05.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.767+0000 7f7d9de90640 1 -- 172.21.15.29:0/352742384 shutdown_connections 2024-01-25T15:05:05.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.767+0000 7f7d9de90640 1 --2- 172.21.15.29:0/352742384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d9806d590 0x7f7d980c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.767+0000 7f7d9de90640 1 --2- 172.21.15.29:0/352742384 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7d7806af00 0x7f7d7806d3c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.767+0000 7f7d9de90640 1 --2- 172.21.15.29:0/352742384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d9814fd80 0x7f7d9814f170 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.767+0000 7f7d9de90640 1 --2- 172.21.15.29:0/352742384 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7d840039e0 0x7f7d981ed7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.767+0000 7f7d9de90640 1 -- 172.21.15.29:0/352742384 >> 172.21.15.29:0/352742384 conn(0x7f7d980c7f10 msgr2=0x7f7d9806e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.767+0000 7f7d9de90640 1 -- 172.21.15.29:0/352742384 shutdown_connections 2024-01-25T15:05:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.767+0000 7f7d9de90640 1 -- 172.21.15.29:0/352742384 wait complete. 2024-01-25T15:05:05.778 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:05:05.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.882+0000 7fe5411c9640 1 Processor -- start 2024-01-25T15:05:05.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.882+0000 7fe5411c9640 1 -- start start 2024-01-25T15:05:05.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.883+0000 7fe5411c9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe53c151f80 0x7fe53c0c6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.883+0000 7fe5411c9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe53c155190 0x7fe53c0c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.883+0000 7fe5411c9640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe53c158120 con 0x7fe53c0c48d0 2024-01-25T15:05:05.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.883+0000 7fe5411c9640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe53c155640 con 0x7fe53c151f80 2024-01-25T15:05:05.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.883+0000 7fe5411c9640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c0c4db0 con 0x7fe53c155190 2024-01-25T15:05:05.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.883+0000 7fe53ad9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe53c151f80 0x7fe53c0c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.883+0000 7fe53a59c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe53c0c48d0 0x7fe53c1585b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34592/0 (socket says 172.21.15.29:34592) 2024-01-25T15:05:05.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.883+0000 7fe53a59c640 1 -- 172.21.15.29:0/461340671 learned_addr learned my addr 172.21.15.29:0/461340671 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:05.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.883+0000 7fe53ad9d640 1 -- 172.21.15.29:0/461340671 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe53c155190 msgr2=0x7fe53c0c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:05.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.883+0000 7fe53b59e640 1 --2- 172.21.15.29:0/461340671 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe53c155190 0x7fe53c0c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.883+0000 7fe53ad9d640 1 --2- 172.21.15.29:0/461340671 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe53c155190 0x7fe53c0c74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.883+0000 7fe53ad9d640 1 -- 172.21.15.29:0/461340671 >> v1:172.21.15.29:6789/0 conn(0x7fe53c0c48d0 legacy=0x7fe53c1585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:05.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.883+0000 7fe539d9b640 1 -- 172.21.15.29:0/461340671 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170676577 0 0) 0x7fe53c158120 con 0x7fe53c0c48d0 2024-01-25T15:05:05.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.883+0000 7fe53ad9d640 1 -- 172.21.15.29:0/461340671 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53c0c5090 con 0x7fe53c151f80 2024-01-25T15:05:05.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.884+0000 7fe53ad9d640 1 --2- 172.21.15.29:0/461340671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe53c151f80 0x7fe53c0c6030 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe5340097a0 tx=0x7fe53402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8869c61d0ef672da server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:05.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.884+0000 7fe539d9b640 1 -- 172.21.15.29:0/461340671 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe534031830 con 0x7fe53c151f80 2024-01-25T15:05:05.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.884+0000 7fe539d9b640 1 -- 172.21.15.29:0/461340671 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe534031990 con 0x7fe53c151f80 2024-01-25T15:05:05.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.884+0000 7fe539d9b640 1 -- 172.21.15.29:0/461340671 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe534031d20 con 0x7fe53c151f80 2024-01-25T15:05:05.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.885+0000 7fe5411c9640 1 -- 172.21.15.29:0/461340671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe53c151f80 msgr2=0x7fe53c0c6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:05.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.885+0000 7fe5411c9640 1 --2- 172.21.15.29:0/461340671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe53c151f80 0x7fe53c0c6030 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe5340097a0 tx=0x7fe53402b8d0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.885+0000 7fe5411c9640 1 -- 172.21.15.29:0/461340671 shutdown_connections 2024-01-25T15:05:05.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.885+0000 7fe5411c9640 1 --2- 172.21.15.29:0/461340671 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe53c155190 0x7fe53c0c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.885+0000 7fe5411c9640 1 --2- 172.21.15.29:0/461340671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe53c151f80 0x7fe53c0c6030 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.885+0000 7fe5411c9640 1 -- 172.21.15.29:0/461340671 >> 172.21.15.29:0/461340671 conn(0x7fe53c0c7f10 msgr2=0x7fe53c0c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:05.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.885+0000 7fe5411c9640 1 -- 172.21.15.29:0/461340671 shutdown_connections 2024-01-25T15:05:05.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.885+0000 7fe5411c9640 1 -- 172.21.15.29:0/461340671 wait complete. 2024-01-25T15:05:05.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.886+0000 7fe5411c9640 1 Processor -- start 2024-01-25T15:05:05.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.886+0000 7fe5411c9640 1 -- start start 2024-01-25T15:05:05.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.887+0000 7fe5411c9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe53c0c48d0 0x7fe53c148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.887+0000 7fe5411c9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe53c151f80 0x7fe53c153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.887+0000 7fe5411c9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe53c155190 0x7fe53c1ea410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.887+0000 7fe5411c9640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c1ee040 con 0x7fe53c0c48d0 2024-01-25T15:05:05.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.887+0000 7fe5411c9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c1ee320 con 0x7fe53c151f80 2024-01-25T15:05:05.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.887+0000 7fe5411c9640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c0ac660 con 0x7fe53c155190 2024-01-25T15:05:05.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.887+0000 7fe53ad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe53c0c48d0 0x7fe53c148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.887+0000 7fe53ad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe53c0c48d0 0x7fe53c148840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55522/0 (socket says 172.21.15.29:55522) 2024-01-25T15:05:05.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.887+0000 7fe53ad9d640 1 -- 172.21.15.29:0/184279570 learned_addr learned my addr 172.21.15.29:0/184279570 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:05.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.887+0000 7fe53a59c640 1 --2- 172.21.15.29:0/184279570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe53c151f80 0x7fe53c153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.887+0000 7fe53b59e640 1 --2- 172.21.15.29:0/184279570 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe53c155190 0x7fe53c1ea410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.887+0000 7fe53ad9d640 1 -- 172.21.15.29:0/184279570 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe53c155190 msgr2=0x7fe53c1ea410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:05.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.887+0000 7fe53ad9d640 1 --2- 172.21.15.29:0/184279570 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe53c155190 0x7fe53c1ea410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.887+0000 7fe53ad9d640 1 -- 172.21.15.29:0/184279570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe53c151f80 msgr2=0x7fe53c153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:05.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.887+0000 7fe53ad9d640 1 --2- 172.21.15.29:0/184279570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe53c151f80 0x7fe53c153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:05.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.887+0000 7fe53ad9d640 1 -- 172.21.15.29:0/184279570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe534009400 con 0x7fe53c0c48d0 2024-01-25T15:05:05.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.887+0000 7fe53ad9d640 1 --2- 172.21.15.29:0/184279570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe53c0c48d0 0x7fe53c148840 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe53402bee0 tx=0x7fe5340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:05.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.888+0000 7fe5337fe640 1 -- 172.21.15.29:0/184279570 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53403ba70 con 0x7fe53c0c48d0 2024-01-25T15:05:05.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.888+0000 7fe5337fe640 1 -- 172.21.15.29:0/184279570 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53403bbf0 con 0x7fe53c0c48d0 2024-01-25T15:05:05.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.888+0000 7fe5411c9640 1 -- 172.21.15.29:0/184279570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe53c0ac940 con 0x7fe53c0c48d0 2024-01-25T15:05:05.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.888+0000 7fe5337fe640 1 -- 172.21.15.29:0/184279570 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5340453f0 con 0x7fe53c0c48d0 2024-01-25T15:05:05.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.888+0000 7fe5411c9640 1 -- 172.21.15.29:0/184279570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe53c14aad0 con 0x7fe53c0c48d0 2024-01-25T15:05:05.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.889+0000 7fe5411c9640 1 -- 172.21.15.29:0/184279570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe53c04eb10 con 0x7fe53c0c48d0 2024-01-25T15:05:05.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.889+0000 7fe5337fe640 1 -- 172.21.15.29:0/184279570 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fe53404e450 con 0x7fe53c0c48d0 2024-01-25T15:05:05.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.889+0000 7fe5337fe640 1 --2- 172.21.15.29:0/184279570 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe51c06aed0 0x7fe51c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:05.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.890+0000 7fe5337fe640 1 -- 172.21.15.29:0/184279570 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe5340aba60 con 0x7fe53c0c48d0 2024-01-25T15:05:05.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.890+0000 7fe53a59c640 1 --2- 172.21.15.29:0/184279570 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe51c06aed0 0x7fe51c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:05.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.890+0000 7fe53a59c640 1 --2- 172.21.15.29:0/184279570 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe51c06aed0 0x7fe51c06d390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe53c1544f0 tx=0x7fe524007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:05.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:05.894+0000 7fe5337fe640 1 -- 172.21.15.29:0/184279570 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fe5340766e0 con 0x7fe53c0c48d0 2024-01-25T15:05:06.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.076+0000 7fe5411c9640 1 -- 172.21.15.29:0/184279570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe53c14acc0 con 0x7fe53c0c48d0 2024-01-25T15:05:06.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.076+0000 7fe5337fe640 1 -- 172.21.15.29:0/184279570 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe534035020 con 0x7fe53c0c48d0 2024-01-25T15:05:06.077 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-25T15:05:06.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.078+0000 7fe5411c9640 1 -- 172.21.15.29:0/184279570 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe51c06aed0 msgr2=0x7fe51c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:06.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.078+0000 7fe5411c9640 1 --2- 172.21.15.29:0/184279570 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe51c06aed0 0x7fe51c06d390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe53c1544f0 tx=0x7fe524007de0 comp rx=0 tx=0).stop 2024-01-25T15:05:06.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.078+0000 7fe5411c9640 1 -- 172.21.15.29:0/184279570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe53c0c48d0 msgr2=0x7fe53c148840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:06.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.078+0000 7fe5411c9640 1 --2- 172.21.15.29:0/184279570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe53c0c48d0 0x7fe53c148840 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe53402bee0 tx=0x7fe5340046c0 comp rx=0 tx=0).stop 2024-01-25T15:05:06.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.078+0000 7fe5411c9640 1 -- 172.21.15.29:0/184279570 shutdown_connections 2024-01-25T15:05:06.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.078+0000 7fe5411c9640 1 --2- 172.21.15.29:0/184279570 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe53c155190 0x7fe53c1ea410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:06.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.078+0000 7fe5411c9640 1 --2- 172.21.15.29:0/184279570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe53c151f80 0x7fe53c153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:06.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.078+0000 7fe5411c9640 1 --2- 172.21.15.29:0/184279570 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe51c06aed0 0x7fe51c06d390 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:06.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.078+0000 7fe5411c9640 1 --2- 172.21.15.29:0/184279570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe53c0c48d0 0x7fe53c148840 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:06.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.078+0000 7fe5411c9640 1 -- 172.21.15.29:0/184279570 >> 172.21.15.29:0/184279570 conn(0x7fe53c0c7f10 msgr2=0x7fe53c0c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:06.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.078+0000 7fe5411c9640 1 -- 172.21.15.29:0/184279570 shutdown_connections 2024-01-25T15:05:06.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.078+0000 7fe5411c9640 1 -- 172.21.15.29:0/184279570 wait complete. 2024-01-25T15:05:06.090 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-25T15:05:06.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.193+0000 7f3fcd0fc640 1 Processor -- start 2024-01-25T15:05:06.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.193+0000 7f3fcd0fc640 1 -- start start 2024-01-25T15:05:06.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.193+0000 7f3fcd0fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3fc8151d80 0x7f3fc8155120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:06.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.193+0000 7f3fcd0fc640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3fc806b2b0 0x7f3fc806b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:06.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.193+0000 7f3fcd0fc640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc80c58c0 con 0x7f3fc80c5d50 2024-01-25T15:05:06.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.193+0000 7f3fcd0fc640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc806c0a0 con 0x7f3fc8151d80 2024-01-25T15:05:06.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.193+0000 7f3fcd0fc640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc80c7f10 con 0x7f3fc806b2b0 2024-01-25T15:05:06.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.194+0000 7f3fc759e640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3fc80c5d50 0x7f3fc80c61d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34594/0 (socket says 172.21.15.29:34594) 2024-01-25T15:05:06.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.194+0000 7f3fc759e640 1 -- 172.21.15.29:0/3614489956 learned_addr learned my addr 172.21.15.29:0/3614489956 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:06.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.194+0000 7f3fbe59c640 1 --2- 172.21.15.29:0/3614489956 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3fc806b2b0 0x7f3fc806b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:06.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.194+0000 7f3fc6d9d640 1 --2- 172.21.15.29:0/3614489956 >> v2:172.21.15.52:3300/0 conn(0x7f3fc8151d80 0x7f3fc8155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:06.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.194+0000 7f3fc659c640 1 -- 172.21.15.29:0/3614489956 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312815016 0 0) 0x7f3fc80c58c0 con 0x7f3fc80c5d50 2024-01-25T15:05:06.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.194+0000 7f3fc659c640 1 -- 172.21.15.29:0/3614489956 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fb4003520 con 0x7f3fc80c5d50 2024-01-25T15:05:06.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.194+0000 7f3fc659c640 1 -- 172.21.15.29:0/3614489956 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1991906692 0 0) 0x7f3fb4003520 con 0x7f3fc80c5d50 2024-01-25T15:05:06.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.194+0000 7f3fbe59c640 1 -- 172.21.15.29:0/3614489956 >> v2:172.21.15.52:3300/0 conn(0x7f3fc8151d80 msgr2=0x7f3fc8155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:06.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.194+0000 7f3fbe59c640 1 --2- 172.21.15.29:0/3614489956 >> v2:172.21.15.52:3300/0 conn(0x7f3fc8151d80 0x7f3fc8155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:06.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.194+0000 7f3fbe59c640 1 -- 172.21.15.29:0/3614489956 >> v1:172.21.15.29:6789/0 conn(0x7f3fc80c5d50 legacy=0x7f3fc80c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:06.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.194+0000 7f3fbe59c640 1 -- 172.21.15.29:0/3614489956 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc80c68e0 con 0x7f3fc806b2b0 2024-01-25T15:05:06.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.195+0000 7f3fbe59c640 1 --2- 172.21.15.29:0/3614489956 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3fc806b2b0 0x7f3fc806b710 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3fb00097a0 tx=0x7f3fb002b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41b8dfd599fc3e3a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:06.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.195+0000 7f3fc659c640 1 -- 172.21.15.29:0/3614489956 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc00019f0 con 0x7f3fc806b2b0 2024-01-25T15:05:06.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.195+0000 7f3fc659c640 1 -- 172.21.15.29:0/3614489956 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb002e050 con 0x7f3fc806b2b0 2024-01-25T15:05:06.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.195+0000 7f3fc659c640 1 -- 172.21.15.29:0/3614489956 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0030710 con 0x7f3fc806b2b0 2024-01-25T15:05:06.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.195+0000 7f3fcd0fc640 1 -- 172.21.15.29:0/3614489956 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3fc806b2b0 msgr2=0x7f3fc806b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:06.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.195+0000 7f3fcd0fc640 1 --2- 172.21.15.29:0/3614489956 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3fc806b2b0 0x7f3fc806b710 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3fb00097a0 tx=0x7f3fb002b710 comp rx=0 tx=0).stop 2024-01-25T15:05:06.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.196+0000 7f3fcd0fc640 1 -- 172.21.15.29:0/3614489956 shutdown_connections 2024-01-25T15:05:06.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.196+0000 7f3fcd0fc640 1 --2- 172.21.15.29:0/3614489956 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3fc806b2b0 0x7f3fc806b710 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:06.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.196+0000 7f3fcd0fc640 1 --2- 172.21.15.29:0/3614489956 >> v2:172.21.15.52:3300/0 conn(0x7f3fc8151d80 0x7f3fc8155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:06.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.196+0000 7f3fcd0fc640 1 -- 172.21.15.29:0/3614489956 >> 172.21.15.29:0/3614489956 conn(0x7f3fc80ca1f0 msgr2=0x7f3fc80ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:06.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.196+0000 7f3fcd0fc640 1 -- 172.21.15.29:0/3614489956 shutdown_connections 2024-01-25T15:05:06.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.196+0000 7f3fcd0fc640 1 -- 172.21.15.29:0/3614489956 wait complete. 2024-01-25T15:05:06.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.197+0000 7f3fcd0fc640 1 Processor -- start 2024-01-25T15:05:06.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.197+0000 7f3fcd0fc640 1 -- start start 2024-01-25T15:05:06.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.198+0000 7f3fcd0fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fc806b2b0 0x7f3fc81ea720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:06.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.198+0000 7f3fcd0fc640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3fc80c5d50 0x7f3fc80c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:06.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.198+0000 7f3fcd0fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fc8151d80 0x7f3fc80c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:06.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.198+0000 7f3fcd0fc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc80c1ea0 con 0x7f3fc806b2b0 2024-01-25T15:05:06.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.198+0000 7f3fcd0fc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc81eac60 con 0x7f3fc8151d80 2024-01-25T15:05:06.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.198+0000 7f3fcd0fc640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc80c2110 con 0x7f3fc80c5d50 2024-01-25T15:05:06.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.198+0000 7f3fc6d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fc806b2b0 0x7f3fc81ea720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:06.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.198+0000 7f3fc6d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fc806b2b0 0x7f3fc81ea720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55528/0 (socket says 172.21.15.29:55528) 2024-01-25T15:05:06.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.198+0000 7f3fc6d9d640 1 -- 172.21.15.29:0/993067162 learned_addr learned my addr 172.21.15.29:0/993067162 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:06.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.198+0000 7f3fc759e640 1 --2- 172.21.15.29:0/993067162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fc8151d80 0x7f3fc80c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:06.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.198+0000 7f3fbe59c640 1 --2- 172.21.15.29:0/993067162 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3fc80c5d50 0x7f3fc80c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:06.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.198+0000 7f3fc6d9d640 1 -- 172.21.15.29:0/993067162 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3fc80c5d50 msgr2=0x7f3fc80c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:06.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.198+0000 7f3fc6d9d640 1 --2- 172.21.15.29:0/993067162 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3fc80c5d50 0x7f3fc80c92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:06.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.198+0000 7f3fc6d9d640 1 -- 172.21.15.29:0/993067162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fc8151d80 msgr2=0x7f3fc80c36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:06.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.198+0000 7f3fc6d9d640 1 --2- 172.21.15.29:0/993067162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fc8151d80 0x7f3fc80c36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:06.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.198+0000 7f3fc6d9d640 1 -- 172.21.15.29:0/993067162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb0009400 con 0x7f3fc806b2b0 2024-01-25T15:05:06.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.198+0000 7f3fc6d9d640 1 --2- 172.21.15.29:0/993067162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fc806b2b0 0x7f3fc81ea720 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800e9b0 tx=0x7f3fb800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:06.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.198+0000 7f3fbffff640 1 -- 172.21.15.29:0/993067162 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8009670 con 0x7f3fc806b2b0 2024-01-25T15:05:06.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.199+0000 7f3fbffff640 1 -- 172.21.15.29:0/993067162 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb800c9a0 con 0x7f3fc806b2b0 2024-01-25T15:05:06.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.199+0000 7f3fcd0fc640 1 -- 172.21.15.29:0/993067162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc80c23f0 con 0x7f3fc806b2b0 2024-01-25T15:05:06.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.199+0000 7f3fbffff640 1 -- 172.21.15.29:0/993067162 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb800cd50 con 0x7f3fc806b2b0 2024-01-25T15:05:06.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.199+0000 7f3fcd0fc640 1 -- 172.21.15.29:0/993067162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc80c15f0 con 0x7f3fc806b2b0 2024-01-25T15:05:06.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.200+0000 7f3fcd0fc640 1 -- 172.21.15.29:0/993067162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc8067be0 con 0x7f3fc806b2b0 2024-01-25T15:05:06.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.200+0000 7f3fbffff640 1 -- 172.21.15.29:0/993067162 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f3fb8013470 con 0x7f3fc806b2b0 2024-01-25T15:05:06.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.200+0000 7f3fbffff640 1 --2- 172.21.15.29:0/993067162 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3fa806aed0 0x7f3fa806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:06.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.200+0000 7f3fbffff640 1 -- 172.21.15.29:0/993067162 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3fb8089a50 con 0x7f3fc806b2b0 2024-01-25T15:05:06.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.201+0000 7f3fbe59c640 1 --2- 172.21.15.29:0/993067162 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3fa806aed0 0x7f3fa806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:06.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.201+0000 7f3fbe59c640 1 --2- 172.21.15.29:0/993067162 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3fa806aed0 0x7f3fa806d390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8067260 tx=0x7f3fb0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:06.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.205+0000 7f3fbffff640 1 -- 172.21.15.29:0/993067162 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f3fb8054770 con 0x7f3fc806b2b0 2024-01-25T15:05:06.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.383+0000 7f3fcd0fc640 1 -- 172.21.15.29:0/993067162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3fc8074010 con 0x7f3fc806b2b0 2024-01-25T15:05:06.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.383+0000 7f3fbffff640 1 -- 172.21.15.29:0/993067162 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3fb80170a0 con 0x7f3fc806b2b0 2024-01-25T15:05:06.384 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:06.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.385+0000 7f3fcd0fc640 1 -- 172.21.15.29:0/993067162 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3fa806aed0 msgr2=0x7f3fa806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:06.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.385+0000 7f3fcd0fc640 1 --2- 172.21.15.29:0/993067162 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3fa806aed0 0x7f3fa806d390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8067260 tx=0x7f3fb0008030 comp rx=0 tx=0).stop 2024-01-25T15:05:06.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.385+0000 7f3fcd0fc640 1 -- 172.21.15.29:0/993067162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fc806b2b0 msgr2=0x7f3fc81ea720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.385+0000 7f3fcd0fc640 1 --2- 172.21.15.29:0/993067162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fc806b2b0 0x7f3fc81ea720 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800e9b0 tx=0x7f3fb800ee70 comp rx=0 tx=0).stop 2024-01-25T15:05:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.385+0000 7f3fcd0fc640 1 -- 172.21.15.29:0/993067162 shutdown_connections 2024-01-25T15:05:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.385+0000 7f3fcd0fc640 1 --2- 172.21.15.29:0/993067162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fc8151d80 0x7f3fc80c36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.385+0000 7f3fcd0fc640 1 --2- 172.21.15.29:0/993067162 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3fc80c5d50 0x7f3fc80c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.385+0000 7f3fcd0fc640 1 --2- 172.21.15.29:0/993067162 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3fa806aed0 0x7f3fa806d390 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.385+0000 7f3fcd0fc640 1 --2- 172.21.15.29:0/993067162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fc806b2b0 0x7f3fc81ea720 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.385+0000 7f3fcd0fc640 1 -- 172.21.15.29:0/993067162 >> 172.21.15.29:0/993067162 conn(0x7f3fc80ca1f0 msgr2=0x7f3fc806b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.386+0000 7f3fcd0fc640 1 -- 172.21.15.29:0/993067162 shutdown_connections 2024-01-25T15:05:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.386+0000 7f3fcd0fc640 1 -- 172.21.15.29:0/993067162 wait complete. 2024-01-25T15:05:06.397 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2024-01-25T15:05:06.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.498+0000 7f1af40ca640 1 Processor -- start 2024-01-25T15:05:06.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.498+0000 7f1af40ca640 1 -- start start 2024-01-25T15:05:06.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.499+0000 7f1af40ca640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1aec152160 0x7f1aec06bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:06.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.499+0000 7f1af40ca640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1aec0c4990 0x7f1aec0c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:06.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.499+0000 7f1af40ca640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aec155430 con 0x7f1aec0c53e0 2024-01-25T15:05:06.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.499+0000 7f1af40ca640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aec154b40 con 0x7f1aec152160 2024-01-25T15:05:06.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.499+0000 7f1af40ca640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec152540 con 0x7f1aec0c4990 2024-01-25T15:05:06.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.499+0000 7f1af2667640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1aec0c53e0 0x7f1aec0c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34604/0 (socket says 172.21.15.29:34604) 2024-01-25T15:05:06.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.499+0000 7f1af2667640 1 -- 172.21.15.29:0/2108600310 learned_addr learned my addr 172.21.15.29:0/2108600310 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:06.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.499+0000 7f1af0e64640 1 -- 172.21.15.29:0/2108600310 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142921256 0 0) 0x7f1aec155430 con 0x7f1aec0c53e0 2024-01-25T15:05:06.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af0e64640 1 -- 172.21.15.29:0/2108600310 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ad8003520 con 0x7f1aec0c53e0 2024-01-25T15:05:06.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af1e66640 1 --2- 172.21.15.29:0/2108600310 >> v2:172.21.15.52:3300/0 conn(0x7f1aec152160 0x7f1aec06bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:06.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af1665640 1 --2- 172.21.15.29:0/2108600310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1aec0c4990 0x7f1aec0c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:06.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af0e64640 1 -- 172.21.15.29:0/2108600310 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 687245176 0 0) 0x7f1ad8003520 con 0x7f1aec0c53e0 2024-01-25T15:05:06.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af0e64640 1 -- 172.21.15.29:0/2108600310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1aec0c4990 msgr2=0x7f1aec0c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:06.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af0e64640 1 --2- 172.21.15.29:0/2108600310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1aec0c4990 0x7f1aec0c4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:06.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af0e64640 1 -- 172.21.15.29:0/2108600310 >> v2:172.21.15.52:3300/0 conn(0x7f1aec152160 msgr2=0x7f1aec06bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:06.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af0e64640 1 --2- 172.21.15.29:0/2108600310 >> v2:172.21.15.52:3300/0 conn(0x7f1aec152160 0x7f1aec06bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:06.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af0e64640 1 -- 172.21.15.29:0/2108600310 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec0c64b0 con 0x7f1aec0c53e0 2024-01-25T15:05:06.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af0e64640 1 -- 172.21.15.29:0/2108600310 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f1ae40019f0 con 0x7f1aec0c53e0 2024-01-25T15:05:06.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af0e64640 1 -- 172.21.15.29:0/2108600310 >> v1:172.21.15.29:6789/0 conn(0x7f1aec0c53e0 legacy=0x7f1aec0c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:06.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af0e64640 1 --2- 172.21.15.29:0/2108600310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ad8003970 0x7f1ad8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:06.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af0e64640 1 --2- 172.21.15.29:0/2108600310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1aec0c4990 0x7f1ad80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:06.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af0e64640 1 --2- 172.21.15.29:0/2108600310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ad8004d00 0x7f1ad8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:06.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af0e64640 1 -- 172.21.15.29:0/2108600310 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec154b40 con 0x7f1ad8003970 2024-01-25T15:05:06.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af0e64640 1 -- 172.21.15.29:0/2108600310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec152540 con 0x7f1ad8004d00 2024-01-25T15:05:06.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af0e64640 1 -- 172.21.15.29:0/2108600310 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad800b980 con 0x7f1aec0c4990 2024-01-25T15:05:06.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af1e66640 1 --2- 172.21.15.29:0/2108600310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ad8003970 0x7f1ad8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:06.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af1665640 1 --2- 172.21.15.29:0/2108600310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1aec0c4990 0x7f1ad80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:06.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af2667640 1 --2- 172.21.15.29:0/2108600310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ad8004d00 0x7f1ad8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:06.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af1e66640 1 -- 172.21.15.29:0/2108600310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1aec0c4990 msgr2=0x7f1ad80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:06.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af1e66640 1 --2- 172.21.15.29:0/2108600310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1aec0c4990 0x7f1ad80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:06.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af1e66640 1 -- 172.21.15.29:0/2108600310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ad8004d00 msgr2=0x7f1ad8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:06.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af1e66640 1 --2- 172.21.15.29:0/2108600310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ad8004d00 0x7f1ad8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:06.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.500+0000 7f1af1e66640 1 -- 172.21.15.29:0/2108600310 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad8003520 con 0x7f1ad8003970 2024-01-25T15:05:06.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.501+0000 7f1af1e66640 1 --2- 172.21.15.29:0/2108600310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ad8003970 0x7f1ad8003d90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8009ac0 tx=0x7f1ad80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e5cdce76bfeb65 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:06.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.501+0000 7f1af0e64640 1 -- 172.21.15.29:0/2108600310 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae802c710 con 0x7f1ad8003970 2024-01-25T15:05:06.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.501+0000 7f1af0e64640 1 -- 172.21.15.29:0/2108600310 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae802c870 con 0x7f1ad8003970 2024-01-25T15:05:06.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.501+0000 7f1af0e64640 1 -- 172.21.15.29:0/2108600310 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae802cc00 con 0x7f1ad8003970 2024-01-25T15:05:06.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.501+0000 7f1af40ca640 1 -- 172.21.15.29:0/2108600310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ad8003970 msgr2=0x7f1ad8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:06.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.502+0000 7f1af40ca640 1 --2- 172.21.15.29:0/2108600310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ad8003970 0x7f1ad8003d90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8009ac0 tx=0x7f1ad80057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:06.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.502+0000 7f1af2667640 1 -- 172.21.15.29:0/2108600310 reap_dead start 2024-01-25T15:05:06.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.502+0000 7f1af40ca640 1 -- 172.21.15.29:0/2108600310 shutdown_connections 2024-01-25T15:05:06.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.502+0000 7f1af40ca640 1 -- 172.21.15.29:0/2108600310 >> 172.21.15.29:0/2108600310 conn(0x7f1aec0ca1f0 msgr2=0x7f1aec0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:06.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.502+0000 7f1af40ca640 1 -- 172.21.15.29:0/2108600310 shutdown_connections 2024-01-25T15:05:06.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.502+0000 7f1af40ca640 1 -- 172.21.15.29:0/2108600310 wait complete. 2024-01-25T15:05:06.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.503+0000 7f1af40ca640 1 Processor -- start 2024-01-25T15:05:06.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.503+0000 7f1af40ca640 1 -- start start 2024-01-25T15:05:06.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.503+0000 7f1af40ca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ad8003970 0x7f1aec1584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:06.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.503+0000 7f1af40ca640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1aec14db40 0x7f1aec1eb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:06.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.503+0000 7f1af40ca640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1aec14eee0 0x7f1aec1ebe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:06.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.503+0000 7f1af40ca640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec149180 con 0x7f1ad8003970 2024-01-25T15:05:06.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.503+0000 7f1af40ca640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec14ce10 con 0x7f1aec14db40 2024-01-25T15:05:06.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.503+0000 7f1af40ca640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec0c1960 con 0x7f1aec14eee0 2024-01-25T15:05:06.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.504+0000 7f1af1e66640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ad8003970 0x7f1aec1584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:06.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.504+0000 7f1af1e66640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ad8003970 0x7f1aec1584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55554/0 (socket says 172.21.15.29:55554) 2024-01-25T15:05:06.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.504+0000 7f1af1e66640 1 -- 172.21.15.29:0/658071453 learned_addr learned my addr 172.21.15.29:0/658071453 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:06.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.504+0000 7f1af2667640 1 --2- 172.21.15.29:0/658071453 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1aec14eee0 0x7f1aec1ebe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:06.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.504+0000 7f1af1665640 1 --2- 172.21.15.29:0/658071453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1aec14db40 0x7f1aec1eb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:06.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.504+0000 7f1af1e66640 1 -- 172.21.15.29:0/658071453 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1aec14eee0 msgr2=0x7f1aec1ebe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:06.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.504+0000 7f1af1e66640 1 --2- 172.21.15.29:0/658071453 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1aec14eee0 0x7f1aec1ebe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:06.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.504+0000 7f1af1e66640 1 -- 172.21.15.29:0/658071453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1aec14db40 msgr2=0x7f1aec1eb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:06.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.504+0000 7f1af1e66640 1 --2- 172.21.15.29:0/658071453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1aec14db40 0x7f1aec1eb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:06.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.504+0000 7f1af1e66640 1 -- 172.21.15.29:0/658071453 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec1ee7e0 con 0x7f1ad8003970 2024-01-25T15:05:06.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.504+0000 7f1af1e66640 1 --2- 172.21.15.29:0/658071453 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ad8003970 0x7f1aec1584e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8037040 tx=0x7f1ae8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:06.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.504+0000 7f1ae27fc640 1 -- 172.21.15.29:0/658071453 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8003810 con 0x7f1ad8003970 2024-01-25T15:05:06.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.504+0000 7f1ae27fc640 1 -- 172.21.15.29:0/658071453 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae8003990 con 0x7f1ad8003970 2024-01-25T15:05:06.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.504+0000 7f1af40ca640 1 -- 172.21.15.29:0/658071453 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aec14d060 con 0x7f1ad8003970 2024-01-25T15:05:06.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.504+0000 7f1ae27fc640 1 -- 172.21.15.29:0/658071453 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8003d40 con 0x7f1ad8003970 2024-01-25T15:05:06.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.504+0000 7f1af40ca640 1 -- 172.21.15.29:0/658071453 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aec14d620 con 0x7f1ad8003970 2024-01-25T15:05:06.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.505+0000 7f1af40ca640 1 -- 172.21.15.29:0/658071453 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aec0bd9b0 con 0x7f1ad8003970 2024-01-25T15:05:06.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.506+0000 7f1ae27fc640 1 -- 172.21.15.29:0/658071453 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f1ae8040450 con 0x7f1ad8003970 2024-01-25T15:05:06.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.506+0000 7f1ae27fc640 1 --2- 172.21.15.29:0/658071453 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1ad006aed0 0x7f1ad006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:06.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.506+0000 7f1ae27fc640 1 -- 172.21.15.29:0/658071453 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1ae80ab7d0 con 0x7f1ad8003970 2024-01-25T15:05:06.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.506+0000 7f1af1665640 1 --2- 172.21.15.29:0/658071453 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1ad006aed0 0x7f1ad006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:06.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.507+0000 7f1af1665640 1 --2- 172.21.15.29:0/658071453 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1ad006aed0 0x7f1ad006d390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1aec0ca8b0 tx=0x7f1adc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:06.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.510+0000 7f1ae27fc640 1 -- 172.21.15.29:0/658071453 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f1ae8076560 con 0x7f1ad8003970 2024-01-25T15:05:06.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:06.762+0000 7f1af40ca640 1 -- 172.21.15.29:0/658071453 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f1aec14d7b0 con 0x7f1ad8003970 2024-01-25T15:05:07.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.669+0000 7f1ae27fc640 1 -- 172.21.15.29:0/658071453 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v64) v1 ==== 162+0+0 (secure 0 0 0) 0x7f1ae8079b80 con 0x7f1ad8003970 2024-01-25T15:05:07.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.674+0000 7f1af40ca640 1 -- 172.21.15.29:0/658071453 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1ad006aed0 msgr2=0x7f1ad006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:07.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.674+0000 7f1af40ca640 1 --2- 172.21.15.29:0/658071453 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1ad006aed0 0x7f1ad006d390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1aec0ca8b0 tx=0x7f1adc008040 comp rx=0 tx=0).stop 2024-01-25T15:05:07.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.674+0000 7f1af40ca640 1 -- 172.21.15.29:0/658071453 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ad8003970 msgr2=0x7f1aec1584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:07.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.674+0000 7f1af40ca640 1 --2- 172.21.15.29:0/658071453 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ad8003970 0x7f1aec1584e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8037040 tx=0x7f1ae8004730 comp rx=0 tx=0).stop 2024-01-25T15:05:07.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.674+0000 7f1af40ca640 1 -- 172.21.15.29:0/658071453 shutdown_connections 2024-01-25T15:05:07.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.674+0000 7f1af40ca640 1 --2- 172.21.15.29:0/658071453 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1aec14eee0 0x7f1aec1ebe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:07.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.674+0000 7f1af40ca640 1 --2- 172.21.15.29:0/658071453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1aec14db40 0x7f1aec1eb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:07.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.674+0000 7f1af40ca640 1 --2- 172.21.15.29:0/658071453 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1ad006aed0 0x7f1ad006d390 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:07.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.674+0000 7f1af40ca640 1 --2- 172.21.15.29:0/658071453 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ad8003970 0x7f1aec1584e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:07.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.674+0000 7f1af40ca640 1 -- 172.21.15.29:0/658071453 >> 172.21.15.29:0/658071453 conn(0x7f1aec0ca1f0 msgr2=0x7f1aec1509b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:07.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.674+0000 7f1af40ca640 1 -- 172.21.15.29:0/658071453 shutdown_connections 2024-01-25T15:05:07.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.674+0000 7f1af40ca640 1 -- 172.21.15.29:0/658071453 wait complete. 2024-01-25T15:05:07.693 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-25T15:05:07.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.803+0000 7f8c90394640 1 Processor -- start 2024-01-25T15:05:07.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.803+0000 7f8c90394640 1 -- start start 2024-01-25T15:05:07.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.804+0000 7f8c90394640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8c8806b490 0x7f8c880c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:07.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.804+0000 7f8c90394640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c880c6770 con 0x7f8c88158b80 2024-01-25T15:05:07.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.804+0000 7f8c90394640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c88154f10 con 0x7f8c880c8620 2024-01-25T15:05:07.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.804+0000 7f8c90394640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c881551f0 con 0x7f8c8806b490 2024-01-25T15:05:07.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.804+0000 7f8c8d92f640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8c88158b80 0x7f8c880c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34610/0 (socket says 172.21.15.29:34610) 2024-01-25T15:05:07.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.804+0000 7f8c8d92f640 1 -- 172.21.15.29:0/2110519755 learned_addr learned my addr 172.21.15.29:0/2110519755 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:07.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.804+0000 7f8c8e130640 1 --2- 172.21.15.29:0/2110519755 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8c8806b490 0x7f8c880c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:07.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.804+0000 7f8c8d12e640 1 -- 172.21.15.29:0/2110519755 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060386640 0 0) 0x7f8c880c6770 con 0x7f8c88158b80 2024-01-25T15:05:07.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.804+0000 7f8c8d12e640 1 -- 172.21.15.29:0/2110519755 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c74003520 con 0x7f8c88158b80 2024-01-25T15:05:07.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.804+0000 7f8c8d12e640 1 -- 172.21.15.29:0/2110519755 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229515535 0 0) 0x7f8c88154f10 con 0x7f8c880c8620 2024-01-25T15:05:07.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.804+0000 7f8c8d12e640 1 -- 172.21.15.29:0/2110519755 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c880c6770 con 0x7f8c880c8620 2024-01-25T15:05:07.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.804+0000 7f8c8e130640 1 -- 172.21.15.29:0/2110519755 >> v1:172.21.15.52:6789/0 conn(0x7f8c880c8620 legacy=0x7f8c88151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:07.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.804+0000 7f8c8e130640 1 -- 172.21.15.29:0/2110519755 >> v1:172.21.15.29:6789/0 conn(0x7f8c88158b80 legacy=0x7f8c880c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:07.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.804+0000 7f8c8e130640 1 -- 172.21.15.29:0/2110519755 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c881554d0 con 0x7f8c8806b490 2024-01-25T15:05:07.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.805+0000 7f8c8e130640 1 --2- 172.21.15.29:0/2110519755 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8c8806b490 0x7f8c880c6120 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8c840097d0 tx=0x7f8c8402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0609e2f8ce35e0d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:07.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.805+0000 7f8c8d12e640 1 -- 172.21.15.29:0/2110519755 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c84031800 con 0x7f8c8806b490 2024-01-25T15:05:07.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.806+0000 7f8c8d12e640 1 -- 172.21.15.29:0/2110519755 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c84031960 con 0x7f8c8806b490 2024-01-25T15:05:07.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.806+0000 7f8c8d12e640 1 -- 172.21.15.29:0/2110519755 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c84031cf0 con 0x7f8c8806b490 2024-01-25T15:05:07.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.806+0000 7f8c90394640 1 -- 172.21.15.29:0/2110519755 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8c8806b490 msgr2=0x7f8c880c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:07.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.806+0000 7f8c90394640 1 --2- 172.21.15.29:0/2110519755 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8c8806b490 0x7f8c880c6120 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8c840097d0 tx=0x7f8c8402b8a0 comp rx=0 tx=0).stop 2024-01-25T15:05:07.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.806+0000 7f8c90394640 1 -- 172.21.15.29:0/2110519755 shutdown_connections 2024-01-25T15:05:07.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.806+0000 7f8c90394640 1 --2- 172.21.15.29:0/2110519755 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8c8806b490 0x7f8c880c6120 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:07.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.806+0000 7f8c90394640 1 -- 172.21.15.29:0/2110519755 >> 172.21.15.29:0/2110519755 conn(0x7f8c880ca010 msgr2=0x7f8c880ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:07.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.806+0000 7f8c90394640 1 -- 172.21.15.29:0/2110519755 shutdown_connections 2024-01-25T15:05:07.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.806+0000 7f8c90394640 1 -- 172.21.15.29:0/2110519755 wait complete. 2024-01-25T15:05:07.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.807+0000 7f8c90394640 1 Processor -- start 2024-01-25T15:05:07.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.807+0000 7f8c90394640 1 -- start start 2024-01-25T15:05:07.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.808+0000 7f8c90394640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8c8806b490 0x7f8c881571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:07.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.808+0000 7f8c90394640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c880c8620 0x7f8c8814b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:07.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.808+0000 7f8c90394640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c88158b80 0x7f8c8814b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:07.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.808+0000 7f8c90394640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c880bfa40 con 0x7f8c88158b80 2024-01-25T15:05:07.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.808+0000 7f8c90394640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c881eae90 con 0x7f8c880c8620 2024-01-25T15:05:07.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.808+0000 7f8c90394640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c881ea960 con 0x7f8c8806b490 2024-01-25T15:05:07.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.808+0000 7f8c8e931640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c88158b80 0x7f8c8814b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:07.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.808+0000 7f8c8e931640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c88158b80 0x7f8c8814b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55566/0 (socket says 172.21.15.29:55566) 2024-01-25T15:05:07.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.808+0000 7f8c8e931640 1 -- 172.21.15.29:0/2071348800 learned_addr learned my addr 172.21.15.29:0/2071348800 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:07.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.808+0000 7f8c8e130640 1 --2- 172.21.15.29:0/2071348800 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8c8806b490 0x7f8c881571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:07.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.808+0000 7f8c8d92f640 1 --2- 172.21.15.29:0/2071348800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c880c8620 0x7f8c8814b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:07.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.808+0000 7f8c8e931640 1 -- 172.21.15.29:0/2071348800 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8c8806b490 msgr2=0x7f8c881571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:07.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.808+0000 7f8c8e931640 1 --2- 172.21.15.29:0/2071348800 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8c8806b490 0x7f8c881571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:07.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.808+0000 7f8c8e931640 1 -- 172.21.15.29:0/2071348800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c880c8620 msgr2=0x7f8c8814b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:07.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.808+0000 7f8c8e931640 1 --2- 172.21.15.29:0/2071348800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c880c8620 0x7f8c8814b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:07.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.808+0000 7f8c8e931640 1 -- 172.21.15.29:0/2071348800 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c84009400 con 0x7f8c88158b80 2024-01-25T15:05:07.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.809+0000 7f8c8e931640 1 --2- 172.21.15.29:0/2071348800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c88158b80 0x7f8c8814b550 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000c790 tx=0x7f8c8000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:07.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.809+0000 7f8c7effd640 1 -- 172.21.15.29:0/2071348800 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8000cea0 con 0x7f8c88158b80 2024-01-25T15:05:07.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.809+0000 7f8c7effd640 1 -- 172.21.15.29:0/2071348800 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c80003b70 con 0x7f8c88158b80 2024-01-25T15:05:07.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.809+0000 7f8c90394640 1 -- 172.21.15.29:0/2071348800 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c88155b70 con 0x7f8c88158b80 2024-01-25T15:05:07.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.809+0000 7f8c7effd640 1 -- 172.21.15.29:0/2071348800 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8000a850 con 0x7f8c88158b80 2024-01-25T15:05:07.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.809+0000 7f8c90394640 1 -- 172.21.15.29:0/2071348800 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c8814e520 con 0x7f8c88158b80 2024-01-25T15:05:07.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.810+0000 7f8c90394640 1 -- 172.21.15.29:0/2071348800 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c880a97d0 con 0x7f8c88158b80 2024-01-25T15:05:07.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.810+0000 7f8c7effd640 1 -- 172.21.15.29:0/2071348800 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8c8000a9b0 con 0x7f8c88158b80 2024-01-25T15:05:07.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.811+0000 7f8c7effd640 1 --2- 172.21.15.29:0/2071348800 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8c6c06aed0 0x7f8c6c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:07.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.811+0000 7f8c7effd640 1 -- 172.21.15.29:0/2071348800 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f8c800896f0 con 0x7f8c88158b80 2024-01-25T15:05:07.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.811+0000 7f8c8e130640 1 --2- 172.21.15.29:0/2071348800 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8c6c06aed0 0x7f8c6c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:07.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.811+0000 7f8c8e130640 1 --2- 172.21.15.29:0/2071348800 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8c6c06aed0 0x7f8c6c06d390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8c84036000 tx=0x7f8c8403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:07.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.815+0000 7f8c7effd640 1 -- 172.21.15.29:0/2071348800 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8c80054320 con 0x7f8c88158b80 2024-01-25T15:05:07.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.996+0000 7f8c90394640 1 -- 172.21.15.29:0/2071348800 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8c88074010 con 0x7f8c88158b80 2024-01-25T15:05:07.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:07.998+0000 7f8c7effd640 1 -- 172.21.15.29:0/2071348800 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8c80057940 con 0x7f8c88158b80 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.001+0000 7f8c90394640 1 -- 172.21.15.29:0/2071348800 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8c6c06aed0 msgr2=0x7f8c6c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.001+0000 7f8c90394640 1 --2- 172.21.15.29:0/2071348800 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8c6c06aed0 0x7f8c6c06d390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8c84036000 tx=0x7f8c8403c040 comp rx=0 tx=0).stop 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.001+0000 7f8c90394640 1 -- 172.21.15.29:0/2071348800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c88158b80 msgr2=0x7f8c8814b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.001+0000 7f8c90394640 1 --2- 172.21.15.29:0/2071348800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c88158b80 0x7f8c8814b550 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000c790 tx=0x7f8c8000cc50 comp rx=0 tx=0).stop 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.001+0000 7f8c90394640 1 -- 172.21.15.29:0/2071348800 shutdown_connections 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.001+0000 7f8c90394640 1 --2- 172.21.15.29:0/2071348800 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8c6c06aed0 0x7f8c6c06d390 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.001+0000 7f8c90394640 1 --2- 172.21.15.29:0/2071348800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c88158b80 0x7f8c8814b550 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.001+0000 7f8c90394640 1 --2- 172.21.15.29:0/2071348800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c880c8620 0x7f8c8814b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.001+0000 7f8c90394640 1 --2- 172.21.15.29:0/2071348800 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8c8806b490 0x7f8c881571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.001+0000 7f8c90394640 1 -- 172.21.15.29:0/2071348800 >> 172.21.15.29:0/2071348800 conn(0x7f8c880ca010 msgr2=0x7f8c880c6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.001+0000 7f8c90394640 1 -- 172.21.15.29:0/2071348800 shutdown_connections 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.001+0000 7f8c90394640 1 -- 172.21.15.29:0/2071348800 wait complete. 2024-01-25T15:05:08.012 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-25T15:05:08.013 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-25T15:05:08.053 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-25T15:05:08.101 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-25T15:05:08.101 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:05:08.101 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:05:08.116 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:05:08.117 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:05:08.171 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:05:08.172 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:05:08.226 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:08.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.367+0000 7f5e6377b640 1 Processor -- start 2024-01-25T15:05:08.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.368+0000 7f5e6377b640 1 -- start start 2024-01-25T15:05:08.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.368+0000 7f5e6377b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5e5c1520b0 0x7f5e5c155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:08.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.368+0000 7f5e6377b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5e5c0c55e0 0x7f5e5c0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:08.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.368+0000 7f5e6377b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e5c0c4f00 0x7f5e5c0c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:08.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.368+0000 7f5e6377b640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5c0c66c0 con 0x7f5e5c0c55e0 2024-01-25T15:05:08.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.368+0000 7f5e6377b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5c06cfc0 con 0x7f5e5c1520b0 2024-01-25T15:05:08.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.368+0000 7f5e6377b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c152490 con 0x7f5e5c0c4f00 2024-01-25T15:05:08.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.369+0000 7f5e60d16640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5e5c0c55e0 0x7f5e5c0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:08.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.369+0000 7f5e60d16640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5e5c0c55e0 0x7f5e5c0c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55576/0 (socket says 172.21.15.29:55576) 2024-01-25T15:05:08.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.369+0000 7f5e60d16640 1 -- 172.21.15.29:0/2386970252 learned_addr learned my addr 172.21.15.29:0/2386970252 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:08.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.369+0000 7f5e60d16640 1 -- 172.21.15.29:0/2386970252 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e5c0c4f00 msgr2=0x7f5e5c0c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:08.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.369+0000 7f5e60d16640 1 --2- 172.21.15.29:0/2386970252 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e5c0c4f00 0x7f5e5c0c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.369+0000 7f5e60d16640 1 -- 172.21.15.29:0/2386970252 >> v2:172.21.15.52:3300/0 conn(0x7f5e5c1520b0 msgr2=0x7f5e5c155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:08.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.369+0000 7f5e61517640 1 --2- 172.21.15.29:0/2386970252 >> v2:172.21.15.52:3300/0 conn(0x7f5e5c1520b0 0x7f5e5c155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:08.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.369+0000 7f5e60d16640 1 --2- 172.21.15.29:0/2386970252 >> v2:172.21.15.52:3300/0 conn(0x7f5e5c1520b0 0x7f5e5c155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.369+0000 7f5e60d16640 1 -- 172.21.15.29:0/2386970252 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5c0c6910 con 0x7f5e5c0c55e0 2024-01-25T15:05:08.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.370+0000 7f5e60d16640 1 --2- 172.21.15.29:0/2386970252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e5c0c55e0 0x7f5e5c0c8120 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c08bbe0 tx=0x7f5e4c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7022cddd39695426 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:08.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.370+0000 7f5e53fff640 1 -- 172.21.15.29:0/2386970252 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c0317e0 con 0x7f5e5c0c55e0 2024-01-25T15:05:08.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.370+0000 7f5e53fff640 1 -- 172.21.15.29:0/2386970252 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4c031940 con 0x7f5e5c0c55e0 2024-01-25T15:05:08.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.370+0000 7f5e53fff640 1 -- 172.21.15.29:0/2386970252 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c031cd0 con 0x7f5e5c0c55e0 2024-01-25T15:05:08.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.370+0000 7f5e6377b640 1 -- 172.21.15.29:0/2386970252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e5c0c55e0 msgr2=0x7f5e5c0c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:08.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.370+0000 7f5e6377b640 1 --2- 172.21.15.29:0/2386970252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e5c0c55e0 0x7f5e5c0c8120 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c08bbe0 tx=0x7f5e4c02b880 comp rx=0 tx=0).stop 2024-01-25T15:05:08.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.370+0000 7f5e6377b640 1 -- 172.21.15.29:0/2386970252 shutdown_connections 2024-01-25T15:05:08.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.370+0000 7f5e6377b640 1 --2- 172.21.15.29:0/2386970252 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e5c0c4f00 0x7f5e5c0c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.370+0000 7f5e6377b640 1 --2- 172.21.15.29:0/2386970252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e5c0c55e0 0x7f5e5c0c8120 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.370+0000 7f5e6377b640 1 --2- 172.21.15.29:0/2386970252 >> v2:172.21.15.52:3300/0 conn(0x7f5e5c1520b0 0x7f5e5c155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.370+0000 7f5e6377b640 1 -- 172.21.15.29:0/2386970252 >> 172.21.15.29:0/2386970252 conn(0x7f5e5c0ca220 msgr2=0x7f5e5c0ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.370+0000 7f5e6377b640 1 -- 172.21.15.29:0/2386970252 shutdown_connections 2024-01-25T15:05:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.370+0000 7f5e6377b640 1 -- 172.21.15.29:0/2386970252 wait complete. 2024-01-25T15:05:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.371+0000 7f5e6377b640 1 Processor -- start 2024-01-25T15:05:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.372+0000 7f5e6377b640 1 -- start start 2024-01-25T15:05:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.372+0000 7f5e6377b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e5c0c4f00 0x7f5e5c148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.372+0000 7f5e6377b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e5c1520b0 0x7f5e5c147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.372+0000 7f5e6377b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e5c155d90 0x7f5e5c0aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.372+0000 7f5e6377b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c158b80 con 0x7f5e5c155d90 2024-01-25T15:05:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.372+0000 7f5e6377b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c14c350 con 0x7f5e5c0c4f00 2024-01-25T15:05:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.372+0000 7f5e6377b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c148500 con 0x7f5e5c1520b0 2024-01-25T15:05:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.372+0000 7f5e61d18640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e5c155d90 0x7f5e5c0aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.372+0000 7f5e61d18640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e5c155d90 0x7f5e5c0aacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55586/0 (socket says 172.21.15.29:55586) 2024-01-25T15:05:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.372+0000 7f5e61d18640 1 -- 172.21.15.29:0/3862867229 learned_addr learned my addr 172.21.15.29:0/3862867229 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.372+0000 7f5e61517640 1 --2- 172.21.15.29:0/3862867229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e5c0c4f00 0x7f5e5c148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.372+0000 7f5e60d16640 1 --2- 172.21.15.29:0/3862867229 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e5c1520b0 0x7f5e5c147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.373+0000 7f5e61d18640 1 -- 172.21.15.29:0/3862867229 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e5c1520b0 msgr2=0x7f5e5c147fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.373+0000 7f5e61d18640 1 --2- 172.21.15.29:0/3862867229 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e5c1520b0 0x7f5e5c147fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.373+0000 7f5e61d18640 1 -- 172.21.15.29:0/3862867229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e5c0c4f00 msgr2=0x7f5e5c148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.373+0000 7f5e61d18640 1 --2- 172.21.15.29:0/3862867229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e5c0c4f00 0x7f5e5c148710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.373+0000 7f5e61d18640 1 -- 172.21.15.29:0/3862867229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c0094d0 con 0x7f5e5c155d90 2024-01-25T15:05:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.373+0000 7f5e61d18640 1 --2- 172.21.15.29:0/3862867229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e5c155d90 0x7f5e5c0aacc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5e5400b970 tx=0x7f5e5400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.373+0000 7f5e51ffb640 1 -- 172.21.15.29:0/3862867229 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5400cb40 con 0x7f5e5c155d90 2024-01-25T15:05:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.373+0000 7f5e51ffb640 1 -- 172.21.15.29:0/3862867229 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5400ccc0 con 0x7f5e5c155d90 2024-01-25T15:05:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.373+0000 7f5e6377b640 1 -- 172.21.15.29:0/3862867229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5c1eb1c0 con 0x7f5e5c155d90 2024-01-25T15:05:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.373+0000 7f5e51ffb640 1 -- 172.21.15.29:0/3862867229 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e54014680 con 0x7f5e5c155d90 2024-01-25T15:05:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.373+0000 7f5e6377b640 1 -- 172.21.15.29:0/3862867229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5c14def0 con 0x7f5e5c155d90 2024-01-25T15:05:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.374+0000 7f5e6377b640 1 -- 172.21.15.29:0/3862867229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5c14c4c0 con 0x7f5e5c155d90 2024-01-25T15:05:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.375+0000 7f5e51ffb640 1 -- 172.21.15.29:0/3862867229 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f5e5401d3b0 con 0x7f5e5c155d90 2024-01-25T15:05:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.375+0000 7f5e51ffb640 1 --2- 172.21.15.29:0/3862867229 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5e4006aed0 0x7f5e4006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.375+0000 7f5e51ffb640 1 -- 172.21.15.29:0/3862867229 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5e54089900 con 0x7f5e5c155d90 2024-01-25T15:05:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.375+0000 7f5e61517640 1 --2- 172.21.15.29:0/3862867229 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5e4006aed0 0x7f5e4006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.376+0000 7f5e61517640 1 --2- 172.21.15.29:0/3862867229 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5e4006aed0 0x7f5e4006d390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5e58006fd0 tx=0x7f5e58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:08.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.379+0000 7f5e51ffb640 1 -- 172.21.15.29:0/3862867229 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f5e54054480 con 0x7f5e5c155d90 2024-01-25T15:05:08.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.559+0000 7f5e6377b640 1 -- 172.21.15.29:0/3862867229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e5c074080 con 0x7f5e5c155d90 2024-01-25T15:05:08.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.560+0000 7f5e51ffb640 1 -- 172.21.15.29:0/3862867229 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18747 (secure 0 0 0) 0x7f5e54057aa0 con 0x7f5e5c155d90 2024-01-25T15:05:08.561 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:08.561 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:05:07.664665+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:08.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.562+0000 7f5e6377b640 1 -- 172.21.15.29:0/3862867229 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5e4006aed0 msgr2=0x7f5e4006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:08.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.562+0000 7f5e6377b640 1 --2- 172.21.15.29:0/3862867229 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5e4006aed0 0x7f5e4006d390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5e58006fd0 tx=0x7f5e58008040 comp rx=0 tx=0).stop 2024-01-25T15:05:08.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.562+0000 7f5e6377b640 1 -- 172.21.15.29:0/3862867229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e5c155d90 msgr2=0x7f5e5c0aacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:08.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.562+0000 7f5e6377b640 1 --2- 172.21.15.29:0/3862867229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e5c155d90 0x7f5e5c0aacc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5e5400b970 tx=0x7f5e5400be30 comp rx=0 tx=0).stop 2024-01-25T15:05:08.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.562+0000 7f5e6377b640 1 -- 172.21.15.29:0/3862867229 shutdown_connections 2024-01-25T15:05:08.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.562+0000 7f5e6377b640 1 --2- 172.21.15.29:0/3862867229 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5e4006aed0 0x7f5e4006d390 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.562+0000 7f5e6377b640 1 --2- 172.21.15.29:0/3862867229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e5c155d90 0x7f5e5c0aacc0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.562+0000 7f5e6377b640 1 --2- 172.21.15.29:0/3862867229 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e5c1520b0 0x7f5e5c147fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.562+0000 7f5e6377b640 1 --2- 172.21.15.29:0/3862867229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e5c0c4f00 0x7f5e5c148710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.562+0000 7f5e6377b640 1 -- 172.21.15.29:0/3862867229 >> 172.21.15.29:0/3862867229 conn(0x7f5e5c0ca220 msgr2=0x7f5e5c153720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:08.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.562+0000 7f5e6377b640 1 -- 172.21.15.29:0/3862867229 shutdown_connections 2024-01-25T15:05:08.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.562+0000 7f5e6377b640 1 -- 172.21.15.29:0/3862867229 wait complete. 2024-01-25T15:05:08.574 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T15:04:14.955791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T15:04:24.986626+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T15:04:25.873673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-25T15:04:29.578261+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-25T15:05:08.574 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:05:08.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.682+0000 7f3a20eec640 1 Processor -- start 2024-01-25T15:05:08.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.682+0000 7f3a20eec640 1 -- start start 2024-01-25T15:05:08.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.683+0000 7f3a20eec640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3a1c149190 0x7f3a1c0ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:08.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.683+0000 7f3a20eec640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1c070d40 con 0x7f3a1c152590 2024-01-25T15:05:08.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.683+0000 7f3a20eec640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1c155c00 con 0x7f3a1c070510 2024-01-25T15:05:08.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.683+0000 7f3a20eec640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a1c153080 con 0x7f3a1c149190 2024-01-25T15:05:08.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.683+0000 7f3a1a59c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3a1c149190 0x7f3a1c0ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:08.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.683+0000 7f3a1ad9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3a1c152590 0x7f3a1c152970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34614/0 (socket says 172.21.15.29:34614) 2024-01-25T15:05:08.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.683+0000 7f3a1ad9d640 1 -- 172.21.15.29:0/1525843637 learned_addr learned my addr 172.21.15.29:0/1525843637 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:08.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.683+0000 7f3a1a59c640 1 -- 172.21.15.29:0/1525843637 >> v1:172.21.15.52:6789/0 conn(0x7f3a1c070510 legacy=0x7f3a1c0c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:08.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.683+0000 7f3a1a59c640 1 -- 172.21.15.29:0/1525843637 >> v1:172.21.15.29:6789/0 conn(0x7f3a1c152590 legacy=0x7f3a1c152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:08.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.683+0000 7f3a19d9b640 1 -- 172.21.15.29:0/1525843637 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 343064060 0 0) 0x7f3a1c070d40 con 0x7f3a1c152590 2024-01-25T15:05:08.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.683+0000 7f3a1a59c640 1 -- 172.21.15.29:0/1525843637 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c155ee0 con 0x7f3a1c149190 2024-01-25T15:05:08.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.684+0000 7f3a1a59c640 1 --2- 172.21.15.29:0/1525843637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a1c149190 0x7f3a1c0ad0b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c1531c0 tx=0x7f3a0c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8257e9e6adfbc3 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:08.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.684+0000 7f3a19d9b640 1 -- 172.21.15.29:0/1525843637 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c030610 con 0x7f3a1c149190 2024-01-25T15:05:08.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.684+0000 7f3a19d9b640 1 -- 172.21.15.29:0/1525843637 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c030770 con 0x7f3a1c149190 2024-01-25T15:05:08.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.684+0000 7f3a19d9b640 1 -- 172.21.15.29:0/1525843637 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c030b00 con 0x7f3a1c149190 2024-01-25T15:05:08.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.685+0000 7f3a20eec640 1 -- 172.21.15.29:0/1525843637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a1c149190 msgr2=0x7f3a1c0ad0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:08.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.685+0000 7f3a20eec640 1 --2- 172.21.15.29:0/1525843637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a1c149190 0x7f3a1c0ad0b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c1531c0 tx=0x7f3a0c02b960 comp rx=0 tx=0).stop 2024-01-25T15:05:08.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.685+0000 7f3a20eec640 1 -- 172.21.15.29:0/1525843637 shutdown_connections 2024-01-25T15:05:08.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.685+0000 7f3a20eec640 1 --2- 172.21.15.29:0/1525843637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a1c149190 0x7f3a1c0ad0b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.685+0000 7f3a20eec640 1 -- 172.21.15.29:0/1525843637 >> 172.21.15.29:0/1525843637 conn(0x7f3a1c0c7f80 msgr2=0x7f3a1c0c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:08.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.685+0000 7f3a20eec640 1 -- 172.21.15.29:0/1525843637 shutdown_connections 2024-01-25T15:05:08.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.685+0000 7f3a20eec640 1 -- 172.21.15.29:0/1525843637 wait complete. 2024-01-25T15:05:08.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.686+0000 7f3a20eec640 1 Processor -- start 2024-01-25T15:05:08.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.686+0000 7f3a20eec640 1 -- start start 2024-01-25T15:05:08.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.687+0000 7f3a20eec640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a1c070510 0x7f3a1c1df3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:08.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.687+0000 7f3a20eec640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a1c149190 0x7f3a1c14d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:08.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.687+0000 7f3a20eec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a1c152590 0x7f3a1c1e89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:08.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.687+0000 7f3a20eec640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c14a850 con 0x7f3a1c149190 2024-01-25T15:05:08.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.687+0000 7f3a20eec640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c1e85a0 con 0x7f3a1c152590 2024-01-25T15:05:08.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.687+0000 7f3a20eec640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c1462f0 con 0x7f3a1c070510 2024-01-25T15:05:08.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.687+0000 7f3a13fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a1c149190 0x7f3a1c14d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:08.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.687+0000 7f3a13fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a1c149190 0x7f3a1c14d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55612/0 (socket says 172.21.15.29:55612) 2024-01-25T15:05:08.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.687+0000 7f3a13fff640 1 -- 172.21.15.29:0/807779874 learned_addr learned my addr 172.21.15.29:0/807779874 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:08.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.687+0000 7f3a1ad9d640 1 --2- 172.21.15.29:0/807779874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a1c152590 0x7f3a1c1e89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:08.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.687+0000 7f3a1a59c640 1 --2- 172.21.15.29:0/807779874 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a1c070510 0x7f3a1c1df3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:08.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.687+0000 7f3a13fff640 1 -- 172.21.15.29:0/807779874 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a1c070510 msgr2=0x7f3a1c1df3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:08.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.687+0000 7f3a13fff640 1 --2- 172.21.15.29:0/807779874 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a1c070510 0x7f3a1c1df3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.687+0000 7f3a13fff640 1 -- 172.21.15.29:0/807779874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a1c152590 msgr2=0x7f3a1c1e89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:08.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.687+0000 7f3a13fff640 1 --2- 172.21.15.29:0/807779874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a1c152590 0x7f3a1c1e89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.687+0000 7f3a13fff640 1 -- 172.21.15.29:0/807779874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c009400 con 0x7f3a1c149190 2024-01-25T15:05:08.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.688+0000 7f3a13fff640 1 --2- 172.21.15.29:0/807779874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a1c149190 0x7f3a1c14d560 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400c400 tx=0x7f3a0400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:08.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.688+0000 7f3a12ffd640 1 -- 172.21.15.29:0/807779874 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a040052d0 con 0x7f3a1c149190 2024-01-25T15:05:08.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.688+0000 7f3a12ffd640 1 -- 172.21.15.29:0/807779874 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a04005430 con 0x7f3a1c149190 2024-01-25T15:05:08.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.688+0000 7f3a20eec640 1 -- 172.21.15.29:0/807779874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1c149d60 con 0x7f3a1c149190 2024-01-25T15:05:08.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.688+0000 7f3a12ffd640 1 -- 172.21.15.29:0/807779874 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a04003830 con 0x7f3a1c149190 2024-01-25T15:05:08.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.688+0000 7f3a20eec640 1 -- 172.21.15.29:0/807779874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1c14a290 con 0x7f3a1c149190 2024-01-25T15:05:08.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.689+0000 7f3a20eec640 1 -- 172.21.15.29:0/807779874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1c1523b0 con 0x7f3a1c149190 2024-01-25T15:05:08.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.689+0000 7f3a12ffd640 1 -- 172.21.15.29:0/807779874 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f3a04003990 con 0x7f3a1c149190 2024-01-25T15:05:08.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.690+0000 7f3a12ffd640 1 --2- 172.21.15.29:0/807779874 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f39fc06aed0 0x7f39fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:08.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.690+0000 7f3a12ffd640 1 -- 172.21.15.29:0/807779874 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3a04088f90 con 0x7f3a1c149190 2024-01-25T15:05:08.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.690+0000 7f3a1a59c640 1 --2- 172.21.15.29:0/807779874 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f39fc06aed0 0x7f39fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:08.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.690+0000 7f3a1a59c640 1 --2- 172.21.15.29:0/807779874 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f39fc06aed0 0x7f39fc06d390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c036000 tx=0x7f3a0c03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:08.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.694+0000 7f3a12ffd640 1 -- 172.21.15.29:0/807779874 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f3a040bc190 con 0x7f3a1c149190 2024-01-25T15:05:08.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.875+0000 7f3a20eec640 1 -- 172.21.15.29:0/807779874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a1c1e8290 con 0x7f3a1c149190 2024-01-25T15:05:08.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.875+0000 7f3a12ffd640 1 -- 172.21.15.29:0/807779874 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a040170a0 con 0x7f3a1c149190 2024-01-25T15:05:08.876 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-25T15:05:08.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.877+0000 7f3a20eec640 1 -- 172.21.15.29:0/807779874 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f39fc06aed0 msgr2=0x7f39fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:08.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.877+0000 7f3a20eec640 1 --2- 172.21.15.29:0/807779874 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f39fc06aed0 0x7f39fc06d390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c036000 tx=0x7f3a0c03b040 comp rx=0 tx=0).stop 2024-01-25T15:05:08.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.877+0000 7f3a20eec640 1 -- 172.21.15.29:0/807779874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a1c149190 msgr2=0x7f3a1c14d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:08.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.877+0000 7f3a20eec640 1 --2- 172.21.15.29:0/807779874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a1c149190 0x7f3a1c14d560 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400c400 tx=0x7f3a0400c8c0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.877+0000 7f3a20eec640 1 -- 172.21.15.29:0/807779874 shutdown_connections 2024-01-25T15:05:08.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.877+0000 7f3a20eec640 1 --2- 172.21.15.29:0/807779874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a1c152590 0x7f3a1c1e89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.877+0000 7f3a20eec640 1 --2- 172.21.15.29:0/807779874 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f39fc06aed0 0x7f39fc06d390 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.877+0000 7f3a20eec640 1 --2- 172.21.15.29:0/807779874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a1c149190 0x7f3a1c14d560 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.877+0000 7f3a20eec640 1 --2- 172.21.15.29:0/807779874 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a1c070510 0x7f3a1c1df3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.877+0000 7f3a20eec640 1 -- 172.21.15.29:0/807779874 >> 172.21.15.29:0/807779874 conn(0x7f3a1c0c7f80 msgr2=0x7f3a1c153960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:08.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.877+0000 7f3a20eec640 1 -- 172.21.15.29:0/807779874 shutdown_connections 2024-01-25T15:05:08.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.877+0000 7f3a20eec640 1 -- 172.21.15.29:0/807779874 wait complete. 2024-01-25T15:05:08.888 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:05:08.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.994+0000 7f094f141640 1 Processor -- start 2024-01-25T15:05:08.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.994+0000 7f094f141640 1 -- start start 2024-01-25T15:05:08.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.995+0000 7f094f141640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0948151d80 0x7f0948155120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:08.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.995+0000 7f094f141640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f094806b710 0x7f09480c6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:08.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.995+0000 7f094f141640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09480c58c0 con 0x7f094806b2b0 2024-01-25T15:05:08.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.995+0000 7f094f141640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f094806c0a0 con 0x7f094806b710 2024-01-25T15:05:08.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.995+0000 7f094f141640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09480c7f10 con 0x7f0948151d80 2024-01-25T15:05:08.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.995+0000 7f0947fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f094806b2b0 0x7f09480c5d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34626/0 (socket says 172.21.15.29:34626) 2024-01-25T15:05:08.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.995+0000 7f0947fff640 1 -- 172.21.15.29:0/3508954988 learned_addr learned my addr 172.21.15.29:0/3508954988 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:08.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.995+0000 7f094cedd640 1 --2- 172.21.15.29:0/3508954988 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0948151d80 0x7f0948155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:08.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.995+0000 7f09477fe640 1 -- 172.21.15.29:0/3508954988 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277033234 0 0) 0x7f09480c58c0 con 0x7f094806b2b0 2024-01-25T15:05:08.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.995+0000 7f094d6de640 1 --2- 172.21.15.29:0/3508954988 >> v2:172.21.15.52:3300/0 conn(0x7f094806b710 0x7f09480c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:08.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.995+0000 7f09477fe640 1 -- 172.21.15.29:0/3508954988 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0930003520 con 0x7f094806b2b0 2024-01-25T15:05:08.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.996+0000 7f09477fe640 1 -- 172.21.15.29:0/3508954988 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2809211521 0 0) 0x7f0930003520 con 0x7f094806b2b0 2024-01-25T15:05:08.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.996+0000 7f09477fe640 1 -- 172.21.15.29:0/3508954988 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0948151d80 msgr2=0x7f0948155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:08.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.996+0000 7f09477fe640 1 --2- 172.21.15.29:0/3508954988 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0948151d80 0x7f0948155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.996+0000 7f09477fe640 1 -- 172.21.15.29:0/3508954988 >> v2:172.21.15.52:3300/0 conn(0x7f094806b710 msgr2=0x7f09480c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:08.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.996+0000 7f09477fe640 1 --2- 172.21.15.29:0/3508954988 >> v2:172.21.15.52:3300/0 conn(0x7f094806b710 0x7f09480c6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:08.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.996+0000 7f09477fe640 1 -- 172.21.15.29:0/3508954988 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09480c4990 con 0x7f094806b2b0 2024-01-25T15:05:08.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.996+0000 7f09477fe640 1 -- 172.21.15.29:0/3508954988 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f093c001670 con 0x7f094806b2b0 2024-01-25T15:05:08.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.996+0000 7f09477fe640 1 -- 172.21.15.29:0/3508954988 >> v1:172.21.15.29:6789/0 conn(0x7f094806b2b0 legacy=0x7f09480c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.996+0000 7f09477fe640 1 --2- 172.21.15.29:0/3508954988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0930003a10 0x7f0930003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.996+0000 7f09477fe640 1 --2- 172.21.15.29:0/3508954988 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0948151d80 0x7f09300047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.996+0000 7f09477fe640 1 --2- 172.21.15.29:0/3508954988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0930004d00 0x7f0930005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.996+0000 7f09477fe640 1 -- 172.21.15.29:0/3508954988 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093000b980 con 0x7f0930004d00 2024-01-25T15:05:09.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.996+0000 7f09477fe640 1 -- 172.21.15.29:0/3508954988 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093000bac0 con 0x7f0930003a10 2024-01-25T15:05:09.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.996+0000 7f09477fe640 1 -- 172.21.15.29:0/3508954988 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093000bc80 con 0x7f0948151d80 2024-01-25T15:05:09.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.996+0000 7f094d6de640 1 --2- 172.21.15.29:0/3508954988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0930004d00 0x7f0930005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.996+0000 7f094cedd640 1 --2- 172.21.15.29:0/3508954988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0930003a10 0x7f0930003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.996+0000 7f0947fff640 1 --2- 172.21.15.29:0/3508954988 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0948151d80 0x7f09300047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.996+0000 7f094d6de640 1 -- 172.21.15.29:0/3508954988 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0948151d80 msgr2=0x7f09300047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:09.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.996+0000 7f094d6de640 1 --2- 172.21.15.29:0/3508954988 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0948151d80 0x7f09300047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.996+0000 7f094d6de640 1 -- 172.21.15.29:0/3508954988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0930003a10 msgr2=0x7f0930003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:09.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.996+0000 7f094d6de640 1 --2- 172.21.15.29:0/3508954988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0930003a10 0x7f0930003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.996+0000 7f094d6de640 1 -- 172.21.15.29:0/3508954988 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0930003520 con 0x7f0930004d00 2024-01-25T15:05:09.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.997+0000 7f094d6de640 1 --2- 172.21.15.29:0/3508954988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0930004d00 0x7f0930005180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0938009ac0 tx=0x7f09300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1b4abf0b26bc1d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:09.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.997+0000 7f09477fe640 1 -- 172.21.15.29:0/3508954988 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093802c710 con 0x7f0930004d00 2024-01-25T15:05:09.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.997+0000 7f09477fe640 1 -- 172.21.15.29:0/3508954988 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093802c870 con 0x7f0930004d00 2024-01-25T15:05:09.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.997+0000 7f09477fe640 1 -- 172.21.15.29:0/3508954988 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093802cc00 con 0x7f0930004d00 2024-01-25T15:05:09.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.997+0000 7f094f141640 1 -- 172.21.15.29:0/3508954988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0930004d00 msgr2=0x7f0930005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.997+0000 7f094f141640 1 --2- 172.21.15.29:0/3508954988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0930004d00 0x7f0930005180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0938009ac0 tx=0x7f09300057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.997+0000 7f094d6de640 1 -- 172.21.15.29:0/3508954988 reap_dead start 2024-01-25T15:05:09.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.997+0000 7f094f141640 1 -- 172.21.15.29:0/3508954988 shutdown_connections 2024-01-25T15:05:09.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.998+0000 7f094f141640 1 -- 172.21.15.29:0/3508954988 >> 172.21.15.29:0/3508954988 conn(0x7f09480ca1f0 msgr2=0x7f09480ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:09.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.998+0000 7f094f141640 1 -- 172.21.15.29:0/3508954988 shutdown_connections 2024-01-25T15:05:09.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.998+0000 7f094f141640 1 -- 172.21.15.29:0/3508954988 wait complete. 2024-01-25T15:05:09.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.999+0000 7f094f141640 1 Processor -- start 2024-01-25T15:05:09.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.999+0000 7f094f141640 1 -- start start 2024-01-25T15:05:09.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.999+0000 7f094f141640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09480c8de0 0x7f0948153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.999+0000 7f094f141640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09481ea550 0x7f09481ed950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.999+0000 7f094f141640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0948149210 0x7f0948149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.999+0000 7f094f141640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09481ed4c0 con 0x7f0948149210 2024-01-25T15:05:09.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.999+0000 7f094f141640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0948152e40 con 0x7f09480c8de0 2024-01-25T15:05:09.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:08.999+0000 7f094f141640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09481ed190 con 0x7f09481ea550 2024-01-25T15:05:09.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.000+0000 7f094d6de640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0948149210 0x7f0948149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.000+0000 7f094d6de640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0948149210 0x7f0948149690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55626/0 (socket says 172.21.15.29:55626) 2024-01-25T15:05:09.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.000+0000 7f094d6de640 1 -- 172.21.15.29:0/444262813 learned_addr learned my addr 172.21.15.29:0/444262813 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:09.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.000+0000 7f0947fff640 1 --2- 172.21.15.29:0/444262813 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09481ea550 0x7f09481ed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.000+0000 7f094cedd640 1 --2- 172.21.15.29:0/444262813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09480c8de0 0x7f0948153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.000+0000 7f094d6de640 1 -- 172.21.15.29:0/444262813 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09481ea550 msgr2=0x7f09481ed950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.000+0000 7f094d6de640 1 --2- 172.21.15.29:0/444262813 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09481ea550 0x7f09481ed950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.000+0000 7f094d6de640 1 -- 172.21.15.29:0/444262813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09480c8de0 msgr2=0x7f0948153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.000+0000 7f094d6de640 1 --2- 172.21.15.29:0/444262813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09480c8de0 0x7f0948153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.000+0000 7f094d6de640 1 -- 172.21.15.29:0/444262813 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0948152880 con 0x7f0948149210 2024-01-25T15:05:09.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.000+0000 7f094cedd640 1 --2- 172.21.15.29:0/444262813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09480c8de0 0x7f0948153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:09.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.000+0000 7f094d6de640 1 --2- 172.21.15.29:0/444262813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0948149210 0x7f0948149690 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0938009ac0 tx=0x7f0938004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:09.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.000+0000 7f09457fa640 1 -- 172.21.15.29:0/444262813 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093802c710 con 0x7f0948149210 2024-01-25T15:05:09.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.000+0000 7f09457fa640 1 -- 172.21.15.29:0/444262813 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0938003810 con 0x7f0948149210 2024-01-25T15:05:09.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.000+0000 7f09457fa640 1 -- 172.21.15.29:0/444262813 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938003bc0 con 0x7f0948149210 2024-01-25T15:05:09.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.000+0000 7f094f141640 1 -- 172.21.15.29:0/444262813 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0948152b60 con 0x7f0948149210 2024-01-25T15:05:09.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.000+0000 7f094f141640 1 -- 172.21.15.29:0/444262813 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0948149bd0 con 0x7f0948149210 2024-01-25T15:05:09.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.001+0000 7f094f141640 1 -- 172.21.15.29:0/444262813 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0948074010 con 0x7f0948149210 2024-01-25T15:05:09.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.002+0000 7f09457fa640 1 -- 172.21.15.29:0/444262813 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0938003d20 con 0x7f0948149210 2024-01-25T15:05:09.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.002+0000 7f09457fa640 1 --2- 172.21.15.29:0/444262813 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f093406af00 0x7f093406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.002+0000 7f09457fa640 1 -- 172.21.15.29:0/444262813 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f09380ab080 con 0x7f0948149210 2024-01-25T15:05:09.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.002+0000 7f094cedd640 1 --2- 172.21.15.29:0/444262813 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f093406af00 0x7f093406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.003+0000 7f094cedd640 1 --2- 172.21.15.29:0/444262813 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f093406af00 0x7f093406d3c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0940007520 tx=0x7f094000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:09.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.006+0000 7f09457fa640 1 -- 172.21.15.29:0/444262813 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f0938075c00 con 0x7f0948149210 2024-01-25T15:05:09.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.183+0000 7f094f141640 1 -- 172.21.15.29:0/444262813 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f09480c9ae0 con 0x7f0948149210 2024-01-25T15:05:09.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.184+0000 7f09457fa640 1 -- 172.21.15.29:0/444262813 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0938079220 con 0x7f0948149210 2024-01-25T15:05:09.185 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:09.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.185+0000 7f094f141640 1 -- 172.21.15.29:0/444262813 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f093406af00 msgr2=0x7f093406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.185+0000 7f094f141640 1 --2- 172.21.15.29:0/444262813 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f093406af00 0x7f093406d3c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0940007520 tx=0x7f094000b040 comp rx=0 tx=0).stop 2024-01-25T15:05:09.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.186+0000 7f094f141640 1 -- 172.21.15.29:0/444262813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0948149210 msgr2=0x7f0948149690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.186+0000 7f094f141640 1 --2- 172.21.15.29:0/444262813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0948149210 0x7f0948149690 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0938009ac0 tx=0x7f0938004730 comp rx=0 tx=0).stop 2024-01-25T15:05:09.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.186+0000 7f094f141640 1 -- 172.21.15.29:0/444262813 shutdown_connections 2024-01-25T15:05:09.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.186+0000 7f094f141640 1 --2- 172.21.15.29:0/444262813 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f093406af00 0x7f093406d3c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.186+0000 7f094f141640 1 --2- 172.21.15.29:0/444262813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0948149210 0x7f0948149690 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.186+0000 7f094f141640 1 --2- 172.21.15.29:0/444262813 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f09481ea550 0x7f09481ed950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.186+0000 7f094f141640 1 --2- 172.21.15.29:0/444262813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09480c8de0 0x7f0948153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.186+0000 7f094f141640 1 -- 172.21.15.29:0/444262813 >> 172.21.15.29:0/444262813 conn(0x7f09480ca1f0 msgr2=0x7f09480c5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:09.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.186+0000 7f094f141640 1 -- 172.21.15.29:0/444262813 shutdown_connections 2024-01-25T15:05:09.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.186+0000 7f094f141640 1 -- 172.21.15.29:0/444262813 wait complete. 2024-01-25T15:05:09.197 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:05:09.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.302+0000 7ff00f3d0640 1 Processor -- start 2024-01-25T15:05:09.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.302+0000 7ff00f3d0640 1 -- start start 2024-01-25T15:05:09.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.302+0000 7ff00f3d0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff0080abcf0 0x7ff0080ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.302+0000 7ff00f3d0640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff008154fd0 con 0x7ff00806dbc0 2024-01-25T15:05:09.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.302+0000 7ff00f3d0640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff008071da0 con 0x7ff008154090 2024-01-25T15:05:09.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.302+0000 7ff00f3d0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0080a9540 con 0x7ff0080abcf0 2024-01-25T15:05:09.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.303+0000 7ff00c96b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff0080abcf0 0x7ff0080ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.303+0000 7ff00d96d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff00806dbc0 0x7ff00806e030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34628/0 (socket says 172.21.15.29:34628) 2024-01-25T15:05:09.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.303+0000 7ff00d96d640 1 -- 172.21.15.29:0/1650291537 learned_addr learned my addr 172.21.15.29:0/1650291537 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:09.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.303+0000 7ff00c96b640 1 -- 172.21.15.29:0/1650291537 >> v1:172.21.15.52:6789/0 conn(0x7ff008154090 legacy=0x7ff008154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.303+0000 7ff00c96b640 1 -- 172.21.15.29:0/1650291537 >> v1:172.21.15.29:6789/0 conn(0x7ff00806dbc0 legacy=0x7ff00806e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.303+0000 7ff00c96b640 1 -- 172.21.15.29:0/1650291537 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff008072760 con 0x7ff0080abcf0 2024-01-25T15:05:09.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.303+0000 7ff007fff640 1 -- 172.21.15.29:0/1650291537 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392070581 0 0) 0x7ff008154fd0 con 0x7ff00806dbc0 2024-01-25T15:05:09.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.304+0000 7ff00c96b640 1 --2- 172.21.15.29:0/1650291537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0080abcf0 0x7ff0080ab6a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7feffc0097d0 tx=0x7feffc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eeb869175f2c285 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:09.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.304+0000 7ff007fff640 1 -- 172.21.15.29:0/1650291537 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc02e070 con 0x7ff0080abcf0 2024-01-25T15:05:09.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.304+0000 7ff007fff640 1 -- 172.21.15.29:0/1650291537 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feffc0315a0 con 0x7ff0080abcf0 2024-01-25T15:05:09.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.304+0000 7ff007fff640 1 -- 172.21.15.29:0/1650291537 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc031930 con 0x7ff0080abcf0 2024-01-25T15:05:09.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.304+0000 7ff00f3d0640 1 -- 172.21.15.29:0/1650291537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0080abcf0 msgr2=0x7ff0080ab6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.304+0000 7ff00f3d0640 1 --2- 172.21.15.29:0/1650291537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0080abcf0 0x7ff0080ab6a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7feffc0097d0 tx=0x7feffc02b840 comp rx=0 tx=0).stop 2024-01-25T15:05:09.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.304+0000 7ff00f3d0640 1 -- 172.21.15.29:0/1650291537 shutdown_connections 2024-01-25T15:05:09.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.304+0000 7ff00f3d0640 1 --2- 172.21.15.29:0/1650291537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0080abcf0 0x7ff0080ab6a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.304+0000 7ff00f3d0640 1 -- 172.21.15.29:0/1650291537 >> 172.21.15.29:0/1650291537 conn(0x7ff0080c2a10 msgr2=0x7ff0080c2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:09.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.304+0000 7ff00f3d0640 1 -- 172.21.15.29:0/1650291537 shutdown_connections 2024-01-25T15:05:09.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.304+0000 7ff00f3d0640 1 -- 172.21.15.29:0/1650291537 wait complete. 2024-01-25T15:05:09.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.306+0000 7ff00f3d0640 1 Processor -- start 2024-01-25T15:05:09.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.306+0000 7ff00f3d0640 1 -- start start 2024-01-25T15:05:09.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.306+0000 7ff00f3d0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff00806dbc0 0x7ff0081384d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.306+0000 7ff00f3d0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff0080abcf0 0x7ff008153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.306+0000 7ff00f3d0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff008154090 0x7ff0081ed470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.306+0000 7ff00f3d0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0081429c0 con 0x7ff008154090 2024-01-25T15:05:09.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.306+0000 7ff00f3d0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0080c46f0 con 0x7ff00806dbc0 2024-01-25T15:05:09.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.306+0000 7ff00f3d0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0081421b0 con 0x7ff0080abcf0 2024-01-25T15:05:09.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.306+0000 7ff00d96d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff008154090 0x7ff0081ed470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.306+0000 7ff00d96d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff008154090 0x7ff0081ed470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55638/0 (socket says 172.21.15.29:55638) 2024-01-25T15:05:09.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.306+0000 7ff00d96d640 1 -- 172.21.15.29:0/2092869653 learned_addr learned my addr 172.21.15.29:0/2092869653 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:09.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.307+0000 7ff00d16c640 1 --2- 172.21.15.29:0/2092869653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff00806dbc0 0x7ff0081384d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.307+0000 7ff00c96b640 1 --2- 172.21.15.29:0/2092869653 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff0080abcf0 0x7ff008153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.307+0000 7ff00d96d640 1 -- 172.21.15.29:0/2092869653 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff0080abcf0 msgr2=0x7ff008153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.307+0000 7ff00d96d640 1 --2- 172.21.15.29:0/2092869653 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff0080abcf0 0x7ff008153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.307+0000 7ff00d96d640 1 -- 172.21.15.29:0/2092869653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff00806dbc0 msgr2=0x7ff0081384d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.307+0000 7ff00d96d640 1 --2- 172.21.15.29:0/2092869653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff00806dbc0 0x7ff0081384d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.307+0000 7ff00d96d640 1 -- 172.21.15.29:0/2092869653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc009400 con 0x7ff008154090 2024-01-25T15:05:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.307+0000 7ff00d16c640 1 --2- 172.21.15.29:0/2092869653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff00806dbc0 0x7ff0081384d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.307+0000 7ff00d96d640 1 --2- 172.21.15.29:0/2092869653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff008154090 0x7ff0081ed470 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7feff800c730 tx=0x7feff800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.307+0000 7ff005ffb640 1 -- 172.21.15.29:0/2092869653 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff800ce40 con 0x7ff008154090 2024-01-25T15:05:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.307+0000 7ff00f3d0640 1 -- 172.21.15.29:0/2092869653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0080c4c90 con 0x7ff008154090 2024-01-25T15:05:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.307+0000 7ff005ffb640 1 -- 172.21.15.29:0/2092869653 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff800a640 con 0x7ff008154090 2024-01-25T15:05:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.307+0000 7ff005ffb640 1 -- 172.21.15.29:0/2092869653 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff800a9f0 con 0x7ff008154090 2024-01-25T15:05:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.307+0000 7ff00f3d0640 1 -- 172.21.15.29:0/2092869653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff008142400 con 0x7ff008154090 2024-01-25T15:05:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.308+0000 7ff00f3d0640 1 -- 172.21.15.29:0/2092869653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff008067be0 con 0x7ff008154090 2024-01-25T15:05:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.309+0000 7ff005ffb640 1 -- 172.21.15.29:0/2092869653 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7feff800ab50 con 0x7ff008154090 2024-01-25T15:05:09.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.309+0000 7ff005ffb640 1 --2- 172.21.15.29:0/2092869653 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7feff406aed0 0x7feff406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.309+0000 7ff005ffb640 1 -- 172.21.15.29:0/2092869653 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7feff80891b0 con 0x7ff008154090 2024-01-25T15:05:09.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.309+0000 7ff00d16c640 1 --2- 172.21.15.29:0/2092869653 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7feff406aed0 0x7feff406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.310+0000 7ff00d16c640 1 --2- 172.21.15.29:0/2092869653 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7feff406aed0 0x7feff406d390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff000007fd0 tx=0x7ff000009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:09.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.313+0000 7ff005ffb640 1 -- 172.21.15.29:0/2092869653 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7feff8053ca0 con 0x7ff008154090 2024-01-25T15:05:09.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.491+0000 7ff00f3d0640 1 -- 172.21.15.29:0/2092869653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff0080c4e20 con 0x7ff008154090 2024-01-25T15:05:09.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.492+0000 7ff005ffb640 1 -- 172.21.15.29:0/2092869653 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7feff80572c0 con 0x7ff008154090 2024-01-25T15:05:09.493 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-25T15:05:09.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.494+0000 7ff00f3d0640 1 -- 172.21.15.29:0/2092869653 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7feff406aed0 msgr2=0x7feff406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.494+0000 7ff00f3d0640 1 --2- 172.21.15.29:0/2092869653 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7feff406aed0 0x7feff406d390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff000007fd0 tx=0x7ff000009040 comp rx=0 tx=0).stop 2024-01-25T15:05:09.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.494+0000 7ff00f3d0640 1 -- 172.21.15.29:0/2092869653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff008154090 msgr2=0x7ff0081ed470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.494+0000 7ff00f3d0640 1 --2- 172.21.15.29:0/2092869653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff008154090 0x7ff0081ed470 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7feff800c730 tx=0x7feff800cbf0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.494+0000 7ff00f3d0640 1 -- 172.21.15.29:0/2092869653 shutdown_connections 2024-01-25T15:05:09.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.494+0000 7ff00f3d0640 1 --2- 172.21.15.29:0/2092869653 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7feff406aed0 0x7feff406d390 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.494+0000 7ff00f3d0640 1 --2- 172.21.15.29:0/2092869653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff008154090 0x7ff0081ed470 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.494+0000 7ff00f3d0640 1 --2- 172.21.15.29:0/2092869653 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff0080abcf0 0x7ff008153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.494+0000 7ff00f3d0640 1 --2- 172.21.15.29:0/2092869653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff00806dbc0 0x7ff0081384d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.494+0000 7ff00f3d0640 1 -- 172.21.15.29:0/2092869653 >> 172.21.15.29:0/2092869653 conn(0x7ff0080c2a10 msgr2=0x7ff0080ab490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:09.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.494+0000 7ff00f3d0640 1 -- 172.21.15.29:0/2092869653 shutdown_connections 2024-01-25T15:05:09.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.494+0000 7ff00f3d0640 1 -- 172.21.15.29:0/2092869653 wait complete. 2024-01-25T15:05:09.505 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-25T15:05:09.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.609+0000 7f400792c640 1 Processor -- start 2024-01-25T15:05:09.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.609+0000 7f400792c640 1 -- start start 2024-01-25T15:05:09.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.610+0000 7f400792c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4000151d80 0x7f40000c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.610+0000 7f400792c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f400006c370 0x7f40000c4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.610+0000 7f400792c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f400006bee0 con 0x7f4000155210 2024-01-25T15:05:09.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.610+0000 7f400792c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40000c7400 con 0x7f4000151d80 2024-01-25T15:05:09.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.610+0000 7f400792c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400006b8d0 con 0x7f400006c370 2024-01-25T15:05:09.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.610+0000 7f40056c8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4000151d80 0x7f40000c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.610+0000 7f4004ec7640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4000155210 0x7f40000c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34630/0 (socket says 172.21.15.29:34630) 2024-01-25T15:05:09.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.610+0000 7f4004ec7640 1 -- 172.21.15.29:0/2989272372 learned_addr learned my addr 172.21.15.29:0/2989272372 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:09.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.610+0000 7f4005ec9640 1 --2- 172.21.15.29:0/2989272372 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f400006c370 0x7f40000c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.610+0000 7f40056c8640 1 -- 172.21.15.29:0/2989272372 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f400006c370 msgr2=0x7f40000c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:09.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.610+0000 7f40056c8640 1 --2- 172.21.15.29:0/2989272372 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f400006c370 0x7f40000c4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.610+0000 7f40056c8640 1 -- 172.21.15.29:0/2989272372 >> v1:172.21.15.29:6789/0 conn(0x7f4000155210 legacy=0x7f40000c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.610+0000 7f40056c8640 1 -- 172.21.15.29:0/2989272372 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40000c7120 con 0x7f4000151d80 2024-01-25T15:05:09.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.610+0000 7f3ffffff640 1 -- 172.21.15.29:0/2989272372 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272396550 0 0) 0x7f400006bee0 con 0x7f4000155210 2024-01-25T15:05:09.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.611+0000 7f40056c8640 1 --2- 172.21.15.29:0/2989272372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4000151d80 0x7f40000c6a20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80097a0 tx=0x7f3ff802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f97ce08d075377 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:09.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.611+0000 7f3ffffff640 1 -- 172.21.15.29:0/2989272372 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff802e070 con 0x7f4000151d80 2024-01-25T15:05:09.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.611+0000 7f3ffffff640 1 -- 172.21.15.29:0/2989272372 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff80315a0 con 0x7f4000151d80 2024-01-25T15:05:09.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.611+0000 7f3ffffff640 1 -- 172.21.15.29:0/2989272372 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8031930 con 0x7f4000151d80 2024-01-25T15:05:09.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.612+0000 7f400792c640 1 -- 172.21.15.29:0/2989272372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4000151d80 msgr2=0x7f40000c6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.612+0000 7f400792c640 1 --2- 172.21.15.29:0/2989272372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4000151d80 0x7f40000c6a20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80097a0 tx=0x7f3ff802b840 comp rx=0 tx=0).stop 2024-01-25T15:05:09.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.612+0000 7f400792c640 1 -- 172.21.15.29:0/2989272372 shutdown_connections 2024-01-25T15:05:09.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.612+0000 7f400792c640 1 --2- 172.21.15.29:0/2989272372 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f400006c370 0x7f40000c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.612+0000 7f400792c640 1 --2- 172.21.15.29:0/2989272372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4000151d80 0x7f40000c6a20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.612+0000 7f400792c640 1 -- 172.21.15.29:0/2989272372 >> 172.21.15.29:0/2989272372 conn(0x7f40000abd80 msgr2=0x7f40000ac190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:09.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.612+0000 7f400792c640 1 -- 172.21.15.29:0/2989272372 shutdown_connections 2024-01-25T15:05:09.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.612+0000 7f400792c640 1 -- 172.21.15.29:0/2989272372 wait complete. 2024-01-25T15:05:09.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.613+0000 7f400792c640 1 Processor -- start 2024-01-25T15:05:09.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.613+0000 7f400792c640 1 -- start start 2024-01-25T15:05:09.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.614+0000 7f400792c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f400006c370 0x7f40001ed790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.614+0000 7f400792c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4000151d80 0x7f40001edcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.614+0000 7f400792c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4000155210 0x7f40001e70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.614+0000 7f400792c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40000ad000 con 0x7f4000155210 2024-01-25T15:05:09.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.614+0000 7f400792c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40001ebd50 con 0x7f400006c370 2024-01-25T15:05:09.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.614+0000 7f400792c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40000c3c80 con 0x7f4000151d80 2024-01-25T15:05:09.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.614+0000 7f4005ec9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4000155210 0x7f40001e70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.614+0000 7f4005ec9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4000155210 0x7f40001e70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55660/0 (socket says 172.21.15.29:55660) 2024-01-25T15:05:09.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.614+0000 7f4005ec9640 1 -- 172.21.15.29:0/563844559 learned_addr learned my addr 172.21.15.29:0/563844559 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:09.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.614+0000 7f40056c8640 1 --2- 172.21.15.29:0/563844559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f400006c370 0x7f40001ed790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.614+0000 7f4004ec7640 1 --2- 172.21.15.29:0/563844559 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4000151d80 0x7f40001edcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.614+0000 7f4005ec9640 1 -- 172.21.15.29:0/563844559 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4000151d80 msgr2=0x7f40001edcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.614+0000 7f4005ec9640 1 --2- 172.21.15.29:0/563844559 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4000151d80 0x7f40001edcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.614+0000 7f4005ec9640 1 -- 172.21.15.29:0/563844559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f400006c370 msgr2=0x7f40001ed790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.614+0000 7f4005ec9640 1 --2- 172.21.15.29:0/563844559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f400006c370 0x7f40001ed790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.614+0000 7f4005ec9640 1 -- 172.21.15.29:0/563844559 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff8009400 con 0x7f4000155210 2024-01-25T15:05:09.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.614+0000 7f4005ec9640 1 --2- 172.21.15.29:0/563844559 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4000155210 0x7f40001e70c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0007e90 tx=0x7f3ff000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:09.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.614+0000 7f3ffdffb640 1 -- 172.21.15.29:0/563844559 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0014420 con 0x7f4000155210 2024-01-25T15:05:09.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.614+0000 7f3ffdffb640 1 -- 172.21.15.29:0/563844559 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff0014580 con 0x7f4000155210 2024-01-25T15:05:09.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.614+0000 7f3ffdffb640 1 -- 172.21.15.29:0/563844559 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0014930 con 0x7f4000155210 2024-01-25T15:05:09.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.614+0000 7f400792c640 1 -- 172.21.15.29:0/563844559 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40001ee210 con 0x7f4000155210 2024-01-25T15:05:09.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.615+0000 7f400792c640 1 -- 172.21.15.29:0/563844559 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40001eb700 con 0x7f4000155210 2024-01-25T15:05:09.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.616+0000 7f400792c640 1 -- 172.21.15.29:0/563844559 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40000c9db0 con 0x7f4000155210 2024-01-25T15:05:09.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.616+0000 7f3ffdffb640 1 -- 172.21.15.29:0/563844559 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f3ff0014a90 con 0x7f4000155210 2024-01-25T15:05:09.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.616+0000 7f3ffdffb640 1 --2- 172.21.15.29:0/563844559 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3fec06af00 0x7f3fec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.616+0000 7f3ffdffb640 1 -- 172.21.15.29:0/563844559 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3ff008a170 con 0x7f4000155210 2024-01-25T15:05:09.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.617+0000 7f40056c8640 1 --2- 172.21.15.29:0/563844559 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3fec06af00 0x7f3fec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.617+0000 7f40056c8640 1 --2- 172.21.15.29:0/563844559 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3fec06af00 0x7f3fec06d3c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8036000 tx=0x7f3ff803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:09.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.621+0000 7f3ffdffb640 1 -- 172.21.15.29:0/563844559 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f3ff0054da0 con 0x7f4000155210 2024-01-25T15:05:09.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.800+0000 7f400792c640 1 -- 172.21.15.29:0/563844559 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4000074010 con 0x7f4000155210 2024-01-25T15:05:09.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.800+0000 7f3ffdffb640 1 -- 172.21.15.29:0/563844559 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3ff00583c0 con 0x7f4000155210 2024-01-25T15:05:09.801 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:09.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.802+0000 7f400792c640 1 -- 172.21.15.29:0/563844559 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3fec06af00 msgr2=0x7f3fec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.802+0000 7f400792c640 1 --2- 172.21.15.29:0/563844559 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3fec06af00 0x7f3fec06d3c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8036000 tx=0x7f3ff803d040 comp rx=0 tx=0).stop 2024-01-25T15:05:09.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.802+0000 7f400792c640 1 -- 172.21.15.29:0/563844559 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4000155210 msgr2=0x7f40001e70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.802+0000 7f400792c640 1 --2- 172.21.15.29:0/563844559 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4000155210 0x7f40001e70c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0007e90 tx=0x7f3ff000e4b0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.802+0000 7f400792c640 1 -- 172.21.15.29:0/563844559 shutdown_connections 2024-01-25T15:05:09.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.802+0000 7f400792c640 1 --2- 172.21.15.29:0/563844559 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3fec06af00 0x7f3fec06d3c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.802+0000 7f400792c640 1 --2- 172.21.15.29:0/563844559 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4000155210 0x7f40001e70c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.802+0000 7f400792c640 1 --2- 172.21.15.29:0/563844559 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4000151d80 0x7f40001edcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.802+0000 7f400792c640 1 --2- 172.21.15.29:0/563844559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f400006c370 0x7f40001ed790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.802+0000 7f400792c640 1 -- 172.21.15.29:0/563844559 >> 172.21.15.29:0/563844559 conn(0x7f40000abd80 msgr2=0x7f400014ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:09.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.802+0000 7f400792c640 1 -- 172.21.15.29:0/563844559 shutdown_connections 2024-01-25T15:05:09.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.802+0000 7f400792c640 1 -- 172.21.15.29:0/563844559 wait complete. 2024-01-25T15:05:09.814 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-25T15:05:09.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.915+0000 7f3e4751d640 1 Processor -- start 2024-01-25T15:05:09.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.915+0000 7f3e4751d640 1 -- start start 2024-01-25T15:05:09.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.916+0000 7f3e4751d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e400c48d0 0x7f3e400c6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.916+0000 7f3e4751d640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e40158120 con 0x7f3e40155190 2024-01-25T15:05:09.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.916+0000 7f3e4751d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e40155640 con 0x7f3e40151f80 2024-01-25T15:05:09.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.916+0000 7f3e4751d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e400c4db0 con 0x7f3e400c48d0 2024-01-25T15:05:09.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.916+0000 7f3e45aba640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3e40155190 0x7f3e400c74f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34636/0 (socket says 172.21.15.29:34636) 2024-01-25T15:05:09.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.916+0000 7f3e45aba640 1 -- 172.21.15.29:0/2857640364 learned_addr learned my addr 172.21.15.29:0/2857640364 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:09.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.916+0000 7f3e44ab8640 1 --2- 172.21.15.29:0/2857640364 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e400c48d0 0x7f3e400c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.916+0000 7f3e37fff640 1 -- 172.21.15.29:0/2857640364 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2342376765 0 0) 0x7f3e40158120 con 0x7f3e40155190 2024-01-25T15:05:09.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.916+0000 7f3e37fff640 1 -- 172.21.15.29:0/2857640364 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e2c003520 con 0x7f3e40155190 2024-01-25T15:05:09.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.916+0000 7f3e37fff640 1 -- 172.21.15.29:0/2857640364 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186305437 0 0) 0x7f3e40155640 con 0x7f3e40151f80 2024-01-25T15:05:09.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.916+0000 7f3e37fff640 1 -- 172.21.15.29:0/2857640364 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e40158120 con 0x7f3e40151f80 2024-01-25T15:05:09.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.916+0000 7f3e44ab8640 1 -- 172.21.15.29:0/2857640364 >> v1:172.21.15.52:6789/0 conn(0x7f3e40151f80 legacy=0x7f3e401585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.916+0000 7f3e44ab8640 1 -- 172.21.15.29:0/2857640364 >> v1:172.21.15.29:6789/0 conn(0x7f3e40155190 legacy=0x7f3e400c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.916+0000 7f3e44ab8640 1 -- 172.21.15.29:0/2857640364 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e400c5090 con 0x7f3e400c48d0 2024-01-25T15:05:09.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.917+0000 7f3e44ab8640 1 --2- 172.21.15.29:0/2857640364 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e400c48d0 0x7f3e400c6030 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3e300097d0 tx=0x7f3e3002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c68e78544cd922 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:09.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.917+0000 7f3e37fff640 1 -- 172.21.15.29:0/2857640364 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30031890 con 0x7f3e400c48d0 2024-01-25T15:05:09.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.917+0000 7f3e37fff640 1 -- 172.21.15.29:0/2857640364 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e300319f0 con 0x7f3e400c48d0 2024-01-25T15:05:09.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.917+0000 7f3e37fff640 1 -- 172.21.15.29:0/2857640364 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30031d60 con 0x7f3e400c48d0 2024-01-25T15:05:09.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.918+0000 7f3e4751d640 1 -- 172.21.15.29:0/2857640364 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e400c48d0 msgr2=0x7f3e400c6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.918+0000 7f3e4751d640 1 --2- 172.21.15.29:0/2857640364 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e400c48d0 0x7f3e400c6030 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3e300097d0 tx=0x7f3e3002b930 comp rx=0 tx=0).stop 2024-01-25T15:05:09.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.918+0000 7f3e4751d640 1 -- 172.21.15.29:0/2857640364 shutdown_connections 2024-01-25T15:05:09.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.918+0000 7f3e4751d640 1 --2- 172.21.15.29:0/2857640364 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e400c48d0 0x7f3e400c6030 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.918+0000 7f3e4751d640 1 -- 172.21.15.29:0/2857640364 >> 172.21.15.29:0/2857640364 conn(0x7f3e400c7f10 msgr2=0x7f3e400c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:09.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.918+0000 7f3e4751d640 1 -- 172.21.15.29:0/2857640364 shutdown_connections 2024-01-25T15:05:09.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.918+0000 7f3e4751d640 1 -- 172.21.15.29:0/2857640364 wait complete. 2024-01-25T15:05:09.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.919+0000 7f3e4751d640 1 Processor -- start 2024-01-25T15:05:09.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.919+0000 7f3e4751d640 1 -- start start 2024-01-25T15:05:09.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.920+0000 7f3e4751d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e400c48d0 0x7f3e401edad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.920+0000 7f3e4751d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e40151f80 0x7f3e40145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.920+0000 7f3e4751d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e40155190 0x7f3e401eadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.920+0000 7f3e4751d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e40147810 con 0x7f3e40151f80 2024-01-25T15:05:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.920+0000 7f3e4751d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e401eea60 con 0x7f3e400c48d0 2024-01-25T15:05:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.920+0000 7f3e4751d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e401ea630 con 0x7f3e40155190 2024-01-25T15:05:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.920+0000 7f3e44ab8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e40151f80 0x7f3e40145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.920+0000 7f3e44ab8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e40151f80 0x7f3e40145ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55676/0 (socket says 172.21.15.29:55676) 2024-01-25T15:05:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.920+0000 7f3e44ab8640 1 -- 172.21.15.29:0/2975008009 learned_addr learned my addr 172.21.15.29:0/2975008009 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.920+0000 7f3e452b9640 1 --2- 172.21.15.29:0/2975008009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e400c48d0 0x7f3e401edad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.920+0000 7f3e45aba640 1 --2- 172.21.15.29:0/2975008009 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e40155190 0x7f3e401eadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.920+0000 7f3e44ab8640 1 -- 172.21.15.29:0/2975008009 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e40155190 msgr2=0x7f3e401eadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.920+0000 7f3e44ab8640 1 --2- 172.21.15.29:0/2975008009 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e40155190 0x7f3e401eadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.920+0000 7f3e44ab8640 1 -- 172.21.15.29:0/2975008009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e400c48d0 msgr2=0x7f3e401edad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.920+0000 7f3e44ab8640 1 --2- 172.21.15.29:0/2975008009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e400c48d0 0x7f3e401edad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.920+0000 7f3e44ab8640 1 -- 172.21.15.29:0/2975008009 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e30009400 con 0x7f3e40151f80 2024-01-25T15:05:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.920+0000 7f3e44ab8640 1 --2- 172.21.15.29:0/2975008009 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e40151f80 0x7f3e40145ec0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3e30000c00 tx=0x7f3e300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.920+0000 7f3e35ffb640 1 -- 172.21.15.29:0/2975008009 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3003abe0 con 0x7f3e40151f80 2024-01-25T15:05:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.920+0000 7f3e35ffb640 1 -- 172.21.15.29:0/2975008009 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3003ad40 con 0x7f3e40151f80 2024-01-25T15:05:09.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.920+0000 7f3e4751d640 1 -- 172.21.15.29:0/2975008009 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e40146400 con 0x7f3e40151f80 2024-01-25T15:05:09.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.920+0000 7f3e35ffb640 1 -- 172.21.15.29:0/2975008009 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30044630 con 0x7f3e40151f80 2024-01-25T15:05:09.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.921+0000 7f3e4751d640 1 -- 172.21.15.29:0/2975008009 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e40146cf0 con 0x7f3e40151f80 2024-01-25T15:05:09.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.922+0000 7f3e4751d640 1 -- 172.21.15.29:0/2975008009 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4004eb10 con 0x7f3e40151f80 2024-01-25T15:05:09.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.922+0000 7f3e35ffb640 1 -- 172.21.15.29:0/2975008009 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f3e3004d450 con 0x7f3e40151f80 2024-01-25T15:05:09.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.922+0000 7f3e35ffb640 1 --2- 172.21.15.29:0/2975008009 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3e2406aed0 0x7f3e2406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:09.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.923+0000 7f3e35ffb640 1 -- 172.21.15.29:0/2975008009 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3e300abde0 con 0x7f3e40151f80 2024-01-25T15:05:09.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.923+0000 7f3e452b9640 1 --2- 172.21.15.29:0/2975008009 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3e2406aed0 0x7f3e2406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:09.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.923+0000 7f3e452b9640 1 --2- 172.21.15.29:0/2975008009 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3e2406aed0 0x7f3e2406d390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c007fd0 tx=0x7f3e3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:09.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:09.927+0000 7f3e35ffb640 1 -- 172.21.15.29:0/2975008009 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f3e30076990 con 0x7f3e40151f80 2024-01-25T15:05:10.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.117+0000 7f3e4751d640 1 -- 172.21.15.29:0/2975008009 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3e40074010 con 0x7f3e40151f80 2024-01-25T15:05:10.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.118+0000 7f3e35ffb640 1 -- 172.21.15.29:0/2975008009 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3e30079fb0 con 0x7f3e40151f80 2024-01-25T15:05:10.119 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-25T15:05:10.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.120+0000 7f3e4751d640 1 -- 172.21.15.29:0/2975008009 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3e2406aed0 msgr2=0x7f3e2406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:10.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.120+0000 7f3e4751d640 1 --2- 172.21.15.29:0/2975008009 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3e2406aed0 0x7f3e2406d390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c007fd0 tx=0x7f3e3c009040 comp rx=0 tx=0).stop 2024-01-25T15:05:10.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.120+0000 7f3e4751d640 1 -- 172.21.15.29:0/2975008009 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e40151f80 msgr2=0x7f3e40145ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:10.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.120+0000 7f3e4751d640 1 --2- 172.21.15.29:0/2975008009 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e40151f80 0x7f3e40145ec0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3e30000c00 tx=0x7f3e300046c0 comp rx=0 tx=0).stop 2024-01-25T15:05:10.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.120+0000 7f3e4751d640 1 -- 172.21.15.29:0/2975008009 shutdown_connections 2024-01-25T15:05:10.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.120+0000 7f3e4751d640 1 --2- 172.21.15.29:0/2975008009 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e40155190 0x7f3e401eadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:10.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.120+0000 7f3e4751d640 1 --2- 172.21.15.29:0/2975008009 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3e2406aed0 0x7f3e2406d390 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:10.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.120+0000 7f3e4751d640 1 --2- 172.21.15.29:0/2975008009 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e40151f80 0x7f3e40145ec0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:10.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.120+0000 7f3e4751d640 1 --2- 172.21.15.29:0/2975008009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e400c48d0 0x7f3e401edad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:10.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.120+0000 7f3e4751d640 1 -- 172.21.15.29:0/2975008009 >> 172.21.15.29:0/2975008009 conn(0x7f3e400c7f10 msgr2=0x7f3e400c1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:10.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.120+0000 7f3e4751d640 1 -- 172.21.15.29:0/2975008009 shutdown_connections 2024-01-25T15:05:10.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.120+0000 7f3e4751d640 1 -- 172.21.15.29:0/2975008009 wait complete. 2024-01-25T15:05:10.131 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-25T15:05:10.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:10.131 DEBUG:teuthology.orchestra.run.smithi029:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-01-25T15:05:10.159 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-01-25T15:05:10.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:10.159 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-25T15:05:10.214 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:05:10.214 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:05:10.233 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:05:10.233 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:05:10.292 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:05:10.292 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:05:10.350 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:10.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.451+0000 7f2072a64640 1 Processor -- start 2024-01-25T15:05:10.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.451+0000 7f2072a64640 1 -- start start 2024-01-25T15:05:10.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.452+0000 7f2072a64640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f206c06b2b0 0x7f206c06b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:10.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.452+0000 7f2072a64640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f206c1521d0 con 0x7f206c0c66b0 2024-01-25T15:05:10.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.452+0000 7f2072a64640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f206c0c5b10 con 0x7f206c1551a0 2024-01-25T15:05:10.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.452+0000 7f2072a64640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f206c06be50 con 0x7f206c06b2b0 2024-01-25T15:05:10.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.452+0000 7f2070800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f206c06b2b0 0x7f206c06b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:10.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.452+0000 7f2070800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f206c06b2b0 0x7f206c06b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55688/0 (socket says 172.21.15.29:55688) 2024-01-25T15:05:10.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.452+0000 7f2070800640 1 -- 172.21.15.29:0/3678539927 learned_addr learned my addr 172.21.15.29:0/3678539927 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:10.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.452+0000 7f2070800640 1 -- 172.21.15.29:0/3678539927 >> v1:172.21.15.52:6789/0 conn(0x7f206c1551a0 legacy=0x7f206c0c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:10.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.452+0000 7f2070800640 1 -- 172.21.15.29:0/3678539927 >> v1:172.21.15.29:6789/0 conn(0x7f206c0c66b0 legacy=0x7f206c15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:10.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.452+0000 7f2070800640 1 -- 172.21.15.29:0/3678539927 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c0c4f20 con 0x7f206c06b2b0 2024-01-25T15:05:10.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.453+0000 7f2070800640 1 --2- 172.21.15.29:0/3678539927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f206c06b2b0 0x7f206c06b690 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2060009870 tx=0x7f206002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7c050a3c71aaaf server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:10.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.453+0000 7f206b7fe640 1 -- 172.21.15.29:0/3678539927 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060030860 con 0x7f206c06b2b0 2024-01-25T15:05:10.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.453+0000 7f206b7fe640 1 -- 172.21.15.29:0/3678539927 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20600309c0 con 0x7f206c06b2b0 2024-01-25T15:05:10.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.453+0000 7f206b7fe640 1 -- 172.21.15.29:0/3678539927 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060030d50 con 0x7f206c06b2b0 2024-01-25T15:05:10.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.454+0000 7f2072a64640 1 -- 172.21.15.29:0/3678539927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f206c06b2b0 msgr2=0x7f206c06b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:10.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.454+0000 7f2072a64640 1 --2- 172.21.15.29:0/3678539927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f206c06b2b0 0x7f206c06b690 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2060009870 tx=0x7f206002b9a0 comp rx=0 tx=0).stop 2024-01-25T15:05:10.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.454+0000 7f2072a64640 1 -- 172.21.15.29:0/3678539927 shutdown_connections 2024-01-25T15:05:10.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.454+0000 7f2072a64640 1 --2- 172.21.15.29:0/3678539927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f206c06b2b0 0x7f206c06b690 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:10.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.454+0000 7f2072a64640 1 -- 172.21.15.29:0/3678539927 >> 172.21.15.29:0/3678539927 conn(0x7f206c0ca1f0 msgr2=0x7f206c0ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:10.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.454+0000 7f2072a64640 1 -- 172.21.15.29:0/3678539927 shutdown_connections 2024-01-25T15:05:10.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.454+0000 7f2072a64640 1 -- 172.21.15.29:0/3678539927 wait complete. 2024-01-25T15:05:10.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.455+0000 7f2072a64640 1 Processor -- start 2024-01-25T15:05:10.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.455+0000 7f2072a64640 1 -- start start 2024-01-25T15:05:10.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.456+0000 7f2072a64640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f206c06b2b0 0x7f206c1eb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:10.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.456+0000 7f2072a64640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f206c0c66b0 0x7f206c0c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:10.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.456+0000 7f2072a64640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f206c1551a0 0x7f206c14b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:10.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.456+0000 7f2072a64640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c1eb650 con 0x7f206c0c66b0 2024-01-25T15:05:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.456+0000 7f2072a64640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c1edd30 con 0x7f206c1551a0 2024-01-25T15:05:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.456+0000 7f2072a64640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206c1ee010 con 0x7f206c06b2b0 2024-01-25T15:05:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.456+0000 7f206bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f206c0c66b0 0x7f206c0c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.456+0000 7f206bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f206c0c66b0 0x7f206c0c8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55694/0 (socket says 172.21.15.29:55694) 2024-01-25T15:05:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.456+0000 7f206bfff640 1 -- 172.21.15.29:0/508778319 learned_addr learned my addr 172.21.15.29:0/508778319 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.456+0000 7f2071001640 1 --2- 172.21.15.29:0/508778319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f206c1551a0 0x7f206c14b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.456+0000 7f2070800640 1 --2- 172.21.15.29:0/508778319 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f206c06b2b0 0x7f206c1eb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.456+0000 7f206bfff640 1 -- 172.21.15.29:0/508778319 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f206c06b2b0 msgr2=0x7f206c1eb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.456+0000 7f206bfff640 1 --2- 172.21.15.29:0/508778319 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f206c06b2b0 0x7f206c1eb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.456+0000 7f206bfff640 1 -- 172.21.15.29:0/508778319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f206c1551a0 msgr2=0x7f206c14b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.456+0000 7f206bfff640 1 --2- 172.21.15.29:0/508778319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f206c1551a0 0x7f206c14b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.456+0000 7f206bfff640 1 -- 172.21.15.29:0/508778319 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20600094d0 con 0x7f206c0c66b0 2024-01-25T15:05:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.456+0000 7f206bfff640 1 --2- 172.21.15.29:0/508778319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f206c0c66b0 0x7f206c0c8f90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f205800c3c0 tx=0x7f205800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:10.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.456+0000 7f20697fa640 1 -- 172.21.15.29:0/508778319 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20580052d0 con 0x7f206c0c66b0 2024-01-25T15:05:10.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.457+0000 7f20697fa640 1 -- 172.21.15.29:0/508778319 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2058005450 con 0x7f206c0c66b0 2024-01-25T15:05:10.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.457+0000 7f2072a64640 1 -- 172.21.15.29:0/508778319 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f206c1ee2f0 con 0x7f206c0c66b0 2024-01-25T15:05:10.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.457+0000 7f20697fa640 1 -- 172.21.15.29:0/508778319 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2058007260 con 0x7f206c0c66b0 2024-01-25T15:05:10.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.457+0000 7f2072a64640 1 -- 172.21.15.29:0/508778319 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f206c1ee8b0 con 0x7f206c0c66b0 2024-01-25T15:05:10.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.458+0000 7f2072a64640 1 -- 172.21.15.29:0/508778319 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f206c074080 con 0x7f206c0c66b0 2024-01-25T15:05:10.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.458+0000 7f20697fa640 1 -- 172.21.15.29:0/508778319 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f20580073c0 con 0x7f206c0c66b0 2024-01-25T15:05:10.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.458+0000 7f20697fa640 1 --2- 172.21.15.29:0/508778319 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f205006aed0 0x7f205006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:10.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.458+0000 7f20697fa640 1 -- 172.21.15.29:0/508778319 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f2058088d30 con 0x7f206c0c66b0 2024-01-25T15:05:10.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.459+0000 7f2070800640 1 --2- 172.21.15.29:0/508778319 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f205006aed0 0x7f205006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:10.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.459+0000 7f2070800640 1 --2- 172.21.15.29:0/508778319 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f205006aed0 0x7f205006d390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2060036000 tx=0x7f2060008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:10.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.463+0000 7f20697fa640 1 -- 172.21.15.29:0/508778319 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f20580538b0 con 0x7f206c0c66b0 2024-01-25T15:05:10.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.643+0000 7f2072a64640 1 -- 172.21.15.29:0/508778319 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f206c0c9a70 con 0x7f206c0c66b0 2024-01-25T15:05:10.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.644+0000 7f20697fa640 1 -- 172.21.15.29:0/508778319 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18747 (secure 0 0 0) 0x7f2058056ed0 con 0x7f206c0c66b0 2024-01-25T15:05:10.645 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:10.645 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":26,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:05:08.669787+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:10.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.646+0000 7f2072a64640 1 -- 172.21.15.29:0/508778319 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f205006aed0 msgr2=0x7f205006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:10.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.646+0000 7f2072a64640 1 --2- 172.21.15.29:0/508778319 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f205006aed0 0x7f205006d390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2060036000 tx=0x7f2060008030 comp rx=0 tx=0).stop 2024-01-25T15:05:10.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.646+0000 7f2072a64640 1 -- 172.21.15.29:0/508778319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f206c0c66b0 msgr2=0x7f206c0c8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:10.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.646+0000 7f2072a64640 1 --2- 172.21.15.29:0/508778319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f206c0c66b0 0x7f206c0c8f90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f205800c3c0 tx=0x7f205800c880 comp rx=0 tx=0).stop 2024-01-25T15:05:10.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.646+0000 7f2072a64640 1 -- 172.21.15.29:0/508778319 shutdown_connections 2024-01-25T15:05:10.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.646+0000 7f2072a64640 1 --2- 172.21.15.29:0/508778319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f206c1551a0 0x7f206c14b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:10.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.646+0000 7f2072a64640 1 --2- 172.21.15.29:0/508778319 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f205006aed0 0x7f205006d390 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:10.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.646+0000 7f2072a64640 1 --2- 172.21.15.29:0/508778319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f206c0c66b0 0x7f206c0c8f90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:10.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.646+0000 7f2072a64640 1 --2- 172.21.15.29:0/508778319 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f206c06b2b0 0x7f206c1eb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:10.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.646+0000 7f2072a64640 1 -- 172.21.15.29:0/508778319 >> 172.21.15.29:0/508778319 conn(0x7f206c0ca1f0 msgr2=0x7f206c151120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:10.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.646+0000 7f2072a64640 1 -- 172.21.15.29:0/508778319 shutdown_connections 2024-01-25T15:05:10.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.646+0000 7f2072a64640 1 -- 172.21.15.29:0/508778319 wait complete. 2024-01-25T15:05:10.657 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T15:04:14.955791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T15:04:24.986626+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T15:04:25.873673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-25T15:04:29.578261+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-25T15:05:10.658 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:05:10.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.762+0000 7f2c9e27c640 1 Processor -- start 2024-01-25T15:05:10.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.762+0000 7f2c9e27c640 1 -- start start 2024-01-25T15:05:10.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.763+0000 7f2c9e27c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2c9806b490 0x7f2c980c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:10.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.763+0000 7f2c9e27c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2c98158b80 0x7f2c980c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:10.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.763+0000 7f2c9e27c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c980c8880 con 0x7f2c980c8450 2024-01-25T15:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.763+0000 7f2c9e27c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c980c6770 con 0x7f2c98158b80 2024-01-25T15:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.763+0000 7f2c9e27c640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c98154f10 con 0x7f2c9806b490 2024-01-25T15:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.763+0000 7f2c977fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2c98158b80 0x7f2c980c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.763+0000 7f2c9c819640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2c980c8450 0x7f2c98151c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34664/0 (socket says 172.21.15.29:34664) 2024-01-25T15:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.763+0000 7f2c9c819640 1 -- 172.21.15.29:0/1627159650 learned_addr learned my addr 172.21.15.29:0/1627159650 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.763+0000 7f2c977fe640 1 --2- 172.21.15.29:0/1627159650 >> v2:172.21.15.29:3300/0 conn(0x7f2c98158b80 0x7f2c980c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55706/0 (socket says 172.21.15.29:55706) 2024-01-25T15:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.763+0000 7f2c97fff640 1 --2- 172.21.15.29:0/1627159650 >> v2:172.21.15.52:3300/0 conn(0x7f2c9806b490 0x7f2c980c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.763+0000 7f2c977fe640 1 -- 172.21.15.29:0/1627159650 >> v2:172.21.15.52:3300/0 conn(0x7f2c9806b490 msgr2=0x7f2c980c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.763+0000 7f2c977fe640 1 --2- 172.21.15.29:0/1627159650 >> v2:172.21.15.52:3300/0 conn(0x7f2c9806b490 0x7f2c980c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.763+0000 7f2c977fe640 1 -- 172.21.15.29:0/1627159650 >> v1:172.21.15.29:6789/0 conn(0x7f2c980c8450 legacy=0x7f2c98151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.763+0000 7f2c977fe640 1 -- 172.21.15.29:0/1627159650 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c981551f0 con 0x7f2c98158b80 2024-01-25T15:05:10.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.763+0000 7f2c96ffd640 1 -- 172.21.15.29:0/1627159650 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732211142 0 0) 0x7f2c980c8880 con 0x7f2c980c8450 2024-01-25T15:05:10.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.764+0000 7f2c977fe640 1 --2- 172.21.15.29:0/1627159650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c98158b80 0x7f2c980c7f10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2c980c7b60 tx=0x7f2c8c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b750769b29f6a4ad server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:10.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.764+0000 7f2c96ffd640 1 -- 172.21.15.29:0/1627159650 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c02e070 con 0x7f2c98158b80 2024-01-25T15:05:10.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.764+0000 7f2c96ffd640 1 -- 172.21.15.29:0/1627159650 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8c0315a0 con 0x7f2c98158b80 2024-01-25T15:05:10.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.764+0000 7f2c96ffd640 1 -- 172.21.15.29:0/1627159650 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c031930 con 0x7f2c98158b80 2024-01-25T15:05:10.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.765+0000 7f2c9e27c640 1 -- 172.21.15.29:0/1627159650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c98158b80 msgr2=0x7f2c980c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:10.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.765+0000 7f2c9e27c640 1 --2- 172.21.15.29:0/1627159650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c98158b80 0x7f2c980c7f10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2c980c7b60 tx=0x7f2c8c02b840 comp rx=0 tx=0).stop 2024-01-25T15:05:10.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.765+0000 7f2c9e27c640 1 -- 172.21.15.29:0/1627159650 shutdown_connections 2024-01-25T15:05:10.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.765+0000 7f2c9e27c640 1 --2- 172.21.15.29:0/1627159650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c98158b80 0x7f2c980c7f10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:10.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.765+0000 7f2c9e27c640 1 --2- 172.21.15.29:0/1627159650 >> v2:172.21.15.52:3300/0 conn(0x7f2c9806b490 0x7f2c980c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:10.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.765+0000 7f2c9e27c640 1 -- 172.21.15.29:0/1627159650 >> 172.21.15.29:0/1627159650 conn(0x7f2c980ca010 msgr2=0x7f2c980ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:10.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.765+0000 7f2c9e27c640 1 -- 172.21.15.29:0/1627159650 shutdown_connections 2024-01-25T15:05:10.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.765+0000 7f2c9e27c640 1 -- 172.21.15.29:0/1627159650 wait complete. 2024-01-25T15:05:10.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.766+0000 7f2c9e27c640 1 Processor -- start 2024-01-25T15:05:10.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.766+0000 7f2c9e27c640 1 -- start start 2024-01-25T15:05:10.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.767+0000 7f2c9e27c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c9806b490 0x7f2c981edda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:10.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.767+0000 7f2c9e27c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c980c8450 0x7f2c980aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:10.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.767+0000 7f2c9e27c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c98158b80 0x7f2c981e9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:10.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.767+0000 7f2c9e27c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c981ed350 con 0x7f2c9806b490 2024-01-25T15:05:10.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.767+0000 7f2c9e27c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9814c5b0 con 0x7f2c98158b80 2024-01-25T15:05:10.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.767+0000 7f2c9e27c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9814c890 con 0x7f2c980c8450 2024-01-25T15:05:10.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.767+0000 7f2c97fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c9806b490 0x7f2c981edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:10.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.767+0000 7f2c97fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c9806b490 0x7f2c981edda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55718/0 (socket says 172.21.15.29:55718) 2024-01-25T15:05:10.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.767+0000 7f2c97fff640 1 -- 172.21.15.29:0/96538585 learned_addr learned my addr 172.21.15.29:0/96538585 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:10.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.767+0000 7f2c9c819640 1 --2- 172.21.15.29:0/96538585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c98158b80 0x7f2c981e9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:10.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.767+0000 7f2c977fe640 1 --2- 172.21.15.29:0/96538585 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c980c8450 0x7f2c980aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:10.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.767+0000 7f2c97fff640 1 -- 172.21.15.29:0/96538585 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c980c8450 msgr2=0x7f2c980aaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:10.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.767+0000 7f2c97fff640 1 --2- 172.21.15.29:0/96538585 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c980c8450 0x7f2c980aaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:10.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.767+0000 7f2c97fff640 1 -- 172.21.15.29:0/96538585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c98158b80 msgr2=0x7f2c981e9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:10.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.767+0000 7f2c97fff640 1 --2- 172.21.15.29:0/96538585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c98158b80 0x7f2c981e9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:10.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.767+0000 7f2c97fff640 1 -- 172.21.15.29:0/96538585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8c009400 con 0x7f2c9806b490 2024-01-25T15:05:10.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.767+0000 7f2c97fff640 1 --2- 172.21.15.29:0/96538585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c9806b490 0x7f2c981edda0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800e9b0 tx=0x7f2c8800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:10.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.767+0000 7f2c94ff9640 1 -- 172.21.15.29:0/96538585 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c88009670 con 0x7f2c9806b490 2024-01-25T15:05:10.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.768+0000 7f2c94ff9640 1 -- 172.21.15.29:0/96538585 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8800c9a0 con 0x7f2c9806b490 2024-01-25T15:05:10.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.768+0000 7f2c9e27c640 1 -- 172.21.15.29:0/96538585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c981ed5a0 con 0x7f2c9806b490 2024-01-25T15:05:10.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.768+0000 7f2c94ff9640 1 -- 172.21.15.29:0/96538585 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8800cd50 con 0x7f2c9806b490 2024-01-25T15:05:10.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.768+0000 7f2c9e27c640 1 -- 172.21.15.29:0/96538585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c980ab410 con 0x7f2c9806b490 2024-01-25T15:05:10.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.769+0000 7f2c9e27c640 1 -- 172.21.15.29:0/96538585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c98067be0 con 0x7f2c9806b490 2024-01-25T15:05:10.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.769+0000 7f2c94ff9640 1 -- 172.21.15.29:0/96538585 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2c88013470 con 0x7f2c9806b490 2024-01-25T15:05:10.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.769+0000 7f2c94ff9640 1 --2- 172.21.15.29:0/96538585 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2c8406aed0 0x7f2c8406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:10.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.769+0000 7f2c94ff9640 1 -- 172.21.15.29:0/96538585 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f2c88089bf0 con 0x7f2c9806b490 2024-01-25T15:05:10.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.770+0000 7f2c977fe640 1 --2- 172.21.15.29:0/96538585 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2c8406aed0 0x7f2c8406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:10.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.770+0000 7f2c977fe640 1 --2- 172.21.15.29:0/96538585 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2c8406aed0 0x7f2c8406d390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c036000 tx=0x7f2c8c03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:10.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.774+0000 7f2c94ff9640 1 -- 172.21.15.29:0/96538585 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2c88054770 con 0x7f2c9806b490 2024-01-25T15:05:10.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.952+0000 7f2c9e27c640 1 -- 172.21.15.29:0/96538585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c980a97d0 con 0x7f2c9806b490 2024-01-25T15:05:10.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.953+0000 7f2c94ff9640 1 -- 172.21.15.29:0/96538585 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c880170a0 con 0x7f2c9806b490 2024-01-25T15:05:10.953 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-25T15:05:10.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.954+0000 7f2c9e27c640 1 -- 172.21.15.29:0/96538585 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2c8406aed0 msgr2=0x7f2c8406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.954+0000 7f2c9e27c640 1 --2- 172.21.15.29:0/96538585 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2c8406aed0 0x7f2c8406d390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c036000 tx=0x7f2c8c03d040 comp rx=0 tx=0).stop 2024-01-25T15:05:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.954+0000 7f2c9e27c640 1 -- 172.21.15.29:0/96538585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c9806b490 msgr2=0x7f2c981edda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.954+0000 7f2c9e27c640 1 --2- 172.21.15.29:0/96538585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c9806b490 0x7f2c981edda0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800e9b0 tx=0x7f2c8800ee70 comp rx=0 tx=0).stop 2024-01-25T15:05:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.954+0000 7f2c9e27c640 1 -- 172.21.15.29:0/96538585 shutdown_connections 2024-01-25T15:05:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.954+0000 7f2c9e27c640 1 --2- 172.21.15.29:0/96538585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c98158b80 0x7f2c981e9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.954+0000 7f2c9e27c640 1 --2- 172.21.15.29:0/96538585 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c980c8450 0x7f2c980aaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.954+0000 7f2c9e27c640 1 --2- 172.21.15.29:0/96538585 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2c8406aed0 0x7f2c8406d390 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.954+0000 7f2c9e27c640 1 --2- 172.21.15.29:0/96538585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c9806b490 0x7f2c981edda0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.954+0000 7f2c9e27c640 1 -- 172.21.15.29:0/96538585 >> 172.21.15.29:0/96538585 conn(0x7f2c980ca010 msgr2=0x7f2c980c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.955+0000 7f2c9e27c640 1 -- 172.21.15.29:0/96538585 shutdown_connections 2024-01-25T15:05:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:10.955+0000 7f2c9e27c640 1 -- 172.21.15.29:0/96538585 wait complete. 2024-01-25T15:05:10.966 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:05:11.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.070+0000 7f518de61640 1 Processor -- start 2024-01-25T15:05:11.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.070+0000 7f518de61640 1 -- start start 2024-01-25T15:05:11.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.071+0000 7f518de61640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f518806d2f0 0x7f51880a6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.071+0000 7f518de61640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f51880c1240 0x7f51880c1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.071+0000 7f518de61640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51880c8730 con 0x7f51880c63d0 2024-01-25T15:05:11.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.071+0000 7f518de61640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51880c5fb0 con 0x7f51880c1240 2024-01-25T15:05:11.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.071+0000 7f518de61640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51880c7ed0 con 0x7f518806d2f0 2024-01-25T15:05:11.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.071+0000 7f5187fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f51880c1240 0x7f51880c1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.071+0000 7f5186ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f51880c63d0 0x7f51880c6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34676/0 (socket says 172.21.15.29:34676) 2024-01-25T15:05:11.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.071+0000 7f5186ffd640 1 -- 172.21.15.29:0/2902492200 learned_addr learned my addr 172.21.15.29:0/2902492200 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:11.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.071+0000 7f51877fe640 1 --2- 172.21.15.29:0/2902492200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f518806d2f0 0x7f51880a6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.071+0000 7f5187fff640 1 -- 172.21.15.29:0/2902492200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f518806d2f0 msgr2=0x7f51880a6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:11.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.071+0000 7f5187fff640 1 --2- 172.21.15.29:0/2902492200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f518806d2f0 0x7f51880a6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.071+0000 7f5187fff640 1 -- 172.21.15.29:0/2902492200 >> v1:172.21.15.29:6789/0 conn(0x7f51880c63d0 legacy=0x7f51880c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:11.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.071+0000 7f5187fff640 1 -- 172.21.15.29:0/2902492200 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51880c8170 con 0x7f51880c1240 2024-01-25T15:05:11.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.071+0000 7f51867fc640 1 -- 172.21.15.29:0/2902492200 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2336803716 0 0) 0x7f517c001110 con 0x7f51880c63d0 2024-01-25T15:05:11.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.072+0000 7f5187fff640 1 --2- 172.21.15.29:0/2902492200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51880c1240 0x7f51880c1690 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5180009d90 tx=0x7f518002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f7ce825c4ee3df server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:11.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.072+0000 7f51867fc640 1 -- 172.21.15.29:0/2902492200 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518002cbc0 con 0x7f51880c1240 2024-01-25T15:05:11.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.072+0000 7f51867fc640 1 -- 172.21.15.29:0/2902492200 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518002cd20 con 0x7f51880c1240 2024-01-25T15:05:11.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.072+0000 7f51867fc640 1 -- 172.21.15.29:0/2902492200 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5180034660 con 0x7f51880c1240 2024-01-25T15:05:11.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.073+0000 7f518de61640 1 -- 172.21.15.29:0/2902492200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51880c1240 msgr2=0x7f51880c1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:11.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.073+0000 7f518de61640 1 --2- 172.21.15.29:0/2902492200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51880c1240 0x7f51880c1690 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5180009d90 tx=0x7f518002be10 comp rx=0 tx=0).stop 2024-01-25T15:05:11.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.073+0000 7f518de61640 1 -- 172.21.15.29:0/2902492200 shutdown_connections 2024-01-25T15:05:11.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.073+0000 7f518de61640 1 --2- 172.21.15.29:0/2902492200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51880c1240 0x7f51880c1690 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.073+0000 7f518de61640 1 --2- 172.21.15.29:0/2902492200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f518806d2f0 0x7f51880a6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.073+0000 7f518de61640 1 -- 172.21.15.29:0/2902492200 >> 172.21.15.29:0/2902492200 conn(0x7f51880a9bc0 msgr2=0x7f51880a9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:11.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.073+0000 7f518de61640 1 -- 172.21.15.29:0/2902492200 shutdown_connections 2024-01-25T15:05:11.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.073+0000 7f518de61640 1 -- 172.21.15.29:0/2902492200 wait complete. 2024-01-25T15:05:11.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.074+0000 7f518de61640 1 Processor -- start 2024-01-25T15:05:11.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.074+0000 7f518de61640 1 -- start start 2024-01-25T15:05:11.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.075+0000 7f518de61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f518806d2f0 0x7f51881eab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.075+0000 7f518de61640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51880c1240 0x7f518806f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.075+0000 7f518de61640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51880c63d0 0x7f51881510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.075+0000 7f518de61640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51881eb090 con 0x7f518806d2f0 2024-01-25T15:05:11.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.075+0000 7f518de61640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51880acc30 con 0x7f51880c63d0 2024-01-25T15:05:11.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.075+0000 7f518de61640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5188157f10 con 0x7f51880c1240 2024-01-25T15:05:11.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.075+0000 7f51877fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f518806d2f0 0x7f51881eab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.075+0000 7f51877fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f518806d2f0 0x7f51881eab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55748/0 (socket says 172.21.15.29:55748) 2024-01-25T15:05:11.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.075+0000 7f51877fe640 1 -- 172.21.15.29:0/3613688535 learned_addr learned my addr 172.21.15.29:0/3613688535 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:11.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.075+0000 7f5187fff640 1 --2- 172.21.15.29:0/3613688535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51880c63d0 0x7f51881510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.075+0000 7f5186ffd640 1 --2- 172.21.15.29:0/3613688535 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51880c1240 0x7f518806f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.075+0000 7f51877fe640 1 -- 172.21.15.29:0/3613688535 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51880c1240 msgr2=0x7f518806f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:11.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.075+0000 7f51877fe640 1 --2- 172.21.15.29:0/3613688535 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51880c1240 0x7f518806f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.075+0000 7f51877fe640 1 -- 172.21.15.29:0/3613688535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51880c63d0 msgr2=0x7f51881510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:11.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.075+0000 7f51877fe640 1 --2- 172.21.15.29:0/3613688535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51880c63d0 0x7f51881510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.075+0000 7f51877fe640 1 -- 172.21.15.29:0/3613688535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5180009a70 con 0x7f518806d2f0 2024-01-25T15:05:11.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.075+0000 7f51877fe640 1 --2- 172.21.15.29:0/3613688535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f518806d2f0 0x7f51881eab50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f517800d5f0 tx=0x7f517800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:11.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.075+0000 7f516ffff640 1 -- 172.21.15.29:0/3613688535 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51780125f0 con 0x7f518806d2f0 2024-01-25T15:05:11.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.075+0000 7f516ffff640 1 -- 172.21.15.29:0/3613688535 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5178012750 con 0x7f518806d2f0 2024-01-25T15:05:11.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.075+0000 7f518de61640 1 -- 172.21.15.29:0/3613688535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51881581f0 con 0x7f518806d2f0 2024-01-25T15:05:11.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.075+0000 7f516ffff640 1 -- 172.21.15.29:0/3613688535 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5178012b00 con 0x7f518806d2f0 2024-01-25T15:05:11.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.075+0000 7f518de61640 1 -- 172.21.15.29:0/3613688535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f518809a330 con 0x7f518806d2f0 2024-01-25T15:05:11.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.077+0000 7f518de61640 1 -- 172.21.15.29:0/3613688535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f518809a4c0 con 0x7f518806d2f0 2024-01-25T15:05:11.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.077+0000 7f516ffff640 1 -- 172.21.15.29:0/3613688535 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f5178012c60 con 0x7f518806d2f0 2024-01-25T15:05:11.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.077+0000 7f516ffff640 1 --2- 172.21.15.29:0/3613688535 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f517406aed0 0x7f517406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.077+0000 7f516ffff640 1 -- 172.21.15.29:0/3613688535 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5178089d40 con 0x7f518806d2f0 2024-01-25T15:05:11.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.078+0000 7f5186ffd640 1 --2- 172.21.15.29:0/3613688535 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f517406aed0 0x7f517406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.078+0000 7f5186ffd640 1 --2- 172.21.15.29:0/3613688535 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f517406aed0 0x7f517406d390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f51880ad030 tx=0x7f517c007b90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:11.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.082+0000 7f516ffff640 1 -- 172.21.15.29:0/3613688535 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f5178054970 con 0x7f518806d2f0 2024-01-25T15:05:11.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.259+0000 7f518de61640 1 -- 172.21.15.29:0/3613688535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f51881583e0 con 0x7f518806d2f0 2024-01-25T15:05:11.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.259+0000 7f516ffff640 1 -- 172.21.15.29:0/3613688535 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5178057f90 con 0x7f518806d2f0 2024-01-25T15:05:11.260 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:11.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.261+0000 7f518de61640 1 -- 172.21.15.29:0/3613688535 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f517406aed0 msgr2=0x7f517406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:11.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.261+0000 7f518de61640 1 --2- 172.21.15.29:0/3613688535 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f517406aed0 0x7f517406d390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f51880ad030 tx=0x7f517c007b90 comp rx=0 tx=0).stop 2024-01-25T15:05:11.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.261+0000 7f518de61640 1 -- 172.21.15.29:0/3613688535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f518806d2f0 msgr2=0x7f51881eab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:11.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.261+0000 7f518de61640 1 --2- 172.21.15.29:0/3613688535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f518806d2f0 0x7f51881eab50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f517800d5f0 tx=0x7f517800dab0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.261+0000 7f518de61640 1 -- 172.21.15.29:0/3613688535 shutdown_connections 2024-01-25T15:05:11.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.261+0000 7f518de61640 1 --2- 172.21.15.29:0/3613688535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51880c63d0 0x7f51881510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.261+0000 7f518de61640 1 --2- 172.21.15.29:0/3613688535 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51880c1240 0x7f518806f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.261+0000 7f518de61640 1 --2- 172.21.15.29:0/3613688535 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f517406aed0 0x7f517406d390 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.261+0000 7f518de61640 1 --2- 172.21.15.29:0/3613688535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f518806d2f0 0x7f51881eab50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.261+0000 7f518de61640 1 -- 172.21.15.29:0/3613688535 >> 172.21.15.29:0/3613688535 conn(0x7f51880a9bc0 msgr2=0x7f51880c6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:11.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.261+0000 7f518de61640 1 -- 172.21.15.29:0/3613688535 shutdown_connections 2024-01-25T15:05:11.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.261+0000 7f518de61640 1 -- 172.21.15.29:0/3613688535 wait complete. 2024-01-25T15:05:11.273 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:05:11.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.377+0000 7f80e40a2640 1 Processor -- start 2024-01-25T15:05:11.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.377+0000 7f80e40a2640 1 -- start start 2024-01-25T15:05:11.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.378+0000 7f80e40a2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f80dc06b490 0x7f80dc0c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.378+0000 7f80e40a2640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80dc0c6770 con 0x7f80dc0c8620 2024-01-25T15:05:11.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.378+0000 7f80e40a2640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80dc154f10 con 0x7f80dc158b80 2024-01-25T15:05:11.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.378+0000 7f80e40a2640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80dc1551f0 con 0x7f80dc06b490 2024-01-25T15:05:11.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.378+0000 7f80e263f640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f80dc0c8620 0x7f80dc151c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34692/0 (socket says 172.21.15.29:34692) 2024-01-25T15:05:11.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.378+0000 7f80e263f640 1 -- 172.21.15.29:0/2834029148 learned_addr learned my addr 172.21.15.29:0/2834029148 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:11.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.378+0000 7f80e1e3e640 1 --2- 172.21.15.29:0/2834029148 >> v2:172.21.15.52:3300/0 conn(0x7f80dc06b490 0x7f80dc0c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.378+0000 7f80e0e3c640 1 -- 172.21.15.29:0/2834029148 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2351436824 0 0) 0x7f80dc0c6770 con 0x7f80dc0c8620 2024-01-25T15:05:11.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.378+0000 7f80e0e3c640 1 -- 172.21.15.29:0/2834029148 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80c4003520 con 0x7f80dc0c8620 2024-01-25T15:05:11.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.379+0000 7f80e0e3c640 1 -- 172.21.15.29:0/2834029148 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2623591597 0 0) 0x7f80c4003520 con 0x7f80dc0c8620 2024-01-25T15:05:11.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.379+0000 7f80e0e3c640 1 -- 172.21.15.29:0/2834029148 >> v2:172.21.15.52:3300/0 conn(0x7f80dc06b490 msgr2=0x7f80dc0c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:11.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.379+0000 7f80e0e3c640 1 --2- 172.21.15.29:0/2834029148 >> v2:172.21.15.52:3300/0 conn(0x7f80dc06b490 0x7f80dc0c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.379+0000 7f80e0e3c640 1 -- 172.21.15.29:0/2834029148 >> v1:172.21.15.52:6789/0 conn(0x7f80dc158b80 legacy=0x7f80dc0c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:11.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.379+0000 7f80e0e3c640 1 -- 172.21.15.29:0/2834029148 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc1554d0 con 0x7f80dc0c8620 2024-01-25T15:05:11.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.379+0000 7f80e0e3c640 1 -- 172.21.15.29:0/2834029148 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f80cc0019f0 con 0x7f80dc0c8620 2024-01-25T15:05:11.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.379+0000 7f80e0e3c640 1 -- 172.21.15.29:0/2834029148 >> v1:172.21.15.29:6789/0 conn(0x7f80dc0c8620 legacy=0x7f80dc151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:11.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.379+0000 7f80e0e3c640 1 --2- 172.21.15.29:0/2834029148 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80c40039e0 0x7f80c4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.379+0000 7f80e0e3c640 1 --2- 172.21.15.29:0/2834029148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80c40047c0 0x7f80c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.379+0000 7f80e0e3c640 1 --2- 172.21.15.29:0/2834029148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80c40051f0 0x7f80c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.379+0000 7f80e0e3c640 1 -- 172.21.15.29:0/2834029148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc1551f0 con 0x7f80c40051f0 2024-01-25T15:05:11.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.379+0000 7f80e0e3c640 1 -- 172.21.15.29:0/2834029148 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c400c150 con 0x7f80c40047c0 2024-01-25T15:05:11.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.379+0000 7f80e0e3c640 1 -- 172.21.15.29:0/2834029148 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c400c310 con 0x7f80c40039e0 2024-01-25T15:05:11.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.379+0000 7f80e263f640 1 --2- 172.21.15.29:0/2834029148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80c40051f0 0x7f80c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.379+0000 7f80e1e3e640 1 --2- 172.21.15.29:0/2834029148 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80c40039e0 0x7f80c4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.379+0000 7f80e163d640 1 --2- 172.21.15.29:0/2834029148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80c40047c0 0x7f80c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.379+0000 7f80e263f640 1 -- 172.21.15.29:0/2834029148 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80c40039e0 msgr2=0x7f80c4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:11.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.379+0000 7f80e263f640 1 --2- 172.21.15.29:0/2834029148 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80c40039e0 0x7f80c4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.379+0000 7f80e263f640 1 -- 172.21.15.29:0/2834029148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80c40047c0 msgr2=0x7f80c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:11.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.379+0000 7f80e263f640 1 --2- 172.21.15.29:0/2834029148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80c40047c0 0x7f80c4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.379+0000 7f80e263f640 1 -- 172.21.15.29:0/2834029148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c4003520 con 0x7f80c40051f0 2024-01-25T15:05:11.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.380+0000 7f80e263f640 1 -- 172.21.15.29:0/2834029148 reap_dead start 2024-01-25T15:05:11.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.380+0000 7f80e263f640 1 --2- 172.21.15.29:0/2834029148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80c40051f0 0x7f80c400b980 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f80cc00a830 tx=0x7f80c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a924108e58e82dbb server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:11.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.380+0000 7f80e0e3c640 1 -- 172.21.15.29:0/2834029148 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc0072d0 con 0x7f80c40051f0 2024-01-25T15:05:11.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.380+0000 7f80e0e3c640 1 -- 172.21.15.29:0/2834029148 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc02f070 con 0x7f80c40051f0 2024-01-25T15:05:11.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.380+0000 7f80e0e3c640 1 -- 172.21.15.29:0/2834029148 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc0076b0 con 0x7f80c40051f0 2024-01-25T15:05:11.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.381+0000 7f80e40a2640 1 -- 172.21.15.29:0/2834029148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80c40051f0 msgr2=0x7f80c400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:11.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.381+0000 7f80e40a2640 1 --2- 172.21.15.29:0/2834029148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80c40051f0 0x7f80c400b980 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f80cc00a830 tx=0x7f80c40057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.381+0000 7f80e40a2640 1 -- 172.21.15.29:0/2834029148 shutdown_connections 2024-01-25T15:05:11.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.381+0000 7f80e40a2640 1 --2- 172.21.15.29:0/2834029148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80c40051f0 0x7f80c400b980 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.381+0000 7f80e40a2640 1 -- 172.21.15.29:0/2834029148 >> 172.21.15.29:0/2834029148 conn(0x7f80dc0ca010 msgr2=0x7f80dc0ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:11.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.381+0000 7f80e40a2640 1 -- 172.21.15.29:0/2834029148 shutdown_connections 2024-01-25T15:05:11.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.381+0000 7f80e40a2640 1 -- 172.21.15.29:0/2834029148 wait complete. 2024-01-25T15:05:11.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.382+0000 7f80e40a2640 1 Processor -- start 2024-01-25T15:05:11.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.382+0000 7f80e40a2640 1 -- start start 2024-01-25T15:05:11.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.383+0000 7f80e40a2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80c40051f0 0x7f80dc14cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.383+0000 7f80e40a2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80dc14dd60 0x7f80dc0aada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.383+0000 7f80e40a2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80dc1e9d70 0x7f80dc1ea1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.383+0000 7f80e40a2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc0bf440 con 0x7f80dc1e9d70 2024-01-25T15:05:11.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.383+0000 7f80e40a2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc0c0530 con 0x7f80c40051f0 2024-01-25T15:05:11.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.383+0000 7f80e40a2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc1edcf0 con 0x7f80dc14dd60 2024-01-25T15:05:11.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.383+0000 7f80e263f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80dc1e9d70 0x7f80dc1ea1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.383+0000 7f80e263f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80dc1e9d70 0x7f80dc1ea1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55756/0 (socket says 172.21.15.29:55756) 2024-01-25T15:05:11.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.383+0000 7f80e263f640 1 -- 172.21.15.29:0/2518991805 learned_addr learned my addr 172.21.15.29:0/2518991805 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:11.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.383+0000 7f80e1e3e640 1 --2- 172.21.15.29:0/2518991805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80c40051f0 0x7f80dc14cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.383+0000 7f80e163d640 1 --2- 172.21.15.29:0/2518991805 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80dc14dd60 0x7f80dc0aada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.383+0000 7f80e263f640 1 -- 172.21.15.29:0/2518991805 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80dc14dd60 msgr2=0x7f80dc0aada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.383+0000 7f80e263f640 1 --2- 172.21.15.29:0/2518991805 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80dc14dd60 0x7f80dc0aada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.383+0000 7f80e263f640 1 -- 172.21.15.29:0/2518991805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80c40051f0 msgr2=0x7f80dc14cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.383+0000 7f80e263f640 1 --2- 172.21.15.29:0/2518991805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80c40051f0 0x7f80dc14cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.383+0000 7f80e263f640 1 -- 172.21.15.29:0/2518991805 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc155b70 con 0x7f80dc1e9d70 2024-01-25T15:05:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.383+0000 7f80e263f640 1 --2- 172.21.15.29:0/2518991805 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80dc1e9d70 0x7f80dc1ea1f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f80cc000f80 tx=0x7f80cc001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.383+0000 7f80da7fc640 1 -- 172.21.15.29:0/2518991805 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc0019b0 con 0x7f80dc1e9d70 2024-01-25T15:05:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.383+0000 7f80da7fc640 1 -- 172.21.15.29:0/2518991805 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc004b60 con 0x7f80dc1e9d70 2024-01-25T15:05:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.383+0000 7f80da7fc640 1 -- 172.21.15.29:0/2518991805 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc0070d0 con 0x7f80dc1e9d70 2024-01-25T15:05:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.383+0000 7f80e40a2640 1 -- 172.21.15.29:0/2518991805 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80dc14c960 con 0x7f80dc1e9d70 2024-01-25T15:05:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.383+0000 7f80e40a2640 1 -- 172.21.15.29:0/2518991805 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80dc1edf90 con 0x7f80dc1e9d70 2024-01-25T15:05:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.384+0000 7f80e40a2640 1 -- 172.21.15.29:0/2518991805 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80dc0c06a0 con 0x7f80dc1e9d70 2024-01-25T15:05:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.385+0000 7f80da7fc640 1 -- 172.21.15.29:0/2518991805 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f80cc031030 con 0x7f80dc1e9d70 2024-01-25T15:05:11.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.385+0000 7f80da7fc640 1 --2- 172.21.15.29:0/2518991805 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f80c806aed0 0x7f80c806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.385+0000 7f80da7fc640 1 -- 172.21.15.29:0/2518991805 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f80cc0ab430 con 0x7f80dc1e9d70 2024-01-25T15:05:11.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.385+0000 7f80e1e3e640 1 --2- 172.21.15.29:0/2518991805 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f80c806aed0 0x7f80c806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.386+0000 7f80e1e3e640 1 --2- 172.21.15.29:0/2518991805 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f80c806aed0 0x7f80c806d390 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009b40 tx=0x7f80d4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:11.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.389+0000 7f80da7fc640 1 -- 172.21.15.29:0/2518991805 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f80dc0c06a0 con 0x7f80dc1e9d70 2024-01-25T15:05:11.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.569+0000 7f80e40a2640 1 -- 172.21.15.29:0/2518991805 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f80dc0c06a0 con 0x7f80dc1e9d70 2024-01-25T15:05:11.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.570+0000 7f80da7fc640 1 -- 172.21.15.29:0/2518991805 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f80dc0c06a0 con 0x7f80dc1e9d70 2024-01-25T15:05:11.571 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-25T15:05:11.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.572+0000 7f80e40a2640 1 -- 172.21.15.29:0/2518991805 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f80c806aed0 msgr2=0x7f80c806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:11.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.572+0000 7f80e40a2640 1 --2- 172.21.15.29:0/2518991805 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f80c806aed0 0x7f80c806d390 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009b40 tx=0x7f80d4009190 comp rx=0 tx=0).stop 2024-01-25T15:05:11.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.572+0000 7f80e40a2640 1 -- 172.21.15.29:0/2518991805 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80dc1e9d70 msgr2=0x7f80dc1ea1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:11.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.572+0000 7f80e40a2640 1 --2- 172.21.15.29:0/2518991805 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80dc1e9d70 0x7f80dc1ea1f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f80cc000f80 tx=0x7f80cc001d80 comp rx=0 tx=0).stop 2024-01-25T15:05:11.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.572+0000 7f80e40a2640 1 -- 172.21.15.29:0/2518991805 shutdown_connections 2024-01-25T15:05:11.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.572+0000 7f80e40a2640 1 --2- 172.21.15.29:0/2518991805 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f80c806aed0 0x7f80c806d390 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.572+0000 7f80e40a2640 1 --2- 172.21.15.29:0/2518991805 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80dc1e9d70 0x7f80dc1ea1f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.572+0000 7f80e40a2640 1 --2- 172.21.15.29:0/2518991805 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f80dc14dd60 0x7f80dc0aada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.572+0000 7f80e40a2640 1 --2- 172.21.15.29:0/2518991805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80c40051f0 0x7f80dc14cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.572+0000 7f80e40a2640 1 -- 172.21.15.29:0/2518991805 >> 172.21.15.29:0/2518991805 conn(0x7f80dc0ca010 msgr2=0x7f80dc0c8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:11.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.572+0000 7f80e40a2640 1 -- 172.21.15.29:0/2518991805 shutdown_connections 2024-01-25T15:05:11.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.572+0000 7f80e40a2640 1 -- 172.21.15.29:0/2518991805 wait complete. 2024-01-25T15:05:11.583 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-25T15:05:11.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.688+0000 7f826caa4640 1 Processor -- start 2024-01-25T15:05:11.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.688+0000 7f826caa4640 1 -- start start 2024-01-25T15:05:11.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.689+0000 7f826caa4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f826806d560 0x7f826806b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.689+0000 7f826caa4640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82680afaa0 con 0x7f82680c4fe0 2024-01-25T15:05:11.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.689+0000 7f826caa4640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82680c6060 con 0x7f82680af6c0 2024-01-25T15:05:11.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.689+0000 7f826caa4640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f826806c480 con 0x7f826806d560 2024-01-25T15:05:11.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.689+0000 7f8266d9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f82680c4fe0 0x7f826806b760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34700/0 (socket says 172.21.15.29:34700) 2024-01-25T15:05:11.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.689+0000 7f8266d9d640 1 -- 172.21.15.29:0/2614698378 learned_addr learned my addr 172.21.15.29:0/2614698378 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:11.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.689+0000 7f826559a640 1 -- 172.21.15.29:0/2614698378 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869391124 0 0) 0x7f82680afaa0 con 0x7f82680c4fe0 2024-01-25T15:05:11.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.689+0000 7f826559a640 1 -- 172.21.15.29:0/2614698378 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8254003520 con 0x7f82680c4fe0 2024-01-25T15:05:11.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.689+0000 7f8265d9b640 1 --2- 172.21.15.29:0/2614698378 >> v2:172.21.15.52:3300/0 conn(0x7f826806d560 0x7f826806b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.690+0000 7f826559a640 1 -- 172.21.15.29:0/2614698378 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2629234557 0 0) 0x7f8254003520 con 0x7f82680c4fe0 2024-01-25T15:05:11.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.690+0000 7f826559a640 1 -- 172.21.15.29:0/2614698378 >> v2:172.21.15.52:3300/0 conn(0x7f826806d560 msgr2=0x7f826806b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:11.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.690+0000 7f826559a640 1 --2- 172.21.15.29:0/2614698378 >> v2:172.21.15.52:3300/0 conn(0x7f826806d560 0x7f826806b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.690+0000 7f826559a640 1 -- 172.21.15.29:0/2614698378 >> v1:172.21.15.52:6789/0 conn(0x7f82680af6c0 legacy=0x7f82680c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:11.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.690+0000 7f826559a640 1 -- 172.21.15.29:0/2614698378 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8268155480 con 0x7f82680c4fe0 2024-01-25T15:05:11.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.690+0000 7f826559a640 1 -- 172.21.15.29:0/2614698378 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f82580019f0 con 0x7f82680c4fe0 2024-01-25T15:05:11.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.690+0000 7f826559a640 1 -- 172.21.15.29:0/2614698378 >> v1:172.21.15.29:6789/0 conn(0x7f82680c4fe0 legacy=0x7f826806b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:11.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.690+0000 7f826559a640 1 --2- 172.21.15.29:0/2614698378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82540039e0 0x7f8254003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.690+0000 7f826559a640 1 --2- 172.21.15.29:0/2614698378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82540047c0 0x7f8254004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.690+0000 7f826559a640 1 --2- 172.21.15.29:0/2614698378 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8254005180 0x7f825400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.690+0000 7f826559a640 1 -- 172.21.15.29:0/2614698378 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826806c480 con 0x7f82540039e0 2024-01-25T15:05:11.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.690+0000 7f826559a640 1 -- 172.21.15.29:0/2614698378 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825400c0d0 con 0x7f82540047c0 2024-01-25T15:05:11.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.690+0000 7f826559a640 1 -- 172.21.15.29:0/2614698378 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825400c290 con 0x7f8254005180 2024-01-25T15:05:11.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.690+0000 7f826659c640 1 --2- 172.21.15.29:0/2614698378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82540039e0 0x7f8254003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.690+0000 7f8265d9b640 1 --2- 172.21.15.29:0/2614698378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82540047c0 0x7f8254004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.690+0000 7f8266d9d640 1 --2- 172.21.15.29:0/2614698378 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8254005180 0x7f825400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.690+0000 7f826659c640 1 -- 172.21.15.29:0/2614698378 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8254005180 msgr2=0x7f825400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:11.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.690+0000 7f826659c640 1 --2- 172.21.15.29:0/2614698378 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8254005180 0x7f825400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.690+0000 7f826659c640 1 -- 172.21.15.29:0/2614698378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82540047c0 msgr2=0x7f8254004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:11.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.690+0000 7f826659c640 1 --2- 172.21.15.29:0/2614698378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82540047c0 0x7f8254004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.690+0000 7f826659c640 1 -- 172.21.15.29:0/2614698378 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8254003520 con 0x7f82540039e0 2024-01-25T15:05:11.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.690+0000 7f8266d9d640 1 -- 172.21.15.29:0/2614698378 reap_dead start 2024-01-25T15:05:11.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.691+0000 7f826659c640 1 --2- 172.21.15.29:0/2614698378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82540039e0 0x7f8254003de0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8260001780 tx=0x7f82540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf70a0b13903dff server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:11.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.691+0000 7f826559a640 1 -- 172.21.15.29:0/2614698378 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82600052d0 con 0x7f82540039e0 2024-01-25T15:05:11.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.691+0000 7f826559a640 1 -- 172.21.15.29:0/2614698378 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826002e050 con 0x7f82540039e0 2024-01-25T15:05:11.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.691+0000 7f826559a640 1 -- 172.21.15.29:0/2614698378 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8260003850 con 0x7f82540039e0 2024-01-25T15:05:11.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.691+0000 7f826caa4640 1 -- 172.21.15.29:0/2614698378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82540039e0 msgr2=0x7f8254003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:11.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.691+0000 7f826caa4640 1 --2- 172.21.15.29:0/2614698378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82540039e0 0x7f8254003de0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8260001780 tx=0x7f82540057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.692+0000 7f826caa4640 1 -- 172.21.15.29:0/2614698378 shutdown_connections 2024-01-25T15:05:11.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.692+0000 7f826caa4640 1 --2- 172.21.15.29:0/2614698378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82540039e0 0x7f8254003de0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.692+0000 7f826caa4640 1 -- 172.21.15.29:0/2614698378 >> 172.21.15.29:0/2614698378 conn(0x7f82680c6ca0 msgr2=0x7f82680c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:11.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.692+0000 7f826caa4640 1 -- 172.21.15.29:0/2614698378 shutdown_connections 2024-01-25T15:05:11.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.692+0000 7f826caa4640 1 -- 172.21.15.29:0/2614698378 wait complete. 2024-01-25T15:05:11.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.693+0000 7f826caa4640 1 Processor -- start 2024-01-25T15:05:11.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.693+0000 7f826caa4640 1 -- start start 2024-01-25T15:05:11.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f826caa4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82540039e0 0x7f82680c0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f826caa4640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8268151660 0x7f82681ed820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f826caa4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82680c3210 0x7f8268150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f826caa4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8268151150 con 0x7f82680c3210 2024-01-25T15:05:11.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f826caa4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82680c0890 con 0x7f82540039e0 2024-01-25T15:05:11.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f826caa4640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82680c1260 con 0x7f8268151660 2024-01-25T15:05:11.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f8266d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82680c3210 0x7f8268150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f8266d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82680c3210 0x7f8268150400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55784/0 (socket says 172.21.15.29:55784) 2024-01-25T15:05:11.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f8266d9d640 1 -- 172.21.15.29:0/2281236505 learned_addr learned my addr 172.21.15.29:0/2281236505 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:11.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f826659c640 1 --2- 172.21.15.29:0/2281236505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82540039e0 0x7f82680c0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f8265d9b640 1 --2- 172.21.15.29:0/2281236505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8268151660 0x7f82681ed820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f8266d9d640 1 -- 172.21.15.29:0/2281236505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8268151660 msgr2=0x7f82681ed820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:11.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f8266d9d640 1 --2- 172.21.15.29:0/2281236505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8268151660 0x7f82681ed820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f8266d9d640 1 -- 172.21.15.29:0/2281236505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82540039e0 msgr2=0x7f82680c0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:11.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f8266d9d640 1 --2- 172.21.15.29:0/2281236505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82540039e0 0x7f82680c0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f8266d9d640 1 -- 172.21.15.29:0/2281236505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82680c4080 con 0x7f82680c3210 2024-01-25T15:05:11.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f8265d9b640 1 --2- 172.21.15.29:0/2281236505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8268151660 0x7f82681ed820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:11.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f8266d9d640 1 --2- 172.21.15.29:0/2281236505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82680c3210 0x7f8268150400 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f82680c53c0 tx=0x7f8258007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:11.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f825effd640 1 -- 172.21.15.29:0/2281236505 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825800ea80 con 0x7f82680c3210 2024-01-25T15:05:11.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f825effd640 1 -- 172.21.15.29:0/2281236505 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825800ec00 con 0x7f82680c3210 2024-01-25T15:05:11.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f826caa4640 1 -- 172.21.15.29:0/2281236505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8268151380 con 0x7f82680c3210 2024-01-25T15:05:11.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f825effd640 1 -- 172.21.15.29:0/2281236505 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8258013420 con 0x7f82680c3210 2024-01-25T15:05:11.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.694+0000 7f826caa4640 1 -- 172.21.15.29:0/2281236505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82681ee360 con 0x7f82680c3210 2024-01-25T15:05:11.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.695+0000 7f826caa4640 1 -- 172.21.15.29:0/2281236505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8268074010 con 0x7f82680c3210 2024-01-25T15:05:11.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.696+0000 7f825effd640 1 -- 172.21.15.29:0/2281236505 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8258013580 con 0x7f82680c3210 2024-01-25T15:05:11.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.696+0000 7f825effd640 1 --2- 172.21.15.29:0/2281236505 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f824806af00 0x7f824806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.696+0000 7f825effd640 1 -- 172.21.15.29:0/2281236505 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f8258089cd0 con 0x7f82680c3210 2024-01-25T15:05:11.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.697+0000 7f826659c640 1 --2- 172.21.15.29:0/2281236505 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f824806af00 0x7f824806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.697+0000 7f826659c640 1 --2- 172.21.15.29:0/2281236505 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f824806af00 0x7f824806d3c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8260033000 tx=0x7f8260009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:11.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.701+0000 7f825effd640 1 -- 172.21.15.29:0/2281236505 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8258054850 con 0x7f82680c3210 2024-01-25T15:05:11.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.880+0000 7f826caa4640 1 -- 172.21.15.29:0/2281236505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f82680ac950 con 0x7f82680c3210 2024-01-25T15:05:11.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.881+0000 7f825effd640 1 -- 172.21.15.29:0/2281236505 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8258057e70 con 0x7f82680c3210 2024-01-25T15:05:11.882 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.882+0000 7f826caa4640 1 -- 172.21.15.29:0/2281236505 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f824806af00 msgr2=0x7f824806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.882+0000 7f826caa4640 1 --2- 172.21.15.29:0/2281236505 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f824806af00 0x7f824806d3c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8260033000 tx=0x7f8260009030 comp rx=0 tx=0).stop 2024-01-25T15:05:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.882+0000 7f826caa4640 1 -- 172.21.15.29:0/2281236505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82680c3210 msgr2=0x7f8268150400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.883+0000 7f826caa4640 1 --2- 172.21.15.29:0/2281236505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82680c3210 0x7f8268150400 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f82680c53c0 tx=0x7f8258007bc0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.883+0000 7f826caa4640 1 -- 172.21.15.29:0/2281236505 shutdown_connections 2024-01-25T15:05:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.883+0000 7f826caa4640 1 --2- 172.21.15.29:0/2281236505 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f824806af00 0x7f824806d3c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.883+0000 7f826caa4640 1 --2- 172.21.15.29:0/2281236505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82680c3210 0x7f8268150400 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.883+0000 7f826caa4640 1 --2- 172.21.15.29:0/2281236505 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8268151660 0x7f82681ed820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.883+0000 7f826caa4640 1 --2- 172.21.15.29:0/2281236505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f82540039e0 0x7f82680c0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.883+0000 7f826caa4640 1 -- 172.21.15.29:0/2281236505 >> 172.21.15.29:0/2281236505 conn(0x7f82680c6ca0 msgr2=0x7f82680ab260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.883+0000 7f826caa4640 1 -- 172.21.15.29:0/2281236505 shutdown_connections 2024-01-25T15:05:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.883+0000 7f826caa4640 1 -- 172.21.15.29:0/2281236505 wait complete. 2024-01-25T15:05:11.894 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-25T15:05:11.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.996+0000 7f720af0f640 1 Processor -- start 2024-01-25T15:05:11.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.996+0000 7f720af0f640 1 -- start start 2024-01-25T15:05:11.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.997+0000 7f720af0f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7204151f80 0x7f72040c6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:11.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.997+0000 7f720af0f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7204158120 con 0x7f7204155190 2024-01-25T15:05:11.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.997+0000 7f720af0f640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72040c4db0 con 0x7f72040c48d0 2024-01-25T15:05:11.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.997+0000 7f720af0f640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72040c5090 con 0x7f7204151f80 2024-01-25T15:05:11.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.997+0000 7f72094ac640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7204155190 0x7f72040c74f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34704/0 (socket says 172.21.15.29:34704) 2024-01-25T15:05:11.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.997+0000 7f72094ac640 1 -- 172.21.15.29:0/470076815 learned_addr learned my addr 172.21.15.29:0/470076815 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:11.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.997+0000 7f7208cab640 1 --2- 172.21.15.29:0/470076815 >> v2:172.21.15.29:3300/0 conn(0x7f7204151f80 0x7f72040c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:11.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.997+0000 7f72037fe640 1 -- 172.21.15.29:0/470076815 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178727202 0 0) 0x7f7204158120 con 0x7f7204155190 2024-01-25T15:05:11.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.997+0000 7f72037fe640 1 -- 172.21.15.29:0/470076815 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71f4003520 con 0x7f7204155190 2024-01-25T15:05:11.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.997+0000 7f7208cab640 1 -- 172.21.15.29:0/470076815 >> v1:172.21.15.52:6789/0 conn(0x7f72040c48d0 legacy=0x7f72041585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:11.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.997+0000 7f7208cab640 1 -- 172.21.15.29:0/470076815 >> v1:172.21.15.29:6789/0 conn(0x7f7204155190 legacy=0x7f72040c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:11.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.997+0000 7f7208cab640 1 -- 172.21.15.29:0/470076815 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72040c5370 con 0x7f7204151f80 2024-01-25T15:05:12.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.998+0000 7f7208cab640 1 --2- 172.21.15.29:0/470076815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7204151f80 0x7f72040c6030 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f71f80097a0 tx=0x7f71f802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f41eaa104220d9 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:12.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.998+0000 7f72037fe640 1 -- 172.21.15.29:0/470076815 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f8030610 con 0x7f7204151f80 2024-01-25T15:05:12.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.998+0000 7f72037fe640 1 -- 172.21.15.29:0/470076815 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f8030770 con 0x7f7204151f80 2024-01-25T15:05:12.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.998+0000 7f72037fe640 1 -- 172.21.15.29:0/470076815 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f8030ae0 con 0x7f7204151f80 2024-01-25T15:05:12.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.998+0000 7f720af0f640 1 -- 172.21.15.29:0/470076815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7204151f80 msgr2=0x7f72040c6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:12.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.998+0000 7f720af0f640 1 --2- 172.21.15.29:0/470076815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7204151f80 0x7f72040c6030 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f71f80097a0 tx=0x7f71f802b960 comp rx=0 tx=0).stop 2024-01-25T15:05:12.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.999+0000 7f720af0f640 1 -- 172.21.15.29:0/470076815 shutdown_connections 2024-01-25T15:05:12.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.999+0000 7f720af0f640 1 --2- 172.21.15.29:0/470076815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7204151f80 0x7f72040c6030 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.999+0000 7f720af0f640 1 -- 172.21.15.29:0/470076815 >> 172.21.15.29:0/470076815 conn(0x7f72040c7f10 msgr2=0x7f72040c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:12.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.999+0000 7f720af0f640 1 -- 172.21.15.29:0/470076815 shutdown_connections 2024-01-25T15:05:12.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:11.999+0000 7f720af0f640 1 -- 172.21.15.29:0/470076815 wait complete. 2024-01-25T15:05:12.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.000+0000 7f720af0f640 1 Processor -- start 2024-01-25T15:05:12.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.000+0000 7f720af0f640 1 -- start start 2024-01-25T15:05:12.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.000+0000 7f720af0f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72040c48d0 0x7f72041edc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:12.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.000+0000 7f720af0f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7204151f80 0x7f7204156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:12.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.000+0000 7f720af0f640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7204155190 0x7f72041461a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:12.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.000+0000 7f720af0f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72041eb750 con 0x7f7204151f80 2024-01-25T15:05:12.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.000+0000 7f720af0f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72041eb140 con 0x7f72040c48d0 2024-01-25T15:05:12.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.000+0000 7f720af0f640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72041ee190 con 0x7f7204155190 2024-01-25T15:05:12.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.001+0000 7f7203fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7204151f80 0x7f7204156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:12.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.001+0000 7f7203fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7204151f80 0x7f7204156dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55806/0 (socket says 172.21.15.29:55806) 2024-01-25T15:05:12.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.001+0000 7f7203fff640 1 -- 172.21.15.29:0/3170681059 learned_addr learned my addr 172.21.15.29:0/3170681059 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:12.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.001+0000 7f7208cab640 1 --2- 172.21.15.29:0/3170681059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72040c48d0 0x7f72041edc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:12.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.001+0000 7f72094ac640 1 --2- 172.21.15.29:0/3170681059 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7204155190 0x7f72041461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:12.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.001+0000 7f7203fff640 1 -- 172.21.15.29:0/3170681059 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7204155190 msgr2=0x7f72041461a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:12.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.001+0000 7f7203fff640 1 --2- 172.21.15.29:0/3170681059 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7204155190 0x7f72041461a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.001+0000 7f7203fff640 1 -- 172.21.15.29:0/3170681059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72040c48d0 msgr2=0x7f72041edc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:12.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.001+0000 7f7203fff640 1 --2- 172.21.15.29:0/3170681059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72040c48d0 0x7f72041edc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.001+0000 7f7203fff640 1 -- 172.21.15.29:0/3170681059 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f8009400 con 0x7f7204151f80 2024-01-25T15:05:12.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.001+0000 7f7203fff640 1 --2- 172.21.15.29:0/3170681059 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7204151f80 0x7f7204156dd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f71f000c3c0 tx=0x7f71f000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:12.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.001+0000 7f72017fa640 1 -- 172.21.15.29:0/3170681059 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f00052d0 con 0x7f7204151f80 2024-01-25T15:05:12.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.001+0000 7f72017fa640 1 -- 172.21.15.29:0/3170681059 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f0005450 con 0x7f7204151f80 2024-01-25T15:05:12.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.001+0000 7f720af0f640 1 -- 172.21.15.29:0/3170681059 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72040ac830 con 0x7f7204151f80 2024-01-25T15:05:12.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.001+0000 7f72017fa640 1 -- 172.21.15.29:0/3170681059 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f0007260 con 0x7f7204151f80 2024-01-25T15:05:12.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.001+0000 7f720af0f640 1 -- 172.21.15.29:0/3170681059 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72041eb3e0 con 0x7f7204151f80 2024-01-25T15:05:12.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.002+0000 7f720af0f640 1 -- 172.21.15.29:0/3170681059 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f720404eb10 con 0x7f7204151f80 2024-01-25T15:05:12.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.003+0000 7f72017fa640 1 -- 172.21.15.29:0/3170681059 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f71f00073c0 con 0x7f7204151f80 2024-01-25T15:05:12.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.003+0000 7f72017fa640 1 --2- 172.21.15.29:0/3170681059 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f71e806aed0 0x7f71e806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:12.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.003+0000 7f72017fa640 1 -- 172.21.15.29:0/3170681059 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f71f0088d30 con 0x7f7204151f80 2024-01-25T15:05:12.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.003+0000 7f7208cab640 1 --2- 172.21.15.29:0/3170681059 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f71e806aed0 0x7f71e806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:12.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.004+0000 7f7208cab640 1 --2- 172.21.15.29:0/3170681059 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f71e806aed0 0x7f71e806d390 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f71f8036000 tx=0x7f71f8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:12.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.007+0000 7f72017fa640 1 -- 172.21.15.29:0/3170681059 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f71f00538b0 con 0x7f7204151f80 2024-01-25T15:05:12.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.199+0000 7f720af0f640 1 -- 172.21.15.29:0/3170681059 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f72041eb570 con 0x7f7204151f80 2024-01-25T15:05:12.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.199+0000 7f72017fa640 1 -- 172.21.15.29:0/3170681059 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f71f0056ed0 con 0x7f7204151f80 2024-01-25T15:05:12.200 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-25T15:05:12.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.201+0000 7f720af0f640 1 -- 172.21.15.29:0/3170681059 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f71e806aed0 msgr2=0x7f71e806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:12.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.201+0000 7f720af0f640 1 --2- 172.21.15.29:0/3170681059 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f71e806aed0 0x7f71e806d390 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f71f8036000 tx=0x7f71f8008030 comp rx=0 tx=0).stop 2024-01-25T15:05:12.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.201+0000 7f720af0f640 1 -- 172.21.15.29:0/3170681059 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7204151f80 msgr2=0x7f7204156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:12.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.201+0000 7f720af0f640 1 --2- 172.21.15.29:0/3170681059 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7204151f80 0x7f7204156dd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f71f000c3c0 tx=0x7f71f000c880 comp rx=0 tx=0).stop 2024-01-25T15:05:12.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.201+0000 7f720af0f640 1 -- 172.21.15.29:0/3170681059 shutdown_connections 2024-01-25T15:05:12.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.201+0000 7f720af0f640 1 --2- 172.21.15.29:0/3170681059 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7204155190 0x7f72041461a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.201+0000 7f720af0f640 1 --2- 172.21.15.29:0/3170681059 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f71e806aed0 0x7f71e806d390 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.201+0000 7f720af0f640 1 --2- 172.21.15.29:0/3170681059 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7204151f80 0x7f7204156dd0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.201+0000 7f720af0f640 1 --2- 172.21.15.29:0/3170681059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72040c48d0 0x7f72041edc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.201+0000 7f720af0f640 1 -- 172.21.15.29:0/3170681059 >> 172.21.15.29:0/3170681059 conn(0x7f72040c7f10 msgr2=0x7f72041515d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:12.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.201+0000 7f720af0f640 1 -- 172.21.15.29:0/3170681059 shutdown_connections 2024-01-25T15:05:12.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.201+0000 7f720af0f640 1 -- 172.21.15.29:0/3170681059 wait complete. 2024-01-25T15:05:12.212 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-25T15:05:12.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:12.213 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-01-25T15:05:12.247 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-01-25T15:05:12.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:12.247 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-25T15:05:12.308 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-01-25T15:05:12.308 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:05:12.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.409+0000 7f5a7aa46640 1 Processor -- start 2024-01-25T15:05:12.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.409+0000 7f5a7aa46640 1 -- start start 2024-01-25T15:05:12.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.410+0000 7f5a7aa46640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5a7406b2b0 0x7f5a7406b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:12.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.410+0000 7f5a7aa46640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5a740c66b0 0x7f5a7415f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:12.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.410+0000 7f5a7aa46640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a741521d0 con 0x7f5a741551a0 2024-01-25T15:05:12.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.410+0000 7f5a7aa46640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7406be50 con 0x7f5a740c66b0 2024-01-25T15:05:12.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.410+0000 7f5a7aa46640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a740c5b10 con 0x7f5a7406b2b0 2024-01-25T15:05:12.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.410+0000 7f5a78fe3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5a740c66b0 0x7f5a7415f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:12.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.410+0000 7f5a737fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5a741551a0 0x7f5a740c5fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34710/0 (socket says 172.21.15.29:34710) 2024-01-25T15:05:12.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.410+0000 7f5a737fe640 1 -- 172.21.15.29:0/2326047640 learned_addr learned my addr 172.21.15.29:0/2326047640 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:12.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.410+0000 7f5a73fff640 1 --2- 172.21.15.29:0/2326047640 >> v2:172.21.15.52:3300/0 conn(0x7f5a7406b2b0 0x7f5a7406b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:12.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.410+0000 7f5a78fe3640 1 -- 172.21.15.29:0/2326047640 >> v2:172.21.15.52:3300/0 conn(0x7f5a7406b2b0 msgr2=0x7f5a7406b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:12.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.410+0000 7f5a78fe3640 1 --2- 172.21.15.29:0/2326047640 >> v2:172.21.15.52:3300/0 conn(0x7f5a7406b2b0 0x7f5a7406b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.410+0000 7f5a78fe3640 1 -- 172.21.15.29:0/2326047640 >> v1:172.21.15.29:6789/0 conn(0x7f5a741551a0 legacy=0x7f5a740c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:12.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.410+0000 7f5a72ffd640 1 -- 172.21.15.29:0/2326047640 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038747950 0 0) 0x7f5a741521d0 con 0x7f5a741551a0 2024-01-25T15:05:12.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.410+0000 7f5a78fe3640 1 -- 172.21.15.29:0/2326047640 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a740c4f20 con 0x7f5a740c66b0 2024-01-25T15:05:12.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.411+0000 7f5a78fe3640 1 --2- 172.21.15.29:0/2326047640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a740c66b0 0x7f5a7415f0a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5a7408b610 tx=0x7f5a6c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da553118b4c4735 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:12.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.411+0000 7f5a72ffd640 1 -- 172.21.15.29:0/2326047640 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c02cbf0 con 0x7f5a740c66b0 2024-01-25T15:05:12.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.411+0000 7f5a72ffd640 1 -- 172.21.15.29:0/2326047640 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c02cd50 con 0x7f5a740c66b0 2024-01-25T15:05:12.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.411+0000 7f5a72ffd640 1 -- 172.21.15.29:0/2326047640 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c034660 con 0x7f5a740c66b0 2024-01-25T15:05:12.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.412+0000 7f5a7aa46640 1 -- 172.21.15.29:0/2326047640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a740c66b0 msgr2=0x7f5a7415f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:12.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.412+0000 7f5a7aa46640 1 --2- 172.21.15.29:0/2326047640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a740c66b0 0x7f5a7415f0a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5a7408b610 tx=0x7f5a6c02be40 comp rx=0 tx=0).stop 2024-01-25T15:05:12.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.412+0000 7f5a7aa46640 1 -- 172.21.15.29:0/2326047640 shutdown_connections 2024-01-25T15:05:12.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.412+0000 7f5a7aa46640 1 --2- 172.21.15.29:0/2326047640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a740c66b0 0x7f5a7415f0a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.412+0000 7f5a7aa46640 1 --2- 172.21.15.29:0/2326047640 >> v2:172.21.15.52:3300/0 conn(0x7f5a7406b2b0 0x7f5a7406b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.412+0000 7f5a7aa46640 1 -- 172.21.15.29:0/2326047640 >> 172.21.15.29:0/2326047640 conn(0x7f5a740ca1f0 msgr2=0x7f5a740ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:12.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.412+0000 7f5a7aa46640 1 -- 172.21.15.29:0/2326047640 shutdown_connections 2024-01-25T15:05:12.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.412+0000 7f5a7aa46640 1 -- 172.21.15.29:0/2326047640 wait complete. 2024-01-25T15:05:12.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.413+0000 7f5a7aa46640 1 Processor -- start 2024-01-25T15:05:12.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.413+0000 7f5a7aa46640 1 -- start start 2024-01-25T15:05:12.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.414+0000 7f5a7aa46640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a7406b2b0 0x7f5a740c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:12.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.414+0000 7f5a7aa46640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a740c66b0 0x7f5a740c3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:12.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.414+0000 7f5a7aa46640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a741551a0 0x7f5a740ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:12.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.414+0000 7f5a7aa46640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a741ed760 con 0x7f5a740c66b0 2024-01-25T15:05:12.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.414+0000 7f5a7aa46640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a741eda40 con 0x7f5a741551a0 2024-01-25T15:05:12.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.414+0000 7f5a7aa46640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a741edd20 con 0x7f5a7406b2b0 2024-01-25T15:05:12.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.414+0000 7f5a737fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a740c66b0 0x7f5a740c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:12.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.414+0000 7f5a737fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a740c66b0 0x7f5a740c3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55830/0 (socket says 172.21.15.29:55830) 2024-01-25T15:05:12.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.414+0000 7f5a737fe640 1 -- 172.21.15.29:0/2044374406 learned_addr learned my addr 172.21.15.29:0/2044374406 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:12.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.414+0000 7f5a73fff640 1 --2- 172.21.15.29:0/2044374406 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a7406b2b0 0x7f5a740c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:12.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.414+0000 7f5a78fe3640 1 --2- 172.21.15.29:0/2044374406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a741551a0 0x7f5a740ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:12.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.414+0000 7f5a737fe640 1 -- 172.21.15.29:0/2044374406 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a7406b2b0 msgr2=0x7f5a740c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:12.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.414+0000 7f5a737fe640 1 --2- 172.21.15.29:0/2044374406 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a7406b2b0 0x7f5a740c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.414+0000 7f5a737fe640 1 -- 172.21.15.29:0/2044374406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a741551a0 msgr2=0x7f5a740ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:12.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.414+0000 7f5a737fe640 1 --2- 172.21.15.29:0/2044374406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a741551a0 0x7f5a740ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.414+0000 7f5a737fe640 1 -- 172.21.15.29:0/2044374406 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c009a70 con 0x7f5a740c66b0 2024-01-25T15:05:12.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.414+0000 7f5a737fe640 1 --2- 172.21.15.29:0/2044374406 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a740c66b0 0x7f5a740c3300 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400c430 tx=0x7f5a6400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:12.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.415+0000 7f5a70ff9640 1 -- 172.21.15.29:0/2044374406 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a640074e0 con 0x7f5a740c66b0 2024-01-25T15:05:12.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.415+0000 7f5a70ff9640 1 -- 172.21.15.29:0/2044374406 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a64007660 con 0x7f5a740c66b0 2024-01-25T15:05:12.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.415+0000 7f5a7aa46640 1 -- 172.21.15.29:0/2044374406 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a741ee000 con 0x7f5a740c66b0 2024-01-25T15:05:12.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.415+0000 7f5a70ff9640 1 -- 172.21.15.29:0/2044374406 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a64004a20 con 0x7f5a740c66b0 2024-01-25T15:05:12.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.415+0000 7f5a7aa46640 1 -- 172.21.15.29:0/2044374406 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a740c3840 con 0x7f5a740c66b0 2024-01-25T15:05:12.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.416+0000 7f5a7aa46640 1 -- 172.21.15.29:0/2044374406 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a740c9d00 con 0x7f5a740c66b0 2024-01-25T15:05:12.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.416+0000 7f5a70ff9640 1 -- 172.21.15.29:0/2044374406 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f5a64004b80 con 0x7f5a740c66b0 2024-01-25T15:05:12.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.417+0000 7f5a70ff9640 1 --2- 172.21.15.29:0/2044374406 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5a6006af00 0x7f5a6006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:12.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.417+0000 7f5a70ff9640 1 -- 172.21.15.29:0/2044374406 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5a64089800 con 0x7f5a740c66b0 2024-01-25T15:05:12.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.417+0000 7f5a73fff640 1 --2- 172.21.15.29:0/2044374406 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5a6006af00 0x7f5a6006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:12.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.417+0000 7f5a73fff640 1 --2- 172.21.15.29:0/2044374406 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5a6006af00 0x7f5a6006d3c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5a68006fd0 tx=0x7f5a68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:12.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.421+0000 7f5a70ff9640 1 -- 172.21.15.29:0/2044374406 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f5a64054380 con 0x7f5a740c66b0 2024-01-25T15:05:12.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.644+0000 7f5a7aa46640 1 -- 172.21.15.29:0/2044374406 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a74074080 con 0x7f5a740c66b0 2024-01-25T15:05:12.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.644+0000 7f5a70ff9640 1 -- 172.21.15.29:0/2044374406 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4931 (secure 0 0 0) 0x7f5a640579a0 con 0x7f5a740c66b0 2024-01-25T15:05:12.645 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:12.645 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6836/2584242962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2584242962},{"type":"v1","addr":"172.21.15.52:6836","nonce":2584242962}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1800543981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1800543981},{"type":"v1","addr":"172.21.15.29:6834","nonce":1800543981}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3686497601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3686497601},{"type":"v1","addr":"172.21.15.29:6835","nonce":3686497601}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:04:26.896909+0000","modified":"2024-01-25T15:04:42.952775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6837/417879912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6835","nonce":417879912},{"type":"v1","addr":"172.21.15.52:6837","nonce":417879912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-25T15:05:12.645 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-01-25T15:05:12.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.646+0000 7f5a7aa46640 1 -- 172.21.15.29:0/2044374406 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5a6006af00 msgr2=0x7f5a6006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:12.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.646+0000 7f5a7aa46640 1 --2- 172.21.15.29:0/2044374406 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5a6006af00 0x7f5a6006d3c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5a68006fd0 tx=0x7f5a68008040 comp rx=0 tx=0).stop 2024-01-25T15:05:12.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.646+0000 7f5a7aa46640 1 -- 172.21.15.29:0/2044374406 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a740c66b0 msgr2=0x7f5a740c3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:12.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.646+0000 7f5a7aa46640 1 --2- 172.21.15.29:0/2044374406 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a740c66b0 0x7f5a740c3300 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400c430 tx=0x7f5a6400c8f0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.646+0000 7f5a7aa46640 1 -- 172.21.15.29:0/2044374406 shutdown_connections 2024-01-25T15:05:12.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.646+0000 7f5a7aa46640 1 --2- 172.21.15.29:0/2044374406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a741551a0 0x7f5a740ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.646+0000 7f5a7aa46640 1 --2- 172.21.15.29:0/2044374406 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5a6006af00 0x7f5a6006d3c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.646+0000 7f5a7aa46640 1 --2- 172.21.15.29:0/2044374406 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a740c66b0 0x7f5a740c3300 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.646+0000 7f5a7aa46640 1 --2- 172.21.15.29:0/2044374406 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a7406b2b0 0x7f5a740c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.646+0000 7f5a7aa46640 1 -- 172.21.15.29:0/2044374406 >> 172.21.15.29:0/2044374406 conn(0x7f5a740ca1f0 msgr2=0x7f5a740c82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:12.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.646+0000 7f5a7aa46640 1 -- 172.21.15.29:0/2044374406 shutdown_connections 2024-01-25T15:05:12.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.646+0000 7f5a7aa46640 1 -- 172.21.15.29:0/2044374406 wait complete. 2024-01-25T15:05:12.658 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:12.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.758+0000 7fd4a27de640 1 Processor -- start 2024-01-25T15:05:12.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.759+0000 7fd4a27de640 1 -- start start 2024-01-25T15:05:12.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.759+0000 7fd4a27de640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd49c0c8560 0x7fd49c1551a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:12.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.759+0000 7fd4a27de640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd49c0c56f0 0x7fd49c14e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:12.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.759+0000 7fd4a27de640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49c0c1f10 con 0x7fd49c0c2ad0 2024-01-25T15:05:12.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.759+0000 7fd4a27de640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd49c0c2720 con 0x7fd49c0c8560 2024-01-25T15:05:12.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.759+0000 7fd4a27de640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c1556e0 con 0x7fd49c0c56f0 2024-01-25T15:05:12.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.759+0000 7fd49bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd49c0c8560 0x7fd49c1551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:12.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.759+0000 7fd49bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd49c0c8560 0x7fd49c1551a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55832/0 (socket says 172.21.15.29:55832) 2024-01-25T15:05:12.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.759+0000 7fd49bfff640 1 -- 172.21.15.29:0/1522912943 learned_addr learned my addr 172.21.15.29:0/1522912943 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:12.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.760+0000 7fd4a0d7b640 1 --2- 172.21.15.29:0/1522912943 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd49c0c56f0 0x7fd49c14e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:12.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.760+0000 7fd49bfff640 1 -- 172.21.15.29:0/1522912943 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd49c0c56f0 msgr2=0x7fd49c14e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:12.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.760+0000 7fd49bfff640 1 --2- 172.21.15.29:0/1522912943 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd49c0c56f0 0x7fd49c14e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.760+0000 7fd49bfff640 1 -- 172.21.15.29:0/1522912943 >> v1:172.21.15.52:6789/0 conn(0x7fd49c0c2ad0 legacy=0x7fd49c0c4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:12.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.760+0000 7fd49bfff640 1 -- 172.21.15.29:0/1522912943 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49c0c2160 con 0x7fd49c0c8560 2024-01-25T15:05:12.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.760+0000 7fd4a0d7b640 1 --2- 172.21.15.29:0/1522912943 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd49c0c56f0 0x7fd49c14e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:12.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.760+0000 7fd49bfff640 1 --2- 172.21.15.29:0/1522912943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd49c0c8560 0x7fd49c1551a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd484009870 tx=0x7fd48402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8d119cbacbd4f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:12.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.761+0000 7fd49affd640 1 -- 172.21.15.29:0/1522912943 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd484031640 con 0x7fd49c0c8560 2024-01-25T15:05:12.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.761+0000 7fd49affd640 1 -- 172.21.15.29:0/1522912943 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4840317a0 con 0x7fd49c0c8560 2024-01-25T15:05:12.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.761+0000 7fd49affd640 1 -- 172.21.15.29:0/1522912943 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd484031b30 con 0x7fd49c0c8560 2024-01-25T15:05:12.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.761+0000 7fd4a27de640 1 -- 172.21.15.29:0/1522912943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd49c0c8560 msgr2=0x7fd49c1551a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:12.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.761+0000 7fd4a27de640 1 --2- 172.21.15.29:0/1522912943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd49c0c8560 0x7fd49c1551a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd484009870 tx=0x7fd48402b8f0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.761+0000 7fd4a27de640 1 -- 172.21.15.29:0/1522912943 shutdown_connections 2024-01-25T15:05:12.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.761+0000 7fd4a27de640 1 --2- 172.21.15.29:0/1522912943 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd49c0c56f0 0x7fd49c14e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.761+0000 7fd4a27de640 1 --2- 172.21.15.29:0/1522912943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd49c0c8560 0x7fd49c1551a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.761+0000 7fd4a27de640 1 -- 172.21.15.29:0/1522912943 >> 172.21.15.29:0/1522912943 conn(0x7fd49c06a8a0 msgr2=0x7fd49c06acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:12.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.761+0000 7fd4a27de640 1 -- 172.21.15.29:0/1522912943 shutdown_connections 2024-01-25T15:05:12.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.761+0000 7fd4a27de640 1 -- 172.21.15.29:0/1522912943 wait complete. 2024-01-25T15:05:12.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.762+0000 7fd4a27de640 1 Processor -- start 2024-01-25T15:05:12.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.762+0000 7fd4a27de640 1 -- start start 2024-01-25T15:05:12.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.763+0000 7fd4a27de640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c0c2ad0 0x7fd49c153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:12.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.763+0000 7fd4a27de640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd49c0c56f0 0x7fd49c1e6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:12.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.763+0000 7fd4a27de640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd49c0c8560 0x7fd49c1e73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:12.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.763+0000 7fd4a27de640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c14f700 con 0x7fd49c0c8560 2024-01-25T15:05:12.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.763+0000 7fd4a27de640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c1ed3d0 con 0x7fd49c0c2ad0 2024-01-25T15:05:12.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.763+0000 7fd4a27de640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c1ed6b0 con 0x7fd49c0c56f0 2024-01-25T15:05:12.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.763+0000 7fd4a0d7b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd49c0c8560 0x7fd49c1e73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:12.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.763+0000 7fd4a0d7b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd49c0c8560 0x7fd49c1e73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55838/0 (socket says 172.21.15.29:55838) 2024-01-25T15:05:12.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.763+0000 7fd4a0d7b640 1 -- 172.21.15.29:0/2989354713 learned_addr learned my addr 172.21.15.29:0/2989354713 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:12.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.763+0000 7fd49bfff640 1 --2- 172.21.15.29:0/2989354713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c0c2ad0 0x7fd49c153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:12.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.763+0000 7fd49b7fe640 1 --2- 172.21.15.29:0/2989354713 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd49c0c56f0 0x7fd49c1e6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:12.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.763+0000 7fd4a0d7b640 1 -- 172.21.15.29:0/2989354713 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd49c0c56f0 msgr2=0x7fd49c1e6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:12.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.763+0000 7fd4a0d7b640 1 --2- 172.21.15.29:0/2989354713 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd49c0c56f0 0x7fd49c1e6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.763+0000 7fd4a0d7b640 1 -- 172.21.15.29:0/2989354713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c0c2ad0 msgr2=0x7fd49c153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:12.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.763+0000 7fd4a0d7b640 1 --2- 172.21.15.29:0/2989354713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c0c2ad0 0x7fd49c153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.763+0000 7fd4a0d7b640 1 -- 172.21.15.29:0/2989354713 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4840094d0 con 0x7fd49c0c8560 2024-01-25T15:05:12.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.764+0000 7fd4a0d7b640 1 --2- 172.21.15.29:0/2989354713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd49c0c8560 0x7fd49c1e73e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd49400ce70 tx=0x7fd49400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:12.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.764+0000 7fd498ff9640 1 -- 172.21.15.29:0/2989354713 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494003b90 con 0x7fd49c0c8560 2024-01-25T15:05:12.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.764+0000 7fd498ff9640 1 -- 172.21.15.29:0/2989354713 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd494003d10 con 0x7fd49c0c8560 2024-01-25T15:05:12.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.764+0000 7fd4a27de640 1 -- 172.21.15.29:0/2989354713 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd49c1ed990 con 0x7fd49c0c8560 2024-01-25T15:05:12.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.764+0000 7fd498ff9640 1 -- 172.21.15.29:0/2989354713 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494004260 con 0x7fd49c0c8560 2024-01-25T15:05:12.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.764+0000 7fd4a27de640 1 -- 172.21.15.29:0/2989354713 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd49c153b50 con 0x7fd49c0c8560 2024-01-25T15:05:12.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.765+0000 7fd4a27de640 1 -- 172.21.15.29:0/2989354713 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd49c1ee190 con 0x7fd49c0c8560 2024-01-25T15:05:12.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.765+0000 7fd498ff9640 1 -- 172.21.15.29:0/2989354713 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fd4940043c0 con 0x7fd49c0c8560 2024-01-25T15:05:12.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.766+0000 7fd498ff9640 1 --2- 172.21.15.29:0/2989354713 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd47c06aed0 0x7fd47c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:12.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.766+0000 7fd498ff9640 1 -- 172.21.15.29:0/2989354713 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd49408a280 con 0x7fd49c0c8560 2024-01-25T15:05:12.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.766+0000 7fd49bfff640 1 --2- 172.21.15.29:0/2989354713 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd47c06aed0 0x7fd47c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:12.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.766+0000 7fd49bfff640 1 --2- 172.21.15.29:0/2989354713 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd47c06aed0 0x7fd47c06d390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd484036000 tx=0x7fd48403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:12.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.770+0000 7fd498ff9640 1 -- 172.21.15.29:0/2989354713 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fd49c1ee190 con 0x7fd49c0c8560 2024-01-25T15:05:12.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.950+0000 7fd4a27de640 1 -- 172.21.15.29:0/2989354713 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd49c1ee190 con 0x7fd49c0c8560 2024-01-25T15:05:12.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.951+0000 7fd498ff9640 1 -- 172.21.15.29:0/2989354713 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18747 (secure 0 0 0) 0x7fd49c1ee190 con 0x7fd49c0c8560 2024-01-25T15:05:12.952 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:12.952 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":26,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:05:08.669787+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:12.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.953+0000 7fd4a27de640 1 -- 172.21.15.29:0/2989354713 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd47c06aed0 msgr2=0x7fd47c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:12.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.953+0000 7fd4a27de640 1 --2- 172.21.15.29:0/2989354713 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd47c06aed0 0x7fd47c06d390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd484036000 tx=0x7fd48403c040 comp rx=0 tx=0).stop 2024-01-25T15:05:12.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.953+0000 7fd4a27de640 1 -- 172.21.15.29:0/2989354713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd49c0c8560 msgr2=0x7fd49c1e73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:12.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.953+0000 7fd4a27de640 1 --2- 172.21.15.29:0/2989354713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd49c0c8560 0x7fd49c1e73e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd49400ce70 tx=0x7fd49400a710 comp rx=0 tx=0).stop 2024-01-25T15:05:12.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.953+0000 7fd4a27de640 1 -- 172.21.15.29:0/2989354713 shutdown_connections 2024-01-25T15:05:12.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.953+0000 7fd4a27de640 1 --2- 172.21.15.29:0/2989354713 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd47c06aed0 0x7fd47c06d390 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.953+0000 7fd4a27de640 1 --2- 172.21.15.29:0/2989354713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd49c0c8560 0x7fd49c1e73e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.953+0000 7fd4a27de640 1 --2- 172.21.15.29:0/2989354713 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd49c0c56f0 0x7fd49c1e6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.953+0000 7fd4a27de640 1 --2- 172.21.15.29:0/2989354713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd49c0c2ad0 0x7fd49c153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:12.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.953+0000 7fd4a27de640 1 -- 172.21.15.29:0/2989354713 >> 172.21.15.29:0/2989354713 conn(0x7fd49c06a8a0 msgr2=0x7fd49c0c63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:12.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.953+0000 7fd4a27de640 1 -- 172.21.15.29:0/2989354713 shutdown_connections 2024-01-25T15:05:12.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:12.953+0000 7fd4a27de640 1 -- 172.21.15.29:0/2989354713 wait complete. 2024-01-25T15:05:12.965 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T15:04:14.955791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T15:04:24.986626+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T15:04:25.873673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-25T15:04:29.578261+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-25T15:05:12.965 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:05:13.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.069+0000 7fb8b2b4c640 1 Processor -- start 2024-01-25T15:05:13.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.069+0000 7fb8b2b4c640 1 -- start start 2024-01-25T15:05:13.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.070+0000 7fb8b2b4c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8ac14fbf0 0x7fb8ac0c1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.070+0000 7fb8b2b4c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb8ac0c1e60 0x7fb8ac15cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.070+0000 7fb8b2b4c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ac0a9ce0 con 0x7fb8ac0abe10 2024-01-25T15:05:13.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.070+0000 7fb8b2b4c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8ac153400 con 0x7fb8ac0c1e60 2024-01-25T15:05:13.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.070+0000 7fb8b2b4c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0ab050 con 0x7fb8ac14fbf0 2024-01-25T15:05:13.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.070+0000 7fb8b10e9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb8ac0c1e60 0x7fb8ac15cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.070+0000 7fb8abfff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb8ac0abe10 0x7fb8ac0a8490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34722/0 (socket says 172.21.15.29:34722) 2024-01-25T15:05:13.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.070+0000 7fb8b10e9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb8ac0c1e60 0x7fb8ac15cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55852/0 (socket says 172.21.15.29:55852) 2024-01-25T15:05:13.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.070+0000 7fb8abfff640 1 -- 172.21.15.29:0/2183096785 learned_addr learned my addr 172.21.15.29:0/2183096785 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:13.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.070+0000 7fb8b08e8640 1 --2- 172.21.15.29:0/2183096785 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8ac14fbf0 0x7fb8ac0c1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.070+0000 7fb8b10e9640 1 -- 172.21.15.29:0/2183096785 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8ac14fbf0 msgr2=0x7fb8ac0c1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:13.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.070+0000 7fb8b10e9640 1 --2- 172.21.15.29:0/2183096785 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8ac14fbf0 0x7fb8ac0c1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.070+0000 7fb8b10e9640 1 -- 172.21.15.29:0/2183096785 >> v1:172.21.15.29:6789/0 conn(0x7fb8ac0abe10 legacy=0x7fb8ac0a8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:13.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.070+0000 7fb8b10e9640 1 -- 172.21.15.29:0/2183096785 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac0ab330 con 0x7fb8ac0c1e60 2024-01-25T15:05:13.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.070+0000 7fb8ab7fe640 1 -- 172.21.15.29:0/2183096785 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376430282 0 0) 0x7fb898001110 con 0x7fb8ac0abe10 2024-01-25T15:05:13.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.070+0000 7fb8b08e8640 1 --2- 172.21.15.29:0/2183096785 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8ac14fbf0 0x7fb8ac0c1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:13.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.071+0000 7fb8b10e9640 1 --2- 172.21.15.29:0/2183096785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8ac0c1e60 0x7fb8ac15cd90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009d90 tx=0x7fb8a402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268c522572999a2e server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:13.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.071+0000 7fb8ab7fe640 1 -- 172.21.15.29:0/2183096785 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a402cc50 con 0x7fb8ac0c1e60 2024-01-25T15:05:13.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.071+0000 7fb8ab7fe640 1 -- 172.21.15.29:0/2183096785 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a402cdb0 con 0x7fb8ac0c1e60 2024-01-25T15:05:13.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.071+0000 7fb8ab7fe640 1 -- 172.21.15.29:0/2183096785 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4034660 con 0x7fb8ac0c1e60 2024-01-25T15:05:13.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.072+0000 7fb8b2b4c640 1 -- 172.21.15.29:0/2183096785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8ac0c1e60 msgr2=0x7fb8ac15cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:13.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.072+0000 7fb8b2b4c640 1 --2- 172.21.15.29:0/2183096785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8ac0c1e60 0x7fb8ac15cd90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009d90 tx=0x7fb8a402bea0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.072+0000 7fb8b2b4c640 1 -- 172.21.15.29:0/2183096785 shutdown_connections 2024-01-25T15:05:13.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.072+0000 7fb8b2b4c640 1 --2- 172.21.15.29:0/2183096785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8ac0c1e60 0x7fb8ac15cd90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.072+0000 7fb8b2b4c640 1 --2- 172.21.15.29:0/2183096785 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8ac14fbf0 0x7fb8ac0c1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.072+0000 7fb8b2b4c640 1 -- 172.21.15.29:0/2183096785 >> 172.21.15.29:0/2183096785 conn(0x7fb8ac0c2a10 msgr2=0x7fb8ac0c2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:13.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.072+0000 7fb8b2b4c640 1 -- 172.21.15.29:0/2183096785 shutdown_connections 2024-01-25T15:05:13.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.072+0000 7fb8b2b4c640 1 -- 172.21.15.29:0/2183096785 wait complete. 2024-01-25T15:05:13.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.073+0000 7fb8b2b4c640 1 Processor -- start 2024-01-25T15:05:13.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.073+0000 7fb8b2b4c640 1 -- start start 2024-01-25T15:05:13.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.074+0000 7fb8b2b4c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8ac0abe10 0x7fb8ac0c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.074+0000 7fb8b2b4c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8ac0c1e60 0x7fb8ac0bef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.074+0000 7fb8b2b4c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8ac14fbf0 0x7fb8ac0bf470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.074+0000 7fb8b2b4c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0bd9d0 con 0x7fb8ac0c1e60 2024-01-25T15:05:13.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.074+0000 7fb8b2b4c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0beac0 con 0x7fb8ac14fbf0 2024-01-25T15:05:13.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.074+0000 7fb8b2b4c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac14b1f0 con 0x7fb8ac0abe10 2024-01-25T15:05:13.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.074+0000 7fb8abfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8ac0c1e60 0x7fb8ac0bef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.074+0000 7fb8abfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8ac0c1e60 0x7fb8ac0bef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55856/0 (socket says 172.21.15.29:55856) 2024-01-25T15:05:13.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.074+0000 7fb8abfff640 1 -- 172.21.15.29:0/73855560 learned_addr learned my addr 172.21.15.29:0/73855560 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:13.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.074+0000 7fb8b08e8640 1 --2- 172.21.15.29:0/73855560 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8ac0abe10 0x7fb8ac0c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.074+0000 7fb8b10e9640 1 --2- 172.21.15.29:0/73855560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8ac14fbf0 0x7fb8ac0bf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.074+0000 7fb8abfff640 1 -- 172.21.15.29:0/73855560 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8ac0abe10 msgr2=0x7fb8ac0c15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:13.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.074+0000 7fb8abfff640 1 --2- 172.21.15.29:0/73855560 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8ac0abe10 0x7fb8ac0c15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.074+0000 7fb8abfff640 1 -- 172.21.15.29:0/73855560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8ac14fbf0 msgr2=0x7fb8ac0bf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:13.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.074+0000 7fb8abfff640 1 --2- 172.21.15.29:0/73855560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8ac14fbf0 0x7fb8ac0bf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.074+0000 7fb8abfff640 1 -- 172.21.15.29:0/73855560 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a4009a70 con 0x7fb8ac0c1e60 2024-01-25T15:05:13.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.074+0000 7fb8abfff640 1 --2- 172.21.15.29:0/73855560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8ac0c1e60 0x7fb8ac0bef30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb89800c430 tx=0x7fb89800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:13.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.074+0000 7fb8a97fa640 1 -- 172.21.15.29:0/73855560 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8980074e0 con 0x7fb8ac0c1e60 2024-01-25T15:05:13.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.075+0000 7fb8a97fa640 1 -- 172.21.15.29:0/73855560 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb898007660 con 0x7fb8ac0c1e60 2024-01-25T15:05:13.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.075+0000 7fb8a97fa640 1 -- 172.21.15.29:0/73855560 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb898004a20 con 0x7fb8ac0c1e60 2024-01-25T15:05:13.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.075+0000 7fb8b2b4c640 1 -- 172.21.15.29:0/73855560 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ac1e8bb0 con 0x7fb8ac0c1e60 2024-01-25T15:05:13.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.075+0000 7fb8b2b4c640 1 -- 172.21.15.29:0/73855560 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ac1561d0 con 0x7fb8ac0c1e60 2024-01-25T15:05:13.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.076+0000 7fb8b2b4c640 1 -- 172.21.15.29:0/73855560 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ac0bec50 con 0x7fb8ac0c1e60 2024-01-25T15:05:13.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.076+0000 7fb8a97fa640 1 -- 172.21.15.29:0/73855560 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fb898004b80 con 0x7fb8ac0c1e60 2024-01-25T15:05:13.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.076+0000 7fb8a97fa640 1 --2- 172.21.15.29:0/73855560 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb89006af00 0x7fb89006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.076+0000 7fb8a97fa640 1 -- 172.21.15.29:0/73855560 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb8980894f0 con 0x7fb8ac0c1e60 2024-01-25T15:05:13.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.077+0000 7fb8b08e8640 1 --2- 172.21.15.29:0/73855560 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb89006af00 0x7fb89006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.077+0000 7fb8b08e8640 1 --2- 172.21.15.29:0/73855560 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb89006af00 0x7fb89006d3c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0006fd0 tx=0x7fb8a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:13.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.080+0000 7fb8a97fa640 1 -- 172.21.15.29:0/73855560 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fb8ac0bec50 con 0x7fb8ac0c1e60 2024-01-25T15:05:13.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.258+0000 7fb8b2b4c640 1 -- 172.21.15.29:0/73855560 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb8ac0a9ce0 con 0x7fb8ac0c1e60 2024-01-25T15:05:13.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.258+0000 7fb8a97fa640 1 -- 172.21.15.29:0/73855560 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb8ac0a9ce0 con 0x7fb8ac0c1e60 2024-01-25T15:05:13.259 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-25T15:05:13.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.260+0000 7fb8b2b4c640 1 -- 172.21.15.29:0/73855560 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb89006af00 msgr2=0x7fb89006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:13.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.260+0000 7fb8b2b4c640 1 --2- 172.21.15.29:0/73855560 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb89006af00 0x7fb89006d3c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0006fd0 tx=0x7fb8a0008040 comp rx=0 tx=0).stop 2024-01-25T15:05:13.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.260+0000 7fb8b2b4c640 1 -- 172.21.15.29:0/73855560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8ac0c1e60 msgr2=0x7fb8ac0bef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:13.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.260+0000 7fb8b2b4c640 1 --2- 172.21.15.29:0/73855560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8ac0c1e60 0x7fb8ac0bef30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb89800c430 tx=0x7fb89800c8f0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.260+0000 7fb8b2b4c640 1 -- 172.21.15.29:0/73855560 shutdown_connections 2024-01-25T15:05:13.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.260+0000 7fb8b2b4c640 1 --2- 172.21.15.29:0/73855560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8ac14fbf0 0x7fb8ac0bf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.260+0000 7fb8b2b4c640 1 --2- 172.21.15.29:0/73855560 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb89006af00 0x7fb89006d3c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.260+0000 7fb8b2b4c640 1 --2- 172.21.15.29:0/73855560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8ac0c1e60 0x7fb8ac0bef30 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.260+0000 7fb8b2b4c640 1 --2- 172.21.15.29:0/73855560 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8ac0abe10 0x7fb8ac0c15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.260+0000 7fb8b2b4c640 1 -- 172.21.15.29:0/73855560 >> 172.21.15.29:0/73855560 conn(0x7fb8ac0c2a10 msgr2=0x7fb8ac0c4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:13.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.260+0000 7fb8b2b4c640 1 -- 172.21.15.29:0/73855560 shutdown_connections 2024-01-25T15:05:13.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.260+0000 7fb8b2b4c640 1 -- 172.21.15.29:0/73855560 wait complete. 2024-01-25T15:05:13.272 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:05:13.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.375+0000 7f427b1ad640 1 Processor -- start 2024-01-25T15:05:13.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.375+0000 7f427b1ad640 1 -- start start 2024-01-25T15:05:13.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.376+0000 7f427b1ad640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f427406b490 0x7f42740c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.376+0000 7f427b1ad640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f42740c8620 0x7f4274151c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.376+0000 7f427b1ad640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42740c6770 con 0x7f4274158b80 2024-01-25T15:05:13.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.376+0000 7f427b1ad640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4274154f10 con 0x7f42740c8620 2024-01-25T15:05:13.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.376+0000 7f427b1ad640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42741551f0 con 0x7f427406b490 2024-01-25T15:05:13.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.376+0000 7f427974a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f42740c8620 0x7f4274151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.376+0000 7f4273fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4274158b80 0x7f42740c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34734/0 (socket says 172.21.15.29:34734) 2024-01-25T15:05:13.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.376+0000 7f4273fff640 1 -- 172.21.15.29:0/1194547107 learned_addr learned my addr 172.21.15.29:0/1194547107 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:13.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.376+0000 7f4278f49640 1 --2- 172.21.15.29:0/1194547107 >> v2:172.21.15.52:3300/0 conn(0x7f427406b490 0x7f42740c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.376+0000 7f427974a640 1 -- 172.21.15.29:0/1194547107 >> v2:172.21.15.52:3300/0 conn(0x7f427406b490 msgr2=0x7f42740c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:13.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.376+0000 7f427974a640 1 --2- 172.21.15.29:0/1194547107 >> v2:172.21.15.52:3300/0 conn(0x7f427406b490 0x7f42740c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.376+0000 7f427974a640 1 -- 172.21.15.29:0/1194547107 >> v1:172.21.15.29:6789/0 conn(0x7f4274158b80 legacy=0x7f42740c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:13.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.376+0000 7f42737fe640 1 -- 172.21.15.29:0/1194547107 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785551312 0 0) 0x7f42740c6770 con 0x7f4274158b80 2024-01-25T15:05:13.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.376+0000 7f427974a640 1 -- 172.21.15.29:0/1194547107 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42741554d0 con 0x7f42740c8620 2024-01-25T15:05:13.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.376+0000 7f4278f49640 1 --2- 172.21.15.29:0/1194547107 >> v2:172.21.15.52:3300/0 conn(0x7f427406b490 0x7f42740c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:13.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.377+0000 7f427974a640 1 --2- 172.21.15.29:0/1194547107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42740c8620 0x7f4274151c30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f42740c7b60 tx=0x7f426c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a5a76bc6906a24 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:13.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.377+0000 7f42737fe640 1 -- 172.21.15.29:0/1194547107 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c02cbf0 con 0x7f42740c8620 2024-01-25T15:05:13.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.377+0000 7f42737fe640 1 -- 172.21.15.29:0/1194547107 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c02cd50 con 0x7f42740c8620 2024-01-25T15:05:13.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.377+0000 7f42737fe640 1 -- 172.21.15.29:0/1194547107 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c034660 con 0x7f42740c8620 2024-01-25T15:05:13.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.377+0000 7f427b1ad640 1 -- 172.21.15.29:0/1194547107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42740c8620 msgr2=0x7f4274151c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:13.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.377+0000 7f427b1ad640 1 --2- 172.21.15.29:0/1194547107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42740c8620 0x7f4274151c30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f42740c7b60 tx=0x7f426c02be40 comp rx=0 tx=0).stop 2024-01-25T15:05:13.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.377+0000 7f427b1ad640 1 -- 172.21.15.29:0/1194547107 shutdown_connections 2024-01-25T15:05:13.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.377+0000 7f427b1ad640 1 --2- 172.21.15.29:0/1194547107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42740c8620 0x7f4274151c30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.377+0000 7f427b1ad640 1 --2- 172.21.15.29:0/1194547107 >> v2:172.21.15.52:3300/0 conn(0x7f427406b490 0x7f42740c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.378+0000 7f427b1ad640 1 -- 172.21.15.29:0/1194547107 >> 172.21.15.29:0/1194547107 conn(0x7f42740ca010 msgr2=0x7f42740ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:13.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.378+0000 7f427b1ad640 1 -- 172.21.15.29:0/1194547107 shutdown_connections 2024-01-25T15:05:13.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.378+0000 7f427b1ad640 1 -- 172.21.15.29:0/1194547107 wait complete. 2024-01-25T15:05:13.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.379+0000 7f427b1ad640 1 Processor -- start 2024-01-25T15:05:13.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.379+0000 7f427b1ad640 1 -- start start 2024-01-25T15:05:13.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.379+0000 7f427b1ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f427406b490 0x7f42740aac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.379+0000 7f427b1ad640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f42740c8620 0x7f42741500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.379+0000 7f427b1ad640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4274158b80 0x7f427414e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.379+0000 7f427b1ad640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427414c970 con 0x7f4274158b80 2024-01-25T15:05:13.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.379+0000 7f427b1ad640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427414db80 con 0x7f427406b490 2024-01-25T15:05:13.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.379+0000 7f427b1ad640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4274150cd0 con 0x7f42740c8620 2024-01-25T15:05:13.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.380+0000 7f427974a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4274158b80 0x7f427414e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.380+0000 7f427974a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4274158b80 0x7f427414e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55880/0 (socket says 172.21.15.29:55880) 2024-01-25T15:05:13.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.380+0000 7f427974a640 1 -- 172.21.15.29:0/227260919 learned_addr learned my addr 172.21.15.29:0/227260919 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:13.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.380+0000 7f4273fff640 1 --2- 172.21.15.29:0/227260919 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f42740c8620 0x7f42741500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.380+0000 7f4278f49640 1 --2- 172.21.15.29:0/227260919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f427406b490 0x7f42740aac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.380+0000 7f427974a640 1 -- 172.21.15.29:0/227260919 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f42740c8620 msgr2=0x7f42741500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:13.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.380+0000 7f427974a640 1 --2- 172.21.15.29:0/227260919 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f42740c8620 0x7f42741500d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.380+0000 7f427974a640 1 -- 172.21.15.29:0/227260919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f427406b490 msgr2=0x7f42740aac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:13.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.380+0000 7f427974a640 1 --2- 172.21.15.29:0/227260919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f427406b490 0x7f42740aac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.380+0000 7f427974a640 1 -- 172.21.15.29:0/227260919 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c009a70 con 0x7f4274158b80 2024-01-25T15:05:13.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.380+0000 7f427974a640 1 --2- 172.21.15.29:0/227260919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4274158b80 0x7f427414e010 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f426c02c450 tx=0x7f426c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:13.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.380+0000 7f42717fa640 1 -- 172.21.15.29:0/227260919 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c040650 con 0x7f4274158b80 2024-01-25T15:05:13.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.380+0000 7f42717fa640 1 -- 172.21.15.29:0/227260919 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c0407d0 con 0x7f4274158b80 2024-01-25T15:05:13.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.380+0000 7f427b1ad640 1 -- 172.21.15.29:0/227260919 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4274155b70 con 0x7f4274158b80 2024-01-25T15:05:13.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.380+0000 7f42717fa640 1 -- 172.21.15.29:0/227260919 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c040b80 con 0x7f4274158b80 2024-01-25T15:05:13.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.380+0000 7f427b1ad640 1 -- 172.21.15.29:0/227260919 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4274151250 con 0x7f4274158b80 2024-01-25T15:05:13.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.381+0000 7f427b1ad640 1 -- 172.21.15.29:0/227260919 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4274067be0 con 0x7f4274158b80 2024-01-25T15:05:13.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.382+0000 7f42717fa640 1 -- 172.21.15.29:0/227260919 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f426c040ce0 con 0x7f4274158b80 2024-01-25T15:05:13.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.382+0000 7f42717fa640 1 --2- 172.21.15.29:0/227260919 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f425806af00 0x7f425806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.382+0000 7f42717fa640 1 -- 172.21.15.29:0/227260919 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f426c0acc40 con 0x7f4274158b80 2024-01-25T15:05:13.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.382+0000 7f4278f49640 1 --2- 172.21.15.29:0/227260919 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f425806af00 0x7f425806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.383+0000 7f4278f49640 1 --2- 172.21.15.29:0/227260919 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f425806af00 0x7f425806d3c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f426800a990 tx=0x7f4268008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:13.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.386+0000 7f42717fa640 1 -- 172.21.15.29:0/227260919 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f426c077850 con 0x7f4274158b80 2024-01-25T15:05:13.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.565+0000 7f427b1ad640 1 -- 172.21.15.29:0/227260919 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f427414dd30 con 0x7f4274158b80 2024-01-25T15:05:13.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.565+0000 7f42717fa640 1 -- 172.21.15.29:0/227260919 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f427414dd30 con 0x7f4274158b80 2024-01-25T15:05:13.566 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:13.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.567+0000 7f427b1ad640 1 -- 172.21.15.29:0/227260919 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f425806af00 msgr2=0x7f425806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:13.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.567+0000 7f427b1ad640 1 --2- 172.21.15.29:0/227260919 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f425806af00 0x7f425806d3c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f426800a990 tx=0x7f4268008040 comp rx=0 tx=0).stop 2024-01-25T15:05:13.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.567+0000 7f427b1ad640 1 -- 172.21.15.29:0/227260919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4274158b80 msgr2=0x7f427414e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:13.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.567+0000 7f427b1ad640 1 --2- 172.21.15.29:0/227260919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4274158b80 0x7f427414e010 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f426c02c450 tx=0x7f426c004a40 comp rx=0 tx=0).stop 2024-01-25T15:05:13.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.567+0000 7f427b1ad640 1 -- 172.21.15.29:0/227260919 shutdown_connections 2024-01-25T15:05:13.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.567+0000 7f427b1ad640 1 --2- 172.21.15.29:0/227260919 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f425806af00 0x7f425806d3c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.567+0000 7f427b1ad640 1 --2- 172.21.15.29:0/227260919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4274158b80 0x7f427414e010 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.567+0000 7f427b1ad640 1 --2- 172.21.15.29:0/227260919 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f42740c8620 0x7f42741500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.567+0000 7f427b1ad640 1 --2- 172.21.15.29:0/227260919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f427406b490 0x7f42740aac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.567+0000 7f427b1ad640 1 -- 172.21.15.29:0/227260919 >> 172.21.15.29:0/227260919 conn(0x7f42740ca010 msgr2=0x7f42740c4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:13.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.567+0000 7f427b1ad640 1 -- 172.21.15.29:0/227260919 shutdown_connections 2024-01-25T15:05:13.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.567+0000 7f427b1ad640 1 -- 172.21.15.29:0/227260919 wait complete. 2024-01-25T15:05:13.579 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:05:13.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.682+0000 7f9fda25c640 1 Processor -- start 2024-01-25T15:05:13.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.682+0000 7f9fda25c640 1 -- start start 2024-01-25T15:05:13.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.683+0000 7f9fda25c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9fd406b490 0x7f9fd40c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.683+0000 7f9fda25c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9fd4158b80 0x7f9fd40c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.683+0000 7f9fda25c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9fd40c8450 0x7f9fd4151c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.683+0000 7f9fda25c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd40c88e0 con 0x7f9fd406b490 2024-01-25T15:05:13.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.683+0000 7f9fda25c640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd40c6770 con 0x7f9fd40c8450 2024-01-25T15:05:13.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.683+0000 7f9fda25c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd4154f10 con 0x7f9fd4158b80 2024-01-25T15:05:13.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.683+0000 7f9fd37fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9fd406b490 0x7f9fd40c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.683+0000 7f9fd37fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9fd406b490 0x7f9fd40c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55894/0 (socket says 172.21.15.29:55894) 2024-01-25T15:05:13.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.683+0000 7f9fd37fe640 1 -- 172.21.15.29:0/2431104590 learned_addr learned my addr 172.21.15.29:0/2431104590 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:13.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.683+0000 7f9fd37fe640 1 -- 172.21.15.29:0/2431104590 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9fd4158b80 msgr2=0x7f9fd40c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:13.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.683+0000 7f9fd2ffd640 1 --2- 172.21.15.29:0/2431104590 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9fd4158b80 0x7f9fd40c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.683+0000 7f9fd3fff640 1 --2- 172.21.15.29:0/2431104590 >> v2:172.21.15.52:3300/0 conn(0x7f9fd40c8450 0x7f9fd4151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.683+0000 7f9fd37fe640 1 --2- 172.21.15.29:0/2431104590 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9fd4158b80 0x7f9fd40c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.683+0000 7f9fd37fe640 1 -- 172.21.15.29:0/2431104590 >> v2:172.21.15.52:3300/0 conn(0x7f9fd40c8450 msgr2=0x7f9fd4151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:13.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.683+0000 7f9fd37fe640 1 --2- 172.21.15.29:0/2431104590 >> v2:172.21.15.52:3300/0 conn(0x7f9fd40c8450 0x7f9fd4151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.683+0000 7f9fd37fe640 1 -- 172.21.15.29:0/2431104590 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd41551f0 con 0x7f9fd406b490 2024-01-25T15:05:13.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.683+0000 7f9fd2ffd640 1 --2- 172.21.15.29:0/2431104590 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9fd4158b80 0x7f9fd40c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:13.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.683+0000 7f9fd3fff640 1 --2- 172.21.15.29:0/2431104590 >> v2:172.21.15.52:3300/0 conn(0x7f9fd40c8450 0x7f9fd4151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:13.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.684+0000 7f9fd37fe640 1 --2- 172.21.15.29:0/2431104590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fd406b490 0x7f9fd40c6120 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40686d0 tx=0x7f9fc402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c681d1f3cff9a6fe server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:13.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.684+0000 7f9fd27fc640 1 -- 172.21.15.29:0/2431104590 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc40317e0 con 0x7f9fd406b490 2024-01-25T15:05:13.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.684+0000 7f9fd27fc640 1 -- 172.21.15.29:0/2431104590 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc4031940 con 0x7f9fd406b490 2024-01-25T15:05:13.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.684+0000 7f9fd27fc640 1 -- 172.21.15.29:0/2431104590 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4031cd0 con 0x7f9fd406b490 2024-01-25T15:05:13.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.685+0000 7f9fda25c640 1 -- 172.21.15.29:0/2431104590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fd406b490 msgr2=0x7f9fd40c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:13.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.685+0000 7f9fda25c640 1 --2- 172.21.15.29:0/2431104590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fd406b490 0x7f9fd40c6120 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40686d0 tx=0x7f9fc402b880 comp rx=0 tx=0).stop 2024-01-25T15:05:13.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.685+0000 7f9fda25c640 1 -- 172.21.15.29:0/2431104590 shutdown_connections 2024-01-25T15:05:13.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.685+0000 7f9fda25c640 1 --2- 172.21.15.29:0/2431104590 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9fd4158b80 0x7f9fd40c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.685+0000 7f9fda25c640 1 --2- 172.21.15.29:0/2431104590 >> v2:172.21.15.52:3300/0 conn(0x7f9fd40c8450 0x7f9fd4151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.685+0000 7f9fda25c640 1 --2- 172.21.15.29:0/2431104590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fd406b490 0x7f9fd40c6120 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.685+0000 7f9fda25c640 1 -- 172.21.15.29:0/2431104590 >> 172.21.15.29:0/2431104590 conn(0x7f9fd40ca010 msgr2=0x7f9fd40ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:13.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.685+0000 7f9fda25c640 1 -- 172.21.15.29:0/2431104590 shutdown_connections 2024-01-25T15:05:13.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.685+0000 7f9fda25c640 1 -- 172.21.15.29:0/2431104590 wait complete. 2024-01-25T15:05:13.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.686+0000 7f9fda25c640 1 Processor -- start 2024-01-25T15:05:13.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.686+0000 7f9fda25c640 1 -- start start 2024-01-25T15:05:13.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.687+0000 7f9fda25c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fd406b490 0x7f9fd414a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.687+0000 7f9fda25c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fd40c8450 0x7f9fd4157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.687+0000 7f9fda25c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9fd4158b80 0x7f9fd4148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.687+0000 7f9fda25c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd41ea1a0 con 0x7f9fd406b490 2024-01-25T15:05:13.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.687+0000 7f9fda25c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd41ea480 con 0x7f9fd40c8450 2024-01-25T15:05:13.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.687+0000 7f9fda25c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd41ea760 con 0x7f9fd4158b80 2024-01-25T15:05:13.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.687+0000 7f9fd37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fd406b490 0x7f9fd414a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.687+0000 7f9fd37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fd406b490 0x7f9fd414a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55898/0 (socket says 172.21.15.29:55898) 2024-01-25T15:05:13.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.687+0000 7f9fd37fe640 1 -- 172.21.15.29:0/3613558553 learned_addr learned my addr 172.21.15.29:0/3613558553 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:13.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.687+0000 7f9fd3fff640 1 --2- 172.21.15.29:0/3613558553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9fd4158b80 0x7f9fd4148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.687+0000 7f9fd2ffd640 1 --2- 172.21.15.29:0/3613558553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fd40c8450 0x7f9fd4157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.687+0000 7f9fd37fe640 1 -- 172.21.15.29:0/3613558553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9fd4158b80 msgr2=0x7f9fd4148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:13.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.687+0000 7f9fd37fe640 1 --2- 172.21.15.29:0/3613558553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9fd4158b80 0x7f9fd4148270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.687+0000 7f9fd37fe640 1 -- 172.21.15.29:0/3613558553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fd40c8450 msgr2=0x7f9fd4157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:13.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.687+0000 7f9fd37fe640 1 --2- 172.21.15.29:0/3613558553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fd40c8450 0x7f9fd4157d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.687+0000 7f9fd37fe640 1 -- 172.21.15.29:0/3613558553 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc40094d0 con 0x7f9fd406b490 2024-01-25T15:05:13.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.687+0000 7f9fd37fe640 1 --2- 172.21.15.29:0/3613558553 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fd406b490 0x7f9fd414a8d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4000c00 tx=0x7f9fc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:13.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.688+0000 7f9fbbfff640 1 -- 172.21.15.29:0/3613558553 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4032900 con 0x7f9fd406b490 2024-01-25T15:05:13.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.688+0000 7f9fbbfff640 1 -- 172.21.15.29:0/3613558553 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc4032a60 con 0x7f9fd406b490 2024-01-25T15:05:13.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.688+0000 7f9fda25c640 1 -- 172.21.15.29:0/3613558553 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd41eaa40 con 0x7f9fd406b490 2024-01-25T15:05:13.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.688+0000 7f9fbbfff640 1 -- 172.21.15.29:0/3613558553 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4032e10 con 0x7f9fd406b490 2024-01-25T15:05:13.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.689+0000 7f9fda25c640 1 -- 172.21.15.29:0/3613558553 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd414ae10 con 0x7f9fd406b490 2024-01-25T15:05:13.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.689+0000 7f9fda25c640 1 -- 172.21.15.29:0/3613558553 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd41ea8a0 con 0x7f9fd406b490 2024-01-25T15:05:13.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.690+0000 7f9fbbfff640 1 -- 172.21.15.29:0/3613558553 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9fc404e450 con 0x7f9fd406b490 2024-01-25T15:05:13.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.690+0000 7f9fbbfff640 1 --2- 172.21.15.29:0/3613558553 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9fc006aed0 0x7f9fc006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.690+0000 7f9fbbfff640 1 -- 172.21.15.29:0/3613558553 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f9fc40abb80 con 0x7f9fd406b490 2024-01-25T15:05:13.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.690+0000 7f9fd2ffd640 1 --2- 172.21.15.29:0/3613558553 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9fc006aed0 0x7f9fc006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.691+0000 7f9fd2ffd640 1 --2- 172.21.15.29:0/3613558553 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9fc006aed0 0x7f9fc006d390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40678c0 tx=0x7f9fc8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:13.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.695+0000 7f9fbbfff640 1 -- 172.21.15.29:0/3613558553 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f9fd41ea8a0 con 0x7f9fd406b490 2024-01-25T15:05:13.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.875+0000 7f9fda25c640 1 -- 172.21.15.29:0/3613558553 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9fd41ea8a0 con 0x7f9fd406b490 2024-01-25T15:05:13.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.875+0000 7f9fbbfff640 1 -- 172.21.15.29:0/3613558553 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9fd41ea8a0 con 0x7f9fd406b490 2024-01-25T15:05:13.876 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-25T15:05:13.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.877+0000 7f9fda25c640 1 -- 172.21.15.29:0/3613558553 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9fc006aed0 msgr2=0x7f9fc006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:13.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.878+0000 7f9fda25c640 1 --2- 172.21.15.29:0/3613558553 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9fc006aed0 0x7f9fc006d390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40678c0 tx=0x7f9fc8008040 comp rx=0 tx=0).stop 2024-01-25T15:05:13.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.878+0000 7f9fda25c640 1 -- 172.21.15.29:0/3613558553 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fd406b490 msgr2=0x7f9fd414a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:13.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.878+0000 7f9fda25c640 1 --2- 172.21.15.29:0/3613558553 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fd406b490 0x7f9fd414a8d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4000c00 tx=0x7f9fc40046c0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.878+0000 7f9fda25c640 1 -- 172.21.15.29:0/3613558553 shutdown_connections 2024-01-25T15:05:13.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.878+0000 7f9fda25c640 1 --2- 172.21.15.29:0/3613558553 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9fd4158b80 0x7f9fd4148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.878+0000 7f9fda25c640 1 --2- 172.21.15.29:0/3613558553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fd40c8450 0x7f9fd4157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.878+0000 7f9fda25c640 1 --2- 172.21.15.29:0/3613558553 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9fc006aed0 0x7f9fc006d390 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.878+0000 7f9fda25c640 1 --2- 172.21.15.29:0/3613558553 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fd406b490 0x7f9fd414a8d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.878+0000 7f9fda25c640 1 -- 172.21.15.29:0/3613558553 >> 172.21.15.29:0/3613558553 conn(0x7f9fd40ca010 msgr2=0x7f9fd40ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:13.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.878+0000 7f9fda25c640 1 -- 172.21.15.29:0/3613558553 shutdown_connections 2024-01-25T15:05:13.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.878+0000 7f9fda25c640 1 -- 172.21.15.29:0/3613558553 wait complete. 2024-01-25T15:05:13.889 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-25T15:05:13.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.992+0000 7f4f9b748640 1 Processor -- start 2024-01-25T15:05:13.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.992+0000 7f4f9b748640 1 -- start start 2024-01-25T15:05:13.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.993+0000 7f4f9b748640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4f940af6c0 0x7f4f940c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.993+0000 7f4f9b748640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f940afaa0 con 0x7f4f940c5a70 2024-01-25T15:05:13.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.993+0000 7f4f9b748640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f940c6060 con 0x7f4f9406d560 2024-01-25T15:05:13.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.993+0000 7f4f9b748640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9406c480 con 0x7f4f940af6c0 2024-01-25T15:05:13.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.993+0000 7f4f99ce5640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4f940c5a70 0x7f4f9415f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34750/0 (socket says 172.21.15.29:34750) 2024-01-25T15:05:13.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.993+0000 7f4f99ce5640 1 -- 172.21.15.29:0/2651909435 learned_addr learned my addr 172.21.15.29:0/2651909435 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:13.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.993+0000 7f4f994e4640 1 --2- 172.21.15.29:0/2651909435 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4f940af6c0 0x7f4f940c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f93fff640 1 -- 172.21.15.29:0/2651909435 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513648479 0 0) 0x7f4f940afaa0 con 0x7f4f940c5a70 2024-01-25T15:05:13.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f93fff640 1 -- 172.21.15.29:0/2651909435 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f7c003520 con 0x7f4f940c5a70 2024-01-25T15:05:13.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f93fff640 1 -- 172.21.15.29:0/2651909435 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466625368 0 0) 0x7f4f940c6060 con 0x7f4f9406d560 2024-01-25T15:05:13.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f93fff640 1 -- 172.21.15.29:0/2651909435 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f940afaa0 con 0x7f4f9406d560 2024-01-25T15:05:13.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f93fff640 1 -- 172.21.15.29:0/2651909435 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2446868854 0 0) 0x7f4f7c003520 con 0x7f4f940c5a70 2024-01-25T15:05:13.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f93fff640 1 -- 172.21.15.29:0/2651909435 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4f940af6c0 msgr2=0x7f4f940c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:13.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f93fff640 1 --2- 172.21.15.29:0/2651909435 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4f940af6c0 0x7f4f940c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f93fff640 1 -- 172.21.15.29:0/2651909435 >> v1:172.21.15.52:6789/0 conn(0x7f4f9406d560 legacy=0x7f4f9406b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:13.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f93fff640 1 -- 172.21.15.29:0/2651909435 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f94155480 con 0x7f4f940c5a70 2024-01-25T15:05:13.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f93fff640 1 -- 172.21.15.29:0/2651909435 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f4f840019f0 con 0x7f4f940c5a70 2024-01-25T15:05:13.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f93fff640 1 -- 172.21.15.29:0/2651909435 >> v1:172.21.15.29:6789/0 conn(0x7f4f940c5a70 legacy=0x7f4f9415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:13.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f93fff640 1 --2- 172.21.15.29:0/2651909435 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4f940af6c0 0x7f4f7c003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f93fff640 1 --2- 172.21.15.29:0/2651909435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f7c004100 0x7f4f7c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f93fff640 1 --2- 172.21.15.29:0/2651909435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f7c004d00 0x7f4f7c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:13.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f93fff640 1 -- 172.21.15.29:0/2651909435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9406c480 con 0x7f4f7c004d00 2024-01-25T15:05:13.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f93fff640 1 -- 172.21.15.29:0/2651909435 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c00bac0 con 0x7f4f7c004100 2024-01-25T15:05:13.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f93fff640 1 -- 172.21.15.29:0/2651909435 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c00bc80 con 0x7f4f940af6c0 2024-01-25T15:05:13.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f99ce5640 1 --2- 172.21.15.29:0/2651909435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f7c004d00 0x7f4f7c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f994e4640 1 --2- 172.21.15.29:0/2651909435 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4f940af6c0 0x7f4f7c003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f98ce3640 1 --2- 172.21.15.29:0/2651909435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f7c004100 0x7f4f7c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:13.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f99ce5640 1 -- 172.21.15.29:0/2651909435 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4f940af6c0 msgr2=0x7f4f7c003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:13.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f99ce5640 1 --2- 172.21.15.29:0/2651909435 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4f940af6c0 0x7f4f7c003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f99ce5640 1 -- 172.21.15.29:0/2651909435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f7c004100 msgr2=0x7f4f7c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:13.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f99ce5640 1 --2- 172.21.15.29:0/2651909435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f7c004100 0x7f4f7c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:13.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.994+0000 7f4f99ce5640 1 -- 172.21.15.29:0/2651909435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c003520 con 0x7f4f7c004d00 2024-01-25T15:05:13.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.995+0000 7f4f99ce5640 1 --2- 172.21.15.29:0/2651909435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f7c004d00 0x7f4f7c005180 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400a780 tx=0x7f4f7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df36e9b51f7ae46b server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:13.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.995+0000 7f4f93fff640 1 -- 172.21.15.29:0/2651909435 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f84034630 con 0x7f4f7c004d00 2024-01-25T15:05:14.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.995+0000 7f4f93fff640 1 -- 172.21.15.29:0/2651909435 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8402f070 con 0x7f4f7c004d00 2024-01-25T15:05:14.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.995+0000 7f4f93fff640 1 -- 172.21.15.29:0/2651909435 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f84034a10 con 0x7f4f7c004d00 2024-01-25T15:05:14.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.996+0000 7f4f9b748640 1 -- 172.21.15.29:0/2651909435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f7c004d00 msgr2=0x7f4f7c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:14.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.996+0000 7f4f9b748640 1 --2- 172.21.15.29:0/2651909435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f7c004d00 0x7f4f7c005180 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400a780 tx=0x7f4f7c0057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.996+0000 7f4f99ce5640 1 -- 172.21.15.29:0/2651909435 reap_dead start 2024-01-25T15:05:14.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.996+0000 7f4f9b748640 1 -- 172.21.15.29:0/2651909435 shutdown_connections 2024-01-25T15:05:14.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.996+0000 7f4f9b748640 1 -- 172.21.15.29:0/2651909435 >> 172.21.15.29:0/2651909435 conn(0x7f4f940c6ca0 msgr2=0x7f4f940c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:14.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.996+0000 7f4f9b748640 1 -- 172.21.15.29:0/2651909435 shutdown_connections 2024-01-25T15:05:14.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.996+0000 7f4f9b748640 1 -- 172.21.15.29:0/2651909435 wait complete. 2024-01-25T15:05:14.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.997+0000 7f4f9b748640 1 Processor -- start 2024-01-25T15:05:14.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.997+0000 7f4f9b748640 1 -- start start 2024-01-25T15:05:14.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.998+0000 7f4f9b748640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f940ae0c0 0x7f4f9414e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.998+0000 7f4f9b748640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4f941eb230 0x7f4f941442d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.998+0000 7f4f9b748640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f941e1c40 0x7f4f94144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.998+0000 7f4f9b748640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f941eae10 con 0x7f4f940ae0c0 2024-01-25T15:05:14.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.998+0000 7f4f9b748640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940aeab0 con 0x7f4f941e1c40 2024-01-25T15:05:14.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.998+0000 7f4f9b748640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f941df5c0 con 0x7f4f941eb230 2024-01-25T15:05:14.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.998+0000 7f4f994e4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f940ae0c0 0x7f4f9414e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.998+0000 7f4f994e4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f940ae0c0 0x7f4f9414e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55928/0 (socket says 172.21.15.29:55928) 2024-01-25T15:05:14.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.998+0000 7f4f994e4640 1 -- 172.21.15.29:0/904407568 learned_addr learned my addr 172.21.15.29:0/904407568 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:14.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.998+0000 7f4f98ce3640 1 --2- 172.21.15.29:0/904407568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4f941eb230 0x7f4f941442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.998+0000 7f4f994e4640 1 -- 172.21.15.29:0/904407568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4f941eb230 msgr2=0x7f4f941442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:14.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.998+0000 7f4f99ce5640 1 --2- 172.21.15.29:0/904407568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f941e1c40 0x7f4f94144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.998+0000 7f4f994e4640 1 --2- 172.21.15.29:0/904407568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4f941eb230 0x7f4f941442d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.998+0000 7f4f994e4640 1 -- 172.21.15.29:0/904407568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f941e1c40 msgr2=0x7f4f94144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:14.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.998+0000 7f4f994e4640 1 --2- 172.21.15.29:0/904407568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f941e1c40 0x7f4f94144810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.998+0000 7f4f994e4640 1 -- 172.21.15.29:0/904407568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f941df000 con 0x7f4f940ae0c0 2024-01-25T15:05:14.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.998+0000 7f4f98ce3640 1 --2- 172.21.15.29:0/904407568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4f941eb230 0x7f4f941442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:14.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.998+0000 7f4f994e4640 1 --2- 172.21.15.29:0/904407568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f940ae0c0 0x7f4f9414e400 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0119a0 tx=0x7f4f8c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:14.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.998+0000 7f4f91ffb640 1 -- 172.21.15.29:0/904407568 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c00faf0 con 0x7f4f940ae0c0 2024-01-25T15:05:14.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.998+0000 7f4f91ffb640 1 -- 172.21.15.29:0/904407568 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c00fc50 con 0x7f4f940ae0c0 2024-01-25T15:05:14.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.999+0000 7f4f9b748640 1 -- 172.21.15.29:0/904407568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f941df2e0 con 0x7f4f940ae0c0 2024-01-25T15:05:14.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.999+0000 7f4f91ffb640 1 -- 172.21.15.29:0/904407568 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c014440 con 0x7f4f940ae0c0 2024-01-25T15:05:14.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:13.999+0000 7f4f9b748640 1 -- 172.21.15.29:0/904407568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f941eaa30 con 0x7f4f940ae0c0 2024-01-25T15:05:14.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.000+0000 7f4f9b748640 1 -- 172.21.15.29:0/904407568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f941eb080 con 0x7f4f940ae0c0 2024-01-25T15:05:14.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.000+0000 7f4f91ffb640 1 -- 172.21.15.29:0/904407568 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4f8c01d400 con 0x7f4f940ae0c0 2024-01-25T15:05:14.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.000+0000 7f4f91ffb640 1 --2- 172.21.15.29:0/904407568 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4f8006aed0 0x7f4f8006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.001+0000 7f4f91ffb640 1 -- 172.21.15.29:0/904407568 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f4f8c08a230 con 0x7f4f940ae0c0 2024-01-25T15:05:14.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.001+0000 7f4f98ce3640 1 --2- 172.21.15.29:0/904407568 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4f8006aed0 0x7f4f8006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.001+0000 7f4f98ce3640 1 --2- 172.21.15.29:0/904407568 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4f8006aed0 0x7f4f8006d390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4f940abab0 tx=0x7f4f88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:14.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.005+0000 7f4f91ffb640 1 -- 172.21.15.29:0/904407568 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4f8c054db0 con 0x7f4f940ae0c0 2024-01-25T15:05:14.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.182+0000 7f4f9b748640 1 -- 172.21.15.29:0/904407568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4f941ea5b0 con 0x7f4f940ae0c0 2024-01-25T15:05:14.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.183+0000 7f4f91ffb640 1 -- 172.21.15.29:0/904407568 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4f941ea5b0 con 0x7f4f940ae0c0 2024-01-25T15:05:14.183 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:14.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.185+0000 7f4f9b748640 1 -- 172.21.15.29:0/904407568 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4f8006aed0 msgr2=0x7f4f8006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:14.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.185+0000 7f4f9b748640 1 --2- 172.21.15.29:0/904407568 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4f8006aed0 0x7f4f8006d390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4f940abab0 tx=0x7f4f88009040 comp rx=0 tx=0).stop 2024-01-25T15:05:14.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.185+0000 7f4f9b748640 1 -- 172.21.15.29:0/904407568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f940ae0c0 msgr2=0x7f4f9414e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:14.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.185+0000 7f4f9b748640 1 --2- 172.21.15.29:0/904407568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f940ae0c0 0x7f4f9414e400 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0119a0 tx=0x7f4f8c011e60 comp rx=0 tx=0).stop 2024-01-25T15:05:14.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.185+0000 7f4f9b748640 1 -- 172.21.15.29:0/904407568 shutdown_connections 2024-01-25T15:05:14.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.185+0000 7f4f9b748640 1 --2- 172.21.15.29:0/904407568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f941e1c40 0x7f4f94144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.185+0000 7f4f9b748640 1 --2- 172.21.15.29:0/904407568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4f941eb230 0x7f4f941442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.185+0000 7f4f9b748640 1 --2- 172.21.15.29:0/904407568 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4f8006aed0 0x7f4f8006d390 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.185+0000 7f4f9b748640 1 --2- 172.21.15.29:0/904407568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f940ae0c0 0x7f4f9414e400 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.185+0000 7f4f9b748640 1 -- 172.21.15.29:0/904407568 >> 172.21.15.29:0/904407568 conn(0x7f4f940c6ca0 msgr2=0x7f4f940abcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:14.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.185+0000 7f4f9b748640 1 -- 172.21.15.29:0/904407568 shutdown_connections 2024-01-25T15:05:14.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.185+0000 7f4f9b748640 1 -- 172.21.15.29:0/904407568 wait complete. 2024-01-25T15:05:14.196 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:05:14.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.297+0000 7fc4f74ce640 1 Processor -- start 2024-01-25T15:05:14.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.297+0000 7fc4f74ce640 1 -- start start 2024-01-25T15:05:14.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.297+0000 7fc4f74ce640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4f0152160 0x7fc4f006bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.298+0000 7fc4f74ce640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc4f00c4990 0x7fc4f00c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.298+0000 7fc4f74ce640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f0155430 con 0x7fc4f00c53e0 2024-01-25T15:05:14.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.298+0000 7fc4f74ce640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f0154b40 con 0x7fc4f00c4990 2024-01-25T15:05:14.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.298+0000 7fc4f74ce640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f0152540 con 0x7fc4f0152160 2024-01-25T15:05:14.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.298+0000 7fc4f526a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4f0152160 0x7fc4f006bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.298+0000 7fc4f4a69640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc4f00c4990 0x7fc4f00c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.298+0000 7fc4f526a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4f0152160 0x7fc4f006bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:50586/0 (socket says 172.21.15.29:50586) 2024-01-25T15:05:14.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.298+0000 7fc4f5a6b640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc4f00c53e0 0x7fc4f00c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:47306/0 (socket says 172.21.15.29:47306) 2024-01-25T15:05:14.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.298+0000 7fc4f526a640 1 -- 172.21.15.29:0/362809398 learned_addr learned my addr 172.21.15.29:0/362809398 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:14.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.298+0000 7fc4f526a640 1 -- 172.21.15.29:0/362809398 >> v2:172.21.15.52:3300/0 conn(0x7fc4f00c4990 msgr2=0x7fc4f00c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:14.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.298+0000 7fc4f526a640 1 --2- 172.21.15.29:0/362809398 >> v2:172.21.15.52:3300/0 conn(0x7fc4f00c4990 0x7fc4f00c4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.298+0000 7fc4f526a640 1 -- 172.21.15.29:0/362809398 >> v1:172.21.15.52:6789/0 conn(0x7fc4f00c53e0 legacy=0x7fc4f00c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:14.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.298+0000 7fc4f526a640 1 -- 172.21.15.29:0/362809398 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f00c64b0 con 0x7fc4f0152160 2024-01-25T15:05:14.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.299+0000 7fc4f526a640 1 --2- 172.21.15.29:0/362809398 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4f0152160 0x7fc4f006bc00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009870 tx=0x7fc4ec02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a3390a5b5ee8794 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:14.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.299+0000 7fc4e7fff640 1 -- 172.21.15.29:0/362809398 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec031640 con 0x7fc4f0152160 2024-01-25T15:05:14.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.299+0000 7fc4e7fff640 1 -- 172.21.15.29:0/362809398 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec0317a0 con 0x7fc4f0152160 2024-01-25T15:05:14.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.299+0000 7fc4e7fff640 1 -- 172.21.15.29:0/362809398 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec031b30 con 0x7fc4f0152160 2024-01-25T15:05:14.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.300+0000 7fc4f74ce640 1 -- 172.21.15.29:0/362809398 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4f0152160 msgr2=0x7fc4f006bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:14.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.300+0000 7fc4f74ce640 1 --2- 172.21.15.29:0/362809398 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4f0152160 0x7fc4f006bc00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009870 tx=0x7fc4ec02b8f0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.300+0000 7fc4f74ce640 1 -- 172.21.15.29:0/362809398 shutdown_connections 2024-01-25T15:05:14.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.300+0000 7fc4f74ce640 1 --2- 172.21.15.29:0/362809398 >> v2:172.21.15.52:3300/0 conn(0x7fc4f00c4990 0x7fc4f00c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.300+0000 7fc4f74ce640 1 --2- 172.21.15.29:0/362809398 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4f0152160 0x7fc4f006bc00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.300+0000 7fc4f74ce640 1 -- 172.21.15.29:0/362809398 >> 172.21.15.29:0/362809398 conn(0x7fc4f00ca1f0 msgr2=0x7fc4f00ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:14.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.300+0000 7fc4f74ce640 1 -- 172.21.15.29:0/362809398 shutdown_connections 2024-01-25T15:05:14.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.300+0000 7fc4f74ce640 1 -- 172.21.15.29:0/362809398 wait complete. 2024-01-25T15:05:14.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.301+0000 7fc4f74ce640 1 Processor -- start 2024-01-25T15:05:14.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.301+0000 7fc4f74ce640 1 -- start start 2024-01-25T15:05:14.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.302+0000 7fc4f74ce640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4f00c4990 0x7fc4f0156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.302+0000 7fc4f74ce640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4f00c53e0 0x7fc4f014a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.302+0000 7fc4f74ce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4f0152160 0x7fc4f014ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.302+0000 7fc4f74ce640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f01eab40 con 0x7fc4f00c53e0 2024-01-25T15:05:14.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.302+0000 7fc4f74ce640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f014d960 con 0x7fc4f0152160 2024-01-25T15:05:14.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.302+0000 7fc4f74ce640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f01eb030 con 0x7fc4f00c4990 2024-01-25T15:05:14.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.302+0000 7fc4f4a69640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4f00c53e0 0x7fc4f014a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.302+0000 7fc4f4a69640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4f00c53e0 0x7fc4f014a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55942/0 (socket says 172.21.15.29:55942) 2024-01-25T15:05:14.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.302+0000 7fc4f526a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4f00c4990 0x7fc4f0156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.302+0000 7fc4f4a69640 1 -- 172.21.15.29:0/533234922 learned_addr learned my addr 172.21.15.29:0/533234922 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:14.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.302+0000 7fc4f5a6b640 1 --2- 172.21.15.29:0/533234922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4f0152160 0x7fc4f014ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.302+0000 7fc4f4a69640 1 -- 172.21.15.29:0/533234922 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4f00c4990 msgr2=0x7fc4f0156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:14.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.302+0000 7fc4f4a69640 1 --2- 172.21.15.29:0/533234922 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4f00c4990 0x7fc4f0156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.302+0000 7fc4f4a69640 1 -- 172.21.15.29:0/533234922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4f0152160 msgr2=0x7fc4f014ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:14.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.302+0000 7fc4f4a69640 1 --2- 172.21.15.29:0/533234922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4f0152160 0x7fc4f014ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.302+0000 7fc4f4a69640 1 -- 172.21.15.29:0/533234922 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec0094d0 con 0x7fc4f00c53e0 2024-01-25T15:05:14.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.302+0000 7fc4f4a69640 1 --2- 172.21.15.29:0/533234922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4f00c53e0 0x7fc4f014a790 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc4e000e9b0 tx=0x7fc4e000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:14.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.303+0000 7fc4e5ffb640 1 -- 172.21.15.29:0/533234922 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0009670 con 0x7fc4f00c53e0 2024-01-25T15:05:14.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.303+0000 7fc4e5ffb640 1 -- 172.21.15.29:0/533234922 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e000c9a0 con 0x7fc4f00c53e0 2024-01-25T15:05:14.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.303+0000 7fc4f74ce640 1 -- 172.21.15.29:0/533234922 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f01ead50 con 0x7fc4f00c53e0 2024-01-25T15:05:14.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.303+0000 7fc4e5ffb640 1 -- 172.21.15.29:0/533234922 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e000cd30 con 0x7fc4f00c53e0 2024-01-25T15:05:14.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.303+0000 7fc4f74ce640 1 -- 172.21.15.29:0/533234922 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f014acd0 con 0x7fc4f00c53e0 2024-01-25T15:05:14.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.304+0000 7fc4f74ce640 1 -- 172.21.15.29:0/533234922 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f01558a0 con 0x7fc4f00c53e0 2024-01-25T15:05:14.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.304+0000 7fc4e5ffb640 1 -- 172.21.15.29:0/533234922 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fc4e0013470 con 0x7fc4f00c53e0 2024-01-25T15:05:14.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.305+0000 7fc4e5ffb640 1 --2- 172.21.15.29:0/533234922 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc4d406aed0 0x7fc4d406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.305+0000 7fc4e5ffb640 1 -- 172.21.15.29:0/533234922 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc4e0089bb0 con 0x7fc4f00c53e0 2024-01-25T15:05:14.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.305+0000 7fc4f526a640 1 --2- 172.21.15.29:0/533234922 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc4d406aed0 0x7fc4d406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.305+0000 7fc4f526a640 1 --2- 172.21.15.29:0/533234922 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc4d406aed0 0x7fc4d406d390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec036000 tx=0x7fc4ec03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:14.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.309+0000 7fc4e5ffb640 1 -- 172.21.15.29:0/533234922 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fc4f01558a0 con 0x7fc4f00c53e0 2024-01-25T15:05:14.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.523+0000 7fc4f74ce640 1 -- 172.21.15.29:0/533234922 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4f01558a0 con 0x7fc4f00c53e0 2024-01-25T15:05:14.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.524+0000 7fc4e5ffb640 1 -- 172.21.15.29:0/533234922 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4931 (secure 0 0 0) 0x7fc4f01558a0 con 0x7fc4f00c53e0 2024-01-25T15:05:14.525 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:14.525 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6836/2584242962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2584242962},{"type":"v1","addr":"172.21.15.52:6836","nonce":2584242962}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1800543981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1800543981},{"type":"v1","addr":"172.21.15.29:6834","nonce":1800543981}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3686497601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3686497601},{"type":"v1","addr":"172.21.15.29:6835","nonce":3686497601}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:04:26.896909+0000","modified":"2024-01-25T15:04:42.952775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6837/417879912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6835","nonce":417879912},{"type":"v1","addr":"172.21.15.52:6837","nonce":417879912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-25T15:05:14.525 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-01-25T15:05:14.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.526+0000 7fc4f74ce640 1 -- 172.21.15.29:0/533234922 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc4d406aed0 msgr2=0x7fc4d406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:14.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.526+0000 7fc4f74ce640 1 --2- 172.21.15.29:0/533234922 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc4d406aed0 0x7fc4d406d390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec036000 tx=0x7fc4ec03c040 comp rx=0 tx=0).stop 2024-01-25T15:05:14.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.526+0000 7fc4f74ce640 1 -- 172.21.15.29:0/533234922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4f00c53e0 msgr2=0x7fc4f014a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:14.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.526+0000 7fc4f74ce640 1 --2- 172.21.15.29:0/533234922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4f00c53e0 0x7fc4f014a790 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc4e000e9b0 tx=0x7fc4e000ee70 comp rx=0 tx=0).stop 2024-01-25T15:05:14.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.526+0000 7fc4f74ce640 1 -- 172.21.15.29:0/533234922 shutdown_connections 2024-01-25T15:05:14.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.526+0000 7fc4f74ce640 1 --2- 172.21.15.29:0/533234922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4f0152160 0x7fc4f014ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.526+0000 7fc4f74ce640 1 --2- 172.21.15.29:0/533234922 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc4d406aed0 0x7fc4d406d390 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.526+0000 7fc4f74ce640 1 --2- 172.21.15.29:0/533234922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4f00c53e0 0x7fc4f014a790 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.526+0000 7fc4f74ce640 1 --2- 172.21.15.29:0/533234922 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4f00c4990 0x7fc4f0156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.526+0000 7fc4f74ce640 1 -- 172.21.15.29:0/533234922 >> 172.21.15.29:0/533234922 conn(0x7fc4f00ca1f0 msgr2=0x7fc4f00ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:14.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.526+0000 7fc4f74ce640 1 -- 172.21.15.29:0/533234922 shutdown_connections 2024-01-25T15:05:14.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.526+0000 7fc4f74ce640 1 -- 172.21.15.29:0/533234922 wait complete. 2024-01-25T15:05:14.538 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:14.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.639+0000 7faaee8b2640 1 Processor -- start 2024-01-25T15:05:14.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.639+0000 7faaee8b2640 1 -- start start 2024-01-25T15:05:14.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.639+0000 7faaee8b2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faae8152160 0x7faae806bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.639+0000 7faaee8b2640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae8155430 con 0x7faae80c7f10 2024-01-25T15:05:14.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.639+0000 7faaee8b2640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae8154b40 con 0x7faae80c4990 2024-01-25T15:05:14.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.639+0000 7faaee8b2640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae8152540 con 0x7faae8152160 2024-01-25T15:05:14.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.640+0000 7faaece4f640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7faae80c7f10 0x7faae815f3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34766/0 (socket says 172.21.15.29:34766) 2024-01-25T15:05:14.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.640+0000 7faaece4f640 1 -- 172.21.15.29:0/1089368401 learned_addr learned my addr 172.21.15.29:0/1089368401 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:14.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.640+0000 7faae7fff640 1 --2- 172.21.15.29:0/1089368401 >> v2:172.21.15.52:3300/0 conn(0x7faae8152160 0x7faae806bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.640+0000 7faae6ffd640 1 -- 172.21.15.29:0/1089368401 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538936195 0 0) 0x7faae8155430 con 0x7faae80c7f10 2024-01-25T15:05:14.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.640+0000 7faae6ffd640 1 -- 172.21.15.29:0/1089368401 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faad0003520 con 0x7faae80c7f10 2024-01-25T15:05:14.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.640+0000 7faae6ffd640 1 -- 172.21.15.29:0/1089368401 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3461974234 0 0) 0x7faad0003520 con 0x7faae80c7f10 2024-01-25T15:05:14.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.640+0000 7faae6ffd640 1 -- 172.21.15.29:0/1089368401 >> v2:172.21.15.52:3300/0 conn(0x7faae8152160 msgr2=0x7faae806bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:14.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.640+0000 7faae6ffd640 1 --2- 172.21.15.29:0/1089368401 >> v2:172.21.15.52:3300/0 conn(0x7faae8152160 0x7faae806bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.640+0000 7faae6ffd640 1 -- 172.21.15.29:0/1089368401 >> v1:172.21.15.52:6789/0 conn(0x7faae80c4990 legacy=0x7faae80c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:14.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.640+0000 7faae6ffd640 1 -- 172.21.15.29:0/1089368401 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae80c64b0 con 0x7faae80c7f10 2024-01-25T15:05:14.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.640+0000 7faae6ffd640 1 -- 172.21.15.29:0/1089368401 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7faae00019f0 con 0x7faae80c7f10 2024-01-25T15:05:14.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.640+0000 7faae6ffd640 1 -- 172.21.15.29:0/1089368401 >> v1:172.21.15.29:6789/0 conn(0x7faae80c7f10 legacy=0x7faae815f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:14.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.640+0000 7faae6ffd640 1 --2- 172.21.15.29:0/1089368401 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faad0003970 0x7faad0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.640+0000 7faae6ffd640 1 --2- 172.21.15.29:0/1089368401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faad0004370 0x7faad0004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.640+0000 7faae6ffd640 1 --2- 172.21.15.29:0/1089368401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faad00050e0 0x7faad000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.640+0000 7faae6ffd640 1 -- 172.21.15.29:0/1089368401 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae8152540 con 0x7faad00050e0 2024-01-25T15:05:14.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.640+0000 7faae6ffd640 1 -- 172.21.15.29:0/1089368401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad000c020 con 0x7faad0004370 2024-01-25T15:05:14.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.640+0000 7faae6ffd640 1 -- 172.21.15.29:0/1089368401 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad000c1e0 con 0x7faad0003970 2024-01-25T15:05:14.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.640+0000 7faaece4f640 1 --2- 172.21.15.29:0/1089368401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faad00050e0 0x7faad000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.640+0000 7faae7fff640 1 --2- 172.21.15.29:0/1089368401 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faad0003970 0x7faad0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.640+0000 7faae77fe640 1 --2- 172.21.15.29:0/1089368401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faad0004370 0x7faad0004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.641+0000 7faaece4f640 1 -- 172.21.15.29:0/1089368401 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faad0003970 msgr2=0x7faad0003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:14.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.641+0000 7faaece4f640 1 --2- 172.21.15.29:0/1089368401 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faad0003970 0x7faad0003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.641+0000 7faaece4f640 1 -- 172.21.15.29:0/1089368401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faad0004370 msgr2=0x7faad0004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:14.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.641+0000 7faaece4f640 1 --2- 172.21.15.29:0/1089368401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faad0004370 0x7faad0004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.641+0000 7faaece4f640 1 -- 172.21.15.29:0/1089368401 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad0003520 con 0x7faad00050e0 2024-01-25T15:05:14.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.641+0000 7faae77fe640 1 --2- 172.21.15.29:0/1089368401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faad0004370 0x7faad0004840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:14.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.641+0000 7faaece4f640 1 -- 172.21.15.29:0/1089368401 reap_dead start 2024-01-25T15:05:14.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.641+0000 7faaece4f640 1 --2- 172.21.15.29:0/1089368401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faad00050e0 0x7faad000b980 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7faae000a7a0 tx=0x7faad00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53acf26bb04417c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:14.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.641+0000 7faae6ffd640 1 -- 172.21.15.29:0/1089368401 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae0034630 con 0x7faad00050e0 2024-01-25T15:05:14.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.641+0000 7faae6ffd640 1 -- 172.21.15.29:0/1089368401 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae002f070 con 0x7faad00050e0 2024-01-25T15:05:14.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.641+0000 7faae6ffd640 1 -- 172.21.15.29:0/1089368401 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae00349f0 con 0x7faad00050e0 2024-01-25T15:05:14.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.642+0000 7faaee8b2640 1 -- 172.21.15.29:0/1089368401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faad00050e0 msgr2=0x7faad000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:14.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.642+0000 7faaee8b2640 1 --2- 172.21.15.29:0/1089368401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faad00050e0 0x7faad000b980 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7faae000a7a0 tx=0x7faad00057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.642+0000 7faaee8b2640 1 -- 172.21.15.29:0/1089368401 shutdown_connections 2024-01-25T15:05:14.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.642+0000 7faaee8b2640 1 --2- 172.21.15.29:0/1089368401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faad00050e0 0x7faad000b980 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.642+0000 7faaee8b2640 1 -- 172.21.15.29:0/1089368401 >> 172.21.15.29:0/1089368401 conn(0x7faae80ca1f0 msgr2=0x7faae80ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:14.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.642+0000 7faaee8b2640 1 -- 172.21.15.29:0/1089368401 shutdown_connections 2024-01-25T15:05:14.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.642+0000 7faaee8b2640 1 -- 172.21.15.29:0/1089368401 wait complete. 2024-01-25T15:05:14.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.643+0000 7faaee8b2640 1 Processor -- start 2024-01-25T15:05:14.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.643+0000 7faaee8b2640 1 -- start start 2024-01-25T15:05:14.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.644+0000 7faaee8b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faad00050e0 0x7faae80ab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.644+0000 7faaee8b2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faae8154850 0x7faae814d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.644+0000 7faaee8b2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faae81eda70 0x7faae8148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.644+0000 7faaee8b2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae814f450 con 0x7faae8154850 2024-01-25T15:05:14.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.644+0000 7faaee8b2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae81495c0 con 0x7faad00050e0 2024-01-25T15:05:14.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.644+0000 7faaee8b2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae81498a0 con 0x7faae81eda70 2024-01-25T15:05:14.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.644+0000 7faae77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faae8154850 0x7faae814d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.644+0000 7faae77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faae8154850 0x7faae814d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55970/0 (socket says 172.21.15.29:55970) 2024-01-25T15:05:14.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.644+0000 7faae77fe640 1 -- 172.21.15.29:0/3873682482 learned_addr learned my addr 172.21.15.29:0/3873682482 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:14.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.644+0000 7faaece4f640 1 --2- 172.21.15.29:0/3873682482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faae81eda70 0x7faae8148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.644+0000 7faae7fff640 1 --2- 172.21.15.29:0/3873682482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faad00050e0 0x7faae80ab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.644+0000 7faae77fe640 1 -- 172.21.15.29:0/3873682482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faae81eda70 msgr2=0x7faae8148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:14.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.644+0000 7faae77fe640 1 --2- 172.21.15.29:0/3873682482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faae81eda70 0x7faae8148200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.644+0000 7faae77fe640 1 -- 172.21.15.29:0/3873682482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faad00050e0 msgr2=0x7faae80ab2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:14.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.644+0000 7faae77fe640 1 --2- 172.21.15.29:0/3873682482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faad00050e0 0x7faae80ab2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.644+0000 7faae77fe640 1 -- 172.21.15.29:0/3873682482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae8149b80 con 0x7faae8154850 2024-01-25T15:05:14.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.644+0000 7faae7fff640 1 --2- 172.21.15.29:0/3873682482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faad00050e0 0x7faae80ab2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:14.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.644+0000 7faaece4f640 1 --2- 172.21.15.29:0/3873682482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faae81eda70 0x7faae8148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:14.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.645+0000 7faae77fe640 1 --2- 172.21.15.29:0/3873682482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faae8154850 0x7faae814d8f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7faadc00e560 tx=0x7faadc00ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:14.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.645+0000 7faae4ff9640 1 -- 172.21.15.29:0/3873682482 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc0052e0 con 0x7faae8154850 2024-01-25T15:05:14.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.645+0000 7faae4ff9640 1 -- 172.21.15.29:0/3873682482 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faadc005440 con 0x7faae8154850 2024-01-25T15:05:14.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.645+0000 7faaee8b2640 1 -- 172.21.15.29:0/3873682482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae81ed270 con 0x7faae8154850 2024-01-25T15:05:14.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.645+0000 7faae4ff9640 1 -- 172.21.15.29:0/3873682482 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc003810 con 0x7faae8154850 2024-01-25T15:05:14.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.645+0000 7faaee8b2640 1 -- 172.21.15.29:0/3873682482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae814de30 con 0x7faae8154850 2024-01-25T15:05:14.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.646+0000 7faaee8b2640 1 -- 172.21.15.29:0/3873682482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae80a97d0 con 0x7faae8154850 2024-01-25T15:05:14.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.646+0000 7faae4ff9640 1 -- 172.21.15.29:0/3873682482 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7faadc003970 con 0x7faae8154850 2024-01-25T15:05:14.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.646+0000 7faae4ff9640 1 --2- 172.21.15.29:0/3873682482 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faad406af00 0x7faad406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.647+0000 7faae4ff9640 1 -- 172.21.15.29:0/3873682482 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7faadc0897e0 con 0x7faae8154850 2024-01-25T15:05:14.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.647+0000 7faae7fff640 1 --2- 172.21.15.29:0/3873682482 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faad406af00 0x7faad406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.647+0000 7faae7fff640 1 --2- 172.21.15.29:0/3873682482 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faad406af00 0x7faad406d3c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faad8009b40 tx=0x7faad8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:14.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.651+0000 7faae4ff9640 1 -- 172.21.15.29:0/3873682482 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7faadc054360 con 0x7faae8154850 2024-01-25T15:05:14.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.832+0000 7faaee8b2640 1 -- 172.21.15.29:0/3873682482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faae8074080 con 0x7faae8154850 2024-01-25T15:05:14.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.833+0000 7faae4ff9640 1 -- 172.21.15.29:0/3873682482 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18747 (secure 0 0 0) 0x7faadc057980 con 0x7faae8154850 2024-01-25T15:05:14.834 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:14.834 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":26,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:05:08.669787+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:14.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.835+0000 7faaee8b2640 1 -- 172.21.15.29:0/3873682482 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faad406af00 msgr2=0x7faad406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:14.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.835+0000 7faaee8b2640 1 --2- 172.21.15.29:0/3873682482 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faad406af00 0x7faad406d3c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faad8009b40 tx=0x7faad8008040 comp rx=0 tx=0).stop 2024-01-25T15:05:14.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.835+0000 7faaee8b2640 1 -- 172.21.15.29:0/3873682482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faae8154850 msgr2=0x7faae814d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:14.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.835+0000 7faaee8b2640 1 --2- 172.21.15.29:0/3873682482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faae8154850 0x7faae814d8f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7faadc00e560 tx=0x7faadc00ea20 comp rx=0 tx=0).stop 2024-01-25T15:05:14.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.835+0000 7faaee8b2640 1 -- 172.21.15.29:0/3873682482 shutdown_connections 2024-01-25T15:05:14.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.835+0000 7faaee8b2640 1 --2- 172.21.15.29:0/3873682482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faae81eda70 0x7faae8148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.835+0000 7faaee8b2640 1 --2- 172.21.15.29:0/3873682482 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faad406af00 0x7faad406d3c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.835+0000 7faaee8b2640 1 --2- 172.21.15.29:0/3873682482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faae8154850 0x7faae814d8f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.835+0000 7faaee8b2640 1 --2- 172.21.15.29:0/3873682482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faad00050e0 0x7faae80ab2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.835+0000 7faaee8b2640 1 -- 172.21.15.29:0/3873682482 >> 172.21.15.29:0/3873682482 conn(0x7faae80ca1f0 msgr2=0x7faae80ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:14.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.835+0000 7faaee8b2640 1 -- 172.21.15.29:0/3873682482 shutdown_connections 2024-01-25T15:05:14.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.835+0000 7faaee8b2640 1 -- 172.21.15.29:0/3873682482 wait complete. 2024-01-25T15:05:14.847 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-25T15:05:14.847 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:05:14.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.948+0000 7efe4585c640 1 Processor -- start 2024-01-25T15:05:14.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.948+0000 7efe4585c640 1 -- start start 2024-01-25T15:05:14.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.949+0000 7efe4585c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efe40151e90 0x7efe4006b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.949+0000 7efe4585c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efe4006b760 0x7efe4015f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.949+0000 7efe4585c640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe400c5b40 con 0x7efe400c7f00 2024-01-25T15:05:14.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.949+0000 7efe4585c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe40154c50 con 0x7efe40151e90 2024-01-25T15:05:14.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.949+0000 7efe4585c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4006c0f0 con 0x7efe4006b760 2024-01-25T15:05:14.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.949+0000 7efe3effd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efe40151e90 0x7efe4006b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.949+0000 7efe3effd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efe40151e90 0x7efe4006b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55984/0 (socket says 172.21.15.29:55984) 2024-01-25T15:05:14.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.949+0000 7efe3effd640 1 -- 172.21.15.29:0/1953072176 learned_addr learned my addr 172.21.15.29:0/1953072176 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:14.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.949+0000 7efe3f7fe640 1 --2- 172.21.15.29:0/1953072176 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efe4006b760 0x7efe4015f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.949+0000 7efe3effd640 1 -- 172.21.15.29:0/1953072176 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efe4006b760 msgr2=0x7efe4015f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:14.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.949+0000 7efe3effd640 1 --2- 172.21.15.29:0/1953072176 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efe4006b760 0x7efe4015f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.949+0000 7efe3effd640 1 -- 172.21.15.29:0/1953072176 >> v1:172.21.15.52:6789/0 conn(0x7efe400c7f00 legacy=0x7efe400c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:14.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.949+0000 7efe3effd640 1 -- 172.21.15.29:0/1953072176 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe400c9d90 con 0x7efe40151e90 2024-01-25T15:05:14.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.950+0000 7efe3effd640 1 --2- 172.21.15.29:0/1953072176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe40151e90 0x7efe4006b220 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efe30009870 tx=0x7efe3002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3d3b8ed53127c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:14.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.950+0000 7efe3dffb640 1 -- 172.21.15.29:0/1953072176 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3002f840 con 0x7efe40151e90 2024-01-25T15:05:14.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.950+0000 7efe3dffb640 1 -- 172.21.15.29:0/1953072176 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3002f9a0 con 0x7efe40151e90 2024-01-25T15:05:14.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.950+0000 7efe3dffb640 1 -- 172.21.15.29:0/1953072176 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3002fd30 con 0x7efe40151e90 2024-01-25T15:05:14.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.950+0000 7efe4585c640 1 -- 172.21.15.29:0/1953072176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe40151e90 msgr2=0x7efe4006b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:14.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.950+0000 7efe4585c640 1 --2- 172.21.15.29:0/1953072176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe40151e90 0x7efe4006b220 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efe30009870 tx=0x7efe3002ba20 comp rx=0 tx=0).stop 2024-01-25T15:05:14.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.951+0000 7efe4585c640 1 -- 172.21.15.29:0/1953072176 shutdown_connections 2024-01-25T15:05:14.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.951+0000 7efe4585c640 1 --2- 172.21.15.29:0/1953072176 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efe4006b760 0x7efe4015f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.951+0000 7efe4585c640 1 --2- 172.21.15.29:0/1953072176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe40151e90 0x7efe4006b220 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.951+0000 7efe4585c640 1 -- 172.21.15.29:0/1953072176 >> 172.21.15.29:0/1953072176 conn(0x7efe400ca000 msgr2=0x7efe400ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:14.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.951+0000 7efe4585c640 1 -- 172.21.15.29:0/1953072176 shutdown_connections 2024-01-25T15:05:14.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.951+0000 7efe4585c640 1 -- 172.21.15.29:0/1953072176 wait complete. 2024-01-25T15:05:14.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.952+0000 7efe4585c640 1 Processor -- start 2024-01-25T15:05:14.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.952+0000 7efe4585c640 1 -- start start 2024-01-25T15:05:14.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.952+0000 7efe4585c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe4006b760 0x7efe40148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.952+0000 7efe4585c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe400c7f00 0x7efe400c3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.952+0000 7efe4585c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efe40151e90 0x7efe40155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.952+0000 7efe4585c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe40151670 con 0x7efe400c7f00 2024-01-25T15:05:14.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.952+0000 7efe4585c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe401ea460 con 0x7efe4006b760 2024-01-25T15:05:14.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.952+0000 7efe4585c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe401eb430 con 0x7efe40151e90 2024-01-25T15:05:14.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.953+0000 7efe3e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe400c7f00 0x7efe400c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.953+0000 7efe3e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe400c7f00 0x7efe400c3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55994/0 (socket says 172.21.15.29:55994) 2024-01-25T15:05:14.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.953+0000 7efe3e7fc640 1 -- 172.21.15.29:0/2028777815 learned_addr learned my addr 172.21.15.29:0/2028777815 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:14.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.953+0000 7efe3effd640 1 --2- 172.21.15.29:0/2028777815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe4006b760 0x7efe40148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.953+0000 7efe3f7fe640 1 --2- 172.21.15.29:0/2028777815 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efe40151e90 0x7efe40155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.953+0000 7efe3e7fc640 1 -- 172.21.15.29:0/2028777815 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efe40151e90 msgr2=0x7efe40155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:14.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.953+0000 7efe3e7fc640 1 --2- 172.21.15.29:0/2028777815 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efe40151e90 0x7efe40155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.953+0000 7efe3e7fc640 1 -- 172.21.15.29:0/2028777815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe4006b760 msgr2=0x7efe40148f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:14.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.953+0000 7efe3e7fc640 1 --2- 172.21.15.29:0/2028777815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe4006b760 0x7efe40148f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:14.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.953+0000 7efe3e7fc640 1 -- 172.21.15.29:0/2028777815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe300094d0 con 0x7efe400c7f00 2024-01-25T15:05:14.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.953+0000 7efe3e7fc640 1 --2- 172.21.15.29:0/2028777815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe400c7f00 0x7efe400c3530 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efe3400c440 tx=0x7efe34001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:14.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.953+0000 7efe27fff640 1 -- 172.21.15.29:0/2028777815 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe340052d0 con 0x7efe400c7f00 2024-01-25T15:05:14.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.953+0000 7efe27fff640 1 -- 172.21.15.29:0/2028777815 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe34005430 con 0x7efe400c7f00 2024-01-25T15:05:14.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.953+0000 7efe4585c640 1 -- 172.21.15.29:0/2028777815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe400c3a70 con 0x7efe400c7f00 2024-01-25T15:05:14.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.953+0000 7efe27fff640 1 -- 172.21.15.29:0/2028777815 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34007260 con 0x7efe400c7f00 2024-01-25T15:05:14.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.953+0000 7efe4585c640 1 -- 172.21.15.29:0/2028777815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe401ea950 con 0x7efe400c7f00 2024-01-25T15:05:14.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.954+0000 7efe4585c640 1 -- 172.21.15.29:0/2028777815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe40154900 con 0x7efe400c7f00 2024-01-25T15:05:14.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.955+0000 7efe27fff640 1 -- 172.21.15.29:0/2028777815 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7efe340073c0 con 0x7efe400c7f00 2024-01-25T15:05:14.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.955+0000 7efe27fff640 1 --2- 172.21.15.29:0/2028777815 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efe2c06aed0 0x7efe2c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:14.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.955+0000 7efe27fff640 1 -- 172.21.15.29:0/2028777815 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7efe34088be0 con 0x7efe400c7f00 2024-01-25T15:05:14.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.955+0000 7efe3effd640 1 --2- 172.21.15.29:0/2028777815 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efe2c06aed0 0x7efe2c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:14.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.956+0000 7efe3effd640 1 --2- 172.21.15.29:0/2028777815 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efe2c06aed0 0x7efe2c06d390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efe30036000 tx=0x7efe30008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:14.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:14.959+0000 7efe27fff640 1 -- 172.21.15.29:0/2028777815 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7efe34053760 con 0x7efe400c7f00 2024-01-25T15:05:15.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.175+0000 7efe4585c640 1 -- 172.21.15.29:0/2028777815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe400c3a70 con 0x7efe400c7f00 2024-01-25T15:05:15.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.175+0000 7efe27fff640 1 -- 172.21.15.29:0/2028777815 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4931 (secure 0 0 0) 0x7efe400c3a70 con 0x7efe400c7f00 2024-01-25T15:05:15.176 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:15.176 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6836/2584242962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2584242962},{"type":"v1","addr":"172.21.15.52:6836","nonce":2584242962}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1800543981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1800543981},{"type":"v1","addr":"172.21.15.29:6834","nonce":1800543981}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3686497601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3686497601},{"type":"v1","addr":"172.21.15.29:6835","nonce":3686497601}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:04:26.896909+0000","modified":"2024-01-25T15:04:42.952775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6837/417879912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6835","nonce":417879912},{"type":"v1","addr":"172.21.15.52:6837","nonce":417879912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-25T15:05:15.177 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-01-25T15:05:15.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.177+0000 7efe4585c640 1 -- 172.21.15.29:0/2028777815 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efe2c06aed0 msgr2=0x7efe2c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:15.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.177+0000 7efe4585c640 1 --2- 172.21.15.29:0/2028777815 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efe2c06aed0 0x7efe2c06d390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efe30036000 tx=0x7efe30008030 comp rx=0 tx=0).stop 2024-01-25T15:05:15.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.177+0000 7efe4585c640 1 -- 172.21.15.29:0/2028777815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe400c7f00 msgr2=0x7efe400c3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:15.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.177+0000 7efe4585c640 1 --2- 172.21.15.29:0/2028777815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe400c7f00 0x7efe400c3530 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efe3400c440 tx=0x7efe34001e70 comp rx=0 tx=0).stop 2024-01-25T15:05:15.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.177+0000 7efe4585c640 1 -- 172.21.15.29:0/2028777815 shutdown_connections 2024-01-25T15:05:15.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.177+0000 7efe4585c640 1 --2- 172.21.15.29:0/2028777815 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efe40151e90 0x7efe40155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.177+0000 7efe4585c640 1 --2- 172.21.15.29:0/2028777815 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efe2c06aed0 0x7efe2c06d390 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.177+0000 7efe4585c640 1 --2- 172.21.15.29:0/2028777815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe400c7f00 0x7efe400c3530 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.177+0000 7efe4585c640 1 --2- 172.21.15.29:0/2028777815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe4006b760 0x7efe40148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.177+0000 7efe4585c640 1 -- 172.21.15.29:0/2028777815 >> 172.21.15.29:0/2028777815 conn(0x7efe400ca000 msgr2=0x7efe400ca3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:15.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.177+0000 7efe4585c640 1 -- 172.21.15.29:0/2028777815 shutdown_connections 2024-01-25T15:05:15.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.177+0000 7efe4585c640 1 -- 172.21.15.29:0/2028777815 wait complete. 2024-01-25T15:05:15.189 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:05:15.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.289+0000 7f303a3a9640 1 Processor -- start 2024-01-25T15:05:15.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.289+0000 7f303a3a9640 1 -- start start 2024-01-25T15:05:15.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.290+0000 7f303a3a9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30341520b0 0x7f3034155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:15.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.290+0000 7f303a3a9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f30340c4f00 0x7f30340c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:15.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.290+0000 7f303a3a9640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30340c66c0 con 0x7f30340c55e0 2024-01-25T15:05:15.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.290+0000 7f303a3a9640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303406cfc0 con 0x7f30340c4f00 2024-01-25T15:05:15.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.290+0000 7f303a3a9640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3034152490 con 0x7f30341520b0 2024-01-25T15:05:15.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.290+0000 7f3038946640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f30340c4f00 0x7f30340c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:15.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.290+0000 7f30337fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f30340c55e0 0x7f30340c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34768/0 (socket says 172.21.15.29:34768) 2024-01-25T15:05:15.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.290+0000 7f30337fe640 1 -- 172.21.15.29:0/2365038388 learned_addr learned my addr 172.21.15.29:0/2365038388 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:15.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.290+0000 7f3033fff640 1 --2- 172.21.15.29:0/2365038388 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30341520b0 0x7f3034155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:15.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.290+0000 7f3038946640 1 -- 172.21.15.29:0/2365038388 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30341520b0 msgr2=0x7f3034155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:15.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.291+0000 7f3038946640 1 --2- 172.21.15.29:0/2365038388 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30341520b0 0x7f3034155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.291+0000 7f3038946640 1 -- 172.21.15.29:0/2365038388 >> v1:172.21.15.29:6789/0 conn(0x7f30340c55e0 legacy=0x7f30340c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:15.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.291+0000 7f3032ffd640 1 -- 172.21.15.29:0/2365038388 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034035429 0 0) 0x7f30340c66c0 con 0x7f30340c55e0 2024-01-25T15:05:15.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.291+0000 7f3038946640 1 -- 172.21.15.29:0/2365038388 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30340c8830 con 0x7f30340c4f00 2024-01-25T15:05:15.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.291+0000 7f3033fff640 1 --2- 172.21.15.29:0/2365038388 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30341520b0 0x7f3034155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:15.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.291+0000 7f3038946640 1 --2- 172.21.15.29:0/2365038388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30340c4f00 0x7f30340c5b30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f302c009d90 tx=0x7f302c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23487735c7f37d74 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:15.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.291+0000 7f3032ffd640 1 -- 172.21.15.29:0/2365038388 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c02cbc0 con 0x7f30340c4f00 2024-01-25T15:05:15.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.291+0000 7f3032ffd640 1 -- 172.21.15.29:0/2365038388 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c02cd20 con 0x7f30340c4f00 2024-01-25T15:05:15.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.291+0000 7f3032ffd640 1 -- 172.21.15.29:0/2365038388 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c034660 con 0x7f30340c4f00 2024-01-25T15:05:15.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.292+0000 7f303a3a9640 1 -- 172.21.15.29:0/2365038388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30340c4f00 msgr2=0x7f30340c5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:15.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.292+0000 7f303a3a9640 1 --2- 172.21.15.29:0/2365038388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30340c4f00 0x7f30340c5b30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f302c009d90 tx=0x7f302c02be10 comp rx=0 tx=0).stop 2024-01-25T15:05:15.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.292+0000 7f303a3a9640 1 -- 172.21.15.29:0/2365038388 shutdown_connections 2024-01-25T15:05:15.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.292+0000 7f303a3a9640 1 --2- 172.21.15.29:0/2365038388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30340c4f00 0x7f30340c5b30 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.292+0000 7f303a3a9640 1 --2- 172.21.15.29:0/2365038388 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30341520b0 0x7f3034155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.292+0000 7f303a3a9640 1 -- 172.21.15.29:0/2365038388 >> 172.21.15.29:0/2365038388 conn(0x7f30340ca220 msgr2=0x7f30340ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:15.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.292+0000 7f303a3a9640 1 -- 172.21.15.29:0/2365038388 shutdown_connections 2024-01-25T15:05:15.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.292+0000 7f303a3a9640 1 -- 172.21.15.29:0/2365038388 wait complete. 2024-01-25T15:05:15.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.293+0000 7f303a3a9640 1 Processor -- start 2024-01-25T15:05:15.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.293+0000 7f303a3a9640 1 -- start start 2024-01-25T15:05:15.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.294+0000 7f303a3a9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30340c4f00 0x7f303414a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:15.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.294+0000 7f303a3a9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30341520b0 0x7f30340aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:15.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.294+0000 7f303a3a9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30340ab710 0x7f30340af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:15.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.294+0000 7f303a3a9640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3034156580 con 0x7f30340c4f00 2024-01-25T15:05:15.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.294+0000 7f303a3a9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30341ed580 con 0x7f30341520b0 2024-01-25T15:05:15.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.294+0000 7f303a3a9640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30341ee3e0 con 0x7f30340ab710 2024-01-25T15:05:15.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.294+0000 7f3033fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30340c4f00 0x7f303414a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:15.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.294+0000 7f3033fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30340c4f00 0x7f303414a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56010/0 (socket says 172.21.15.29:56010) 2024-01-25T15:05:15.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.294+0000 7f3033fff640 1 -- 172.21.15.29:0/4035389675 learned_addr learned my addr 172.21.15.29:0/4035389675 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:15.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.294+0000 7f30337fe640 1 --2- 172.21.15.29:0/4035389675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30341520b0 0x7f30340aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:15.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.294+0000 7f3038946640 1 --2- 172.21.15.29:0/4035389675 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30340ab710 0x7f30340af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:15.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.294+0000 7f3033fff640 1 -- 172.21.15.29:0/4035389675 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30340ab710 msgr2=0x7f30340af500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:15.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.294+0000 7f3033fff640 1 --2- 172.21.15.29:0/4035389675 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30340ab710 0x7f30340af500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.294+0000 7f3033fff640 1 -- 172.21.15.29:0/4035389675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30341520b0 msgr2=0x7f30340aefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:15.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.294+0000 7f3033fff640 1 --2- 172.21.15.29:0/4035389675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30341520b0 0x7f30340aefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.294+0000 7f3033fff640 1 -- 172.21.15.29:0/4035389675 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302c009a70 con 0x7f30340c4f00 2024-01-25T15:05:15.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.295+0000 7f3033fff640 1 --2- 172.21.15.29:0/4035389675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30340c4f00 0x7f303414a7c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f302400d800 tx=0x7f302400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:15.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.295+0000 7f3030ff9640 1 -- 172.21.15.29:0/4035389675 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3024004030 con 0x7f30340c4f00 2024-01-25T15:05:15.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.295+0000 7f3030ff9640 1 -- 172.21.15.29:0/4035389675 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3024004190 con 0x7f30340c4f00 2024-01-25T15:05:15.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.295+0000 7f3030ff9640 1 -- 172.21.15.29:0/4035389675 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3024004520 con 0x7f30340c4f00 2024-01-25T15:05:15.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.295+0000 7f303a3a9640 1 -- 172.21.15.29:0/4035389675 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30341ed7d0 con 0x7f30340c4f00 2024-01-25T15:05:15.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.295+0000 7f303a3a9640 1 -- 172.21.15.29:0/4035389675 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30341edd90 con 0x7f30340c4f00 2024-01-25T15:05:15.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.296+0000 7f303a3a9640 1 -- 172.21.15.29:0/4035389675 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3034074080 con 0x7f30340c4f00 2024-01-25T15:05:15.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.296+0000 7f3030ff9640 1 -- 172.21.15.29:0/4035389675 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f30240096a0 con 0x7f30340c4f00 2024-01-25T15:05:15.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.297+0000 7f3030ff9640 1 --2- 172.21.15.29:0/4035389675 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f302006aed0 0x7f302006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:15.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.297+0000 7f3030ff9640 1 -- 172.21.15.29:0/4035389675 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f30240899d0 con 0x7f30340c4f00 2024-01-25T15:05:15.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.297+0000 7f30337fe640 1 --2- 172.21.15.29:0/4035389675 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f302006aed0 0x7f302006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:15.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.297+0000 7f30337fe640 1 --2- 172.21.15.29:0/4035389675 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f302006aed0 0x7f302006d390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3034149180 tx=0x7f3028007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:15.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.301+0000 7f3030ff9640 1 -- 172.21.15.29:0/4035389675 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f3024054600 con 0x7f30340c4f00 2024-01-25T15:05:15.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.518+0000 7f303a3a9640 1 -- 172.21.15.29:0/4035389675 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30340bd9c0 con 0x7f30340c4f00 2024-01-25T15:05:15.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.518+0000 7f3030ff9640 1 -- 172.21.15.29:0/4035389675 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4931 (secure 0 0 0) 0x7f3024057c20 con 0x7f30340c4f00 2024-01-25T15:05:15.519 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:15.519 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6836/2584242962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2584242962},{"type":"v1","addr":"172.21.15.52:6836","nonce":2584242962}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1800543981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1800543981},{"type":"v1","addr":"172.21.15.29:6834","nonce":1800543981}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3686497601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3686497601},{"type":"v1","addr":"172.21.15.29:6835","nonce":3686497601}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:04:26.896909+0000","modified":"2024-01-25T15:04:42.952775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6837/417879912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6835","nonce":417879912},{"type":"v1","addr":"172.21.15.52:6837","nonce":417879912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-25T15:05:15.519 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-01-25T15:05:15.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.520+0000 7f303a3a9640 1 -- 172.21.15.29:0/4035389675 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f302006aed0 msgr2=0x7f302006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:15.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.520+0000 7f303a3a9640 1 --2- 172.21.15.29:0/4035389675 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f302006aed0 0x7f302006d390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3034149180 tx=0x7f3028007d50 comp rx=0 tx=0).stop 2024-01-25T15:05:15.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.520+0000 7f303a3a9640 1 -- 172.21.15.29:0/4035389675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30340c4f00 msgr2=0x7f303414a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:15.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.520+0000 7f303a3a9640 1 --2- 172.21.15.29:0/4035389675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30340c4f00 0x7f303414a7c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f302400d800 tx=0x7f302400dcc0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.520+0000 7f303a3a9640 1 -- 172.21.15.29:0/4035389675 shutdown_connections 2024-01-25T15:05:15.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.520+0000 7f303a3a9640 1 --2- 172.21.15.29:0/4035389675 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30340ab710 0x7f30340af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.520+0000 7f303a3a9640 1 --2- 172.21.15.29:0/4035389675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30341520b0 0x7f30340aefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.520+0000 7f303a3a9640 1 --2- 172.21.15.29:0/4035389675 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f302006aed0 0x7f302006d390 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.520+0000 7f303a3a9640 1 --2- 172.21.15.29:0/4035389675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30340c4f00 0x7f303414a7c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.520+0000 7f303a3a9640 1 -- 172.21.15.29:0/4035389675 >> 172.21.15.29:0/4035389675 conn(0x7f30340ca220 msgr2=0x7f30341530d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:15.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.520+0000 7f303a3a9640 1 -- 172.21.15.29:0/4035389675 shutdown_connections 2024-01-25T15:05:15.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.520+0000 7f303a3a9640 1 -- 172.21.15.29:0/4035389675 wait complete. 2024-01-25T15:05:15.533 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:15.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.633+0000 7fce34578640 1 Processor -- start 2024-01-25T15:05:15.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.633+0000 7fce34578640 1 -- start start 2024-01-25T15:05:15.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.634+0000 7fce34578640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fce2c14c6f0 0x7fce2c1530b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:15.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.634+0000 7fce34578640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce2c0c3c30 0x7fce2c0c8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:15.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.634+0000 7fce34578640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce2c0c3100 con 0x7fce2c0c6980 2024-01-25T15:05:15.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.634+0000 7fce34578640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce2c0c41d0 con 0x7fce2c14c6f0 2024-01-25T15:05:15.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.634+0000 7fce34578640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c1525d0 con 0x7fce2c0c3c30 2024-01-25T15:05:15.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.634+0000 7fce31b13640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fce2c0c6980 0x7fce2c0c29f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47356/0 (socket says 172.21.15.29:47356) 2024-01-25T15:05:15.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.634+0000 7fce31b13640 1 -- 172.21.15.29:0/758839678 learned_addr learned my addr 172.21.15.29:0/758839678 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:15.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.634+0000 7fce32314640 1 --2- 172.21.15.29:0/758839678 >> v2:172.21.15.52:3300/0 conn(0x7fce2c14c6f0 0x7fce2c1530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:15.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.634+0000 7fce32b15640 1 --2- 172.21.15.29:0/758839678 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce2c0c3c30 0x7fce2c0c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:15.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce31312640 1 -- 172.21.15.29:0/758839678 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307059897 0 0) 0x7fce2c0c3100 con 0x7fce2c0c6980 2024-01-25T15:05:15.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce31312640 1 -- 172.21.15.29:0/758839678 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce14003520 con 0x7fce2c0c6980 2024-01-25T15:05:15.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce31312640 1 -- 172.21.15.29:0/758839678 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3555246038 0 0) 0x7fce14003520 con 0x7fce2c0c6980 2024-01-25T15:05:15.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce31312640 1 -- 172.21.15.29:0/758839678 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce2c0c3c30 msgr2=0x7fce2c0c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:15.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce31312640 1 --2- 172.21.15.29:0/758839678 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce2c0c3c30 0x7fce2c0c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce31312640 1 -- 172.21.15.29:0/758839678 >> v2:172.21.15.52:3300/0 conn(0x7fce2c14c6f0 msgr2=0x7fce2c1530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:15.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce31312640 1 --2- 172.21.15.29:0/758839678 >> v2:172.21.15.52:3300/0 conn(0x7fce2c14c6f0 0x7fce2c1530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce31312640 1 -- 172.21.15.29:0/758839678 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2c1528b0 con 0x7fce2c0c6980 2024-01-25T15:05:15.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce31312640 1 -- 172.21.15.29:0/758839678 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7fce20001670 con 0x7fce2c0c6980 2024-01-25T15:05:15.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce32b15640 1 --2- 172.21.15.29:0/758839678 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce2c0c3c30 0x7fce2c0c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:05:15.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce31312640 1 -- 172.21.15.29:0/758839678 >> v1:172.21.15.29:6789/0 conn(0x7fce2c0c6980 legacy=0x7fce2c0c29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:15.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce31312640 1 --2- 172.21.15.29:0/758839678 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce2c0c3c30 0x7fce14003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:15.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce31312640 1 --2- 172.21.15.29:0/758839678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce14003eb0 0x7fce140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:15.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce31312640 1 --2- 172.21.15.29:0/758839678 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce14004d00 0x7fce14005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:15.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce31312640 1 -- 172.21.15.29:0/758839678 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c0c41d0 con 0x7fce14004d00 2024-01-25T15:05:15.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce31312640 1 -- 172.21.15.29:0/758839678 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c1525d0 con 0x7fce14003eb0 2024-01-25T15:05:15.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce31312640 1 -- 172.21.15.29:0/758839678 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1400b980 con 0x7fce2c0c3c30 2024-01-25T15:05:15.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce32b15640 1 --2- 172.21.15.29:0/758839678 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce14004d00 0x7fce14005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:15.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce31b13640 1 --2- 172.21.15.29:0/758839678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce14003eb0 0x7fce140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:15.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce32314640 1 --2- 172.21.15.29:0/758839678 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce2c0c3c30 0x7fce14003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:15.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce32b15640 1 -- 172.21.15.29:0/758839678 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce2c0c3c30 msgr2=0x7fce14003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:15.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce32b15640 1 --2- 172.21.15.29:0/758839678 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce2c0c3c30 0x7fce14003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce32b15640 1 -- 172.21.15.29:0/758839678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce14003eb0 msgr2=0x7fce140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:15.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce32b15640 1 --2- 172.21.15.29:0/758839678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce14003eb0 0x7fce140047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.635+0000 7fce32b15640 1 -- 172.21.15.29:0/758839678 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1c009a70 con 0x7fce14004d00 2024-01-25T15:05:15.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.636+0000 7fce32b15640 1 --2- 172.21.15.29:0/758839678 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce14004d00 0x7fce14005180 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00e350 tx=0x7fce140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6aa8689f032cad server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:15.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.636+0000 7fce31312640 1 -- 172.21.15.29:0/758839678 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c02cd70 con 0x7fce14004d00 2024-01-25T15:05:15.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.636+0000 7fce31312640 1 -- 172.21.15.29:0/758839678 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1c00f040 con 0x7fce14004d00 2024-01-25T15:05:15.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.636+0000 7fce31312640 1 -- 172.21.15.29:0/758839678 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c034640 con 0x7fce14004d00 2024-01-25T15:05:15.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.637+0000 7fce34578640 1 -- 172.21.15.29:0/758839678 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce14004d00 msgr2=0x7fce14005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:15.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.637+0000 7fce34578640 1 --2- 172.21.15.29:0/758839678 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce14004d00 0x7fce14005180 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00e350 tx=0x7fce140057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.637+0000 7fce32b15640 1 -- 172.21.15.29:0/758839678 reap_dead start 2024-01-25T15:05:15.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.637+0000 7fce34578640 1 -- 172.21.15.29:0/758839678 shutdown_connections 2024-01-25T15:05:15.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.637+0000 7fce34578640 1 -- 172.21.15.29:0/758839678 >> 172.21.15.29:0/758839678 conn(0x7fce2c06a8a0 msgr2=0x7fce2c06acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:15.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.637+0000 7fce34578640 1 -- 172.21.15.29:0/758839678 shutdown_connections 2024-01-25T15:05:15.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.637+0000 7fce34578640 1 -- 172.21.15.29:0/758839678 wait complete. 2024-01-25T15:05:15.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.638+0000 7fce34578640 1 Processor -- start 2024-01-25T15:05:15.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.638+0000 7fce34578640 1 -- start start 2024-01-25T15:05:15.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.639+0000 7fce34578640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce14004d00 0x7fce2c1dbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:15.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.639+0000 7fce34578640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce2c147e90 0x7fce2c14b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:15.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.639+0000 7fce34578640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce2c1df340 0x7fce2c1ddea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:15.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.639+0000 7fce34578640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c1debd0 con 0x7fce2c1df340 2024-01-25T15:05:15.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.639+0000 7fce34578640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c145550 con 0x7fce14004d00 2024-01-25T15:05:15.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.639+0000 7fce34578640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c156230 con 0x7fce2c147e90 2024-01-25T15:05:15.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.639+0000 7fce32b15640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce2c1df340 0x7fce2c1ddea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:15.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.639+0000 7fce32b15640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce2c1df340 0x7fce2c1ddea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49876/0 (socket says 172.21.15.29:49876) 2024-01-25T15:05:15.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.639+0000 7fce32b15640 1 -- 172.21.15.29:0/1789953490 learned_addr learned my addr 172.21.15.29:0/1789953490 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:15.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.639+0000 7fce31b13640 1 --2- 172.21.15.29:0/1789953490 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce2c147e90 0x7fce2c14b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:15.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.639+0000 7fce32314640 1 --2- 172.21.15.29:0/1789953490 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce14004d00 0x7fce2c1dbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:15.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.639+0000 7fce32b15640 1 -- 172.21.15.29:0/1789953490 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce2c147e90 msgr2=0x7fce2c14b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:15.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.639+0000 7fce32b15640 1 --2- 172.21.15.29:0/1789953490 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce2c147e90 0x7fce2c14b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.639+0000 7fce32b15640 1 -- 172.21.15.29:0/1789953490 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce14004d00 msgr2=0x7fce2c1dbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:15.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.639+0000 7fce32b15640 1 --2- 172.21.15.29:0/1789953490 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce14004d00 0x7fce2c1dbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.639+0000 7fce32b15640 1 -- 172.21.15.29:0/1789953490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2c156510 con 0x7fce2c1df340 2024-01-25T15:05:15.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.639+0000 7fce32b15640 1 --2- 172.21.15.29:0/1789953490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce2c1df340 0x7fce2c1ddea0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fce1c037040 tx=0x7fce1c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:15.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.639+0000 7fce2affd640 1 -- 172.21.15.29:0/1789953490 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c043070 con 0x7fce2c1df340 2024-01-25T15:05:15.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.639+0000 7fce2affd640 1 -- 172.21.15.29:0/1789953490 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1c034bd0 con 0x7fce2c1df340 2024-01-25T15:05:15.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.639+0000 7fce34578640 1 -- 172.21.15.29:0/1789953490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce2c1dee20 con 0x7fce2c1df340 2024-01-25T15:05:15.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.639+0000 7fce2affd640 1 -- 172.21.15.29:0/1789953490 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c003990 con 0x7fce2c1df340 2024-01-25T15:05:15.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.639+0000 7fce34578640 1 -- 172.21.15.29:0/1789953490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce2c14b990 con 0x7fce2c1df340 2024-01-25T15:05:15.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.640+0000 7fce34578640 1 -- 172.21.15.29:0/1789953490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce2c074080 con 0x7fce2c1df340 2024-01-25T15:05:15.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.641+0000 7fce2affd640 1 -- 172.21.15.29:0/1789953490 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fce1c03e440 con 0x7fce2c1df340 2024-01-25T15:05:15.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.641+0000 7fce2affd640 1 --2- 172.21.15.29:0/1789953490 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fce1806aed0 0x7fce1806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:15.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.641+0000 7fce2affd640 1 -- 172.21.15.29:0/1789953490 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fce1c0ab2a0 con 0x7fce2c1df340 2024-01-25T15:05:15.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.641+0000 7fce32314640 1 --2- 172.21.15.29:0/1789953490 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fce1806aed0 0x7fce1806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:15.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.642+0000 7fce32314640 1 --2- 172.21.15.29:0/1789953490 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fce1806aed0 0x7fce1806d390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fce24009b80 tx=0x7fce24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:15.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.645+0000 7fce2affd640 1 -- 172.21.15.29:0/1789953490 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fce1c075e20 con 0x7fce2c1df340 2024-01-25T15:05:15.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.828+0000 7fce34578640 1 -- 172.21.15.29:0/1789953490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce2c0c6e20 con 0x7fce2c1df340 2024-01-25T15:05:15.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.829+0000 7fce2affd640 1 -- 172.21.15.29:0/1789953490 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18747 (secure 0 0 0) 0x7fce1c009de0 con 0x7fce2c1df340 2024-01-25T15:05:15.830 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:15.830 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":26,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:05:08.669787+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:04:24.986626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T15:04:25.873673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-25T15:04:29.578261+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:15.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.831+0000 7fce34578640 1 -- 172.21.15.29:0/1789953490 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fce1806aed0 msgr2=0x7fce1806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:15.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.831+0000 7fce34578640 1 --2- 172.21.15.29:0/1789953490 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fce1806aed0 0x7fce1806d390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fce24009b80 tx=0x7fce24008040 comp rx=0 tx=0).stop 2024-01-25T15:05:15.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.831+0000 7fce34578640 1 -- 172.21.15.29:0/1789953490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce2c1df340 msgr2=0x7fce2c1ddea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:15.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.831+0000 7fce34578640 1 --2- 172.21.15.29:0/1789953490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce2c1df340 0x7fce2c1ddea0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fce1c037040 tx=0x7fce1c009750 comp rx=0 tx=0).stop 2024-01-25T15:05:15.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.831+0000 7fce34578640 1 -- 172.21.15.29:0/1789953490 shutdown_connections 2024-01-25T15:05:15.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.831+0000 7fce34578640 1 --2- 172.21.15.29:0/1789953490 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fce1806aed0 0x7fce1806d390 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.831+0000 7fce34578640 1 --2- 172.21.15.29:0/1789953490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce2c1df340 0x7fce2c1ddea0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.831+0000 7fce34578640 1 --2- 172.21.15.29:0/1789953490 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce2c147e90 0x7fce2c14b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.831+0000 7fce34578640 1 --2- 172.21.15.29:0/1789953490 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce14004d00 0x7fce2c1dbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.831+0000 7fce34578640 1 -- 172.21.15.29:0/1789953490 >> 172.21.15.29:0/1789953490 conn(0x7fce2c06a8a0 msgr2=0x7fce2c14a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:15.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.831+0000 7fce34578640 1 -- 172.21.15.29:0/1789953490 shutdown_connections 2024-01-25T15:05:15.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.831+0000 7fce34578640 1 -- 172.21.15.29:0/1789953490 wait complete. 2024-01-25T15:05:15.843 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-25T15:05:15.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.944+0000 7f41f5b3e640 1 Processor -- start 2024-01-25T15:05:15.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.944+0000 7f41f5b3e640 1 -- start start 2024-01-25T15:05:15.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.945+0000 7f41f5b3e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41f00af6c0 0x7f41f00c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:15.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.945+0000 7f41f5b3e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f00afaa0 con 0x7f41f00c5a70 2024-01-25T15:05:15.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.945+0000 7f41f5b3e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f00c6060 con 0x7f41f006d560 2024-01-25T15:05:15.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.945+0000 7f41f5b3e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f006c480 con 0x7f41f00af6c0 2024-01-25T15:05:15.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.945+0000 7f41effff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f41f00c5a70 0x7f41f015f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47366/0 (socket says 172.21.15.29:47366) 2024-01-25T15:05:15.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.945+0000 7f41effff640 1 -- 172.21.15.29:0/3941478191 learned_addr learned my addr 172.21.15.29:0/3941478191 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:15.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.946+0000 7f41ef7fe640 1 --2- 172.21.15.29:0/3941478191 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41f00af6c0 0x7f41f00c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:15.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.946+0000 7f41ee7fc640 1 -- 172.21.15.29:0/3941478191 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067374044 0 0) 0x7f41f00afaa0 con 0x7f41f00c5a70 2024-01-25T15:05:15.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.946+0000 7f41ee7fc640 1 -- 172.21.15.29:0/3941478191 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41d8003520 con 0x7f41f00c5a70 2024-01-25T15:05:15.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.946+0000 7f41ee7fc640 1 -- 172.21.15.29:0/3941478191 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464737066 0 0) 0x7f41f00c6060 con 0x7f41f006d560 2024-01-25T15:05:15.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.946+0000 7f41ee7fc640 1 -- 172.21.15.29:0/3941478191 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41f00afaa0 con 0x7f41f006d560 2024-01-25T15:05:15.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.946+0000 7f41ee7fc640 1 -- 172.21.15.29:0/3941478191 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3337683982 0 0) 0x7f41d8003520 con 0x7f41f00c5a70 2024-01-25T15:05:15.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.946+0000 7f41ef7fe640 1 -- 172.21.15.29:0/3941478191 >> v1:172.21.15.52:6789/0 conn(0x7f41f006d560 legacy=0x7f41f006b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:15.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.946+0000 7f41ef7fe640 1 -- 172.21.15.29:0/3941478191 >> v1:172.21.15.29:6789/0 conn(0x7f41f00c5a70 legacy=0x7f41f015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:15.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.946+0000 7f41ef7fe640 1 -- 172.21.15.29:0/3941478191 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f0155480 con 0x7f41f00af6c0 2024-01-25T15:05:15.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.947+0000 7f41ef7fe640 1 --2- 172.21.15.29:0/3941478191 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41f00af6c0 0x7f41f00c5530 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f41e00097d0 tx=0x7f41e002b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61f0ddd691269036 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:15.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.947+0000 7f41ee7fc640 1 -- 172.21.15.29:0/3941478191 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e80019f0 con 0x7f41f00af6c0 2024-01-25T15:05:15.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.947+0000 7f41ee7fc640 1 -- 172.21.15.29:0/3941478191 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e002e050 con 0x7f41f00af6c0 2024-01-25T15:05:15.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.947+0000 7f41ee7fc640 1 -- 172.21.15.29:0/3941478191 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e0030730 con 0x7f41f00af6c0 2024-01-25T15:05:15.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.947+0000 7f41f5b3e640 1 -- 172.21.15.29:0/3941478191 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41f00af6c0 msgr2=0x7f41f00c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:15.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.947+0000 7f41f5b3e640 1 --2- 172.21.15.29:0/3941478191 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41f00af6c0 0x7f41f00c5530 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f41e00097d0 tx=0x7f41e002b800 comp rx=0 tx=0).stop 2024-01-25T15:05:15.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.947+0000 7f41f5b3e640 1 -- 172.21.15.29:0/3941478191 shutdown_connections 2024-01-25T15:05:15.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.947+0000 7f41f5b3e640 1 --2- 172.21.15.29:0/3941478191 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41f00af6c0 0x7f41f00c5530 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.947+0000 7f41f5b3e640 1 -- 172.21.15.29:0/3941478191 >> 172.21.15.29:0/3941478191 conn(0x7f41f00c6ca0 msgr2=0x7f41f00c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:15.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.947+0000 7f41f5b3e640 1 -- 172.21.15.29:0/3941478191 shutdown_connections 2024-01-25T15:05:15.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.947+0000 7f41f5b3e640 1 -- 172.21.15.29:0/3941478191 wait complete. 2024-01-25T15:05:15.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.949+0000 7f41f5b3e640 1 Processor -- start 2024-01-25T15:05:15.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.949+0000 7f41f5b3e640 1 -- start start 2024-01-25T15:05:15.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.949+0000 7f41f5b3e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41f006d560 0x7f41f0158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:15.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.949+0000 7f41f5b3e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f00af6c0 0x7f41f014e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:15.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.949+0000 7f41f5b3e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41f00c5a70 0x7f41f014ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:15.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.949+0000 7f41f5b3e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f0157490 con 0x7f41f00c5a70 2024-01-25T15:05:15.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.949+0000 7f41f5b3e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00c1ed0 con 0x7f41f00af6c0 2024-01-25T15:05:15.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.949+0000 7f41f5b3e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f0157750 con 0x7f41f006d560 2024-01-25T15:05:15.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.950+0000 7f41effff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41f00c5a70 0x7f41f014ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:15.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.950+0000 7f41effff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41f00c5a70 0x7f41f014ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49882/0 (socket says 172.21.15.29:49882) 2024-01-25T15:05:15.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.950+0000 7f41ef7fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41f006d560 0x7f41f0158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:15.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.950+0000 7f41effff640 1 -- 172.21.15.29:0/313563670 learned_addr learned my addr 172.21.15.29:0/313563670 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:15.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.950+0000 7f41eeffd640 1 --2- 172.21.15.29:0/313563670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f00af6c0 0x7f41f014e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:15.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.950+0000 7f41effff640 1 -- 172.21.15.29:0/313563670 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41f006d560 msgr2=0x7f41f0158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:15.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.950+0000 7f41effff640 1 --2- 172.21.15.29:0/313563670 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41f006d560 0x7f41f0158550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.950+0000 7f41effff640 1 -- 172.21.15.29:0/313563670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f00af6c0 msgr2=0x7f41f014e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:15.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.950+0000 7f41effff640 1 --2- 172.21.15.29:0/313563670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f00af6c0 0x7f41f014e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:15.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.950+0000 7f41effff640 1 -- 172.21.15.29:0/313563670 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e0009400 con 0x7f41f00c5a70 2024-01-25T15:05:15.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.950+0000 7f41effff640 1 --2- 172.21.15.29:0/313563670 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41f00c5a70 0x7f41f014ea20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f41e800cbf0 tx=0x7f41e800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:15.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.950+0000 7f41d7fff640 1 -- 172.21.15.29:0/313563670 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e800ad50 con 0x7f41f00c5a70 2024-01-25T15:05:15.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.950+0000 7f41d7fff640 1 -- 172.21.15.29:0/313563670 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e8012400 con 0x7f41f00c5a70 2024-01-25T15:05:15.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.950+0000 7f41d7fff640 1 -- 172.21.15.29:0/313563670 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e80127b0 con 0x7f41f00c5a70 2024-01-25T15:05:15.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.950+0000 7f41f5b3e640 1 -- 172.21.15.29:0/313563670 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f0156ed0 con 0x7f41f00c5a70 2024-01-25T15:05:15.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.950+0000 7f41f5b3e640 1 -- 172.21.15.29:0/313563670 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f00c1b60 con 0x7f41f00c5a70 2024-01-25T15:05:15.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.951+0000 7f41f5b3e640 1 -- 172.21.15.29:0/313563670 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f00c19c0 con 0x7f41f00c5a70 2024-01-25T15:05:15.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.952+0000 7f41d7fff640 1 -- 172.21.15.29:0/313563670 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f41e8007070 con 0x7f41f00c5a70 2024-01-25T15:05:15.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.952+0000 7f41d7fff640 1 --2- 172.21.15.29:0/313563670 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f41dc06aed0 0x7f41dc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:15.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.952+0000 7f41d7fff640 1 -- 172.21.15.29:0/313563670 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f41e8089980 con 0x7f41f00c5a70 2024-01-25T15:05:15.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.952+0000 7f41ef7fe640 1 --2- 172.21.15.29:0/313563670 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f41dc06aed0 0x7f41dc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:15.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.953+0000 7f41ef7fe640 1 --2- 172.21.15.29:0/313563670 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f41dc06aed0 0x7f41dc06d390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f41e0034000 tx=0x7f41e0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:15.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:15.956+0000 7f41d7fff640 1 -- 172.21.15.29:0/313563670 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f41f00c19c0 con 0x7f41f00c5a70 2024-01-25T15:05:16.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.172+0000 7f41f5b3e640 1 -- 172.21.15.29:0/313563670 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f41f00c19c0 con 0x7f41f00c5a70 2024-01-25T15:05:16.173 INFO:tasks.ceph.mon.a.smithi029.stderr:2024-01-25T15:05:16.172+0000 7ff1677c4640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-25T15:05:16.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.174+0000 7f41d7fff640 1 -- 172.21.15.29:0/313563670 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f41f00c19c0 con 0x7f41f00c5a70 2024-01-25T15:05:16.174 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-25T15:05:16.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.176+0000 7f41f5b3e640 1 -- 172.21.15.29:0/313563670 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f41dc06aed0 msgr2=0x7f41dc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:16.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.176+0000 7f41f5b3e640 1 --2- 172.21.15.29:0/313563670 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f41dc06aed0 0x7f41dc06d390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f41e0034000 tx=0x7f41e0008030 comp rx=0 tx=0).stop 2024-01-25T15:05:16.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.176+0000 7f41f5b3e640 1 -- 172.21.15.29:0/313563670 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41f00c5a70 msgr2=0x7f41f014ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:16.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.176+0000 7f41f5b3e640 1 --2- 172.21.15.29:0/313563670 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41f00c5a70 0x7f41f014ea20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f41e800cbf0 tx=0x7f41e800a430 comp rx=0 tx=0).stop 2024-01-25T15:05:16.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.176+0000 7f41f5b3e640 1 -- 172.21.15.29:0/313563670 shutdown_connections 2024-01-25T15:05:16.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.176+0000 7f41f5b3e640 1 --2- 172.21.15.29:0/313563670 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f41dc06aed0 0x7f41dc06d390 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:16.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.176+0000 7f41f5b3e640 1 --2- 172.21.15.29:0/313563670 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41f00c5a70 0x7f41f014ea20 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:16.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.176+0000 7f41f5b3e640 1 --2- 172.21.15.29:0/313563670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f00af6c0 0x7f41f014e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:16.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.176+0000 7f41f5b3e640 1 --2- 172.21.15.29:0/313563670 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41f006d560 0x7f41f0158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:16.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.176+0000 7f41f5b3e640 1 -- 172.21.15.29:0/313563670 >> 172.21.15.29:0/313563670 conn(0x7f41f00c6ca0 msgr2=0x7f41f00aaea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:16.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.176+0000 7f41f5b3e640 1 -- 172.21.15.29:0/313563670 shutdown_connections 2024-01-25T15:05:16.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.177+0000 7f41f5b3e640 1 -- 172.21.15.29:0/313563670 wait complete. 2024-01-25T15:05:16.181 INFO:tasks.ceph.mds.d.smithi052.stderr: -3261> 2024-01-25T15:04:31.508+0000 7f5125937640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-25T15:05:16.188 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-25T15:05:16.211 INFO:tasks.ceph.mds.d.smithi052.stdout:starting mds.d at 2024-01-25T15:05:16.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.293+0000 7f3b2f6d0640 1 Processor -- start 2024-01-25T15:05:16.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.293+0000 7f3b2f6d0640 1 -- start start 2024-01-25T15:05:16.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.293+0000 7f3b2f6d0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b2806bf00 0x7f3b281519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:16.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.294+0000 7f3b2f6d0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3b28151f00 0x7f3b2815bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.294+0000 7f3b2f6d0640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2806c360 con 0x7f3b2814eb20 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.294+0000 7f3b2f6d0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b280a92d0 con 0x7f3b28151f00 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.294+0000 7f3b2f6d0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b28152310 con 0x7f3b2806bf00 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.294+0000 7f3b2dc6d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3b28151f00 0x7f3b2815bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.294+0000 7f3b2d46c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3b2814eb20 0x7f3b280c1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47382/0 (socket says 172.21.15.29:47382) 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.294+0000 7f3b2d46c640 1 -- 172.21.15.29:0/3678394057 learned_addr learned my addr 172.21.15.29:0/3678394057 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.294+0000 7f3b2cc6b640 1 --2- 172.21.15.29:0/3678394057 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b2806bf00 0x7f3b281519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.294+0000 7f3b2dc6d640 1 -- 172.21.15.29:0/3678394057 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b2806bf00 msgr2=0x7f3b281519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.294+0000 7f3b2dc6d640 1 --2- 172.21.15.29:0/3678394057 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b2806bf00 0x7f3b281519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.294+0000 7f3b2dc6d640 1 -- 172.21.15.29:0/3678394057 >> v1:172.21.15.29:6789/0 conn(0x7f3b2814eb20 legacy=0x7f3b280c1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.294+0000 7f3b1ffff640 1 -- 172.21.15.29:0/3678394057 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172007358 0 0) 0x7f3b24001110 con 0x7f3b2814eb20 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.294+0000 7f3b2dc6d640 1 -- 172.21.15.29:0/3678394057 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b281557e0 con 0x7f3b28151f00 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.295+0000 7f3b2dc6d640 1 --2- 172.21.15.29:0/3678394057 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b28151f00 0x7f3b2815bd10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009d90 tx=0x7f3b2002bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6306b2350e0a64 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:16.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.295+0000 7f3b1ffff640 1 -- 172.21.15.29:0/3678394057 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2002cb30 con 0x7f3b28151f00 2024-01-25T15:05:16.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.295+0000 7f3b1ffff640 1 -- 172.21.15.29:0/3678394057 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2002cc90 con 0x7f3b28151f00 2024-01-25T15:05:16.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.295+0000 7f3b1ffff640 1 -- 172.21.15.29:0/3678394057 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20034440 con 0x7f3b28151f00 2024-01-25T15:05:16.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.295+0000 7f3b2f6d0640 1 -- 172.21.15.29:0/3678394057 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b28151f00 msgr2=0x7f3b2815bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:16.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.295+0000 7f3b2f6d0640 1 --2- 172.21.15.29:0/3678394057 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b28151f00 0x7f3b2815bd10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009d90 tx=0x7f3b2002bd80 comp rx=0 tx=0).stop 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.295+0000 7f3b2f6d0640 1 -- 172.21.15.29:0/3678394057 shutdown_connections 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.295+0000 7f3b2f6d0640 1 --2- 172.21.15.29:0/3678394057 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b28151f00 0x7f3b2815bd10 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.295+0000 7f3b2f6d0640 1 --2- 172.21.15.29:0/3678394057 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b2806bf00 0x7f3b281519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.295+0000 7f3b2f6d0640 1 -- 172.21.15.29:0/3678394057 >> 172.21.15.29:0/3678394057 conn(0x7f3b280c2a10 msgr2=0x7f3b280c2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.296+0000 7f3b2f6d0640 1 -- 172.21.15.29:0/3678394057 shutdown_connections 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.296+0000 7f3b2f6d0640 1 -- 172.21.15.29:0/3678394057 wait complete. 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.297+0000 7f3b2f6d0640 1 Processor -- start 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.297+0000 7f3b2f6d0640 1 -- start start 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.297+0000 7f3b2f6d0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b2806bf00 0x7f3b2814df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.297+0000 7f3b2f6d0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b2814eb20 0x7f3b281ed440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.297+0000 7f3b2f6d0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b28151f00 0x7f3b280ab140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.297+0000 7f3b2f6d0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b28154fc0 con 0x7f3b28151f00 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.297+0000 7f3b2f6d0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b280abe90 con 0x7f3b2806bf00 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.297+0000 7f3b2f6d0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b28145020 con 0x7f3b2814eb20 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.297+0000 7f3b2dc6d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b28151f00 0x7f3b280ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.297+0000 7f3b2dc6d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b28151f00 0x7f3b280ab140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49910/0 (socket says 172.21.15.29:49910) 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.297+0000 7f3b2dc6d640 1 -- 172.21.15.29:0/1700188 learned_addr learned my addr 172.21.15.29:0/1700188 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.298+0000 7f3b2cc6b640 1 --2- 172.21.15.29:0/1700188 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b2814eb20 0x7f3b281ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.298+0000 7f3b2d46c640 1 --2- 172.21.15.29:0/1700188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b2806bf00 0x7f3b2814df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.298+0000 7f3b2dc6d640 1 -- 172.21.15.29:0/1700188 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b2814eb20 msgr2=0x7f3b281ed440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.298+0000 7f3b2dc6d640 1 --2- 172.21.15.29:0/1700188 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b2814eb20 0x7f3b281ed440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.298+0000 7f3b2dc6d640 1 -- 172.21.15.29:0/1700188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b2806bf00 msgr2=0x7f3b2814df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.298+0000 7f3b2dc6d640 1 --2- 172.21.15.29:0/1700188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b2806bf00 0x7f3b2814df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.298+0000 7f3b2dc6d640 1 -- 172.21.15.29:0/1700188 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b20009a70 con 0x7f3b28151f00 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.298+0000 7f3b2d46c640 1 --2- 172.21.15.29:0/1700188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b2806bf00 0x7f3b2814df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.298+0000 7f3b2cc6b640 1 --2- 172.21.15.29:0/1700188 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b2814eb20 0x7f3b281ed440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.298+0000 7f3b2dc6d640 1 --2- 172.21.15.29:0/1700188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b28151f00 0x7f3b280ab140 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009d90 tx=0x7f3b20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.298+0000 7f3b1dffb640 1 -- 172.21.15.29:0/1700188 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20009450 con 0x7f3b28151f00 2024-01-25T15:05:16.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.298+0000 7f3b1dffb640 1 -- 172.21.15.29:0/1700188 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b20003990 con 0x7f3b28151f00 2024-01-25T15:05:16.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.298+0000 7f3b2f6d0640 1 -- 172.21.15.29:0/1700188 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b28152b20 con 0x7f3b28151f00 2024-01-25T15:05:16.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.298+0000 7f3b1dffb640 1 -- 172.21.15.29:0/1700188 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20003d20 con 0x7f3b28151f00 2024-01-25T15:05:16.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.298+0000 7f3b2f6d0640 1 -- 172.21.15.29:0/1700188 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b28154ce0 con 0x7f3b28151f00 2024-01-25T15:05:16.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.299+0000 7f3b2f6d0640 1 -- 172.21.15.29:0/1700188 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b28074010 con 0x7f3b28151f00 2024-01-25T15:05:16.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.300+0000 7f3b1dffb640 1 -- 172.21.15.29:0/1700188 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f3b20004030 con 0x7f3b28151f00 2024-01-25T15:05:16.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.300+0000 7f3b1dffb640 1 --2- 172.21.15.29:0/1700188 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3b0c06aed0 0x7f3b0c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:16.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.300+0000 7f3b1dffb640 1 -- 172.21.15.29:0/1700188 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f3b200ac110 con 0x7f3b28151f00 2024-01-25T15:05:16.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.300+0000 7f3b2d46c640 1 --2- 172.21.15.29:0/1700188 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3b0c06aed0 0x7f3b0c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:16.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.301+0000 7f3b2d46c640 1 --2- 172.21.15.29:0/1700188 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3b0c06aed0 0x7f3b0c06d390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3b24000f60 tx=0x7f3b24007a70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:16.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.305+0000 7f3b1dffb640 1 -- 172.21.15.29:0/1700188 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f3b20076c40 con 0x7f3b28151f00 2024-01-25T15:05:16.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:16.525+0000 7f3b2f6d0640 1 -- 172.21.15.29:0/1700188 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3b2806c830 con 0x7f3b28151f00 2024-01-25T15:05:17.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.175+0000 7f3b1dffb640 1 -- 172.21.15.29:0/1700188 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3b2007a260 con 0x7f3b28151f00 2024-01-25T15:05:17.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.178+0000 7f3b2f6d0640 1 -- 172.21.15.29:0/1700188 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3b0c06aed0 msgr2=0x7f3b0c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:17.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.178+0000 7f3b2f6d0640 1 --2- 172.21.15.29:0/1700188 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3b0c06aed0 0x7f3b0c06d390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3b24000f60 tx=0x7f3b24007a70 comp rx=0 tx=0).stop 2024-01-25T15:05:17.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.178+0000 7f3b2f6d0640 1 -- 172.21.15.29:0/1700188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b28151f00 msgr2=0x7f3b280ab140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:17.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.178+0000 7f3b2f6d0640 1 --2- 172.21.15.29:0/1700188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b28151f00 0x7f3b280ab140 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009d90 tx=0x7f3b20004a40 comp rx=0 tx=0).stop 2024-01-25T15:05:17.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.178+0000 7f3b2f6d0640 1 -- 172.21.15.29:0/1700188 shutdown_connections 2024-01-25T15:05:17.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.178+0000 7f3b2f6d0640 1 --2- 172.21.15.29:0/1700188 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3b0c06aed0 0x7f3b0c06d390 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:17.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.178+0000 7f3b2f6d0640 1 --2- 172.21.15.29:0/1700188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b28151f00 0x7f3b280ab140 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:17.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.178+0000 7f3b2f6d0640 1 --2- 172.21.15.29:0/1700188 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b2814eb20 0x7f3b281ed440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:17.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.178+0000 7f3b2f6d0640 1 --2- 172.21.15.29:0/1700188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b2806bf00 0x7f3b2814df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:17.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.178+0000 7f3b2f6d0640 1 -- 172.21.15.29:0/1700188 >> 172.21.15.29:0/1700188 conn(0x7f3b280c2a10 msgr2=0x7f3b2806ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:17.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.178+0000 7f3b2f6d0640 1 -- 172.21.15.29:0/1700188 shutdown_connections 2024-01-25T15:05:17.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.178+0000 7f3b2f6d0640 1 -- 172.21.15.29:0/1700188 wait complete. 2024-01-25T15:05:17.193 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-25T15:05:17.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.299+0000 7f8bd5126640 1 Processor -- start 2024-01-25T15:05:17.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.299+0000 7f8bd5126640 1 -- start start 2024-01-25T15:05:17.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.300+0000 7f8bd5126640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bd0154090 0x7f8bd00ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:17.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.300+0000 7f8bd5126640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8bd006dbc0 0x7f8bd006e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:17.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.300+0000 7f8bd5126640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd0154fd0 con 0x7f8bd00abcf0 2024-01-25T15:05:17.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.300+0000 7f8bd5126640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd0071da0 con 0x7f8bd006dbc0 2024-01-25T15:05:17.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.300+0000 7f8bd5126640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd00a9540 con 0x7f8bd0154090 2024-01-25T15:05:17.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.300+0000 7f8bced9d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bd0154090 0x7f8bd00ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:17.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.300+0000 7f8bcf59e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8bd006dbc0 0x7f8bd006e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:17.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.300+0000 7f8bced9d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bd0154090 0x7f8bd00ab6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:45846/0 (socket says 172.21.15.29:45846) 2024-01-25T15:05:17.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.300+0000 7f8bced9d640 1 -- 172.21.15.29:0/2862983220 learned_addr learned my addr 172.21.15.29:0/2862983220 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:17.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.300+0000 7f8bcf59e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8bd006dbc0 0x7f8bd006e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:38412/0 (socket says 172.21.15.29:38412) 2024-01-25T15:05:17.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.300+0000 7f8bce59c640 1 --1- 172.21.15.29:0/2862983220 >> v1:172.21.15.52:6789/0 conn(0x7f8bd00abcf0 0x7f8bd0154470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:37458/0 (socket says 172.21.15.29:37458) 2024-01-25T15:05:17.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.301+0000 7f8bced9d640 1 -- 172.21.15.29:0/2862983220 >> v2:172.21.15.52:3300/0 conn(0x7f8bd006dbc0 msgr2=0x7f8bd006e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:17.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.301+0000 7f8bced9d640 1 --2- 172.21.15.29:0/2862983220 >> v2:172.21.15.52:3300/0 conn(0x7f8bd006dbc0 0x7f8bd006e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:17.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.301+0000 7f8bced9d640 1 -- 172.21.15.29:0/2862983220 >> v1:172.21.15.52:6789/0 conn(0x7f8bd00abcf0 legacy=0x7f8bd0154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:17.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.301+0000 7f8bcdd9b640 1 -- 172.21.15.29:0/2862983220 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742208761 0 0) 0x7f8bd0154fd0 con 0x7f8bd00abcf0 2024-01-25T15:05:17.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.301+0000 7f8bced9d640 1 -- 172.21.15.29:0/2862983220 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd0072760 con 0x7f8bd0154090 2024-01-25T15:05:17.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.302+0000 7f8bced9d640 1 --2- 172.21.15.29:0/2862983220 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bd0154090 0x7f8bd00ab6a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8bc000bb10 tx=0x7f8bc002e030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b2f61317a6fc087 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:17.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.302+0000 7f8bcdd9b640 1 -- 172.21.15.29:0/2862983220 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc002ede0 con 0x7f8bd0154090 2024-01-25T15:05:17.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.302+0000 7f8bcdd9b640 1 -- 172.21.15.29:0/2862983220 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc0036440 con 0x7f8bd0154090 2024-01-25T15:05:17.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.302+0000 7f8bcdd9b640 1 -- 172.21.15.29:0/2862983220 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc00367d0 con 0x7f8bd0154090 2024-01-25T15:05:17.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.302+0000 7f8bd5126640 1 -- 172.21.15.29:0/2862983220 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bd0154090 msgr2=0x7f8bd00ab6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:17.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.302+0000 7f8bd5126640 1 --2- 172.21.15.29:0/2862983220 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bd0154090 0x7f8bd00ab6a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8bc000bb10 tx=0x7f8bc002e030 comp rx=0 tx=0).stop 2024-01-25T15:05:17.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.303+0000 7f8bd5126640 1 -- 172.21.15.29:0/2862983220 shutdown_connections 2024-01-25T15:05:17.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.303+0000 7f8bd5126640 1 --2- 172.21.15.29:0/2862983220 >> v2:172.21.15.52:3300/0 conn(0x7f8bd006dbc0 0x7f8bd006e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:17.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.303+0000 7f8bd5126640 1 --2- 172.21.15.29:0/2862983220 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bd0154090 0x7f8bd00ab6a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:17.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.303+0000 7f8bd5126640 1 -- 172.21.15.29:0/2862983220 >> 172.21.15.29:0/2862983220 conn(0x7f8bd00c2a10 msgr2=0x7f8bd00c2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:17.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.303+0000 7f8bd5126640 1 -- 172.21.15.29:0/2862983220 shutdown_connections 2024-01-25T15:05:17.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.303+0000 7f8bd5126640 1 -- 172.21.15.29:0/2862983220 wait complete. 2024-01-25T15:05:17.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.304+0000 7f8bd5126640 1 Processor -- start 2024-01-25T15:05:17.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.304+0000 7f8bd5126640 1 -- start start 2024-01-25T15:05:17.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.305+0000 7f8bd5126640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd006dbc0 0x7f8bd014d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.305+0000 7f8bd5126640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bd00abcf0 0x7f8bd01e5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.305+0000 7f8bd5126640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bd0154090 0x7f8bd01e5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.305+0000 7f8bd5126640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd014b290 con 0x7f8bd006dbc0 2024-01-25T15:05:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.305+0000 7f8bd5126640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd0151350 con 0x7f8bd0154090 2024-01-25T15:05:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.305+0000 7f8bd5126640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd0152e10 con 0x7f8bd00abcf0 2024-01-25T15:05:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.305+0000 7f8bced9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd006dbc0 0x7f8bd014d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.305+0000 7f8bced9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd006dbc0 0x7f8bd014d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49914/0 (socket says 172.21.15.29:49914) 2024-01-25T15:05:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.305+0000 7f8bced9d640 1 -- 172.21.15.29:0/210102160 learned_addr learned my addr 172.21.15.29:0/210102160 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.305+0000 7f8bce59c640 1 --2- 172.21.15.29:0/210102160 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bd00abcf0 0x7f8bd01e5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.305+0000 7f8bcf59e640 1 --2- 172.21.15.29:0/210102160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bd0154090 0x7f8bd01e5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.305+0000 7f8bced9d640 1 -- 172.21.15.29:0/210102160 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bd00abcf0 msgr2=0x7f8bd01e5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.305+0000 7f8bced9d640 1 --2- 172.21.15.29:0/210102160 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bd00abcf0 0x7f8bd01e5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.305+0000 7f8bced9d640 1 -- 172.21.15.29:0/210102160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bd0154090 msgr2=0x7f8bd01e5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.305+0000 7f8bced9d640 1 --2- 172.21.15.29:0/210102160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bd0154090 0x7f8bd01e5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.305+0000 7f8bced9d640 1 -- 172.21.15.29:0/210102160 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc000b770 con 0x7f8bd006dbc0 2024-01-25T15:05:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.305+0000 7f8bce59c640 1 --2- 172.21.15.29:0/210102160 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bd00abcf0 0x7f8bd01e5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.305+0000 7f8bced9d640 1 --2- 172.21.15.29:0/210102160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd006dbc0 0x7f8bd014d1a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0039040 tx=0x7f8bc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.306+0000 7f8bb77fe640 1 -- 172.21.15.29:0/210102160 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0004230 con 0x7f8bd006dbc0 2024-01-25T15:05:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.306+0000 7f8bb77fe640 1 -- 172.21.15.29:0/210102160 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc0036e90 con 0x7f8bd006dbc0 2024-01-25T15:05:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.306+0000 7f8bd5126640 1 -- 172.21.15.29:0/210102160 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd0150f00 con 0x7f8bd006dbc0 2024-01-25T15:05:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.306+0000 7f8bb77fe640 1 -- 172.21.15.29:0/210102160 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0003610 con 0x7f8bd006dbc0 2024-01-25T15:05:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.306+0000 7f8bd5126640 1 -- 172.21.15.29:0/210102160 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd014d6e0 con 0x7f8bd006dbc0 2024-01-25T15:05:17.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.306+0000 7f8bd5126640 1 -- 172.21.15.29:0/210102160 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd01511b0 con 0x7f8bd006dbc0 2024-01-25T15:05:17.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.307+0000 7f8bb77fe640 1 -- 172.21.15.29:0/210102160 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8bc003d040 con 0x7f8bd006dbc0 2024-01-25T15:05:17.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.307+0000 7f8bb77fe640 1 --2- 172.21.15.29:0/210102160 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8bbc06aed0 0x7f8bbc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:17.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.307+0000 7f8bb77fe640 1 -- 172.21.15.29:0/210102160 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f8bc00ae2b0 con 0x7f8bd006dbc0 2024-01-25T15:05:17.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.308+0000 7f8bce59c640 1 --2- 172.21.15.29:0/210102160 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8bbc06aed0 0x7f8bbc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:17.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.308+0000 7f8bce59c640 1 --2- 172.21.15.29:0/210102160 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8bbc06aed0 0x7f8bbc06d390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8bd01e34a0 tx=0x7f8bc4007c10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.312+0000 7f8bb77fe640 1 -- 172.21.15.29:0/210102160 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8bd01511b0 con 0x7f8bd006dbc0 2024-01-25T15:05:17.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:17.493+0000 7f8bd5126640 1 -- 172.21.15.29:0/210102160 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8bd01511b0 con 0x7f8bd006dbc0 2024-01-25T15:05:18.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.177+0000 7f8bb77fe640 1 -- 172.21.15.29:0/210102160 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8bd01511b0 con 0x7f8bd006dbc0 2024-01-25T15:05:18.178 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' removed 2024-01-25T15:05:18.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.179+0000 7f8bd5126640 1 -- 172.21.15.29:0/210102160 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8bbc06aed0 msgr2=0x7f8bbc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:18.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.179+0000 7f8bd5126640 1 --2- 172.21.15.29:0/210102160 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8bbc06aed0 0x7f8bbc06d390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8bd01e34a0 tx=0x7f8bc4007c10 comp rx=0 tx=0).stop 2024-01-25T15:05:18.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.179+0000 7f8bd5126640 1 -- 172.21.15.29:0/210102160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd006dbc0 msgr2=0x7f8bd014d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:18.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.180+0000 7f8bd5126640 1 --2- 172.21.15.29:0/210102160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd006dbc0 0x7f8bd014d1a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0039040 tx=0x7f8bc00046c0 comp rx=0 tx=0).stop 2024-01-25T15:05:18.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.180+0000 7f8bd5126640 1 -- 172.21.15.29:0/210102160 shutdown_connections 2024-01-25T15:05:18.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.180+0000 7f8bd5126640 1 --2- 172.21.15.29:0/210102160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bd0154090 0x7f8bd01e5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:18.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.180+0000 7f8bd5126640 1 --2- 172.21.15.29:0/210102160 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8bd00abcf0 0x7f8bd01e5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:18.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.180+0000 7f8bd5126640 1 --2- 172.21.15.29:0/210102160 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8bbc06aed0 0x7f8bbc06d390 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:18.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.180+0000 7f8bd5126640 1 --2- 172.21.15.29:0/210102160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd006dbc0 0x7f8bd014d1a0 secure :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0039040 tx=0x7f8bc00046c0 comp rx=0 tx=0).stop 2024-01-25T15:05:18.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.180+0000 7f8bd5126640 1 -- 172.21.15.29:0/210102160 >> 172.21.15.29:0/210102160 conn(0x7f8bd00c2a10 msgr2=0x7f8bd0070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:18.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.181+0000 7f8bd5126640 1 -- 172.21.15.29:0/210102160 shutdown_connections 2024-01-25T15:05:18.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.181+0000 7f8bd5126640 1 -- 172.21.15.29:0/210102160 wait complete. 2024-01-25T15:05:18.195 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-25T15:05:18.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.303+0000 7f5d79ac3640 1 Processor -- start 2024-01-25T15:05:18.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.303+0000 7f5d79ac3640 1 -- start start 2024-01-25T15:05:18.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.304+0000 7f5d79ac3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5d740c6a20 0x7f5d74155210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:18.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.304+0000 7f5d79ac3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5d7406c370 0x7f5d740c4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:18.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.304+0000 7f5d79ac3640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7406bee0 con 0x7f5d74151d80 2024-01-25T15:05:18.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.304+0000 7f5d79ac3640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d74155750 con 0x7f5d7406c370 2024-01-25T15:05:18.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.304+0000 7f5d79ac3640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d740c7400 con 0x7f5d740c6a20 2024-01-25T15:05:18.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.304+0000 7f5d73fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5d7406c370 0x7f5d740c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:18.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.304+0000 7f5d73fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5d7406c370 0x7f5d740c4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49920/0 (socket says 172.21.15.29:49920) 2024-01-25T15:05:18.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.304+0000 7f5d737fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5d74151d80 0x7f5d740c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47398/0 (socket says 172.21.15.29:47398) 2024-01-25T15:05:18.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.304+0000 7f5d73fff640 1 -- 172.21.15.29:0/1921089841 learned_addr learned my addr 172.21.15.29:0/1921089841 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:18.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.305+0000 7f5d72ffd640 1 --2- 172.21.15.29:0/1921089841 >> v2:172.21.15.52:3300/0 conn(0x7f5d740c6a20 0x7f5d74155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:18.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.305+0000 7f5d73fff640 1 -- 172.21.15.29:0/1921089841 >> v2:172.21.15.52:3300/0 conn(0x7f5d740c6a20 msgr2=0x7f5d74155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:18.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.305+0000 7f5d73fff640 1 --2- 172.21.15.29:0/1921089841 >> v2:172.21.15.52:3300/0 conn(0x7f5d740c6a20 0x7f5d74155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:18.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.305+0000 7f5d73fff640 1 -- 172.21.15.29:0/1921089841 >> v1:172.21.15.29:6789/0 conn(0x7f5d74151d80 legacy=0x7f5d740c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:18.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.305+0000 7f5d73fff640 1 -- 172.21.15.29:0/1921089841 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7406b8d0 con 0x7f5d7406c370 2024-01-25T15:05:18.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.305+0000 7f5d727fc640 1 -- 172.21.15.29:0/1921089841 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210417311 0 0) 0x7f5d7406bee0 con 0x7f5d74151d80 2024-01-25T15:05:18.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.305+0000 7f5d72ffd640 1 --2- 172.21.15.29:0/1921089841 >> v2:172.21.15.52:3300/0 conn(0x7f5d740c6a20 0x7f5d74155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:18.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.305+0000 7f5d73fff640 1 --2- 172.21.15.29:0/1921089841 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d7406c370 0x7f5d740c4990 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5d7406cdb0 tx=0x7f5d6c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0965d63dd703a0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:18.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.306+0000 7f5d727fc640 1 -- 172.21.15.29:0/1921089841 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c02ca80 con 0x7f5d7406c370 2024-01-25T15:05:18.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.306+0000 7f5d727fc640 1 -- 172.21.15.29:0/1921089841 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6c02cbe0 con 0x7f5d7406c370 2024-01-25T15:05:18.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.306+0000 7f5d727fc640 1 -- 172.21.15.29:0/1921089841 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c0343f0 con 0x7f5d7406c370 2024-01-25T15:05:18.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.306+0000 7f5d79ac3640 1 -- 172.21.15.29:0/1921089841 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d7406c370 msgr2=0x7f5d740c4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:18.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.306+0000 7f5d79ac3640 1 --2- 172.21.15.29:0/1921089841 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d7406c370 0x7f5d740c4990 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5d7406cdb0 tx=0x7f5d6c02bee0 comp rx=0 tx=0).stop 2024-01-25T15:05:18.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.306+0000 7f5d79ac3640 1 -- 172.21.15.29:0/1921089841 shutdown_connections 2024-01-25T15:05:18.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.306+0000 7f5d79ac3640 1 --2- 172.21.15.29:0/1921089841 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d7406c370 0x7f5d740c4990 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:18.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.306+0000 7f5d79ac3640 1 --2- 172.21.15.29:0/1921089841 >> v2:172.21.15.52:3300/0 conn(0x7f5d740c6a20 0x7f5d74155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:18.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.306+0000 7f5d79ac3640 1 -- 172.21.15.29:0/1921089841 >> 172.21.15.29:0/1921089841 conn(0x7f5d740abd80 msgr2=0x7f5d740ac190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:18.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.306+0000 7f5d79ac3640 1 -- 172.21.15.29:0/1921089841 shutdown_connections 2024-01-25T15:05:18.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.306+0000 7f5d79ac3640 1 -- 172.21.15.29:0/1921089841 wait complete. 2024-01-25T15:05:18.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.307+0000 7f5d79ac3640 1 Processor -- start 2024-01-25T15:05:18.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.307+0000 7f5d79ac3640 1 -- start start 2024-01-25T15:05:18.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.308+0000 7f5d79ac3640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d7406c370 0x7f5d740c3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:18.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.308+0000 7f5d79ac3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d740c6a20 0x7f5d74154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:18.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.308+0000 7f5d79ac3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d74151d80 0x7f5d74154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:18.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.308+0000 7f5d79ac3640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d741ea630 con 0x7f5d740c6a20 2024-01-25T15:05:18.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.308+0000 7f5d79ac3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d741eab20 con 0x7f5d74151d80 2024-01-25T15:05:18.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.308+0000 7f5d79ac3640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d74155070 con 0x7f5d7406c370 2024-01-25T15:05:18.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.308+0000 7f5d72ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d740c6a20 0x7f5d74154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:18.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.308+0000 7f5d72ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d740c6a20 0x7f5d74154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49936/0 (socket says 172.21.15.29:49936) 2024-01-25T15:05:18.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.308+0000 7f5d72ffd640 1 -- 172.21.15.29:0/1638958475 learned_addr learned my addr 172.21.15.29:0/1638958475 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:18.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.308+0000 7f5d72ffd640 1 -- 172.21.15.29:0/1638958475 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d7406c370 msgr2=0x7f5d740c3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:18.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.308+0000 7f5d72ffd640 1 --2- 172.21.15.29:0/1638958475 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d7406c370 0x7f5d740c3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:18.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.309+0000 7f5d72ffd640 1 -- 172.21.15.29:0/1638958475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d74151d80 msgr2=0x7f5d74154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:18.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.309+0000 7f5d72ffd640 1 --2- 172.21.15.29:0/1638958475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d74151d80 0x7f5d74154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:18.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.309+0000 7f5d72ffd640 1 -- 172.21.15.29:0/1638958475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c009b30 con 0x7f5d740c6a20 2024-01-25T15:05:18.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.309+0000 7f5d72ffd640 1 --2- 172.21.15.29:0/1638958475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d740c6a20 0x7f5d74154250 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800c7f0 tx=0x7f5d6800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:18.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.309+0000 7f5d5bfff640 1 -- 172.21.15.29:0/1638958475 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68007a30 con 0x7f5d740c6a20 2024-01-25T15:05:18.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.309+0000 7f5d5bfff640 1 -- 172.21.15.29:0/1638958475 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d68007b90 con 0x7f5d740c6a20 2024-01-25T15:05:18.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.309+0000 7f5d79ac3640 1 -- 172.21.15.29:0/1638958475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d741ea860 con 0x7f5d740c6a20 2024-01-25T15:05:18.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.309+0000 7f5d5bfff640 1 -- 172.21.15.29:0/1638958475 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6800ce40 con 0x7f5d740c6a20 2024-01-25T15:05:18.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.309+0000 7f5d79ac3640 1 -- 172.21.15.29:0/1638958475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d74154cd0 con 0x7f5d740c6a20 2024-01-25T15:05:18.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.310+0000 7f5d79ac3640 1 -- 172.21.15.29:0/1638958475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7414d8e0 con 0x7f5d740c6a20 2024-01-25T15:05:18.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.310+0000 7f5d5bfff640 1 -- 172.21.15.29:0/1638958475 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f5d680113f0 con 0x7f5d740c6a20 2024-01-25T15:05:18.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.311+0000 7f5d5bfff640 1 --2- 172.21.15.29:0/1638958475 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5d6006aed0 0x7f5d6006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:18.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.311+0000 7f5d5bfff640 1 -- 172.21.15.29:0/1638958475 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6340+0+0 (secure 0 0 0) 0x7f5d680899b0 con 0x7f5d740c6a20 2024-01-25T15:05:18.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.311+0000 7f5d737fe640 1 --2- 172.21.15.29:0/1638958475 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5d6006aed0 0x7f5d6006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:18.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.312+0000 7f5d737fe640 1 --2- 172.21.15.29:0/1638958475 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5d6006aed0 0x7f5d6006d390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5d64007fd0 tx=0x7f5d64007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:18.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.315+0000 7f5d5bfff640 1 -- 172.21.15.29:0/1638958475 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f5d68054690 con 0x7f5d740c6a20 2024-01-25T15:05:18.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:18.494+0000 7f5d79ac3640 1 -- 172.21.15.29:0/1638958475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5d74074010 con 0x7f5d740c6a20 2024-01-25T15:05:19.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.178+0000 7f5d5bfff640 1 -- 172.21.15.29:0/1638958475 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5d6801f0d0 con 0x7f5d740c6a20 2024-01-25T15:05:19.179 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' removed 2024-01-25T15:05:19.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.184+0000 7f5d79ac3640 1 -- 172.21.15.29:0/1638958475 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5d6006aed0 msgr2=0x7f5d6006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:19.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.184+0000 7f5d79ac3640 1 --2- 172.21.15.29:0/1638958475 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5d6006aed0 0x7f5d6006d390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5d64007fd0 tx=0x7f5d64007920 comp rx=0 tx=0).stop 2024-01-25T15:05:19.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.185+0000 7f5d79ac3640 1 -- 172.21.15.29:0/1638958475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d740c6a20 msgr2=0x7f5d74154250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:19.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.185+0000 7f5d79ac3640 1 --2- 172.21.15.29:0/1638958475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d740c6a20 0x7f5d74154250 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800c7f0 tx=0x7f5d6800cbf0 comp rx=0 tx=0).stop 2024-01-25T15:05:19.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.185+0000 7f5d79ac3640 1 -- 172.21.15.29:0/1638958475 shutdown_connections 2024-01-25T15:05:19.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.185+0000 7f5d79ac3640 1 --2- 172.21.15.29:0/1638958475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d74151d80 0x7f5d74154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:19.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.185+0000 7f5d79ac3640 1 --2- 172.21.15.29:0/1638958475 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5d6006aed0 0x7f5d6006d390 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:19.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.185+0000 7f5d79ac3640 1 --2- 172.21.15.29:0/1638958475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d740c6a20 0x7f5d74154250 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:19.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.185+0000 7f5d79ac3640 1 --2- 172.21.15.29:0/1638958475 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d7406c370 0x7f5d740c3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:19.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.185+0000 7f5d79ac3640 1 -- 172.21.15.29:0/1638958475 >> 172.21.15.29:0/1638958475 conn(0x7f5d740abd80 msgr2=0x7f5d740c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:19.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.185+0000 7f5d79ac3640 1 -- 172.21.15.29:0/1638958475 shutdown_connections 2024-01-25T15:05:19.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.186+0000 7f5d79ac3640 1 -- 172.21.15.29:0/1638958475 wait complete. 2024-01-25T15:05:19.201 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-01-25T15:05:19.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.311+0000 7fdfd7265640 1 Processor -- start 2024-01-25T15:05:19.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.311+0000 7fdfd7265640 1 -- start start 2024-01-25T15:05:19.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.312+0000 7fdfd7265640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdfd00c4a10 0x7fdfd00c7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:19.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.312+0000 7fdfd7265640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdfd0158950 0x7fdfd00c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:19.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.312+0000 7fdfd7265640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd0070e20 con 0x7fdfd01551c0 2024-01-25T15:05:19.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.312+0000 7fdfd7265640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd00c7e40 con 0x7fdfd0158950 2024-01-25T15:05:19.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.312+0000 7fdfd7265640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd00c7b60 con 0x7fdfd00c4a10 2024-01-25T15:05:19.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.312+0000 7fdfd4800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdfd0158950 0x7fdfd00c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:19.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.312+0000 7fdfd4800640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdfd0158950 0x7fdfd00c4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49952/0 (socket says 172.21.15.29:49952) 2024-01-25T15:05:19.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.312+0000 7fdfd4800640 1 -- 172.21.15.29:0/998051364 learned_addr learned my addr 172.21.15.29:0/998051364 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:19.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.312+0000 7fdfd5001640 1 --2- 172.21.15.29:0/998051364 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdfd00c4a10 0x7fdfd00c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:19.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.312+0000 7fdfd4800640 1 -- 172.21.15.29:0/998051364 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdfd00c4a10 msgr2=0x7fdfd00c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:19.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.312+0000 7fdfd4800640 1 --2- 172.21.15.29:0/998051364 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdfd00c4a10 0x7fdfd00c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:19.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.312+0000 7fdfd4800640 1 -- 172.21.15.29:0/998051364 >> v1:172.21.15.29:6789/0 conn(0x7fdfd01551c0 legacy=0x7fdfd00c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:19.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.312+0000 7fdfd4800640 1 -- 172.21.15.29:0/998051364 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd0157e70 con 0x7fdfd0158950 2024-01-25T15:05:19.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.312+0000 7fdfc7fff640 1 -- 172.21.15.29:0/998051364 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1327499326 0 0) 0x7fdfd0070e20 con 0x7fdfd01551c0 2024-01-25T15:05:19.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.312+0000 7fdfd5001640 1 --2- 172.21.15.29:0/998051364 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdfd00c4a10 0x7fdfd00c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:19.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.313+0000 7fdfd4800640 1 --2- 172.21.15.29:0/998051364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfd0158950 0x7fdfd00c4df0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009870 tx=0x7fdfc002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b8d73f4b95c4ca server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:19.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.313+0000 7fdfc7fff640 1 -- 172.21.15.29:0/998051364 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0030840 con 0x7fdfd0158950 2024-01-25T15:05:19.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.313+0000 7fdfc7fff640 1 -- 172.21.15.29:0/998051364 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc00309a0 con 0x7fdfd0158950 2024-01-25T15:05:19.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.313+0000 7fdfc7fff640 1 -- 172.21.15.29:0/998051364 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0030d30 con 0x7fdfd0158950 2024-01-25T15:05:19.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.314+0000 7fdfd7265640 1 -- 172.21.15.29:0/998051364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfd0158950 msgr2=0x7fdfd00c4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:19.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.314+0000 7fdfd7265640 1 --2- 172.21.15.29:0/998051364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfd0158950 0x7fdfd00c4df0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009870 tx=0x7fdfc002b980 comp rx=0 tx=0).stop 2024-01-25T15:05:19.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.314+0000 7fdfd7265640 1 -- 172.21.15.29:0/998051364 shutdown_connections 2024-01-25T15:05:19.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.314+0000 7fdfd7265640 1 --2- 172.21.15.29:0/998051364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfd0158950 0x7fdfd00c4df0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:19.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.314+0000 7fdfd7265640 1 --2- 172.21.15.29:0/998051364 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdfd00c4a10 0x7fdfd00c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:19.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.314+0000 7fdfd7265640 1 -- 172.21.15.29:0/998051364 >> 172.21.15.29:0/998051364 conn(0x7fdfd00c7f80 msgr2=0x7fdfd00c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:19.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.314+0000 7fdfd7265640 1 -- 172.21.15.29:0/998051364 shutdown_connections 2024-01-25T15:05:19.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.314+0000 7fdfd7265640 1 -- 172.21.15.29:0/998051364 wait complete. 2024-01-25T15:05:19.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.315+0000 7fdfd7265640 1 Processor -- start 2024-01-25T15:05:19.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.315+0000 7fdfd7265640 1 -- start start 2024-01-25T15:05:19.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.316+0000 7fdfd7265640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdfd00c4a10 0x7fdfd006fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:19.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.316+0000 7fdfd7265640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfd01551c0 0x7fdfd01e7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:19.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.316+0000 7fdfd7265640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfd0158950 0x7fdfd01e7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:19.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.316+0000 7fdfd7265640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd01edcd0 con 0x7fdfd0158950 2024-01-25T15:05:19.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.316+0000 7fdfd7265640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd01ee200 con 0x7fdfd01551c0 2024-01-25T15:05:19.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.316+0000 7fdfd7265640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd01546f0 con 0x7fdfd00c4a10 2024-01-25T15:05:19.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.316+0000 7fdfd5802640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfd0158950 0x7fdfd01e7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:19.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.316+0000 7fdfd5802640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfd0158950 0x7fdfd01e7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49960/0 (socket says 172.21.15.29:49960) 2024-01-25T15:05:19.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.316+0000 7fdfd5802640 1 -- 172.21.15.29:0/1898242140 learned_addr learned my addr 172.21.15.29:0/1898242140 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:19.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.316+0000 7fdfd5001640 1 --2- 172.21.15.29:0/1898242140 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdfd00c4a10 0x7fdfd006fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:19.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.316+0000 7fdfd4800640 1 --2- 172.21.15.29:0/1898242140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfd01551c0 0x7fdfd01e7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:19.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.316+0000 7fdfd5802640 1 -- 172.21.15.29:0/1898242140 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdfd00c4a10 msgr2=0x7fdfd006fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:19.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.316+0000 7fdfd5802640 1 --2- 172.21.15.29:0/1898242140 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdfd00c4a10 0x7fdfd006fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:19.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.316+0000 7fdfd5802640 1 -- 172.21.15.29:0/1898242140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfd01551c0 msgr2=0x7fdfd01e7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:19.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.316+0000 7fdfd5802640 1 --2- 172.21.15.29:0/1898242140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfd01551c0 0x7fdfd01e7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:19.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.316+0000 7fdfd5802640 1 -- 172.21.15.29:0/1898242140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc00094d0 con 0x7fdfd0158950 2024-01-25T15:05:19.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.316+0000 7fdfd4800640 1 --2- 172.21.15.29:0/1898242140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfd01551c0 0x7fdfd01e7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:19.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.317+0000 7fdfd5802640 1 --2- 172.21.15.29:0/1898242140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfd0158950 0x7fdfd01e7540 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdfc800c790 tx=0x7fdfc800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:19.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.317+0000 7fdfc5ffb640 1 -- 172.21.15.29:0/1898242140 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc800cea0 con 0x7fdfd0158950 2024-01-25T15:05:19.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.317+0000 7fdfc5ffb640 1 -- 172.21.15.29:0/1898242140 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc8003da0 con 0x7fdfd0158950 2024-01-25T15:05:19.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.317+0000 7fdfd7265640 1 -- 172.21.15.29:0/1898242140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd01499e0 con 0x7fdfd0158950 2024-01-25T15:05:19.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.317+0000 7fdfc5ffb640 1 -- 172.21.15.29:0/1898242140 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80052b0 con 0x7fdfd0158950 2024-01-25T15:05:19.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.317+0000 7fdfd7265640 1 -- 172.21.15.29:0/1898242140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd0154380 con 0x7fdfd0158950 2024-01-25T15:05:19.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.318+0000 7fdfd7265640 1 -- 172.21.15.29:0/1898242140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd004eb10 con 0x7fdfd0158950 2024-01-25T15:05:19.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.318+0000 7fdfc5ffb640 1 -- 172.21.15.29:0/1898242140 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fdfc8005410 con 0x7fdfd0158950 2024-01-25T15:05:19.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.319+0000 7fdfc5ffb640 1 --2- 172.21.15.29:0/1898242140 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdfb406af00 0x7fdfb406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:19.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.319+0000 7fdfc5ffb640 1 -- 172.21.15.29:0/1898242140 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7fdfc8089320 con 0x7fdfd0158950 2024-01-25T15:05:19.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.319+0000 7fdfd5001640 1 --2- 172.21.15.29:0/1898242140 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdfb406af00 0x7fdfb406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:19.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.319+0000 7fdfd5001640 1 --2- 172.21.15.29:0/1898242140 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdfb406af00 0x7fdfb406d3c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00aac0 tx=0x7fdfcc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:19.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.323+0000 7fdfc5ffb640 1 -- 172.21.15.29:0/1898242140 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fdfc8054230 con 0x7fdfd0158950 2024-01-25T15:05:19.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:19.502+0000 7fdfd7265640 1 -- 172.21.15.29:0/1898242140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdfd0074010 con 0x7fdfd0158950 2024-01-25T15:05:20.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.180+0000 7fdfc5ffb640 1 -- 172.21.15.29:0/1898242140 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7fdfc8057850 con 0x7fdfd0158950 2024-01-25T15:05:20.181 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data_ec' removed 2024-01-25T15:05:20.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.183+0000 7fdfd7265640 1 -- 172.21.15.29:0/1898242140 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdfb406af00 msgr2=0x7fdfb406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.183+0000 7fdfd7265640 1 --2- 172.21.15.29:0/1898242140 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdfb406af00 0x7fdfb406d3c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00aac0 tx=0x7fdfcc008040 comp rx=0 tx=0).stop 2024-01-25T15:05:20.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.183+0000 7fdfd7265640 1 -- 172.21.15.29:0/1898242140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfd0158950 msgr2=0x7fdfd01e7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.183+0000 7fdfd7265640 1 --2- 172.21.15.29:0/1898242140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfd0158950 0x7fdfd01e7540 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdfc800c790 tx=0x7fdfc800cc50 comp rx=0 tx=0).stop 2024-01-25T15:05:20.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.183+0000 7fdfd7265640 1 -- 172.21.15.29:0/1898242140 shutdown_connections 2024-01-25T15:05:20.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.183+0000 7fdfd7265640 1 --2- 172.21.15.29:0/1898242140 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdfb406af00 0x7fdfb406d3c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.183+0000 7fdfd7265640 1 --2- 172.21.15.29:0/1898242140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfd0158950 0x7fdfd01e7540 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.183+0000 7fdfd7265640 1 --2- 172.21.15.29:0/1898242140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfd01551c0 0x7fdfd01e7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.183+0000 7fdfd7265640 1 --2- 172.21.15.29:0/1898242140 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdfd00c4a10 0x7fdfd006fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.183+0000 7fdfd7265640 1 -- 172.21.15.29:0/1898242140 >> 172.21.15.29:0/1898242140 conn(0x7fdfd00c7f80 msgr2=0x7fdfd00c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:20.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.183+0000 7fdfd7265640 1 -- 172.21.15.29:0/1898242140 shutdown_connections 2024-01-25T15:05:20.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.184+0000 7fdfd7265640 1 -- 172.21.15.29:0/1898242140 wait complete. 2024-01-25T15:05:20.198 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-25T15:05:20.199 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-25T15:05:20.199 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-25T15:05:20.199 INFO:teuthology.orchestra.run:waiting for 300 2024-01-25T15:05:20.199 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-25T15:05:20.199 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-25T15:05:20.199 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-25T15:05:20.199 INFO:teuthology.orchestra.run:waiting for 300 2024-01-25T15:05:20.200 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-25T15:05:20.200 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-25T15:05:20.200 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-25T15:05:20.200 INFO:teuthology.orchestra.run:waiting for 300 2024-01-25T15:05:20.200 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-25T15:05:20.200 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-25T15:05:20.201 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-25T15:05:20.201 INFO:teuthology.orchestra.run:waiting for 300 2024-01-25T15:05:20.209 INFO:tasks.ceph.mds.a:Stopped 2024-01-25T15:05:20.209 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-25T15:05:20.210 INFO:tasks.ceph.mds.c:Stopped 2024-01-25T15:05:20.210 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-25T15:05:20.211 INFO:tasks.ceph.mds.b:Stopped 2024-01-25T15:05:20.211 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-25T15:05:20.212 INFO:tasks.ceph.mds.d:Stopped 2024-01-25T15:05:20.212 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-25T15:05:20.252 INFO:tasks.ceph.mds.a:Started 2024-01-25T15:05:20.252 DEBUG:teuthology.parallel:result is None 2024-01-25T15:05:20.253 INFO:tasks.ceph.mds.c:Started 2024-01-25T15:05:20.253 DEBUG:teuthology.parallel:result is None 2024-01-25T15:05:20.254 INFO:tasks.ceph.mds.b:Started 2024-01-25T15:05:20.254 DEBUG:teuthology.parallel:result is None 2024-01-25T15:05:20.254 INFO:tasks.ceph.mds.d:Started 2024-01-25T15:05:20.255 DEBUG:teuthology.parallel:result is None 2024-01-25T15:05:20.255 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-25T15:05:20.333 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2024-01-25T15:05:20.333 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2024-01-25T15:05:20.335 INFO:tasks.ceph.mds.b.smithi052.stdout:starting mds.b at 2024-01-25T15:05:20.335 INFO:tasks.ceph.mds.d.smithi052.stdout:starting mds.d at 2024-01-25T15:05:20.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.364+0000 7f8cfda56640 1 Processor -- start 2024-01-25T15:05:20.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.364+0000 7f8cfda56640 1 -- start start 2024-01-25T15:05:20.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.365+0000 7f8cfda56640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cf8151d80 0x7f8cf80c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.365+0000 7f8cfda56640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8cf806c370 0x7f8cf80c4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.365+0000 7f8cfda56640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf806bee0 con 0x7f8cf8155210 2024-01-25T15:05:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.365+0000 7f8cfda56640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf80c7400 con 0x7f8cf806c370 2024-01-25T15:05:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.365+0000 7f8cfda56640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf806b8d0 con 0x7f8cf8151d80 2024-01-25T15:05:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.365+0000 7f8cf77fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8cf806c370 0x7f8cf80c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.365+0000 7f8cf6ffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cf8151d80 0x7f8cf80c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.365+0000 7f8cf77fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8cf806c370 0x7f8cf80c4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:38466/0 (socket says 172.21.15.29:38466) 2024-01-25T15:05:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.365+0000 7f8cf77fe640 1 -- 172.21.15.29:0/3438822640 learned_addr learned my addr 172.21.15.29:0/3438822640 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.365+0000 7f8cf6ffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cf8151d80 0x7f8cf80c6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:45928/0 (socket says 172.21.15.29:45928) 2024-01-25T15:05:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.365+0000 7f8cf67fc640 1 --1- 172.21.15.29:0/3438822640 >> v1:172.21.15.52:6789/0 conn(0x7f8cf8155210 0x7f8cf80c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:37482/0 (socket says 172.21.15.29:37482) 2024-01-25T15:05:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.365+0000 7f8cf77fe640 1 -- 172.21.15.29:0/3438822640 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cf8151d80 msgr2=0x7f8cf80c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.365+0000 7f8cf77fe640 1 --2- 172.21.15.29:0/3438822640 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cf8151d80 0x7f8cf80c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.365+0000 7f8cf77fe640 1 -- 172.21.15.29:0/3438822640 >> v1:172.21.15.52:6789/0 conn(0x7f8cf8155210 legacy=0x7f8cf80c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.366+0000 7f8cf77fe640 1 -- 172.21.15.29:0/3438822640 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf80c7120 con 0x7f8cf806c370 2024-01-25T15:05:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.366+0000 7f8cf77fe640 1 --2- 172.21.15.29:0/3438822640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf806c370 0x7f8cf80c4990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009e80 tx=0x7f8cf002beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b265e1f9b418c2cd server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:20.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.366+0000 7f8cf5ffb640 1 -- 172.21.15.29:0/3438822640 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf002ca50 con 0x7f8cf806c370 2024-01-25T15:05:20.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.366+0000 7f8cf5ffb640 1 -- 172.21.15.29:0/3438822640 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf002cbb0 con 0x7f8cf806c370 2024-01-25T15:05:20.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.366+0000 7f8cf5ffb640 1 -- 172.21.15.29:0/3438822640 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf00343f0 con 0x7f8cf806c370 2024-01-25T15:05:20.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.367+0000 7f8cfda56640 1 -- 172.21.15.29:0/3438822640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf806c370 msgr2=0x7f8cf80c4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.367+0000 7f8cfda56640 1 --2- 172.21.15.29:0/3438822640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf806c370 0x7f8cf80c4990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009e80 tx=0x7f8cf002beb0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.367+0000 7f8cfda56640 1 -- 172.21.15.29:0/3438822640 shutdown_connections 2024-01-25T15:05:20.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.367+0000 7f8cfda56640 1 --2- 172.21.15.29:0/3438822640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf806c370 0x7f8cf80c4990 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.367+0000 7f8cfda56640 1 --2- 172.21.15.29:0/3438822640 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cf8151d80 0x7f8cf80c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.367+0000 7f8cfda56640 1 -- 172.21.15.29:0/3438822640 >> 172.21.15.29:0/3438822640 conn(0x7f8cf80abd80 msgr2=0x7f8cf80ac190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:20.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.367+0000 7f8cfda56640 1 -- 172.21.15.29:0/3438822640 shutdown_connections 2024-01-25T15:05:20.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.367+0000 7f8cfda56640 1 -- 172.21.15.29:0/3438822640 wait complete. 2024-01-25T15:05:20.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.368+0000 7f8cfda56640 1 Processor -- start 2024-01-25T15:05:20.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.369+0000 7f8cfda56640 1 -- start start 2024-01-25T15:05:20.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.369+0000 7f8cfda56640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf806c370 0x7f8cf80c2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:20.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.369+0000 7f8cfda56640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8cf8151d80 0x7f8cf80a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:20.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.369+0000 7f8cfda56640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cf8155210 0x7f8cf81e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:20.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.369+0000 7f8cfda56640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf8152840 con 0x7f8cf8151d80 2024-01-25T15:05:20.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.369+0000 7f8cfda56640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf81539e0 con 0x7f8cf806c370 2024-01-25T15:05:20.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.369+0000 7f8cfda56640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf80c1df0 con 0x7f8cf8155210 2024-01-25T15:05:20.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.369+0000 7f8cf67fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8cf8151d80 0x7f8cf80a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:20.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.369+0000 7f8cf67fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8cf8151d80 0x7f8cf80a9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49982/0 (socket says 172.21.15.29:49982) 2024-01-25T15:05:20.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.369+0000 7f8cf67fc640 1 -- 172.21.15.29:0/3916864533 learned_addr learned my addr 172.21.15.29:0/3916864533 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:20.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.369+0000 7f8cf6ffd640 1 --2- 172.21.15.29:0/3916864533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf806c370 0x7f8cf80c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:20.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.369+0000 7f8cf77fe640 1 --2- 172.21.15.29:0/3916864533 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cf8155210 0x7f8cf81e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:20.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.370+0000 7f8cf67fc640 1 -- 172.21.15.29:0/3916864533 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cf8155210 msgr2=0x7f8cf81e71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.370+0000 7f8cf67fc640 1 --2- 172.21.15.29:0/3916864533 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cf8155210 0x7f8cf81e71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.370+0000 7f8cf67fc640 1 -- 172.21.15.29:0/3916864533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf806c370 msgr2=0x7f8cf80c2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.370+0000 7f8cf67fc640 1 --2- 172.21.15.29:0/3916864533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf806c370 0x7f8cf80c2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.370+0000 7f8cf67fc640 1 -- 172.21.15.29:0/3916864533 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf0009b30 con 0x7f8cf8151d80 2024-01-25T15:05:20.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.370+0000 7f8cf67fc640 1 --2- 172.21.15.29:0/3916864533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8cf8151d80 0x7f8cf80a9e70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8cec00c400 tx=0x7f8cec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:20.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.370+0000 7f8cdffff640 1 -- 172.21.15.29:0/3916864533 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec0074e0 con 0x7f8cf8151d80 2024-01-25T15:05:20.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.370+0000 7f8cdffff640 1 -- 172.21.15.29:0/3916864533 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec007640 con 0x7f8cf8151d80 2024-01-25T15:05:20.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.370+0000 7f8cfda56640 1 -- 172.21.15.29:0/3916864533 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf80c20d0 con 0x7f8cf8151d80 2024-01-25T15:05:20.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.370+0000 7f8cdffff640 1 -- 172.21.15.29:0/3916864533 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec004a00 con 0x7f8cf8151d80 2024-01-25T15:05:20.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.370+0000 7f8cfda56640 1 -- 172.21.15.29:0/3916864533 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf80c3d70 con 0x7f8cf8151d80 2024-01-25T15:05:20.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.371+0000 7f8cfda56640 1 -- 172.21.15.29:0/3916864533 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf80c1c50 con 0x7f8cf8151d80 2024-01-25T15:05:20.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.372+0000 7f8cdffff640 1 -- 172.21.15.29:0/3916864533 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8cec004b60 con 0x7f8cf8151d80 2024-01-25T15:05:20.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.372+0000 7f8cdffff640 1 --2- 172.21.15.29:0/3916864533 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8ce406aed0 0x7f8ce406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:20.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.372+0000 7f8cdffff640 1 -- 172.21.15.29:0/3916864533 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8cec088d50 con 0x7f8cf8151d80 2024-01-25T15:05:20.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.372+0000 7f8cf6ffd640 1 --2- 172.21.15.29:0/3916864533 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8ce406aed0 0x7f8ce406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:20.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.373+0000 7f8cf6ffd640 1 --2- 172.21.15.29:0/3916864533 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8ce406aed0 0x7f8ce406d390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009aa0 tx=0x7f8ce8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:20.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.376+0000 7f8cdffff640 1 -- 172.21.15.29:0/3916864533 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8cf80c1c50 con 0x7f8cf8151d80 2024-01-25T15:05:20.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:20.570+0000 7f8cfda56640 1 -- 172.21.15.29:0/3916864533 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8cf80c1c50 con 0x7f8cf8151d80 2024-01-25T15:05:21.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.194+0000 7f8cdffff640 1 -- 172.21.15.29:0/3916864533 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8cf80c1c50 con 0x7f8cf8151d80 2024-01-25T15:05:21.195 INFO:teuthology.orchestra.run.smithi029.stderr: removed all blocklist entries 2024-01-25T15:05:21.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.197+0000 7f8cfda56640 1 -- 172.21.15.29:0/3916864533 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8ce406aed0 msgr2=0x7f8ce406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.197+0000 7f8cfda56640 1 --2- 172.21.15.29:0/3916864533 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8ce406aed0 0x7f8ce406d390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009aa0 tx=0x7f8ce8009190 comp rx=0 tx=0).stop 2024-01-25T15:05:21.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.197+0000 7f8cfda56640 1 -- 172.21.15.29:0/3916864533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8cf8151d80 msgr2=0x7f8cf80a9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.197+0000 7f8cfda56640 1 --2- 172.21.15.29:0/3916864533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8cf8151d80 0x7f8cf80a9e70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8cec00c400 tx=0x7f8cec00c8c0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.197+0000 7f8cfda56640 1 -- 172.21.15.29:0/3916864533 shutdown_connections 2024-01-25T15:05:21.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.197+0000 7f8cfda56640 1 --2- 172.21.15.29:0/3916864533 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cf8155210 0x7f8cf81e71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.197+0000 7f8cfda56640 1 --2- 172.21.15.29:0/3916864533 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8ce406aed0 0x7f8ce406d390 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.197+0000 7f8cfda56640 1 --2- 172.21.15.29:0/3916864533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8cf8151d80 0x7f8cf80a9e70 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.197+0000 7f8cfda56640 1 --2- 172.21.15.29:0/3916864533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf806c370 0x7f8cf80c2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.197+0000 7f8cfda56640 1 -- 172.21.15.29:0/3916864533 >> 172.21.15.29:0/3916864533 conn(0x7f8cf80abd80 msgr2=0x7f8cf8150000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:21.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.197+0000 7f8cfda56640 1 -- 172.21.15.29:0/3916864533 shutdown_connections 2024-01-25T15:05:21.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.197+0000 7f8cfda56640 1 -- 172.21.15.29:0/3916864533 wait complete. 2024-01-25T15:05:21.212 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-25T15:05:21.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.316+0000 7f2dc637b640 1 Processor -- start 2024-01-25T15:05:21.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.316+0000 7f2dc637b640 1 -- start start 2024-01-25T15:05:21.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.317+0000 7f2dc637b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dc0152160 0x7f2dc006bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:21.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.317+0000 7f2dc637b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc0155430 con 0x7f2dc00c7f10 2024-01-25T15:05:21.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.317+0000 7f2dc637b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc0154b40 con 0x7f2dc00c4990 2024-01-25T15:05:21.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.317+0000 7f2dc637b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc0152540 con 0x7f2dc0152160 2024-01-25T15:05:21.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.317+0000 7f2dc4918640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2dc00c7f10 0x7f2dc015f3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47458/0 (socket says 172.21.15.29:47458) 2024-01-25T15:05:21.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.317+0000 7f2dc4918640 1 -- 172.21.15.29:0/2368658147 learned_addr learned my addr 172.21.15.29:0/2368658147 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:21.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.317+0000 7f2dbffff640 1 --2- 172.21.15.29:0/2368658147 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dc0152160 0x7f2dc006bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:21.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.317+0000 7f2dbeffd640 1 -- 172.21.15.29:0/2368658147 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477025676 0 0) 0x7f2dc0155430 con 0x7f2dc00c7f10 2024-01-25T15:05:21.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.317+0000 7f2dbeffd640 1 -- 172.21.15.29:0/2368658147 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2da8003520 con 0x7f2dc00c7f10 2024-01-25T15:05:21.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.317+0000 7f2dbeffd640 1 -- 172.21.15.29:0/2368658147 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1113783226 0 0) 0x7f2da8003520 con 0x7f2dc00c7f10 2024-01-25T15:05:21.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.317+0000 7f2dbeffd640 1 -- 172.21.15.29:0/2368658147 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dc0152160 msgr2=0x7f2dc006bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:21.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.317+0000 7f2dbeffd640 1 --2- 172.21.15.29:0/2368658147 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dc0152160 0x7f2dc006bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.317+0000 7f2dbeffd640 1 -- 172.21.15.29:0/2368658147 >> v1:172.21.15.52:6789/0 conn(0x7f2dc00c4990 legacy=0x7f2dc00c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.317+0000 7f2dbeffd640 1 -- 172.21.15.29:0/2368658147 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc00c64b0 con 0x7f2dc00c7f10 2024-01-25T15:05:21.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.317+0000 7f2dbeffd640 1 -- 172.21.15.29:0/2368658147 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f2db80019f0 con 0x7f2dc00c7f10 2024-01-25T15:05:21.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.317+0000 7f2dbeffd640 1 -- 172.21.15.29:0/2368658147 >> v1:172.21.15.29:6789/0 conn(0x7f2dc00c7f10 legacy=0x7f2dc015f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.317+0000 7f2dbeffd640 1 --2- 172.21.15.29:0/2368658147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2da80039a0 0x7f2da8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:21.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.317+0000 7f2dbeffd640 1 --2- 172.21.15.29:0/2368658147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2da8004350 0x7f2da8004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:21.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.317+0000 7f2dbeffd640 1 --2- 172.21.15.29:0/2368658147 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dc0152160 0x7f2da8005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:21.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.317+0000 7f2dbeffd640 1 -- 172.21.15.29:0/2368658147 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc0152540 con 0x7f2da80039a0 2024-01-25T15:05:21.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.317+0000 7f2dbeffd640 1 -- 172.21.15.29:0/2368658147 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da800ba30 con 0x7f2da8004350 2024-01-25T15:05:21.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.317+0000 7f2dbeffd640 1 -- 172.21.15.29:0/2368658147 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da800bbf0 con 0x7f2dc0152160 2024-01-25T15:05:21.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.318+0000 7f2dbffff640 1 --2- 172.21.15.29:0/2368658147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2da80039a0 0x7f2da8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:21.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.318+0000 7f2dc4918640 1 --2- 172.21.15.29:0/2368658147 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dc0152160 0x7f2da8005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:21.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.318+0000 7f2dbf7fe640 1 --2- 172.21.15.29:0/2368658147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2da8004350 0x7f2da8004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:21.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.318+0000 7f2dbffff640 1 -- 172.21.15.29:0/2368658147 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dc0152160 msgr2=0x7f2da8005120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:21.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.318+0000 7f2dbffff640 1 --2- 172.21.15.29:0/2368658147 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dc0152160 0x7f2da8005120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.318+0000 7f2dbffff640 1 -- 172.21.15.29:0/2368658147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2da8004350 msgr2=0x7f2da8004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:21.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.318+0000 7f2dbffff640 1 --2- 172.21.15.29:0/2368658147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2da8004350 0x7f2da8004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.318+0000 7f2dbffff640 1 -- 172.21.15.29:0/2368658147 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da8003520 con 0x7f2da80039a0 2024-01-25T15:05:21.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.319+0000 7f2dbffff640 1 --2- 172.21.15.29:0/2368658147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2da80039a0 0x7f2da8003d80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2db4009ac0 tx=0x7f2da80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe65fb6f392893d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:21.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.319+0000 7f2dbeffd640 1 -- 172.21.15.29:0/2368658147 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db402c6b0 con 0x7f2da80039a0 2024-01-25T15:05:21.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.319+0000 7f2dbeffd640 1 -- 172.21.15.29:0/2368658147 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db402c810 con 0x7f2da80039a0 2024-01-25T15:05:21.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.319+0000 7f2dbeffd640 1 -- 172.21.15.29:0/2368658147 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db402cba0 con 0x7f2da80039a0 2024-01-25T15:05:21.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.319+0000 7f2dc637b640 1 -- 172.21.15.29:0/2368658147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2da80039a0 msgr2=0x7f2da8003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.319+0000 7f2dc637b640 1 --2- 172.21.15.29:0/2368658147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2da80039a0 0x7f2da8003d80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2db4009ac0 tx=0x7f2da80057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.319+0000 7f2dc4918640 1 -- 172.21.15.29:0/2368658147 reap_dead start 2024-01-25T15:05:21.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.319+0000 7f2dc637b640 1 -- 172.21.15.29:0/2368658147 shutdown_connections 2024-01-25T15:05:21.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.319+0000 7f2dc637b640 1 -- 172.21.15.29:0/2368658147 >> 172.21.15.29:0/2368658147 conn(0x7f2dc00ca1f0 msgr2=0x7f2dc00ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:21.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.319+0000 7f2dc637b640 1 -- 172.21.15.29:0/2368658147 shutdown_connections 2024-01-25T15:05:21.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.319+0000 7f2dc637b640 1 -- 172.21.15.29:0/2368658147 wait complete. 2024-01-25T15:05:21.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.320+0000 7f2dc637b640 1 Processor -- start 2024-01-25T15:05:21.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.321+0000 7f2dc637b640 1 -- start start 2024-01-25T15:05:21.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.321+0000 7f2dc637b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2da80039a0 0x7f2dc014b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:21.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.321+0000 7f2dc637b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dc014b780 0x7f2dc01ea7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:21.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.321+0000 7f2dc637b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2dc0153fa0 0x7f2dc0154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:21.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.321+0000 7f2dc637b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc00c3050 con 0x7f2da80039a0 2024-01-25T15:05:21.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.321+0000 7f2dc637b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc01ee0f0 con 0x7f2dc0153fa0 2024-01-25T15:05:21.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.321+0000 7f2dc637b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc00c3390 con 0x7f2dc014b780 2024-01-25T15:05:21.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.321+0000 7f2dbffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2da80039a0 0x7f2dc014b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:21.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.322+0000 7f2dbffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2da80039a0 0x7f2dc014b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49994/0 (socket says 172.21.15.29:49994) 2024-01-25T15:05:21.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.322+0000 7f2dbffff640 1 -- 172.21.15.29:0/524287135 learned_addr learned my addr 172.21.15.29:0/524287135 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:21.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.322+0000 7f2dbf7fe640 1 --2- 172.21.15.29:0/524287135 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dc014b780 0x7f2dc01ea7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:21.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.322+0000 7f2dc4918640 1 --2- 172.21.15.29:0/524287135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2dc0153fa0 0x7f2dc0154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:21.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.322+0000 7f2dbffff640 1 -- 172.21.15.29:0/524287135 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dc014b780 msgr2=0x7f2dc01ea7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.322+0000 7f2dbffff640 1 --2- 172.21.15.29:0/524287135 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dc014b780 0x7f2dc01ea7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.322+0000 7f2dbffff640 1 -- 172.21.15.29:0/524287135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2dc0153fa0 msgr2=0x7f2dc0154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.322+0000 7f2dbffff640 1 --2- 172.21.15.29:0/524287135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2dc0153fa0 0x7f2dc0154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.322+0000 7f2dbffff640 1 -- 172.21.15.29:0/524287135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc014b590 con 0x7f2da80039a0 2024-01-25T15:05:21.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.322+0000 7f2dc4918640 1 --2- 172.21.15.29:0/524287135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2dc0153fa0 0x7f2dc0154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:21.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.322+0000 7f2dbffff640 1 --2- 172.21.15.29:0/524287135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2da80039a0 0x7f2dc014b050 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2db4009be0 tx=0x7f2db4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:21.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.322+0000 7f2dbcff9640 1 -- 172.21.15.29:0/524287135 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db4003810 con 0x7f2da80039a0 2024-01-25T15:05:21.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.322+0000 7f2dbcff9640 1 -- 172.21.15.29:0/524287135 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db4003970 con 0x7f2da80039a0 2024-01-25T15:05:21.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.322+0000 7f2dc637b640 1 -- 172.21.15.29:0/524287135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc01eace0 con 0x7f2da80039a0 2024-01-25T15:05:21.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.322+0000 7f2dbcff9640 1 -- 172.21.15.29:0/524287135 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db4003d00 con 0x7f2da80039a0 2024-01-25T15:05:21.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.322+0000 7f2dc637b640 1 -- 172.21.15.29:0/524287135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc01ed750 con 0x7f2da80039a0 2024-01-25T15:05:21.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.323+0000 7f2dc637b640 1 -- 172.21.15.29:0/524287135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc00a97d0 con 0x7f2da80039a0 2024-01-25T15:05:21.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.324+0000 7f2dbcff9640 1 -- 172.21.15.29:0/524287135 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2db4047450 con 0x7f2da80039a0 2024-01-25T15:05:21.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.324+0000 7f2dbcff9640 1 --2- 172.21.15.29:0/524287135 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2dac06aed0 0x7f2dac06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:21.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.324+0000 7f2dbcff9640 1 -- 172.21.15.29:0/524287135 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2db40ab100 con 0x7f2da80039a0 2024-01-25T15:05:21.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.324+0000 7f2dbf7fe640 1 --2- 172.21.15.29:0/524287135 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2dac06aed0 0x7f2dac06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:21.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.325+0000 7f2dbf7fe640 1 --2- 172.21.15.29:0/524287135 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2dac06aed0 0x7f2dac06d390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2db0000c00 tx=0x7f2db0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:21.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.328+0000 7f2dbcff9640 1 -- 172.21.15.29:0/524287135 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2db4076440 con 0x7f2da80039a0 2024-01-25T15:05:21.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.578+0000 7f2dc637b640 1 -- 172.21.15.29:0/524287135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2dc0074080 con 0x7f2da80039a0 2024-01-25T15:05:21.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.579+0000 7f2dbcff9640 1 -- 172.21.15.29:0/524287135 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6065 (secure 0 0 0) 0x7f2db40044e0 con 0x7f2da80039a0 2024-01-25T15:05:21.580 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:21.580 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-25T15:05:21.580 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_dump": [ 2024-01-25T15:05:21.580 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.580 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.a", 2024-01-25T15:05:21.580 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBFeLJltFBjEBAA9c2uxalPVQBtlaMa+THPRg==", 2024-01-25T15:05:21.580 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.580 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2024-01-25T15:05:21.580 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2024-01-25T15:05:21.580 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2024-01-25T15:05:21.580 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-25T15:05:21.581 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.581 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:21.581 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.581 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.b", 2024-01-25T15:05:21.581 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBFeLJlyXXCHBAAIffuIQAitqv4JSfhTUnafA==", 2024-01-25T15:05:21.581 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.581 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2024-01-25T15:05:21.581 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2024-01-25T15:05:21.581 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2024-01-25T15:05:21.581 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-25T15:05:21.581 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.581 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:21.581 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.581 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.c", 2024-01-25T15:05:21.582 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBFeLJlxbXBFxAAbR1zjpuLeqNc6gSZKaTRsw==", 2024-01-25T15:05:21.582 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.582 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2024-01-25T15:05:21.582 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2024-01-25T15:05:21.582 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2024-01-25T15:05:21.582 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-25T15:05:21.582 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.582 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:21.582 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.582 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.d", 2024-01-25T15:05:21.582 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBFeLJlCP8kJBAA+MiuxyeER080vaH4rjB2lA==", 2024-01-25T15:05:21.582 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.582 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2024-01-25T15:05:21.582 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2024-01-25T15:05:21.582 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2024-01-25T15:05:21.582 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-25T15:05:21.583 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.583 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:21.583 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.583 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.0", 2024-01-25T15:05:21.583 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBHeLJlo8xiAxAArEnwBhVoN1iHgTYZqWSzfA==", 2024-01-25T15:05:21.583 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.583 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-25T15:05:21.583 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-25T15:05:21.583 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-25T15:05:21.583 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.583 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:21.583 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.583 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.1", 2024-01-25T15:05:21.583 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBKeLJlHtSFARAABKQrjF8zyiLLBZkfB/d30A==", 2024-01-25T15:05:21.584 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.584 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-25T15:05:21.584 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-25T15:05:21.584 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-25T15:05:21.584 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.584 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:21.584 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.584 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.2", 2024-01-25T15:05:21.584 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBMeLJllxxROxAAxycfXfVvwFxipwi43Pfw8w==", 2024-01-25T15:05:21.584 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.584 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-25T15:05:21.584 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-25T15:05:21.584 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-25T15:05:21.584 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.584 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:21.585 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.585 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.3", 2024-01-25T15:05:21.585 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBPeLJlkm0UOhAA9OmT8g7n7OEYOScexJhcNA==", 2024-01-25T15:05:21.585 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.585 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-25T15:05:21.585 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-25T15:05:21.585 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-25T15:05:21.585 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.585 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:21.585 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.585 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.4", 2024-01-25T15:05:21.585 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBUeLJlekcxCRAAZ9e1sBf6qgsawkBe2Nkb/g==", 2024-01-25T15:05:21.585 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.585 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-25T15:05:21.585 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-25T15:05:21.586 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-25T15:05:21.586 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.586 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:21.586 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.586 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.5", 2024-01-25T15:05:21.586 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBXeLJlZbqwBxAAg+KhkzocDaUrb/R/6g7TRg==", 2024-01-25T15:05:21.586 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.586 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-25T15:05:21.586 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-25T15:05:21.586 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-25T15:05:21.586 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.586 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:21.586 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.586 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.6", 2024-01-25T15:05:21.586 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBaeLJlg77KBRAAGMq+pUtKE3cXEDKkdksvHA==", 2024-01-25T15:05:21.587 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.587 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-25T15:05:21.587 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-25T15:05:21.587 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-25T15:05:21.587 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.587 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:21.587 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.587 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.7", 2024-01-25T15:05:21.587 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBdeLJlm+gtBBAAyyTEYFJoqNcktTyN5AmCkg==", 2024-01-25T15:05:21.587 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.587 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2024-01-25T15:05:21.587 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2024-01-25T15:05:21.587 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-25T15:05:21.587 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.587 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:21.588 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.588 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.0", 2024-01-25T15:05:21.588 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBFeLJlQhBmKBAAC5MC37SsgxDRQlM8EpzhHQ==", 2024-01-25T15:05:21.588 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.588 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2024-01-25T15:05:21.588 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2024-01-25T15:05:21.588 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2024-01-25T15:05:21.588 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2024-01-25T15:05:21.588 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.588 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:21.588 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.588 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.1", 2024-01-25T15:05:21.588 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBFeLJlX8/WKxAA0Acmb/XM79+7u0ZYjqLfSw==", 2024-01-25T15:05:21.588 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.589 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2024-01-25T15:05:21.589 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2024-01-25T15:05:21.589 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2024-01-25T15:05:21.589 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2024-01-25T15:05:21.589 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.589 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:21.589 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.589 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.admin", 2024-01-25T15:05:21.589 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBEeLJlX/kkLxAABEO3zsOvNCu9W1KQ4QQYyw==", 2024-01-25T15:05:21.589 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.589 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2024-01-25T15:05:21.589 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2024-01-25T15:05:21.589 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2024-01-25T15:05:21.589 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-25T15:05:21.589 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.590 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:21.590 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.590 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-mds", 2024-01-25T15:05:21.590 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBieLJlbAvZKxAAulQ+NHqupkBiSmfvc6I8rA==", 2024-01-25T15:05:21.590 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.590 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-mds" 2024-01-25T15:05:21.590 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.590 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:21.590 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.590 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-mgr", 2024-01-25T15:05:21.590 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBieLJlSBTZKxAA2sOl1weDRWghp5zphuhDyQ==", 2024-01-25T15:05:21.590 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.590 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-mgr" 2024-01-25T15:05:21.590 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.590 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:21.591 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.591 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-osd", 2024-01-25T15:05:21.591 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBieLJljhvZKxAA+xX5krS6CiZr7ocy3gA2JQ==", 2024-01-25T15:05:21.591 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.591 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-osd" 2024-01-25T15:05:21.591 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.591 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:21.591 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.591 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-rbd", 2024-01-25T15:05:21.591 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBieLJlHSLZKxAAc587zoALl0FxOZkDbCxMXQ==", 2024-01-25T15:05:21.591 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.591 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-rbd" 2024-01-25T15:05:21.591 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.591 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:21.592 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.592 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-01-25T15:05:21.592 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBieLJlBynZKxAAdUy9M4kjcMi3B+QLXhDT6g==", 2024-01-25T15:05:21.592 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.592 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-01-25T15:05:21.592 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.592 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:21.592 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.592 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-rgw", 2024-01-25T15:05:21.592 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBieLJlyC/ZKxAA59ddB4DS3t2X0qecEUZDDQ==", 2024-01-25T15:05:21.592 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.592 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-rgw" 2024-01-25T15:05:21.592 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.592 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:21.592 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.593 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mgr.x", 2024-01-25T15:05:21.593 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBFeLJlV6/zDBAA8lku/GJQ9lDaDqc6cdMhzQ==", 2024-01-25T15:05:21.593 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.593 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2024-01-25T15:05:21.593 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile mgr", 2024-01-25T15:05:21.593 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-25T15:05:21.593 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.593 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:21.593 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:21.593 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mgr.y", 2024-01-25T15:05:21.593 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBFeLJl3V+0CBAAPL5xKbXhI141dBDvyNagLg==", 2024-01-25T15:05:21.593 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2024-01-25T15:05:21.593 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2024-01-25T15:05:21.593 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile mgr", 2024-01-25T15:05:21.593 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2024-01-25T15:05:21.593 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.594 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:21.594 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-01-25T15:05:21.594 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-25T15:05:21.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.581+0000 7f2dc637b640 1 -- 172.21.15.29:0/524287135 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2dac06aed0 msgr2=0x7f2dac06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.581+0000 7f2dc637b640 1 --2- 172.21.15.29:0/524287135 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2dac06aed0 0x7f2dac06d390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2db0000c00 tx=0x7f2db0009040 comp rx=0 tx=0).stop 2024-01-25T15:05:21.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.581+0000 7f2dc637b640 1 -- 172.21.15.29:0/524287135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2da80039a0 msgr2=0x7f2dc014b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.581+0000 7f2dc637b640 1 --2- 172.21.15.29:0/524287135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2da80039a0 0x7f2dc014b050 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2db4009be0 tx=0x7f2db4004730 comp rx=0 tx=0).stop 2024-01-25T15:05:21.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.581+0000 7f2dc637b640 1 -- 172.21.15.29:0/524287135 shutdown_connections 2024-01-25T15:05:21.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.581+0000 7f2dc637b640 1 --2- 172.21.15.29:0/524287135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2dc0153fa0 0x7f2dc0154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.581+0000 7f2dc637b640 1 --2- 172.21.15.29:0/524287135 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2dc014b780 0x7f2dc01ea7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.581+0000 7f2dc637b640 1 --2- 172.21.15.29:0/524287135 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2dac06aed0 0x7f2dac06d390 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.581+0000 7f2dc637b640 1 --2- 172.21.15.29:0/524287135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2da80039a0 0x7f2dc014b050 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.581+0000 7f2dc637b640 1 -- 172.21.15.29:0/524287135 >> 172.21.15.29:0/524287135 conn(0x7f2dc00ca1f0 msgr2=0x7f2dc00c8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:21.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.581+0000 7f2dc637b640 1 -- 172.21.15.29:0/524287135 shutdown_connections 2024-01-25T15:05:21.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.581+0000 7f2dc637b640 1 -- 172.21.15.29:0/524287135 wait complete. 2024-01-25T15:05:21.596 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-01-25T15:05:21.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.698+0000 7fee43773640 1 Processor -- start 2024-01-25T15:05:21.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.698+0000 7fee43773640 1 -- start start 2024-01-25T15:05:21.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.699+0000 7fee43773640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fee3c151f80 0x7fee3c0c6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:21.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.699+0000 7fee43773640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee3c158120 con 0x7fee3c155190 2024-01-25T15:05:21.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.699+0000 7fee43773640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee3c0c4db0 con 0x7fee3c0c48d0 2024-01-25T15:05:21.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.699+0000 7fee43773640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee3c0c5090 con 0x7fee3c151f80 2024-01-25T15:05:21.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.699+0000 7fee41d10640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fee3c155190 0x7fee3c0c74f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47466/0 (socket says 172.21.15.29:47466) 2024-01-25T15:05:21.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.699+0000 7fee41d10640 1 -- 172.21.15.29:0/2489068800 learned_addr learned my addr 172.21.15.29:0/2489068800 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:21.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.699+0000 7fee3bfff640 1 -- 172.21.15.29:0/2489068800 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031070259 0 0) 0x7fee3c158120 con 0x7fee3c155190 2024-01-25T15:05:21.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.699+0000 7fee4150f640 1 --2- 172.21.15.29:0/2489068800 >> v2:172.21.15.52:3300/0 conn(0x7fee3c151f80 0x7fee3c0c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:21.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.699+0000 7fee3bfff640 1 -- 172.21.15.29:0/2489068800 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee24003520 con 0x7fee3c155190 2024-01-25T15:05:21.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.700+0000 7fee3bfff640 1 -- 172.21.15.29:0/2489068800 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3002257621 0 0) 0x7fee24003520 con 0x7fee3c155190 2024-01-25T15:05:21.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.700+0000 7fee3bfff640 1 -- 172.21.15.29:0/2489068800 >> v2:172.21.15.52:3300/0 conn(0x7fee3c151f80 msgr2=0x7fee3c0c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:21.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.700+0000 7fee3bfff640 1 --2- 172.21.15.29:0/2489068800 >> v2:172.21.15.52:3300/0 conn(0x7fee3c151f80 0x7fee3c0c6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.700+0000 7fee3bfff640 1 -- 172.21.15.29:0/2489068800 >> v1:172.21.15.52:6789/0 conn(0x7fee3c0c48d0 legacy=0x7fee3c1585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.700+0000 7fee3bfff640 1 -- 172.21.15.29:0/2489068800 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c0c5370 con 0x7fee3c155190 2024-01-25T15:05:21.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.700+0000 7fee3bfff640 1 -- 172.21.15.29:0/2489068800 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7fee34001670 con 0x7fee3c155190 2024-01-25T15:05:21.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.700+0000 7fee3bfff640 1 -- 172.21.15.29:0/2489068800 >> v1:172.21.15.29:6789/0 conn(0x7fee3c155190 legacy=0x7fee3c0c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.700+0000 7fee3bfff640 1 --2- 172.21.15.29:0/2489068800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee240039e0 0x7fee24003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:21.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.700+0000 7fee3bfff640 1 --2- 172.21.15.29:0/2489068800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee240047c0 0x7fee24004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:21.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.700+0000 7fee3bfff640 1 --2- 172.21.15.29:0/2489068800 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee24005180 0x7fee2400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:21.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.700+0000 7fee3bfff640 1 -- 172.21.15.29:0/2489068800 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c0c5090 con 0x7fee240047c0 2024-01-25T15:05:21.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.700+0000 7fee3bfff640 1 -- 172.21.15.29:0/2489068800 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2400c0b0 con 0x7fee240039e0 2024-01-25T15:05:21.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.700+0000 7fee3bfff640 1 -- 172.21.15.29:0/2489068800 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2400c270 con 0x7fee24005180 2024-01-25T15:05:21.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.700+0000 7fee40d0e640 1 --2- 172.21.15.29:0/2489068800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee240047c0 0x7fee24004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:21.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.700+0000 7fee4150f640 1 --2- 172.21.15.29:0/2489068800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee240039e0 0x7fee24003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:21.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.700+0000 7fee41d10640 1 --2- 172.21.15.29:0/2489068800 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee24005180 0x7fee2400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:21.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.700+0000 7fee40d0e640 1 -- 172.21.15.29:0/2489068800 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee24005180 msgr2=0x7fee2400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:21.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.700+0000 7fee40d0e640 1 --2- 172.21.15.29:0/2489068800 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee24005180 0x7fee2400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.700+0000 7fee40d0e640 1 -- 172.21.15.29:0/2489068800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee240039e0 msgr2=0x7fee24003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:21.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.700+0000 7fee40d0e640 1 --2- 172.21.15.29:0/2489068800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee240039e0 0x7fee24003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.700+0000 7fee41d10640 1 -- 172.21.15.29:0/2489068800 reap_dead start 2024-01-25T15:05:21.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.700+0000 7fee40d0e640 1 -- 172.21.15.29:0/2489068800 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee24003520 con 0x7fee240047c0 2024-01-25T15:05:21.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.701+0000 7fee40d0e640 1 --2- 172.21.15.29:0/2489068800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee240047c0 0x7fee24004c40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fee30001750 tx=0x7fee240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef604b5378752e9 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:21.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.701+0000 7fee3bfff640 1 -- 172.21.15.29:0/2489068800 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee300052d0 con 0x7fee240047c0 2024-01-25T15:05:21.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.701+0000 7fee3bfff640 1 -- 172.21.15.29:0/2489068800 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3002e050 con 0x7fee240047c0 2024-01-25T15:05:21.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.701+0000 7fee3bfff640 1 -- 172.21.15.29:0/2489068800 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee30003830 con 0x7fee240047c0 2024-01-25T15:05:21.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.702+0000 7fee43773640 1 -- 172.21.15.29:0/2489068800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee240047c0 msgr2=0x7fee24004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.702+0000 7fee43773640 1 --2- 172.21.15.29:0/2489068800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee240047c0 0x7fee24004c40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fee30001750 tx=0x7fee240057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.702+0000 7fee43773640 1 -- 172.21.15.29:0/2489068800 shutdown_connections 2024-01-25T15:05:21.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.702+0000 7fee43773640 1 --2- 172.21.15.29:0/2489068800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee240047c0 0x7fee24004c40 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.702+0000 7fee43773640 1 -- 172.21.15.29:0/2489068800 >> 172.21.15.29:0/2489068800 conn(0x7fee3c0c7f10 msgr2=0x7fee3c0c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:21.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.702+0000 7fee43773640 1 -- 172.21.15.29:0/2489068800 shutdown_connections 2024-01-25T15:05:21.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.702+0000 7fee43773640 1 -- 172.21.15.29:0/2489068800 wait complete. 2024-01-25T15:05:21.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.703+0000 7fee43773640 1 Processor -- start 2024-01-25T15:05:21.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.703+0000 7fee43773640 1 -- start start 2024-01-25T15:05:21.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.704+0000 7fee43773640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee240047c0 0x7fee3c153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:21.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.704+0000 7fee43773640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee3c0aa5e0 0x7fee3c0a9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:21.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.704+0000 7fee43773640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee3c0a9a70 0x7fee3c155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:21.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.704+0000 7fee43773640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c157590 con 0x7fee240047c0 2024-01-25T15:05:21.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.704+0000 7fee43773640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c1ea640 con 0x7fee3c0aa5e0 2024-01-25T15:05:21.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.704+0000 7fee43773640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c1eab70 con 0x7fee3c0a9a70 2024-01-25T15:05:21.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.704+0000 7fee4150f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee240047c0 0x7fee3c153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:21.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.704+0000 7fee4150f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee240047c0 0x7fee3c153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50014/0 (socket says 172.21.15.29:50014) 2024-01-25T15:05:21.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.704+0000 7fee4150f640 1 -- 172.21.15.29:0/2792517878 learned_addr learned my addr 172.21.15.29:0/2792517878 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:21.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.704+0000 7fee40d0e640 1 --2- 172.21.15.29:0/2792517878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee3c0aa5e0 0x7fee3c0a9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:21.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.704+0000 7fee41d10640 1 --2- 172.21.15.29:0/2792517878 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee3c0a9a70 0x7fee3c155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:21.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.704+0000 7fee4150f640 1 -- 172.21.15.29:0/2792517878 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee3c0a9a70 msgr2=0x7fee3c155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.704+0000 7fee4150f640 1 --2- 172.21.15.29:0/2792517878 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee3c0a9a70 0x7fee3c155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.704+0000 7fee4150f640 1 -- 172.21.15.29:0/2792517878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee3c0aa5e0 msgr2=0x7fee3c0a9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.704+0000 7fee4150f640 1 --2- 172.21.15.29:0/2792517878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee3c0aa5e0 0x7fee3c0a9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.704+0000 7fee4150f640 1 -- 172.21.15.29:0/2792517878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c0ad390 con 0x7fee240047c0 2024-01-25T15:05:21.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.704+0000 7fee41d10640 1 --2- 172.21.15.29:0/2792517878 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee3c0a9a70 0x7fee3c155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:21.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.704+0000 7fee4150f640 1 --2- 172.21.15.29:0/2792517878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee240047c0 0x7fee3c153870 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fee2c009f30 tx=0x7fee2c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:21.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.704+0000 7fee39ffb640 1 -- 172.21.15.29:0/2792517878 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2c00e040 con 0x7fee240047c0 2024-01-25T15:05:21.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.704+0000 7fee39ffb640 1 -- 172.21.15.29:0/2792517878 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2c00f040 con 0x7fee240047c0 2024-01-25T15:05:21.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.704+0000 7fee43773640 1 -- 172.21.15.29:0/2792517878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee3c0a9f20 con 0x7fee240047c0 2024-01-25T15:05:21.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.704+0000 7fee39ffb640 1 -- 172.21.15.29:0/2792517878 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2c003bb0 con 0x7fee240047c0 2024-01-25T15:05:21.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.705+0000 7fee43773640 1 -- 172.21.15.29:0/2792517878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee3c156fd0 con 0x7fee240047c0 2024-01-25T15:05:21.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.705+0000 7fee43773640 1 -- 172.21.15.29:0/2792517878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee3c04eb10 con 0x7fee240047c0 2024-01-25T15:05:21.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.706+0000 7fee39ffb640 1 -- 172.21.15.29:0/2792517878 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fee2c003d10 con 0x7fee240047c0 2024-01-25T15:05:21.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.706+0000 7fee39ffb640 1 --2- 172.21.15.29:0/2792517878 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fee2806aed0 0x7fee2806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:21.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.706+0000 7fee39ffb640 1 -- 172.21.15.29:0/2792517878 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fee2c089f10 con 0x7fee240047c0 2024-01-25T15:05:21.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.706+0000 7fee40d0e640 1 --2- 172.21.15.29:0/2792517878 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fee2806aed0 0x7fee2806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:21.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.707+0000 7fee40d0e640 1 --2- 172.21.15.29:0/2792517878 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fee2806aed0 0x7fee2806d390 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fee30033000 tx=0x7fee30009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:21.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.711+0000 7fee39ffb640 1 -- 172.21.15.29:0/2792517878 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fee2c055090 con 0x7fee240047c0 2024-01-25T15:05:21.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.957+0000 7fee43773640 1 -- 172.21.15.29:0/2792517878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fee3c156e20 con 0x7fee240047c0 2024-01-25T15:05:21.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.958+0000 7fee39ffb640 1 -- 172.21.15.29:0/2792517878 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fee2c0230a0 con 0x7fee240047c0 2024-01-25T15:05:21.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.960+0000 7fee43773640 1 -- 172.21.15.29:0/2792517878 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fee2806aed0 msgr2=0x7fee2806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.960+0000 7fee43773640 1 --2- 172.21.15.29:0/2792517878 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fee2806aed0 0x7fee2806d390 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fee30033000 tx=0x7fee30009030 comp rx=0 tx=0).stop 2024-01-25T15:05:21.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.960+0000 7fee43773640 1 -- 172.21.15.29:0/2792517878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee240047c0 msgr2=0x7fee3c153870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.960+0000 7fee43773640 1 --2- 172.21.15.29:0/2792517878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee240047c0 0x7fee3c153870 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fee2c009f30 tx=0x7fee2c00f580 comp rx=0 tx=0).stop 2024-01-25T15:05:21.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.960+0000 7fee43773640 1 -- 172.21.15.29:0/2792517878 shutdown_connections 2024-01-25T15:05:21.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.960+0000 7fee43773640 1 --2- 172.21.15.29:0/2792517878 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fee3c0a9a70 0x7fee3c155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.960+0000 7fee43773640 1 --2- 172.21.15.29:0/2792517878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee3c0aa5e0 0x7fee3c0a9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.960+0000 7fee43773640 1 --2- 172.21.15.29:0/2792517878 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fee2806aed0 0x7fee2806d390 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.960+0000 7fee43773640 1 --2- 172.21.15.29:0/2792517878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee240047c0 0x7fee3c153870 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.960+0000 7fee43773640 1 -- 172.21.15.29:0/2792517878 >> 172.21.15.29:0/2792517878 conn(0x7fee3c0c7f10 msgr2=0x7fee3c0c2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:21.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.960+0000 7fee43773640 1 -- 172.21.15.29:0/2792517878 shutdown_connections 2024-01-25T15:05:21.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:21.960+0000 7fee43773640 1 -- 172.21.15.29:0/2792517878 wait complete. 2024-01-25T15:05:21.972 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-01-25T15:05:22.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.074+0000 7f00b782f640 1 Processor -- start 2024-01-25T15:05:22.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.074+0000 7f00b782f640 1 -- start start 2024-01-25T15:05:22.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.075+0000 7f00b782f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f00b00ad0b0 0x7f00b00c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.075+0000 7f00b782f640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00b00c7890 0x7f00b0152590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.075+0000 7f00b782f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b00ad540 con 0x7f00b0149190 2024-01-25T15:05:22.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.075+0000 7f00b782f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b0070d40 con 0x7f00b00ad0b0 2024-01-25T15:05:22.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.075+0000 7f00b782f640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b0155c00 con 0x7f00b00c7890 2024-01-25T15:05:22.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.075+0000 7f00b55cb640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f00b0149190 0x7f00b0070510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47478/0 (socket says 172.21.15.29:47478) 2024-01-25T15:05:22.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.075+0000 7f00b55cb640 1 -- 172.21.15.29:0/1594804632 learned_addr learned my addr 172.21.15.29:0/1594804632 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:22.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.075+0000 7f00b5dcc640 1 --2- 172.21.15.29:0/1594804632 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00b00c7890 0x7f00b0152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.075+0000 7f00b4dca640 1 --2- 172.21.15.29:0/1594804632 >> v2:172.21.15.52:3300/0 conn(0x7f00b00ad0b0 0x7f00b00c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00a7fff640 1 -- 172.21.15.29:0/1594804632 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987852143 0 0) 0x7f00a8001110 con 0x7f00b0149190 2024-01-25T15:05:22.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00a7fff640 1 -- 172.21.15.29:0/1594804632 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f009c003520 con 0x7f00b0149190 2024-01-25T15:05:22.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00a7fff640 1 -- 172.21.15.29:0/1594804632 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3794597870 0 0) 0x7f009c003520 con 0x7f00b0149190 2024-01-25T15:05:22.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00a7fff640 1 -- 172.21.15.29:0/1594804632 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00b00c7890 msgr2=0x7f00b0152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:22.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00a7fff640 1 --2- 172.21.15.29:0/1594804632 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00b00c7890 0x7f00b0152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00a7fff640 1 -- 172.21.15.29:0/1594804632 >> v2:172.21.15.52:3300/0 conn(0x7f00b00ad0b0 msgr2=0x7f00b00c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:22.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00a7fff640 1 --2- 172.21.15.29:0/1594804632 >> v2:172.21.15.52:3300/0 conn(0x7f00b00ad0b0 0x7f00b00c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00a7fff640 1 -- 172.21.15.29:0/1594804632 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b0155ee0 con 0x7f00b0149190 2024-01-25T15:05:22.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00a7fff640 1 -- 172.21.15.29:0/1594804632 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f00a8001820 con 0x7f00b0149190 2024-01-25T15:05:22.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00b5dcc640 1 --2- 172.21.15.29:0/1594804632 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00b00c7890 0x7f00b0152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:05:22.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00a7fff640 1 -- 172.21.15.29:0/1594804632 >> v1:172.21.15.29:6789/0 conn(0x7f00b0149190 legacy=0x7f00b0070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00a7fff640 1 --2- 172.21.15.29:0/1594804632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f009c0039e0 0x7f009c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00a7fff640 1 --2- 172.21.15.29:0/1594804632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f009c0047c0 0x7f009c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00a7fff640 1 --2- 172.21.15.29:0/1594804632 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00b00c7890 0x7f009c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00a7fff640 1 -- 172.21.15.29:0/1594804632 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b0070d40 con 0x7f009c0039e0 2024-01-25T15:05:22.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00a7fff640 1 -- 172.21.15.29:0/1594804632 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b0155c00 con 0x7f009c0047c0 2024-01-25T15:05:22.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00a7fff640 1 -- 172.21.15.29:0/1594804632 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009c00b980 con 0x7f00b00c7890 2024-01-25T15:05:22.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00b4dca640 1 --2- 172.21.15.29:0/1594804632 >> v2:172.21.15.52:3300/0 conn(0x7f00b00ad0b0 0x7f00b00c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:05:22.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00b55cb640 1 --2- 172.21.15.29:0/1594804632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f009c0039e0 0x7f009c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00b5dcc640 1 --2- 172.21.15.29:0/1594804632 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00b00c7890 0x7f009c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00b4dca640 1 --2- 172.21.15.29:0/1594804632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f009c0047c0 0x7f009c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00b55cb640 1 -- 172.21.15.29:0/1594804632 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00b00c7890 msgr2=0x7f009c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:22.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00b55cb640 1 --2- 172.21.15.29:0/1594804632 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00b00c7890 0x7f009c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00b55cb640 1 -- 172.21.15.29:0/1594804632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f009c0047c0 msgr2=0x7f009c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:22.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00b55cb640 1 --2- 172.21.15.29:0/1594804632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f009c0047c0 0x7f009c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.076+0000 7f00b55cb640 1 -- 172.21.15.29:0/1594804632 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ac009a70 con 0x7f009c0039e0 2024-01-25T15:05:22.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.077+0000 7f00b55cb640 1 --2- 172.21.15.29:0/1594804632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f009c0039e0 0x7f009c003e00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f00a800c210 tx=0x7f009c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90467932c4668147 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:22.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.077+0000 7f00a7fff640 1 -- 172.21.15.29:0/1594804632 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8005ad0 con 0x7f009c0039e0 2024-01-25T15:05:22.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.077+0000 7f00a7fff640 1 -- 172.21.15.29:0/1594804632 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a8005c30 con 0x7f009c0039e0 2024-01-25T15:05:22.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.077+0000 7f00a7fff640 1 -- 172.21.15.29:0/1594804632 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a802c8a0 con 0x7f009c0039e0 2024-01-25T15:05:22.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.078+0000 7f00b782f640 1 -- 172.21.15.29:0/1594804632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f009c0039e0 msgr2=0x7f009c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.078+0000 7f00b782f640 1 --2- 172.21.15.29:0/1594804632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f009c0039e0 0x7f009c003e00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f00a800c210 tx=0x7f009c0057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.078+0000 7f00b5dcc640 1 -- 172.21.15.29:0/1594804632 reap_dead start 2024-01-25T15:05:22.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.078+0000 7f00b782f640 1 -- 172.21.15.29:0/1594804632 shutdown_connections 2024-01-25T15:05:22.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.078+0000 7f00b782f640 1 -- 172.21.15.29:0/1594804632 >> 172.21.15.29:0/1594804632 conn(0x7f00b00c7f80 msgr2=0x7f00b00c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:22.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.078+0000 7f00b782f640 1 -- 172.21.15.29:0/1594804632 shutdown_connections 2024-01-25T15:05:22.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.078+0000 7f00b782f640 1 -- 172.21.15.29:0/1594804632 wait complete. 2024-01-25T15:05:22.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.079+0000 7f00b782f640 1 Processor -- start 2024-01-25T15:05:22.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.079+0000 7f00b782f640 1 -- start start 2024-01-25T15:05:22.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.080+0000 7f00b782f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f009c0039e0 0x7f00b014e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.080+0000 7f00b782f640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00b01ec090 0x7f00b0154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.080+0000 7f00b782f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00b0145680 0x7f00b0144870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.080+0000 7f00b782f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b01558e0 con 0x7f009c0039e0 2024-01-25T15:05:22.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.080+0000 7f00b782f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b0145b30 con 0x7f00b0145680 2024-01-25T15:05:22.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.080+0000 7f00b782f640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b01453a0 con 0x7f00b01ec090 2024-01-25T15:05:22.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.080+0000 7f00b55cb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f009c0039e0 0x7f00b014e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.080+0000 7f00b55cb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f009c0039e0 0x7f00b014e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50036/0 (socket says 172.21.15.29:50036) 2024-01-25T15:05:22.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.080+0000 7f00b55cb640 1 -- 172.21.15.29:0/2243875772 learned_addr learned my addr 172.21.15.29:0/2243875772 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:22.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.080+0000 7f00b4dca640 1 --2- 172.21.15.29:0/2243875772 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00b01ec090 0x7f00b0154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.080+0000 7f00b5dcc640 1 --2- 172.21.15.29:0/2243875772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00b0145680 0x7f00b0144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.080+0000 7f00b55cb640 1 -- 172.21.15.29:0/2243875772 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00b01ec090 msgr2=0x7f00b0154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.080+0000 7f00b55cb640 1 --2- 172.21.15.29:0/2243875772 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00b01ec090 0x7f00b0154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.080+0000 7f00b55cb640 1 -- 172.21.15.29:0/2243875772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00b0145680 msgr2=0x7f00b0144870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.080+0000 7f00b55cb640 1 --2- 172.21.15.29:0/2243875772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00b0145680 0x7f00b0144870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.080+0000 7f00b55cb640 1 -- 172.21.15.29:0/2243875772 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b014a020 con 0x7f009c0039e0 2024-01-25T15:05:22.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.080+0000 7f00b4dca640 1 --2- 172.21.15.29:0/2243875772 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00b01ec090 0x7f00b0154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:22.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.080+0000 7f00b5dcc640 1 --2- 172.21.15.29:0/2243875772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00b0145680 0x7f00b0144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:22.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.080+0000 7f00b55cb640 1 --2- 172.21.15.29:0/2243875772 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f009c0039e0 0x7f00b014e090 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f00a802c510 tx=0x7f00b014cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:22.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.080+0000 7f00a5ffb640 1 -- 172.21.15.29:0/2243875772 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a802ccb0 con 0x7f009c0039e0 2024-01-25T15:05:22.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.081+0000 7f00a5ffb640 1 -- 172.21.15.29:0/2243875772 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a802ce30 con 0x7f009c0039e0 2024-01-25T15:05:22.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.081+0000 7f00b782f640 1 -- 172.21.15.29:0/2243875772 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b014b270 con 0x7f009c0039e0 2024-01-25T15:05:22.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.081+0000 7f00a5ffb640 1 -- 172.21.15.29:0/2243875772 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a80072b0 con 0x7f009c0039e0 2024-01-25T15:05:22.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.081+0000 7f00b782f640 1 -- 172.21.15.29:0/2243875772 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b014b9c0 con 0x7f009c0039e0 2024-01-25T15:05:22.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.082+0000 7f00b782f640 1 -- 172.21.15.29:0/2243875772 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b0074010 con 0x7f009c0039e0 2024-01-25T15:05:22.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.082+0000 7f00a5ffb640 1 -- 172.21.15.29:0/2243875772 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f00a8032070 con 0x7f009c0039e0 2024-01-25T15:05:22.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.082+0000 7f00a5ffb640 1 --2- 172.21.15.29:0/2243875772 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f009406af00 0x7f009406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.082+0000 7f00a5ffb640 1 -- 172.21.15.29:0/2243875772 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f00a80aa650 con 0x7f009c0039e0 2024-01-25T15:05:22.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.083+0000 7f00b4dca640 1 --2- 172.21.15.29:0/2243875772 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f009406af00 0x7f009406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.083+0000 7f00b4dca640 1 --2- 172.21.15.29:0/2243875772 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f009406af00 0x7f009406d3c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f00b00abc70 tx=0x7f00a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:22.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.087+0000 7f00a5ffb640 1 -- 172.21.15.29:0/2243875772 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f00a8075720 con 0x7f009c0039e0 2024-01-25T15:05:22.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.334+0000 7f00b782f640 1 -- 172.21.15.29:0/2243875772 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f00b00ad540 con 0x7f009c0039e0 2024-01-25T15:05:22.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.336+0000 7f00a5ffb640 1 -- 172.21.15.29:0/2243875772 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f00b00ad540 con 0x7f009c0039e0 2024-01-25T15:05:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.338+0000 7f00b782f640 1 -- 172.21.15.29:0/2243875772 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f009406af00 msgr2=0x7f009406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.338+0000 7f00b782f640 1 --2- 172.21.15.29:0/2243875772 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f009406af00 0x7f009406d3c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f00b00abc70 tx=0x7f00a0008040 comp rx=0 tx=0).stop 2024-01-25T15:05:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.338+0000 7f00b782f640 1 -- 172.21.15.29:0/2243875772 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f009c0039e0 msgr2=0x7f00b014e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.338+0000 7f00b782f640 1 --2- 172.21.15.29:0/2243875772 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f009c0039e0 0x7f00b014e090 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f00a802c510 tx=0x7f00b014cbc0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.338+0000 7f00b782f640 1 -- 172.21.15.29:0/2243875772 shutdown_connections 2024-01-25T15:05:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.338+0000 7f00b782f640 1 --2- 172.21.15.29:0/2243875772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00b0145680 0x7f00b0144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.338+0000 7f00b782f640 1 --2- 172.21.15.29:0/2243875772 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00b01ec090 0x7f00b0154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.338+0000 7f00b782f640 1 --2- 172.21.15.29:0/2243875772 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f009406af00 0x7f009406d3c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.338+0000 7f00b782f640 1 --2- 172.21.15.29:0/2243875772 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f009c0039e0 0x7f00b014e090 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.338+0000 7f00b782f640 1 -- 172.21.15.29:0/2243875772 >> 172.21.15.29:0/2243875772 conn(0x7f00b00c7f80 msgr2=0x7f00b00c36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.338+0000 7f00b782f640 1 -- 172.21.15.29:0/2243875772 shutdown_connections 2024-01-25T15:05:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.338+0000 7f00b782f640 1 -- 172.21.15.29:0/2243875772 wait complete. 2024-01-25T15:05:22.350 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-01-25T15:05:22.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.451+0000 7f0cd1f1a640 1 Processor -- start 2024-01-25T15:05:22.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.451+0000 7f0cd1f1a640 1 -- start start 2024-01-25T15:05:22.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.452+0000 7f0cd1f1a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ccc06b490 0x7f0ccc0c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.452+0000 7f0cd1f1a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0ccc158b80 0x7f0ccc0c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.452+0000 7f0cd1f1a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ccc0c8450 0x7f0ccc151c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.452+0000 7f0cd1f1a640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ccc0c88c0 con 0x7f0ccc158b80 2024-01-25T15:05:22.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.452+0000 7f0cd1f1a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ccc0c6770 con 0x7f0ccc06b490 2024-01-25T15:05:22.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.452+0000 7f0cd1f1a640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc154f10 con 0x7f0ccc0c8450 2024-01-25T15:05:22.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.452+0000 7f0ccaffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0ccc158b80 0x7f0ccc0c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.452+0000 7f0ccaffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0ccc158b80 0x7f0ccc0c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50038/0 (socket says 172.21.15.29:50038) 2024-01-25T15:05:22.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.452+0000 7f0ccaffd640 1 -- 172.21.15.29:0/4089969625 learned_addr learned my addr 172.21.15.29:0/4089969625 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:22.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.452+0000 7f0ccaffd640 1 -- 172.21.15.29:0/4089969625 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ccc0c8450 msgr2=0x7f0ccc151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:22.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.452+0000 7f0ccbfff640 1 --2- 172.21.15.29:0/4089969625 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ccc0c8450 0x7f0ccc151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.452+0000 7f0ccaffd640 1 --2- 172.21.15.29:0/4089969625 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ccc0c8450 0x7f0ccc151c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.452+0000 7f0ccaffd640 1 -- 172.21.15.29:0/4089969625 >> v2:172.21.15.52:3300/0 conn(0x7f0ccc06b490 msgr2=0x7f0ccc0c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:22.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.452+0000 7f0ccaffd640 1 --2- 172.21.15.29:0/4089969625 >> v2:172.21.15.52:3300/0 conn(0x7f0ccc06b490 0x7f0ccc0c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.452+0000 7f0ccaffd640 1 -- 172.21.15.29:0/4089969625 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc1551f0 con 0x7f0ccc158b80 2024-01-25T15:05:22.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.453+0000 7f0ccaffd640 1 --2- 172.21.15.29:0/4089969625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ccc158b80 0x7f0ccc0c7f10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0c7b60 tx=0x7f0cc002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294d1dff66a51805 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:22.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.453+0000 7f0cca7fc640 1 -- 172.21.15.29:0/4089969625 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc00317e0 con 0x7f0ccc158b80 2024-01-25T15:05:22.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.453+0000 7f0cca7fc640 1 -- 172.21.15.29:0/4089969625 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc0031940 con 0x7f0ccc158b80 2024-01-25T15:05:22.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.453+0000 7f0cca7fc640 1 -- 172.21.15.29:0/4089969625 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0031cd0 con 0x7f0ccc158b80 2024-01-25T15:05:22.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.454+0000 7f0cd1f1a640 1 -- 172.21.15.29:0/4089969625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ccc158b80 msgr2=0x7f0ccc0c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.454+0000 7f0cd1f1a640 1 --2- 172.21.15.29:0/4089969625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ccc158b80 0x7f0ccc0c7f10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0c7b60 tx=0x7f0cc002b880 comp rx=0 tx=0).stop 2024-01-25T15:05:22.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.454+0000 7f0cd1f1a640 1 -- 172.21.15.29:0/4089969625 shutdown_connections 2024-01-25T15:05:22.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.454+0000 7f0cd1f1a640 1 --2- 172.21.15.29:0/4089969625 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ccc0c8450 0x7f0ccc151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.454+0000 7f0cd1f1a640 1 --2- 172.21.15.29:0/4089969625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ccc158b80 0x7f0ccc0c7f10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.454+0000 7f0cd1f1a640 1 --2- 172.21.15.29:0/4089969625 >> v2:172.21.15.52:3300/0 conn(0x7f0ccc06b490 0x7f0ccc0c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.454+0000 7f0cd1f1a640 1 -- 172.21.15.29:0/4089969625 >> 172.21.15.29:0/4089969625 conn(0x7f0ccc0ca010 msgr2=0x7f0ccc0ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:22.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.454+0000 7f0cd1f1a640 1 -- 172.21.15.29:0/4089969625 shutdown_connections 2024-01-25T15:05:22.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.454+0000 7f0cd1f1a640 1 -- 172.21.15.29:0/4089969625 wait complete. 2024-01-25T15:05:22.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.455+0000 7f0cd1f1a640 1 Processor -- start 2024-01-25T15:05:22.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.455+0000 7f0cd1f1a640 1 -- start start 2024-01-25T15:05:22.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.456+0000 7f0cd1f1a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ccc06b490 0x7f0ccc151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.456+0000 7f0cd1f1a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ccc0c8450 0x7f0ccc0ab290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.456+0000 7f0cd1f1a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ccc158b80 0x7f0ccc0a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.456+0000 7f0cd1f1a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc1eae60 con 0x7f0ccc06b490 2024-01-25T15:05:22.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.456+0000 7f0cd1f1a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc1516c0 con 0x7f0ccc0c8450 2024-01-25T15:05:22.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.456+0000 7f0cd1f1a640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc1ea4c0 con 0x7f0ccc158b80 2024-01-25T15:05:22.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.456+0000 7f0ccb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ccc06b490 0x7f0ccc151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.456+0000 7f0ccb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ccc06b490 0x7f0ccc151050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50052/0 (socket says 172.21.15.29:50052) 2024-01-25T15:05:22.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.456+0000 7f0ccb7fe640 1 -- 172.21.15.29:0/2001335344 learned_addr learned my addr 172.21.15.29:0/2001335344 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:22.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.456+0000 7f0ccaffd640 1 --2- 172.21.15.29:0/2001335344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ccc0c8450 0x7f0ccc0ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.456+0000 7f0ccbfff640 1 --2- 172.21.15.29:0/2001335344 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ccc158b80 0x7f0ccc0a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.456+0000 7f0ccb7fe640 1 -- 172.21.15.29:0/2001335344 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ccc158b80 msgr2=0x7f0ccc0a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.456+0000 7f0ccb7fe640 1 --2- 172.21.15.29:0/2001335344 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ccc158b80 0x7f0ccc0a99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.456+0000 7f0ccb7fe640 1 -- 172.21.15.29:0/2001335344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ccc0c8450 msgr2=0x7f0ccc0ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.456+0000 7f0ccb7fe640 1 --2- 172.21.15.29:0/2001335344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ccc0c8450 0x7f0ccc0ab290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.456+0000 7f0ccb7fe640 1 -- 172.21.15.29:0/2001335344 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc00094d0 con 0x7f0ccc06b490 2024-01-25T15:05:22.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.456+0000 7f0ccbfff640 1 --2- 172.21.15.29:0/2001335344 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ccc158b80 0x7f0ccc0a99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:22.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.456+0000 7f0ccb7fe640 1 --2- 172.21.15.29:0/2001335344 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ccc06b490 0x7f0ccc151050 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00b4a0 tx=0x7f0cbc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:22.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.457+0000 7f0cb3fff640 1 -- 172.21.15.29:0/2001335344 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc010610 con 0x7f0ccc06b490 2024-01-25T15:05:22.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.457+0000 7f0cb3fff640 1 -- 172.21.15.29:0/2001335344 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc010770 con 0x7f0ccc06b490 2024-01-25T15:05:22.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.457+0000 7f0cd1f1a640 1 -- 172.21.15.29:0/2001335344 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ccc1ea7a0 con 0x7f0ccc06b490 2024-01-25T15:05:22.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.457+0000 7f0cb3fff640 1 -- 172.21.15.29:0/2001335344 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc010b20 con 0x7f0ccc06b490 2024-01-25T15:05:22.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.457+0000 7f0cd1f1a640 1 -- 172.21.15.29:0/2001335344 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ccc0ab7d0 con 0x7f0ccc06b490 2024-01-25T15:05:22.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.458+0000 7f0cd1f1a640 1 -- 172.21.15.29:0/2001335344 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ccc067be0 con 0x7f0ccc06b490 2024-01-25T15:05:22.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.458+0000 7f0cb3fff640 1 -- 172.21.15.29:0/2001335344 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0cbc010c80 con 0x7f0ccc06b490 2024-01-25T15:05:22.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.458+0000 7f0cb3fff640 1 --2- 172.21.15.29:0/2001335344 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0cb806aed0 0x7f0cb806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.459+0000 7f0cb3fff640 1 -- 172.21.15.29:0/2001335344 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0cbc088fe0 con 0x7f0ccc06b490 2024-01-25T15:05:22.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.459+0000 7f0ccaffd640 1 --2- 172.21.15.29:0/2001335344 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0cb806aed0 0x7f0cb806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.459+0000 7f0ccaffd640 1 --2- 172.21.15.29:0/2001335344 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0cb806aed0 0x7f0cb806d390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0036000 tx=0x7f0cc003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:22.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.463+0000 7f0cb3fff640 1 -- 172.21.15.29:0/2001335344 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f0cbc054150 con 0x7f0ccc06b490 2024-01-25T15:05:22.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.713+0000 7f0cd1f1a640 1 -- 172.21.15.29:0/2001335344 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f0ccc0a97d0 con 0x7f0ccc06b490 2024-01-25T15:05:22.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.715+0000 7f0cb3fff640 1 -- 172.21.15.29:0/2001335344 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0cbc057770 con 0x7f0ccc06b490 2024-01-25T15:05:22.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.717+0000 7f0cd1f1a640 1 -- 172.21.15.29:0/2001335344 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0cb806aed0 msgr2=0x7f0cb806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.717+0000 7f0cd1f1a640 1 --2- 172.21.15.29:0/2001335344 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0cb806aed0 0x7f0cb806d390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0036000 tx=0x7f0cc003d040 comp rx=0 tx=0).stop 2024-01-25T15:05:22.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.717+0000 7f0cd1f1a640 1 -- 172.21.15.29:0/2001335344 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ccc06b490 msgr2=0x7f0ccc151050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.717+0000 7f0cd1f1a640 1 --2- 172.21.15.29:0/2001335344 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ccc06b490 0x7f0ccc151050 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00b4a0 tx=0x7f0cbc00b960 comp rx=0 tx=0).stop 2024-01-25T15:05:22.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.717+0000 7f0cd1f1a640 1 -- 172.21.15.29:0/2001335344 shutdown_connections 2024-01-25T15:05:22.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.717+0000 7f0cd1f1a640 1 --2- 172.21.15.29:0/2001335344 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ccc158b80 0x7f0ccc0a99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.717+0000 7f0cd1f1a640 1 --2- 172.21.15.29:0/2001335344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ccc0c8450 0x7f0ccc0ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.717+0000 7f0cd1f1a640 1 --2- 172.21.15.29:0/2001335344 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0cb806aed0 0x7f0cb806d390 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.717+0000 7f0cd1f1a640 1 --2- 172.21.15.29:0/2001335344 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ccc06b490 0x7f0ccc151050 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.717+0000 7f0cd1f1a640 1 -- 172.21.15.29:0/2001335344 >> 172.21.15.29:0/2001335344 conn(0x7f0ccc0ca010 msgr2=0x7f0ccc152150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:22.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.717+0000 7f0cd1f1a640 1 -- 172.21.15.29:0/2001335344 shutdown_connections 2024-01-25T15:05:22.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.717+0000 7f0cd1f1a640 1 -- 172.21.15.29:0/2001335344 wait complete. 2024-01-25T15:05:22.728 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-01-25T15:05:22.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.830+0000 7ff21fd43640 1 Processor -- start 2024-01-25T15:05:22.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.830+0000 7ff21fd43640 1 -- start start 2024-01-25T15:05:22.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.830+0000 7ff21fd43640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff21806b490 0x7ff2180c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.831+0000 7ff21fd43640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff218158b80 0x7ff2180c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.831+0000 7ff21fd43640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2180c8880 con 0x7ff2180c8450 2024-01-25T15:05:22.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.831+0000 7ff21fd43640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2180c6770 con 0x7ff218158b80 2024-01-25T15:05:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.831+0000 7ff21fd43640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff218154f10 con 0x7ff21806b490 2024-01-25T15:05:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.831+0000 7ff21d2de640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff218158b80 0x7ff2180c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.831+0000 7ff21d2de640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff218158b80 0x7ff2180c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50056/0 (socket says 172.21.15.29:50056) 2024-01-25T15:05:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.831+0000 7ff21d2de640 1 -- 172.21.15.29:0/4033934025 learned_addr learned my addr 172.21.15.29:0/4033934025 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.831+0000 7ff21dadf640 1 --2- 172.21.15.29:0/4033934025 >> v2:172.21.15.52:3300/0 conn(0x7ff21806b490 0x7ff2180c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.831+0000 7ff21d2de640 1 -- 172.21.15.29:0/4033934025 >> v2:172.21.15.52:3300/0 conn(0x7ff21806b490 msgr2=0x7ff2180c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.831+0000 7ff21d2de640 1 --2- 172.21.15.29:0/4033934025 >> v2:172.21.15.52:3300/0 conn(0x7ff21806b490 0x7ff2180c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.831+0000 7ff21d2de640 1 -- 172.21.15.29:0/4033934025 >> v1:172.21.15.52:6789/0 conn(0x7ff2180c8450 legacy=0x7ff218151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.831+0000 7ff21d2de640 1 -- 172.21.15.29:0/4033934025 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2181551f0 con 0x7ff218158b80 2024-01-25T15:05:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.832+0000 7ff21d2de640 1 --2- 172.21.15.29:0/4033934025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff218158b80 0x7ff2180c7f10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff2180c7b60 tx=0x7ff20802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5df3777cbec3f07 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.832+0000 7ff21cadd640 1 -- 172.21.15.29:0/4033934025 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2080317e0 con 0x7ff218158b80 2024-01-25T15:05:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.832+0000 7ff21cadd640 1 -- 172.21.15.29:0/4033934025 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff208031940 con 0x7ff218158b80 2024-01-25T15:05:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.832+0000 7ff21cadd640 1 -- 172.21.15.29:0/4033934025 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208031cd0 con 0x7ff218158b80 2024-01-25T15:05:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.832+0000 7ff21fd43640 1 -- 172.21.15.29:0/4033934025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff218158b80 msgr2=0x7ff2180c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.832+0000 7ff21fd43640 1 --2- 172.21.15.29:0/4033934025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff218158b80 0x7ff2180c7f10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff2180c7b60 tx=0x7ff20802b880 comp rx=0 tx=0).stop 2024-01-25T15:05:22.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.832+0000 7ff21fd43640 1 -- 172.21.15.29:0/4033934025 shutdown_connections 2024-01-25T15:05:22.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.832+0000 7ff21fd43640 1 --2- 172.21.15.29:0/4033934025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff218158b80 0x7ff2180c7f10 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.832+0000 7ff21fd43640 1 --2- 172.21.15.29:0/4033934025 >> v2:172.21.15.52:3300/0 conn(0x7ff21806b490 0x7ff2180c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.832+0000 7ff21fd43640 1 -- 172.21.15.29:0/4033934025 >> 172.21.15.29:0/4033934025 conn(0x7ff2180ca010 msgr2=0x7ff2180ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:22.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.833+0000 7ff21fd43640 1 -- 172.21.15.29:0/4033934025 shutdown_connections 2024-01-25T15:05:22.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.833+0000 7ff21fd43640 1 -- 172.21.15.29:0/4033934025 wait complete. 2024-01-25T15:05:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.834+0000 7ff21fd43640 1 Processor -- start 2024-01-25T15:05:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.834+0000 7ff21fd43640 1 -- start start 2024-01-25T15:05:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.834+0000 7ff21fd43640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff21806b490 0x7ff21814c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.834+0000 7ff21fd43640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2180c8450 0x7ff2181ead70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.834+0000 7ff21fd43640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff218158b80 0x7ff2181498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.834+0000 7ff21fd43640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2181ea8e0 con 0x7ff2180c8450 2024-01-25T15:05:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.834+0000 7ff21fd43640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21814d030 con 0x7ff21806b490 2024-01-25T15:05:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.834+0000 7ff21fd43640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21814d310 con 0x7ff218158b80 2024-01-25T15:05:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.834+0000 7ff21d2de640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2180c8450 0x7ff2181ead70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.834+0000 7ff21d2de640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2180c8450 0x7ff2181ead70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50058/0 (socket says 172.21.15.29:50058) 2024-01-25T15:05:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.834+0000 7ff21d2de640 1 -- 172.21.15.29:0/1302166131 learned_addr learned my addr 172.21.15.29:0/1302166131 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.835+0000 7ff21dadf640 1 --2- 172.21.15.29:0/1302166131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff21806b490 0x7ff21814c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.835+0000 7ff21e2e0640 1 --2- 172.21.15.29:0/1302166131 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff218158b80 0x7ff2181498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.835+0000 7ff21d2de640 1 -- 172.21.15.29:0/1302166131 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff218158b80 msgr2=0x7ff2181498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.835+0000 7ff21d2de640 1 --2- 172.21.15.29:0/1302166131 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff218158b80 0x7ff2181498f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.835+0000 7ff21d2de640 1 -- 172.21.15.29:0/1302166131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff21806b490 msgr2=0x7ff21814c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.835+0000 7ff21d2de640 1 --2- 172.21.15.29:0/1302166131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff21806b490 0x7ff21814c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.835+0000 7ff21d2de640 1 -- 172.21.15.29:0/1302166131 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2080094d0 con 0x7ff2180c8450 2024-01-25T15:05:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.835+0000 7ff21dadf640 1 --2- 172.21.15.29:0/1302166131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff21806b490 0x7ff21814c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.835+0000 7ff21d2de640 1 --2- 172.21.15.29:0/1302166131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2180c8450 0x7ff2181ead70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff20802b8c0 tx=0x7ff2080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.835+0000 7ff20e7fc640 1 -- 172.21.15.29:0/1302166131 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208032880 con 0x7ff2180c8450 2024-01-25T15:05:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.835+0000 7ff20e7fc640 1 -- 172.21.15.29:0/1302166131 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff208032a00 con 0x7ff2180c8450 2024-01-25T15:05:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.835+0000 7ff21fd43640 1 -- 172.21.15.29:0/1302166131 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2181ea570 con 0x7ff2180c8450 2024-01-25T15:05:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.835+0000 7ff20e7fc640 1 -- 172.21.15.29:0/1302166131 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208032db0 con 0x7ff2180c8450 2024-01-25T15:05:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.835+0000 7ff21fd43640 1 -- 172.21.15.29:0/1302166131 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff218149e30 con 0x7ff2180c8450 2024-01-25T15:05:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.836+0000 7ff21fd43640 1 -- 172.21.15.29:0/1302166131 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff21814d520 con 0x7ff2180c8450 2024-01-25T15:05:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.837+0000 7ff20e7fc640 1 -- 172.21.15.29:0/1302166131 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ff20804d3f0 con 0x7ff2180c8450 2024-01-25T15:05:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.837+0000 7ff20e7fc640 1 --2- 172.21.15.29:0/1302166131 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff1fc06aed0 0x7ff1fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.837+0000 7ff20e7fc640 1 -- 172.21.15.29:0/1302166131 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff2080ab1a0 con 0x7ff2180c8450 2024-01-25T15:05:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.837+0000 7ff21dadf640 1 --2- 172.21.15.29:0/1302166131 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff1fc06aed0 0x7ff1fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.838+0000 7ff21dadf640 1 --2- 172.21.15.29:0/1302166131 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff1fc06aed0 0x7ff1fc06d390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff214006fd0 tx=0x7ff214008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:22.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:22.842+0000 7ff20e7fc640 1 -- 172.21.15.29:0/1302166131 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7ff208076340 con 0x7ff2180c8450 2024-01-25T15:05:23.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.088+0000 7ff21fd43640 1 -- 172.21.15.29:0/1302166131 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7ff218067be0 con 0x7ff2180c8450 2024-01-25T15:05:23.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.090+0000 7ff20e7fc640 1 -- 172.21.15.29:0/1302166131 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff208079960 con 0x7ff2180c8450 2024-01-25T15:05:23.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.092+0000 7ff21fd43640 1 -- 172.21.15.29:0/1302166131 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff1fc06aed0 msgr2=0x7ff1fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.092+0000 7ff21fd43640 1 --2- 172.21.15.29:0/1302166131 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff1fc06aed0 0x7ff1fc06d390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff214006fd0 tx=0x7ff214008040 comp rx=0 tx=0).stop 2024-01-25T15:05:23.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.092+0000 7ff21fd43640 1 -- 172.21.15.29:0/1302166131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2180c8450 msgr2=0x7ff2181ead70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.092+0000 7ff21fd43640 1 --2- 172.21.15.29:0/1302166131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2180c8450 0x7ff2181ead70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff20802b8c0 tx=0x7ff2080046c0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.092+0000 7ff21fd43640 1 -- 172.21.15.29:0/1302166131 shutdown_connections 2024-01-25T15:05:23.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.092+0000 7ff21fd43640 1 --2- 172.21.15.29:0/1302166131 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff218158b80 0x7ff2181498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.092+0000 7ff21fd43640 1 --2- 172.21.15.29:0/1302166131 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff1fc06aed0 0x7ff1fc06d390 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.092+0000 7ff21fd43640 1 --2- 172.21.15.29:0/1302166131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2180c8450 0x7ff2181ead70 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.092+0000 7ff21fd43640 1 --2- 172.21.15.29:0/1302166131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff21806b490 0x7ff21814c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.092+0000 7ff21fd43640 1 -- 172.21.15.29:0/1302166131 >> 172.21.15.29:0/1302166131 conn(0x7ff2180ca010 msgr2=0x7ff2180c5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:23.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.092+0000 7ff21fd43640 1 -- 172.21.15.29:0/1302166131 shutdown_connections 2024-01-25T15:05:23.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.092+0000 7ff21fd43640 1 -- 172.21.15.29:0/1302166131 wait complete. 2024-01-25T15:05:23.103 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-01-25T15:05:23.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.205+0000 7f6f926b2640 1 Processor -- start 2024-01-25T15:05:23.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.205+0000 7f6f926b2640 1 -- start start 2024-01-25T15:05:23.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.206+0000 7f6f926b2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6f8c06b6d0 0x7f6f8c06bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.206+0000 7f6f926b2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f8c0ab3b0 0x7f6f8c15cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.206+0000 7f6f926b2640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8c156470 con 0x7f6f8c0a7f40 2024-01-25T15:05:23.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.206+0000 7f6f926b2640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8c155b80 con 0x7f6f8c06b6d0 2024-01-25T15:05:23.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.206+0000 7f6f926b2640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8c153410 con 0x7f6f8c0ab3b0 2024-01-25T15:05:23.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.206+0000 7f6f8bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6f8c06b6d0 0x7f6f8c06bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.206+0000 7f6f8bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6f8c06b6d0 0x7f6f8c06bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50062/0 (socket says 172.21.15.29:50062) 2024-01-25T15:05:23.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.206+0000 7f6f8bfff640 1 -- 172.21.15.29:0/3081766 learned_addr learned my addr 172.21.15.29:0/3081766 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:23.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.206+0000 7f6f90c4f640 1 --2- 172.21.15.29:0/3081766 >> v2:172.21.15.52:3300/0 conn(0x7f6f8c0ab3b0 0x7f6f8c15cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.206+0000 7f6f8bfff640 1 -- 172.21.15.29:0/3081766 >> v2:172.21.15.52:3300/0 conn(0x7f6f8c0ab3b0 msgr2=0x7f6f8c15cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:23.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.206+0000 7f6f8bfff640 1 --2- 172.21.15.29:0/3081766 >> v2:172.21.15.52:3300/0 conn(0x7f6f8c0ab3b0 0x7f6f8c15cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.206+0000 7f6f8bfff640 1 -- 172.21.15.29:0/3081766 >> v1:172.21.15.52:6789/0 conn(0x7f6f8c0a7f40 legacy=0x7f6f8c0aaca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:23.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.207+0000 7f6f8bfff640 1 -- 172.21.15.29:0/3081766 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c155e20 con 0x7f6f8c06b6d0 2024-01-25T15:05:23.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.207+0000 7f6f8bfff640 1 --2- 172.21.15.29:0/3081766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f8c06b6d0 0x7f6f8c06bab0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c0a9cd0 tx=0x7f6f7c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90836431026b2f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:23.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.207+0000 7f6f8affd640 1 -- 172.21.15.29:0/3081766 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c031870 con 0x7f6f8c06b6d0 2024-01-25T15:05:23.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.207+0000 7f6f8affd640 1 -- 172.21.15.29:0/3081766 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c0319d0 con 0x7f6f8c06b6d0 2024-01-25T15:05:23.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.207+0000 7f6f8affd640 1 -- 172.21.15.29:0/3081766 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c031d60 con 0x7f6f8c06b6d0 2024-01-25T15:05:23.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.208+0000 7f6f926b2640 1 -- 172.21.15.29:0/3081766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f8c06b6d0 msgr2=0x7f6f8c06bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.208+0000 7f6f926b2640 1 --2- 172.21.15.29:0/3081766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f8c06b6d0 0x7f6f8c06bab0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c0a9cd0 tx=0x7f6f7c02b910 comp rx=0 tx=0).stop 2024-01-25T15:05:23.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.208+0000 7f6f926b2640 1 -- 172.21.15.29:0/3081766 shutdown_connections 2024-01-25T15:05:23.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.208+0000 7f6f926b2640 1 --2- 172.21.15.29:0/3081766 >> v2:172.21.15.52:3300/0 conn(0x7f6f8c0ab3b0 0x7f6f8c15cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.208+0000 7f6f926b2640 1 --2- 172.21.15.29:0/3081766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f8c06b6d0 0x7f6f8c06bab0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.208+0000 7f6f926b2640 1 -- 172.21.15.29:0/3081766 >> 172.21.15.29:0/3081766 conn(0x7f6f8c0c3160 msgr2=0x7f6f8c0c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:23.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.208+0000 7f6f926b2640 1 -- 172.21.15.29:0/3081766 shutdown_connections 2024-01-25T15:05:23.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.208+0000 7f6f926b2640 1 -- 172.21.15.29:0/3081766 wait complete. 2024-01-25T15:05:23.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.209+0000 7f6f926b2640 1 Processor -- start 2024-01-25T15:05:23.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.209+0000 7f6f926b2640 1 -- start start 2024-01-25T15:05:23.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.210+0000 7f6f926b2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f8c06b6d0 0x7f6f8c14d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.210+0000 7f6f926b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f8c0a7f40 0x7f6f8c0c4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.210+0000 7f6f926b2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f8c0ab3b0 0x7f6f8c0c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.210+0000 7f6f926b2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c0c5d20 con 0x7f6f8c06b6d0 2024-01-25T15:05:23.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.210+0000 7f6f926b2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c14e5a0 con 0x7f6f8c0a7f40 2024-01-25T15:05:23.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.210+0000 7f6f926b2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c14be30 con 0x7f6f8c0ab3b0 2024-01-25T15:05:23.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.210+0000 7f6f8bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f8c06b6d0 0x7f6f8c14d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.210+0000 7f6f8bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f8c06b6d0 0x7f6f8c14d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50068/0 (socket says 172.21.15.29:50068) 2024-01-25T15:05:23.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.210+0000 7f6f8bfff640 1 -- 172.21.15.29:0/601615528 learned_addr learned my addr 172.21.15.29:0/601615528 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:23.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.210+0000 7f6f8bfff640 1 -- 172.21.15.29:0/601615528 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f8c0ab3b0 msgr2=0x7f6f8c0c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.210+0000 7f6f8bfff640 1 --2- 172.21.15.29:0/601615528 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f8c0ab3b0 0x7f6f8c0c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.210+0000 7f6f8bfff640 1 -- 172.21.15.29:0/601615528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f8c0a7f40 msgr2=0x7f6f8c0c4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.210+0000 7f6f8bfff640 1 --2- 172.21.15.29:0/601615528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f8c0a7f40 0x7f6f8c0c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.210+0000 7f6f8bfff640 1 -- 172.21.15.29:0/601615528 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c0094d0 con 0x7f6f8c06b6d0 2024-01-25T15:05:23.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.210+0000 7f6f8bfff640 1 --2- 172.21.15.29:0/601615528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f8c06b6d0 0x7f6f8c14d8d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c02b950 tx=0x7f6f7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:23.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.211+0000 7f6f88ff9640 1 -- 172.21.15.29:0/601615528 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c03ad30 con 0x7f6f8c06b6d0 2024-01-25T15:05:23.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.211+0000 7f6f88ff9640 1 -- 172.21.15.29:0/601615528 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c03ae90 con 0x7f6f8c06b6d0 2024-01-25T15:05:23.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.211+0000 7f6f926b2640 1 -- 172.21.15.29:0/601615528 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8c070a80 con 0x7f6f8c06b6d0 2024-01-25T15:05:23.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.211+0000 7f6f88ff9640 1 -- 172.21.15.29:0/601615528 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c044630 con 0x7f6f8c06b6d0 2024-01-25T15:05:23.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.211+0000 7f6f926b2640 1 -- 172.21.15.29:0/601615528 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8c14e2c0 con 0x7f6f8c06b6d0 2024-01-25T15:05:23.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.212+0000 7f6f926b2640 1 -- 172.21.15.29:0/601615528 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8c074010 con 0x7f6f8c06b6d0 2024-01-25T15:05:23.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.212+0000 7f6f88ff9640 1 -- 172.21.15.29:0/601615528 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6f7c044790 con 0x7f6f8c06b6d0 2024-01-25T15:05:23.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.213+0000 7f6f88ff9640 1 --2- 172.21.15.29:0/601615528 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6f6c06aed0 0x7f6f6c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.213+0000 7f6f88ff9640 1 -- 172.21.15.29:0/601615528 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6f7c02d040 con 0x7f6f8c06b6d0 2024-01-25T15:05:23.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.213+0000 7f6f8b7fe640 1 --2- 172.21.15.29:0/601615528 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6f6c06aed0 0x7f6f6c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.213+0000 7f6f8b7fe640 1 --2- 172.21.15.29:0/601615528 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6f6c06aed0 0x7f6f6c06d390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c0c5f10 tx=0x7f6f740079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:23.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.217+0000 7f6f88ff9640 1 -- 172.21.15.29:0/601615528 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6f7c076b70 con 0x7f6f8c06b6d0 2024-01-25T15:05:23.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.463+0000 7f6f926b2640 1 -- 172.21.15.29:0/601615528 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f6f8c152370 con 0x7f6f8c06b6d0 2024-01-25T15:05:23.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.465+0000 7f6f88ff9640 1 -- 172.21.15.29:0/601615528 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6f7c07a190 con 0x7f6f8c06b6d0 2024-01-25T15:05:23.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.467+0000 7f6f926b2640 1 -- 172.21.15.29:0/601615528 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6f6c06aed0 msgr2=0x7f6f6c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.467+0000 7f6f926b2640 1 --2- 172.21.15.29:0/601615528 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6f6c06aed0 0x7f6f6c06d390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c0c5f10 tx=0x7f6f740079b0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.467+0000 7f6f926b2640 1 -- 172.21.15.29:0/601615528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f8c06b6d0 msgr2=0x7f6f8c14d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.467+0000 7f6f926b2640 1 --2- 172.21.15.29:0/601615528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f8c06b6d0 0x7f6f8c14d8d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c02b950 tx=0x7f6f7c0046c0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.467+0000 7f6f926b2640 1 -- 172.21.15.29:0/601615528 shutdown_connections 2024-01-25T15:05:23.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.467+0000 7f6f926b2640 1 --2- 172.21.15.29:0/601615528 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6f8c0ab3b0 0x7f6f8c0c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.467+0000 7f6f926b2640 1 --2- 172.21.15.29:0/601615528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f8c0a7f40 0x7f6f8c0c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.467+0000 7f6f926b2640 1 --2- 172.21.15.29:0/601615528 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6f6c06aed0 0x7f6f6c06d390 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.467+0000 7f6f926b2640 1 --2- 172.21.15.29:0/601615528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f8c06b6d0 0x7f6f8c14d8d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.467+0000 7f6f926b2640 1 -- 172.21.15.29:0/601615528 >> 172.21.15.29:0/601615528 conn(0x7f6f8c0c3160 msgr2=0x7f6f8c0c2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:23.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.468+0000 7f6f926b2640 1 -- 172.21.15.29:0/601615528 shutdown_connections 2024-01-25T15:05:23.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.468+0000 7f6f926b2640 1 -- 172.21.15.29:0/601615528 wait complete. 2024-01-25T15:05:23.479 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-01-25T15:05:23.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.581+0000 7f87116ec640 1 Processor -- start 2024-01-25T15:05:23.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.581+0000 7f87116ec640 1 -- start start 2024-01-25T15:05:23.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.582+0000 7f87116ec640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f870c0c49a0 0x7f870c0c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.582+0000 7f87116ec640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f870c1526a0 0x7f870c152b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.582+0000 7f87116ec640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f870c0ad2e0 con 0x7f870c149190 2024-01-25T15:05:23.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.582+0000 7f87116ec640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f870c0c79f0 con 0x7f870c0c49a0 2024-01-25T15:05:23.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.582+0000 7f87116ec640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c0ac6f0 con 0x7f870c1526a0 2024-01-25T15:05:23.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.582+0000 7f870a7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f870c0c49a0 0x7f870c0c4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.582+0000 7f870a7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f870c0c49a0 0x7f870c0c4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50072/0 (socket says 172.21.15.29:50072) 2024-01-25T15:05:23.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.582+0000 7f870a7fc640 1 -- 172.21.15.29:0/3212494968 learned_addr learned my addr 172.21.15.29:0/3212494968 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:23.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.582+0000 7f870b7fe640 1 --2- 172.21.15.29:0/3212494968 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f870c1526a0 0x7f870c152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.582+0000 7f870a7fc640 1 -- 172.21.15.29:0/3212494968 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f870c1526a0 msgr2=0x7f870c152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:23.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.582+0000 7f870a7fc640 1 --2- 172.21.15.29:0/3212494968 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f870c1526a0 0x7f870c152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.582+0000 7f870a7fc640 1 -- 172.21.15.29:0/3212494968 >> v1:172.21.15.52:6789/0 conn(0x7f870c149190 legacy=0x7f870c0c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:23.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.582+0000 7f870a7fc640 1 -- 172.21.15.29:0/3212494968 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c0ac9b0 con 0x7f870c0c49a0 2024-01-25T15:05:23.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.583+0000 7f870a7fc640 1 --2- 172.21.15.29:0/3212494968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f870c0c49a0 0x7f870c0c4e30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f86f40098a0 tx=0x7f86f402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f210ba608a59ba server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:23.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.583+0000 7f8709ffb640 1 -- 172.21.15.29:0/3212494968 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f4030840 con 0x7f870c0c49a0 2024-01-25T15:05:23.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.583+0000 7f8709ffb640 1 -- 172.21.15.29:0/3212494968 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f40309a0 con 0x7f870c0c49a0 2024-01-25T15:05:23.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.583+0000 7f8709ffb640 1 -- 172.21.15.29:0/3212494968 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f4030d30 con 0x7f870c0c49a0 2024-01-25T15:05:23.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.584+0000 7f87116ec640 1 -- 172.21.15.29:0/3212494968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f870c0c49a0 msgr2=0x7f870c0c4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.584+0000 7f87116ec640 1 --2- 172.21.15.29:0/3212494968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f870c0c49a0 0x7f870c0c4e30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f86f40098a0 tx=0x7f86f402b980 comp rx=0 tx=0).stop 2024-01-25T15:05:23.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.584+0000 7f87116ec640 1 -- 172.21.15.29:0/3212494968 shutdown_connections 2024-01-25T15:05:23.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.584+0000 7f87116ec640 1 --2- 172.21.15.29:0/3212494968 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f870c1526a0 0x7f870c152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.584+0000 7f87116ec640 1 --2- 172.21.15.29:0/3212494968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f870c0c49a0 0x7f870c0c4e30 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.584+0000 7f87116ec640 1 -- 172.21.15.29:0/3212494968 >> 172.21.15.29:0/3212494968 conn(0x7f870c0c7f10 msgr2=0x7f870c0c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:23.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.584+0000 7f87116ec640 1 -- 172.21.15.29:0/3212494968 shutdown_connections 2024-01-25T15:05:23.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.584+0000 7f87116ec640 1 -- 172.21.15.29:0/3212494968 wait complete. 2024-01-25T15:05:23.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.585+0000 7f87116ec640 1 Processor -- start 2024-01-25T15:05:23.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.585+0000 7f87116ec640 1 -- start start 2024-01-25T15:05:23.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f87116ec640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f870c0c49a0 0x7f870c0aa640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f87116ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f870c149190 0x7f870c155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f87116ec640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f870c1526a0 0x7f870c151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f87116ec640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c14f050 con 0x7f870c1526a0 2024-01-25T15:05:23.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f87116ec640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c1e9350 con 0x7f870c149190 2024-01-25T15:05:23.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f87116ec640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c14e370 con 0x7f870c0c49a0 2024-01-25T15:05:23.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f870b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f870c1526a0 0x7f870c151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f870b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f870c1526a0 0x7f870c151460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50082/0 (socket says 172.21.15.29:50082) 2024-01-25T15:05:23.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f870b7fe640 1 -- 172.21.15.29:0/120958525 learned_addr learned my addr 172.21.15.29:0/120958525 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:23.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f870a7fc640 1 --2- 172.21.15.29:0/120958525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f870c149190 0x7f870c155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f870affd640 1 --2- 172.21.15.29:0/120958525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f870c0c49a0 0x7f870c0aa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f870b7fe640 1 -- 172.21.15.29:0/120958525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f870c0c49a0 msgr2=0x7f870c0aa640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f870b7fe640 1 --2- 172.21.15.29:0/120958525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f870c0c49a0 0x7f870c0aa640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f870b7fe640 1 -- 172.21.15.29:0/120958525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f870c149190 msgr2=0x7f870c155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f870b7fe640 1 --2- 172.21.15.29:0/120958525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f870c149190 0x7f870c155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f870b7fe640 1 -- 172.21.15.29:0/120958525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f40094d0 con 0x7f870c1526a0 2024-01-25T15:05:23.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f870affd640 1 --2- 172.21.15.29:0/120958525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f870c0c49a0 0x7f870c0aa640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:23.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f870b7fe640 1 --2- 172.21.15.29:0/120958525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f870c1526a0 0x7f870c151460 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f86fc007e60 tx=0x7f86fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:23.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f87037fe640 1 -- 172.21.15.29:0/120958525 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc014420 con 0x7f870c1526a0 2024-01-25T15:05:23.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f87037fe640 1 -- 172.21.15.29:0/120958525 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86fc0145a0 con 0x7f870c1526a0 2024-01-25T15:05:23.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f87116ec640 1 -- 172.21.15.29:0/120958525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870c1e8db0 con 0x7f870c1526a0 2024-01-25T15:05:23.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f87037fe640 1 -- 172.21.15.29:0/120958525 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc014950 con 0x7f870c1526a0 2024-01-25T15:05:23.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.586+0000 7f87116ec640 1 -- 172.21.15.29:0/120958525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870c0c2470 con 0x7f870c1526a0 2024-01-25T15:05:23.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.587+0000 7f87116ec640 1 -- 172.21.15.29:0/120958525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f870c04eb10 con 0x7f870c1526a0 2024-01-25T15:05:23.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.588+0000 7f87037fe640 1 -- 172.21.15.29:0/120958525 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f86fc014ab0 con 0x7f870c1526a0 2024-01-25T15:05:23.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.588+0000 7f87037fe640 1 --2- 172.21.15.29:0/120958525 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f86ec06af00 0x7f86ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.588+0000 7f87037fe640 1 -- 172.21.15.29:0/120958525 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f86fc089c60 con 0x7f870c1526a0 2024-01-25T15:05:23.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.589+0000 7f870affd640 1 --2- 172.21.15.29:0/120958525 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f86ec06af00 0x7f86ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.589+0000 7f870affd640 1 --2- 172.21.15.29:0/120958525 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f86ec06af00 0x7f86ec06d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8704001700 tx=0x7f8704009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:23.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.593+0000 7f87037fe640 1 -- 172.21.15.29:0/120958525 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f86fc054dd0 con 0x7f870c1526a0 2024-01-25T15:05:23.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.842+0000 7f87116ec640 1 -- 172.21.15.29:0/120958525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f870c067be0 con 0x7f870c1526a0 2024-01-25T15:05:23.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.844+0000 7f87037fe640 1 -- 172.21.15.29:0/120958525 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f86fc0583f0 con 0x7f870c1526a0 2024-01-25T15:05:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.846+0000 7f87116ec640 1 -- 172.21.15.29:0/120958525 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f86ec06af00 msgr2=0x7f86ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.846+0000 7f87116ec640 1 --2- 172.21.15.29:0/120958525 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f86ec06af00 0x7f86ec06d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8704001700 tx=0x7f8704009040 comp rx=0 tx=0).stop 2024-01-25T15:05:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.846+0000 7f87116ec640 1 -- 172.21.15.29:0/120958525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f870c1526a0 msgr2=0x7f870c151460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.846+0000 7f87116ec640 1 --2- 172.21.15.29:0/120958525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f870c1526a0 0x7f870c151460 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f86fc007e60 tx=0x7f86fc00e4b0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.846+0000 7f87116ec640 1 -- 172.21.15.29:0/120958525 shutdown_connections 2024-01-25T15:05:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.846+0000 7f87116ec640 1 --2- 172.21.15.29:0/120958525 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f86ec06af00 0x7f86ec06d3c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.846+0000 7f87116ec640 1 --2- 172.21.15.29:0/120958525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f870c1526a0 0x7f870c151460 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.846+0000 7f87116ec640 1 --2- 172.21.15.29:0/120958525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f870c149190 0x7f870c155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.846+0000 7f87116ec640 1 --2- 172.21.15.29:0/120958525 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f870c0c49a0 0x7f870c0aa640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.846+0000 7f87116ec640 1 -- 172.21.15.29:0/120958525 >> 172.21.15.29:0/120958525 conn(0x7f870c0c7f10 msgr2=0x7f870c144b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.846+0000 7f87116ec640 1 -- 172.21.15.29:0/120958525 shutdown_connections 2024-01-25T15:05:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.846+0000 7f87116ec640 1 -- 172.21.15.29:0/120958525 wait complete. 2024-01-25T15:05:23.857 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:23.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.958+0000 7f1ffea9b640 1 Processor -- start 2024-01-25T15:05:23.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.958+0000 7f1ffea9b640 1 -- start start 2024-01-25T15:05:23.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.959+0000 7f1ffea9b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1ff80c8620 0x7f1ff806bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.959+0000 7f1ffea9b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff8155430 con 0x7f1ff8152160 2024-01-25T15:05:23.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.959+0000 7f1ffea9b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff8154b40 con 0x7f1ff80c4990 2024-01-25T15:05:23.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.959+0000 7f1ffea9b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff8152540 con 0x7f1ff80c8620 2024-01-25T15:05:23.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.959+0000 7f1ffc837640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1ff8152160 0x7f1ff80c4ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47492/0 (socket says 172.21.15.29:47492) 2024-01-25T15:05:23.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.959+0000 7f1ffc837640 1 -- 172.21.15.29:0/3260933349 learned_addr learned my addr 172.21.15.29:0/3260933349 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:23.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.959+0000 7f1ffd038640 1 --2- 172.21.15.29:0/3260933349 >> v2:172.21.15.52:3300/0 conn(0x7f1ff80c8620 0x7f1ff806bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.959+0000 7f1ff77fe640 1 -- 172.21.15.29:0/3260933349 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429959577 0 0) 0x7f1ff8155430 con 0x7f1ff8152160 2024-01-25T15:05:23.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ff77fe640 1 -- 172.21.15.29:0/3260933349 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fe4003520 con 0x7f1ff8152160 2024-01-25T15:05:23.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ff77fe640 1 -- 172.21.15.29:0/3260933349 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742254492 0 0) 0x7f1ff8154b40 con 0x7f1ff80c4990 2024-01-25T15:05:23.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ff77fe640 1 -- 172.21.15.29:0/3260933349 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ff8155430 con 0x7f1ff80c4990 2024-01-25T15:05:23.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ff77fe640 1 -- 172.21.15.29:0/3260933349 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1880202871 0 0) 0x7f1fe4003520 con 0x7f1ff8152160 2024-01-25T15:05:23.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ff77fe640 1 -- 172.21.15.29:0/3260933349 >> v2:172.21.15.52:3300/0 conn(0x7f1ff80c8620 msgr2=0x7f1ff806bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:23.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ff77fe640 1 --2- 172.21.15.29:0/3260933349 >> v2:172.21.15.52:3300/0 conn(0x7f1ff80c8620 0x7f1ff806bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ff77fe640 1 -- 172.21.15.29:0/3260933349 >> v1:172.21.15.52:6789/0 conn(0x7f1ff80c4990 legacy=0x7f1ff80c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ff77fe640 1 -- 172.21.15.29:0/3260933349 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff80c64b0 con 0x7f1ff8152160 2024-01-25T15:05:23.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ff77fe640 1 -- 172.21.15.29:0/3260933349 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f1ff00019f0 con 0x7f1ff8152160 2024-01-25T15:05:23.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ffd038640 1 --2- 172.21.15.29:0/3260933349 >> v2:172.21.15.52:3300/0 conn(0x7f1ff80c8620 0x7f1ff806bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:05:23.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ff77fe640 1 -- 172.21.15.29:0/3260933349 >> v1:172.21.15.29:6789/0 conn(0x7f1ff8152160 legacy=0x7f1ff80c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ff77fe640 1 --2- 172.21.15.29:0/3260933349 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1fe4003b50 0x7f1fe4003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ff77fe640 1 --2- 172.21.15.29:0/3260933349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fe40047c0 0x7f1fe4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ff77fe640 1 --2- 172.21.15.29:0/3260933349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe40051d0 0x7f1fe400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ff77fe640 1 -- 172.21.15.29:0/3260933349 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff8152540 con 0x7f1fe40047c0 2024-01-25T15:05:23.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ff77fe640 1 -- 172.21.15.29:0/3260933349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe400c100 con 0x7f1fe40051d0 2024-01-25T15:05:23.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ff77fe640 1 -- 172.21.15.29:0/3260933349 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe400c2c0 con 0x7f1fe4003b50 2024-01-25T15:05:23.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ff7fff640 1 --2- 172.21.15.29:0/3260933349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fe40047c0 0x7f1fe4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ffc837640 1 --2- 172.21.15.29:0/3260933349 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1fe4003b50 0x7f1fe4003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ffd038640 1 --2- 172.21.15.29:0/3260933349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe40051d0 0x7f1fe400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ff7fff640 1 -- 172.21.15.29:0/3260933349 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1fe4003b50 msgr2=0x7f1fe4003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:23.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ff7fff640 1 --2- 172.21.15.29:0/3260933349 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1fe4003b50 0x7f1fe4003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ff7fff640 1 -- 172.21.15.29:0/3260933349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe40051d0 msgr2=0x7f1fe400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:23.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ff7fff640 1 --2- 172.21.15.29:0/3260933349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe40051d0 0x7f1fe400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ff7fff640 1 -- 172.21.15.29:0/3260933349 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe4003520 con 0x7f1fe40047c0 2024-01-25T15:05:23.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.960+0000 7f1ffd038640 1 -- 172.21.15.29:0/3260933349 reap_dead start 2024-01-25T15:05:23.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.961+0000 7f1ff7fff640 1 --2- 172.21.15.29:0/3260933349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fe40047c0 0x7f1fe4004c40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80018a0 tx=0x7f1fe40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23663a810b7d93e6 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:23.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.961+0000 7f1ff77fe640 1 -- 172.21.15.29:0/3260933349 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80052d0 con 0x7f1fe40047c0 2024-01-25T15:05:23.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.961+0000 7f1ff77fe640 1 -- 172.21.15.29:0/3260933349 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe8005430 con 0x7f1fe40047c0 2024-01-25T15:05:23.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.961+0000 7f1ff77fe640 1 -- 172.21.15.29:0/3260933349 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8003810 con 0x7f1fe40047c0 2024-01-25T15:05:23.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.962+0000 7f1ffea9b640 1 -- 172.21.15.29:0/3260933349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fe40047c0 msgr2=0x7f1fe4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.962+0000 7f1ffea9b640 1 --2- 172.21.15.29:0/3260933349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fe40047c0 0x7f1fe4004c40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80018a0 tx=0x7f1fe40057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.962+0000 7f1ffea9b640 1 -- 172.21.15.29:0/3260933349 shutdown_connections 2024-01-25T15:05:23.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.962+0000 7f1ffea9b640 1 --2- 172.21.15.29:0/3260933349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fe40047c0 0x7f1fe4004c40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.962+0000 7f1ffea9b640 1 -- 172.21.15.29:0/3260933349 >> 172.21.15.29:0/3260933349 conn(0x7f1ff80ca1f0 msgr2=0x7f1ff80ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:23.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.962+0000 7f1ffea9b640 1 -- 172.21.15.29:0/3260933349 shutdown_connections 2024-01-25T15:05:23.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.962+0000 7f1ffea9b640 1 -- 172.21.15.29:0/3260933349 wait complete. 2024-01-25T15:05:23.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.963+0000 7f1ffea9b640 1 Processor -- start 2024-01-25T15:05:23.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.963+0000 7f1ffea9b640 1 -- start start 2024-01-25T15:05:23.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.964+0000 7f1ffea9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe40047c0 0x7f1ff8157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.964+0000 7f1ffea9b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1ff81ee2c0 0x7f1ff8154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.964+0000 7f1ffea9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ff8158130 0x7f1ff80c2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.964+0000 7f1ffea9b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff80c3120 con 0x7f1ff8158130 2024-01-25T15:05:23.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.964+0000 7f1ffea9b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff81570b0 con 0x7f1fe40047c0 2024-01-25T15:05:23.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.964+0000 7f1ffea9b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff8158650 con 0x7f1ff81ee2c0 2024-01-25T15:05:23.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.964+0000 7f1ffd038640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ff8158130 0x7f1ff80c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.964+0000 7f1ffd038640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ff8158130 0x7f1ff80c2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50114/0 (socket says 172.21.15.29:50114) 2024-01-25T15:05:23.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.964+0000 7f1ffd038640 1 -- 172.21.15.29:0/286992631 learned_addr learned my addr 172.21.15.29:0/286992631 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:23.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.964+0000 7f1ff7fff640 1 --2- 172.21.15.29:0/286992631 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1ff81ee2c0 0x7f1ff8154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.964+0000 7f1ffc837640 1 --2- 172.21.15.29:0/286992631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe40047c0 0x7f1ff8157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.964+0000 7f1ffd038640 1 -- 172.21.15.29:0/286992631 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1ff81ee2c0 msgr2=0x7f1ff8154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.964+0000 7f1ffd038640 1 --2- 172.21.15.29:0/286992631 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1ff81ee2c0 0x7f1ff8154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.964+0000 7f1ffd038640 1 -- 172.21.15.29:0/286992631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe40047c0 msgr2=0x7f1ff8157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.964+0000 7f1ffd038640 1 --2- 172.21.15.29:0/286992631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe40047c0 0x7f1ff8157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.964+0000 7f1ffd038640 1 -- 172.21.15.29:0/286992631 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff81ee750 con 0x7f1ff8158130 2024-01-25T15:05:23.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.964+0000 7f1ff7fff640 1 --2- 172.21.15.29:0/286992631 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1ff81ee2c0 0x7f1ff8154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:23.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.964+0000 7f1ffc837640 1 --2- 172.21.15.29:0/286992631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe40047c0 0x7f1ff8157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:23.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.964+0000 7f1ffd038640 1 --2- 172.21.15.29:0/286992631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ff8158130 0x7f1ff80c2320 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1ff808bb00 tx=0x7f1fe0011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:23.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.965+0000 7f1ff57fa640 1 -- 172.21.15.29:0/286992631 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe001b070 con 0x7f1ff8158130 2024-01-25T15:05:23.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.965+0000 7f1ff57fa640 1 -- 172.21.15.29:0/286992631 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe000fa40 con 0x7f1ff8158130 2024-01-25T15:05:23.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.965+0000 7f1ffea9b640 1 -- 172.21.15.29:0/286992631 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff81ea450 con 0x7f1ff8158130 2024-01-25T15:05:23.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.965+0000 7f1ff57fa640 1 -- 172.21.15.29:0/286992631 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe000fbf0 con 0x7f1ff8158130 2024-01-25T15:05:23.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.965+0000 7f1ffea9b640 1 -- 172.21.15.29:0/286992631 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff81eaa10 con 0x7f1ff8158130 2024-01-25T15:05:23.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.966+0000 7f1ffea9b640 1 -- 172.21.15.29:0/286992631 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff80c7be0 con 0x7f1ff8158130 2024-01-25T15:05:23.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.966+0000 7f1ff57fa640 1 -- 172.21.15.29:0/286992631 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f1fe000fd50 con 0x7f1ff8158130 2024-01-25T15:05:23.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.966+0000 7f1ff57fa640 1 --2- 172.21.15.29:0/286992631 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1fd806af00 0x7f1fd806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.966+0000 7f1ff57fa640 1 -- 172.21.15.29:0/286992631 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1fe0088e40 con 0x7f1ff8158130 2024-01-25T15:05:23.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.967+0000 7f1ffc837640 1 --2- 172.21.15.29:0/286992631 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1fd806af00 0x7f1fd806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.967+0000 7f1ffc837640 1 --2- 172.21.15.29:0/286992631 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1fd806af00 0x7f1fd806d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0004b60 tx=0x7f1ff0006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:23.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:23.971+0000 7f1ff57fa640 1 -- 172.21.15.29:0/286992631 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f1fe0053fb0 con 0x7f1ff8158130 2024-01-25T15:05:24.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.150+0000 7f1ffea9b640 1 -- 172.21.15.29:0/286992631 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ff80a97d0 con 0x7f1ff8158130 2024-01-25T15:05:24.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.151+0000 7f1ff57fa640 1 -- 172.21.15.29:0/286992631 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+13027 (secure 0 0 0) 0x7f1fe00575d0 con 0x7f1ff8158130 2024-01-25T15:05:24.152 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:24.152 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":34,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:05:21.202023+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:24.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.153+0000 7f1ffea9b640 1 -- 172.21.15.29:0/286992631 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1fd806af00 msgr2=0x7f1fd806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.153+0000 7f1ffea9b640 1 --2- 172.21.15.29:0/286992631 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1fd806af00 0x7f1fd806d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0004b60 tx=0x7f1ff0006040 comp rx=0 tx=0).stop 2024-01-25T15:05:24.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.153+0000 7f1ffea9b640 1 -- 172.21.15.29:0/286992631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ff8158130 msgr2=0x7f1ff80c2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.153+0000 7f1ffea9b640 1 --2- 172.21.15.29:0/286992631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ff8158130 0x7f1ff80c2320 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1ff808bb00 tx=0x7f1fe0011d60 comp rx=0 tx=0).stop 2024-01-25T15:05:24.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.153+0000 7f1ffea9b640 1 -- 172.21.15.29:0/286992631 shutdown_connections 2024-01-25T15:05:24.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.153+0000 7f1ffea9b640 1 --2- 172.21.15.29:0/286992631 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1fd806af00 0x7f1fd806d3c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.153+0000 7f1ffea9b640 1 --2- 172.21.15.29:0/286992631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ff8158130 0x7f1ff80c2320 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.153+0000 7f1ffea9b640 1 --2- 172.21.15.29:0/286992631 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1ff81ee2c0 0x7f1ff8154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.153+0000 7f1ffea9b640 1 --2- 172.21.15.29:0/286992631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe40047c0 0x7f1ff8157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.153+0000 7f1ffea9b640 1 -- 172.21.15.29:0/286992631 >> 172.21.15.29:0/286992631 conn(0x7f1ff80ca1f0 msgr2=0x7f1ff81513d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:24.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.153+0000 7f1ffea9b640 1 -- 172.21.15.29:0/286992631 shutdown_connections 2024-01-25T15:05:24.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.153+0000 7f1ffea9b640 1 -- 172.21.15.29:0/286992631 wait complete. 2024-01-25T15:05:24.164 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T15:04:14.955791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-25T15:05:24.164 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:05:24.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.268+0000 7f813f1f0640 1 Processor -- start 2024-01-25T15:05:24.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.268+0000 7f813f1f0640 1 -- start start 2024-01-25T15:05:24.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.269+0000 7f813f1f0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f813806b490 0x7f81380c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.269+0000 7f813f1f0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8138158b80 0x7f81380c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.269+0000 7f813f1f0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f81380c8450 0x7f8138151c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.269+0000 7f813f1f0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81380c88e0 con 0x7f813806b490 2024-01-25T15:05:24.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.269+0000 7f813f1f0640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81380c6770 con 0x7f81380c8450 2024-01-25T15:05:24.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.269+0000 7f813f1f0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8138154f10 con 0x7f8138158b80 2024-01-25T15:05:24.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.269+0000 7f813cf8c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f813806b490 0x7f81380c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.269+0000 7f813cf8c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f813806b490 0x7f81380c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50120/0 (socket says 172.21.15.29:50120) 2024-01-25T15:05:24.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.269+0000 7f813cf8c640 1 -- 172.21.15.29:0/1395868083 learned_addr learned my addr 172.21.15.29:0/1395868083 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:24.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.269+0000 7f8137fff640 1 --2- 172.21.15.29:0/1395868083 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8138158b80 0x7f81380c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.269+0000 7f813d78d640 1 --2- 172.21.15.29:0/1395868083 >> v2:172.21.15.52:3300/0 conn(0x7f81380c8450 0x7f8138151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.269+0000 7f813cf8c640 1 -- 172.21.15.29:0/1395868083 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8138158b80 msgr2=0x7f81380c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:24.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.269+0000 7f813cf8c640 1 --2- 172.21.15.29:0/1395868083 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8138158b80 0x7f81380c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.269+0000 7f813cf8c640 1 -- 172.21.15.29:0/1395868083 >> v2:172.21.15.52:3300/0 conn(0x7f81380c8450 msgr2=0x7f8138151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:24.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.269+0000 7f813cf8c640 1 --2- 172.21.15.29:0/1395868083 >> v2:172.21.15.52:3300/0 conn(0x7f81380c8450 0x7f8138151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.269+0000 7f813cf8c640 1 -- 172.21.15.29:0/1395868083 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81381551f0 con 0x7f813806b490 2024-01-25T15:05:24.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.269+0000 7f813d78d640 1 --2- 172.21.15.29:0/1395868083 >> v2:172.21.15.52:3300/0 conn(0x7f81380c8450 0x7f8138151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:24.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.270+0000 7f813cf8c640 1 --2- 172.21.15.29:0/1395868083 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f813806b490 0x7f81380c6120 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f81380686d0 tx=0x7f812802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f00d4eae34a496 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:24.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.270+0000 7f81377fe640 1 -- 172.21.15.29:0/1395868083 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81280317e0 con 0x7f813806b490 2024-01-25T15:05:24.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.270+0000 7f81377fe640 1 -- 172.21.15.29:0/1395868083 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8128031940 con 0x7f813806b490 2024-01-25T15:05:24.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.270+0000 7f81377fe640 1 -- 172.21.15.29:0/1395868083 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128031cd0 con 0x7f813806b490 2024-01-25T15:05:24.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.271+0000 7f813f1f0640 1 -- 172.21.15.29:0/1395868083 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f813806b490 msgr2=0x7f81380c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.271+0000 7f813f1f0640 1 --2- 172.21.15.29:0/1395868083 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f813806b490 0x7f81380c6120 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f81380686d0 tx=0x7f812802b880 comp rx=0 tx=0).stop 2024-01-25T15:05:24.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.271+0000 7f813f1f0640 1 -- 172.21.15.29:0/1395868083 shutdown_connections 2024-01-25T15:05:24.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.271+0000 7f813f1f0640 1 --2- 172.21.15.29:0/1395868083 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8138158b80 0x7f81380c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.271+0000 7f813f1f0640 1 --2- 172.21.15.29:0/1395868083 >> v2:172.21.15.52:3300/0 conn(0x7f81380c8450 0x7f8138151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.271+0000 7f813f1f0640 1 --2- 172.21.15.29:0/1395868083 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f813806b490 0x7f81380c6120 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.271+0000 7f813f1f0640 1 -- 172.21.15.29:0/1395868083 >> 172.21.15.29:0/1395868083 conn(0x7f81380ca010 msgr2=0x7f81380ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.271+0000 7f813f1f0640 1 -- 172.21.15.29:0/1395868083 shutdown_connections 2024-01-25T15:05:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.271+0000 7f813f1f0640 1 -- 172.21.15.29:0/1395868083 wait complete. 2024-01-25T15:05:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.272+0000 7f813f1f0640 1 Processor -- start 2024-01-25T15:05:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.272+0000 7f813f1f0640 1 -- start start 2024-01-25T15:05:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.273+0000 7f813f1f0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f813806b490 0x7f81380be360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.273+0000 7f813f1f0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81380c8450 0x7f81381508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.273+0000 7f813f1f0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8138158b80 0x7f8138150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.273+0000 7f813f1f0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81381ea730 con 0x7f8138158b80 2024-01-25T15:05:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.273+0000 7f813f1f0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81380c06e0 con 0x7f81380c8450 2024-01-25T15:05:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.273+0000 7f813f1f0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81380c0140 con 0x7f813806b490 2024-01-25T15:05:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.273+0000 7f813d78d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8138158b80 0x7f8138150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.273+0000 7f813d78d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8138158b80 0x7f8138150e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50132/0 (socket says 172.21.15.29:50132) 2024-01-25T15:05:24.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.273+0000 7f813d78d640 1 -- 172.21.15.29:0/956379776 learned_addr learned my addr 172.21.15.29:0/956379776 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:24.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.273+0000 7f813cf8c640 1 --2- 172.21.15.29:0/956379776 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f813806b490 0x7f81380be360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.273+0000 7f8137fff640 1 --2- 172.21.15.29:0/956379776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81380c8450 0x7f81381508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.273+0000 7f813d78d640 1 -- 172.21.15.29:0/956379776 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f813806b490 msgr2=0x7f81380be360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.273+0000 7f813d78d640 1 --2- 172.21.15.29:0/956379776 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f813806b490 0x7f81380be360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.273+0000 7f813d78d640 1 -- 172.21.15.29:0/956379776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81380c8450 msgr2=0x7f81381508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.273+0000 7f813d78d640 1 --2- 172.21.15.29:0/956379776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81380c8450 0x7f81381508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.273+0000 7f813d78d640 1 -- 172.21.15.29:0/956379776 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81280094d0 con 0x7f8138158b80 2024-01-25T15:05:24.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.273+0000 7f813d78d640 1 --2- 172.21.15.29:0/956379776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8138158b80 0x7f8138150e20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f813000cef0 tx=0x7f813000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:24.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.274+0000 7f81357fa640 1 -- 172.21.15.29:0/956379776 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813000d840 con 0x7f8138158b80 2024-01-25T15:05:24.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.274+0000 7f81357fa640 1 -- 172.21.15.29:0/956379776 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813000d9c0 con 0x7f8138158b80 2024-01-25T15:05:24.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.274+0000 7f813f1f0640 1 -- 172.21.15.29:0/956379776 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81380bd7e0 con 0x7f8138158b80 2024-01-25T15:05:24.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.274+0000 7f81357fa640 1 -- 172.21.15.29:0/956379776 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813000dd70 con 0x7f8138158b80 2024-01-25T15:05:24.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.274+0000 7f813f1f0640 1 -- 172.21.15.29:0/956379776 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81380c0400 con 0x7f8138158b80 2024-01-25T15:05:24.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.275+0000 7f813f1f0640 1 -- 172.21.15.29:0/956379776 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81381ea870 con 0x7f8138158b80 2024-01-25T15:05:24.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.275+0000 7f81357fa640 1 -- 172.21.15.29:0/956379776 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f813001e3b0 con 0x7f8138158b80 2024-01-25T15:05:24.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.275+0000 7f81357fa640 1 --2- 172.21.15.29:0/956379776 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f812406af00 0x7f812406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.276+0000 7f81357fa640 1 -- 172.21.15.29:0/956379776 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8130089ee0 con 0x7f8138158b80 2024-01-25T15:05:24.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.276+0000 7f813cf8c640 1 --2- 172.21.15.29:0/956379776 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f812406af00 0x7f812406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.276+0000 7f813cf8c640 1 --2- 172.21.15.29:0/956379776 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f812406af00 0x7f812406d3c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8128036000 tx=0x7f812803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:24.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.280+0000 7f81357fa640 1 -- 172.21.15.29:0/956379776 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f81381ea870 con 0x7f8138158b80 2024-01-25T15:05:24.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.460+0000 7f813f1f0640 1 -- 172.21.15.29:0/956379776 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81381ea870 con 0x7f8138158b80 2024-01-25T15:05:24.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.460+0000 7f81357fa640 1 -- 172.21.15.29:0/956379776 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81381ea870 con 0x7f8138158b80 2024-01-25T15:05:24.461 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-25T15:05:24.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.463+0000 7f813f1f0640 1 -- 172.21.15.29:0/956379776 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f812406af00 msgr2=0x7f812406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.463+0000 7f813f1f0640 1 --2- 172.21.15.29:0/956379776 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f812406af00 0x7f812406d3c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8128036000 tx=0x7f812803d040 comp rx=0 tx=0).stop 2024-01-25T15:05:24.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.463+0000 7f813f1f0640 1 -- 172.21.15.29:0/956379776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8138158b80 msgr2=0x7f8138150e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.463+0000 7f813f1f0640 1 --2- 172.21.15.29:0/956379776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8138158b80 0x7f8138150e20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f813000cef0 tx=0x7f813000a710 comp rx=0 tx=0).stop 2024-01-25T15:05:24.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.463+0000 7f813f1f0640 1 -- 172.21.15.29:0/956379776 shutdown_connections 2024-01-25T15:05:24.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.463+0000 7f813f1f0640 1 --2- 172.21.15.29:0/956379776 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f812406af00 0x7f812406d3c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.463+0000 7f813f1f0640 1 --2- 172.21.15.29:0/956379776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8138158b80 0x7f8138150e20 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.463+0000 7f813f1f0640 1 --2- 172.21.15.29:0/956379776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81380c8450 0x7f81381508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.463+0000 7f813f1f0640 1 --2- 172.21.15.29:0/956379776 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f813806b490 0x7f81380be360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.463+0000 7f813f1f0640 1 -- 172.21.15.29:0/956379776 >> 172.21.15.29:0/956379776 conn(0x7f81380ca010 msgr2=0x7f8138153650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:24.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.463+0000 7f813f1f0640 1 -- 172.21.15.29:0/956379776 shutdown_connections 2024-01-25T15:05:24.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.463+0000 7f813f1f0640 1 -- 172.21.15.29:0/956379776 wait complete. 2024-01-25T15:05:24.474 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-25T15:05:24.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.575+0000 7f0617290640 1 Processor -- start 2024-01-25T15:05:24.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.575+0000 7f0617290640 1 -- start start 2024-01-25T15:05:24.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f0617290640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0610152160 0x7f061006bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f0617290640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0610155430 con 0x7f06100c4990 2024-01-25T15:05:24.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f0617290640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0610154b40 con 0x7f06100c7f10 2024-01-25T15:05:24.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f0617290640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0610152540 con 0x7f0610152160 2024-01-25T15:05:24.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f061482b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f06100c4990 0x7f06100c4ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47498/0 (socket says 172.21.15.29:47498) 2024-01-25T15:05:24.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f061482b640 1 -- 172.21.15.29:0/2110962119 learned_addr learned my addr 172.21.15.29:0/2110962119 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:24.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f061502c640 1 --2- 172.21.15.29:0/2110962119 >> v2:172.21.15.52:3300/0 conn(0x7f0610152160 0x7f061006bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f0607fff640 1 -- 172.21.15.29:0/2110962119 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995000402 0 0) 0x7f0610155430 con 0x7f06100c4990 2024-01-25T15:05:24.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f0607fff640 1 -- 172.21.15.29:0/2110962119 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05fc003520 con 0x7f06100c4990 2024-01-25T15:05:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f0607fff640 1 -- 172.21.15.29:0/2110962119 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4153145344 0 0) 0x7f05fc003520 con 0x7f06100c4990 2024-01-25T15:05:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f0607fff640 1 -- 172.21.15.29:0/2110962119 >> v2:172.21.15.52:3300/0 conn(0x7f0610152160 msgr2=0x7f061006bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f0607fff640 1 --2- 172.21.15.29:0/2110962119 >> v2:172.21.15.52:3300/0 conn(0x7f0610152160 0x7f061006bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f0607fff640 1 -- 172.21.15.29:0/2110962119 >> v1:172.21.15.52:6789/0 conn(0x7f06100c7f10 legacy=0x7f061015f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f0607fff640 1 -- 172.21.15.29:0/2110962119 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06100c64b0 con 0x7f06100c4990 2024-01-25T15:05:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f0607fff640 1 -- 172.21.15.29:0/2110962119 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f0600001670 con 0x7f06100c4990 2024-01-25T15:05:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f0607fff640 1 -- 172.21.15.29:0/2110962119 >> v1:172.21.15.29:6789/0 conn(0x7f06100c4990 legacy=0x7f06100c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f0607fff640 1 --2- 172.21.15.29:0/2110962119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05fc003970 0x7f05fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f0607fff640 1 --2- 172.21.15.29:0/2110962119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05fc0047c0 0x7f05fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f0607fff640 1 --2- 172.21.15.29:0/2110962119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05fc005180 0x7f05fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f0607fff640 1 -- 172.21.15.29:0/2110962119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0610152540 con 0x7f05fc0047c0 2024-01-25T15:05:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f0607fff640 1 -- 172.21.15.29:0/2110962119 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc00c120 con 0x7f05fc005180 2024-01-25T15:05:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f0607fff640 1 -- 172.21.15.29:0/2110962119 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc00c2e0 con 0x7f05fc003970 2024-01-25T15:05:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.576+0000 7f061482b640 1 --2- 172.21.15.29:0/2110962119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05fc0047c0 0x7f05fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.577+0000 7f061502c640 1 --2- 172.21.15.29:0/2110962119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05fc003970 0x7f05fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.577+0000 7f061582d640 1 --2- 172.21.15.29:0/2110962119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05fc005180 0x7f05fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.577+0000 7f061482b640 1 -- 172.21.15.29:0/2110962119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05fc003970 msgr2=0x7f05fc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.577+0000 7f061482b640 1 --2- 172.21.15.29:0/2110962119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05fc003970 0x7f05fc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.577+0000 7f061482b640 1 -- 172.21.15.29:0/2110962119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05fc005180 msgr2=0x7f05fc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.577+0000 7f061482b640 1 --2- 172.21.15.29:0/2110962119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05fc005180 0x7f05fc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.577+0000 7f061482b640 1 -- 172.21.15.29:0/2110962119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05fc003520 con 0x7f05fc0047c0 2024-01-25T15:05:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.577+0000 7f061582d640 1 -- 172.21.15.29:0/2110962119 reap_dead start 2024-01-25T15:05:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.577+0000 7f061502c640 1 --2- 172.21.15.29:0/2110962119 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05fc003970 0x7f05fc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.577+0000 7f061482b640 1 --2- 172.21.15.29:0/2110962119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05fc0047c0 0x7f05fc004c40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0600007fd0 tx=0x7f05fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992a765380d5574a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.578+0000 7f0607fff640 1 -- 172.21.15.29:0/2110962119 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0600005ad0 con 0x7f05fc0047c0 2024-01-25T15:05:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.578+0000 7f0607fff640 1 -- 172.21.15.29:0/2110962119 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0600005c50 con 0x7f05fc0047c0 2024-01-25T15:05:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.578+0000 7f0607fff640 1 -- 172.21.15.29:0/2110962119 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060002c870 con 0x7f05fc0047c0 2024-01-25T15:05:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.578+0000 7f0617290640 1 -- 172.21.15.29:0/2110962119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05fc0047c0 msgr2=0x7f05fc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.578+0000 7f0617290640 1 --2- 172.21.15.29:0/2110962119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05fc0047c0 0x7f05fc004c40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0600007fd0 tx=0x7f05fc0057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.578+0000 7f0617290640 1 -- 172.21.15.29:0/2110962119 shutdown_connections 2024-01-25T15:05:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.578+0000 7f0617290640 1 --2- 172.21.15.29:0/2110962119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05fc0047c0 0x7f05fc004c40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.578+0000 7f0617290640 1 -- 172.21.15.29:0/2110962119 >> 172.21.15.29:0/2110962119 conn(0x7f06100ca1f0 msgr2=0x7f06100ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.578+0000 7f0617290640 1 -- 172.21.15.29:0/2110962119 shutdown_connections 2024-01-25T15:05:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.578+0000 7f0617290640 1 -- 172.21.15.29:0/2110962119 wait complete. 2024-01-25T15:05:24.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.579+0000 7f0617290640 1 Processor -- start 2024-01-25T15:05:24.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.579+0000 7f0617290640 1 -- start start 2024-01-25T15:05:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.580+0000 7f0617290640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05fc0047c0 0x7f06101532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.580+0000 7f0617290640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0610144d80 0x7f06101509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.580+0000 7f0617290640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0610150f10 0x7f06101eda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.580+0000 7f0617290640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0610157df0 con 0x7f0610144d80 2024-01-25T15:05:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.580+0000 7f0617290640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0610153d30 con 0x7f0610150f10 2024-01-25T15:05:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.580+0000 7f0617290640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06101ed5a0 con 0x7f05fc0047c0 2024-01-25T15:05:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.580+0000 7f061482b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0610144d80 0x7f06101509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.580+0000 7f061482b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0610144d80 0x7f06101509d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50148/0 (socket says 172.21.15.29:50148) 2024-01-25T15:05:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.580+0000 7f061482b640 1 -- 172.21.15.29:0/1148631322 learned_addr learned my addr 172.21.15.29:0/1148631322 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.580+0000 7f061502c640 1 --2- 172.21.15.29:0/1148631322 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05fc0047c0 0x7f06101532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.580+0000 7f061582d640 1 --2- 172.21.15.29:0/1148631322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0610150f10 0x7f06101eda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.580+0000 7f061482b640 1 -- 172.21.15.29:0/1148631322 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05fc0047c0 msgr2=0x7f06101532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.580+0000 7f061482b640 1 --2- 172.21.15.29:0/1148631322 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05fc0047c0 0x7f06101532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.580+0000 7f061482b640 1 -- 172.21.15.29:0/1148631322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0610150f10 msgr2=0x7f06101eda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.580+0000 7f061482b640 1 --2- 172.21.15.29:0/1148631322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0610150f10 0x7f06101eda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.580+0000 7f061482b640 1 -- 172.21.15.29:0/1148631322 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0610158d90 con 0x7f0610144d80 2024-01-25T15:05:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.581+0000 7f061482b640 1 --2- 172.21.15.29:0/1148631322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0610144d80 0x7f06101509d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0600001930 tx=0x7f060002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.581+0000 7f0605ffb640 1 -- 172.21.15.29:0/1148631322 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060003c040 con 0x7f0610144d80 2024-01-25T15:05:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.581+0000 7f0605ffb640 1 -- 172.21.15.29:0/1148631322 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060002cc80 con 0x7f0610144d80 2024-01-25T15:05:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.581+0000 7f0605ffb640 1 -- 172.21.15.29:0/1148631322 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0600007070 con 0x7f0610144d80 2024-01-25T15:05:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.581+0000 7f0617290640 1 -- 172.21.15.29:0/1148631322 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06101537e0 con 0x7f0610144d80 2024-01-25T15:05:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.581+0000 7f0617290640 1 -- 172.21.15.29:0/1148631322 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0610153f40 con 0x7f0610144d80 2024-01-25T15:05:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.582+0000 7f0617290640 1 -- 172.21.15.29:0/1148631322 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06100c6820 con 0x7f0610144d80 2024-01-25T15:05:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.582+0000 7f0605ffb640 1 -- 172.21.15.29:0/1148631322 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0600032070 con 0x7f0610144d80 2024-01-25T15:05:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.583+0000 7f0605ffb640 1 --2- 172.21.15.29:0/1148631322 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f05f406aed0 0x7f05f406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.583+0000 7f0605ffb640 1 -- 172.21.15.29:0/1148631322 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f06000aab90 con 0x7f0610144d80 2024-01-25T15:05:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.583+0000 7f061502c640 1 --2- 172.21.15.29:0/1148631322 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f05f406aed0 0x7f05f406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.583+0000 7f061502c640 1 --2- 172.21.15.29:0/1148631322 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f05f406aed0 0x7f05f406d390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f06100aa9d0 tx=0x7f060c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:24.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.587+0000 7f0605ffb640 1 -- 172.21.15.29:0/1148631322 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f0600075da0 con 0x7f0610144d80 2024-01-25T15:05:24.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.768+0000 7f0617290640 1 -- 172.21.15.29:0/1148631322 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f06100a97d0 con 0x7f0610144d80 2024-01-25T15:05:24.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.768+0000 7f0605ffb640 1 -- 172.21.15.29:0/1148631322 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0600046020 con 0x7f0610144d80 2024-01-25T15:05:24.769 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:24.769 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2024-01-25T15:05:24.769 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:24.769 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2024-01-25T15:05:24.769 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2024-01-25T15:05:24.769 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:24.769 INFO:teuthology.orchestra.run.smithi029.stdout:] 2024-01-25T15:05:24.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.770+0000 7f0617290640 1 -- 172.21.15.29:0/1148631322 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f05f406aed0 msgr2=0x7f05f406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.770+0000 7f0617290640 1 --2- 172.21.15.29:0/1148631322 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f05f406aed0 0x7f05f406d390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f06100aa9d0 tx=0x7f060c008040 comp rx=0 tx=0).stop 2024-01-25T15:05:24.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.770+0000 7f0617290640 1 -- 172.21.15.29:0/1148631322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0610144d80 msgr2=0x7f06101509d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.770+0000 7f0617290640 1 --2- 172.21.15.29:0/1148631322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0610144d80 0x7f06101509d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0600001930 tx=0x7f060002e070 comp rx=0 tx=0).stop 2024-01-25T15:05:24.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.770+0000 7f0617290640 1 -- 172.21.15.29:0/1148631322 shutdown_connections 2024-01-25T15:05:24.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.770+0000 7f0617290640 1 --2- 172.21.15.29:0/1148631322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0610150f10 0x7f06101eda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.770+0000 7f0617290640 1 --2- 172.21.15.29:0/1148631322 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f05f406aed0 0x7f05f406d390 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.770+0000 7f0617290640 1 --2- 172.21.15.29:0/1148631322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0610144d80 0x7f06101509d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.770+0000 7f0617290640 1 --2- 172.21.15.29:0/1148631322 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05fc0047c0 0x7f06101532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.770+0000 7f0617290640 1 -- 172.21.15.29:0/1148631322 >> 172.21.15.29:0/1148631322 conn(0x7f06100ca1f0 msgr2=0x7f06100ab3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:24.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.770+0000 7f0617290640 1 -- 172.21.15.29:0/1148631322 shutdown_connections 2024-01-25T15:05:24.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.770+0000 7f0617290640 1 -- 172.21.15.29:0/1148631322 wait complete. 2024-01-25T15:05:24.781 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-25T15:05:24.782 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-25T15:05:24.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.886+0000 7f7af8781640 1 Processor -- start 2024-01-25T15:05:24.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.886+0000 7f7af8781640 1 -- start start 2024-01-25T15:05:24.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.887+0000 7f7af8781640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7af0151f80 0x7f7af00c6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.887+0000 7f7af8781640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af0158120 con 0x7f7af0155190 2024-01-25T15:05:24.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.887+0000 7f7af8781640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af00c4db0 con 0x7f7af00c48d0 2024-01-25T15:05:24.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.887+0000 7f7af8781640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7af00c5090 con 0x7f7af0151f80 2024-01-25T15:05:24.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.887+0000 7f7af6d1e640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7af0155190 0x7f7af00c74f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47500/0 (socket says 172.21.15.29:47500) 2024-01-25T15:05:24.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.887+0000 7f7af6d1e640 1 -- 172.21.15.29:0/2725642292 learned_addr learned my addr 172.21.15.29:0/2725642292 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:24.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.887+0000 7f7af651d640 1 --2- 172.21.15.29:0/2725642292 >> v2:172.21.15.52:3300/0 conn(0x7f7af0151f80 0x7f7af00c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.887+0000 7f7af551b640 1 -- 172.21.15.29:0/2725642292 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686123690 0 0) 0x7f7af0158120 con 0x7f7af0155190 2024-01-25T15:05:24.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.887+0000 7f7af551b640 1 -- 172.21.15.29:0/2725642292 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7adc003520 con 0x7f7af0155190 2024-01-25T15:05:24.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.887+0000 7f7af551b640 1 -- 172.21.15.29:0/2725642292 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 633355642 0 0) 0x7f7adc003520 con 0x7f7af0155190 2024-01-25T15:05:24.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.887+0000 7f7af551b640 1 -- 172.21.15.29:0/2725642292 >> v2:172.21.15.52:3300/0 conn(0x7f7af0151f80 msgr2=0x7f7af00c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:24.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.887+0000 7f7af551b640 1 --2- 172.21.15.29:0/2725642292 >> v2:172.21.15.52:3300/0 conn(0x7f7af0151f80 0x7f7af00c6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.887+0000 7f7af551b640 1 -- 172.21.15.29:0/2725642292 >> v1:172.21.15.52:6789/0 conn(0x7f7af00c48d0 legacy=0x7f7af01585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.887+0000 7f7af551b640 1 -- 172.21.15.29:0/2725642292 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af00c5370 con 0x7f7af0155190 2024-01-25T15:05:24.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.887+0000 7f7af551b640 1 -- 172.21.15.29:0/2725642292 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f7ae80019f0 con 0x7f7af0155190 2024-01-25T15:05:24.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.887+0000 7f7af551b640 1 -- 172.21.15.29:0/2725642292 >> v1:172.21.15.29:6789/0 conn(0x7f7af0155190 legacy=0x7f7af00c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.887+0000 7f7af551b640 1 --2- 172.21.15.29:0/2725642292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7adc0039e0 0x7f7adc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.887+0000 7f7af551b640 1 --2- 172.21.15.29:0/2725642292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7adc0047c0 0x7f7adc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.887+0000 7f7af551b640 1 --2- 172.21.15.29:0/2725642292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7adc005180 0x7f7adc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.888+0000 7f7af551b640 1 -- 172.21.15.29:0/2725642292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af00c5090 con 0x7f7adc0039e0 2024-01-25T15:05:24.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.888+0000 7f7af551b640 1 -- 172.21.15.29:0/2725642292 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc00c0b0 con 0x7f7adc005180 2024-01-25T15:05:24.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.888+0000 7f7af551b640 1 -- 172.21.15.29:0/2725642292 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc00c270 con 0x7f7adc0047c0 2024-01-25T15:05:24.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.888+0000 7f7af651d640 1 --2- 172.21.15.29:0/2725642292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7adc0039e0 0x7f7adc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.888+0000 7f7af5d1c640 1 --2- 172.21.15.29:0/2725642292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7adc0047c0 0x7f7adc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.888+0000 7f7af6d1e640 1 --2- 172.21.15.29:0/2725642292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7adc005180 0x7f7adc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.888+0000 7f7af651d640 1 -- 172.21.15.29:0/2725642292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7adc0047c0 msgr2=0x7f7adc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:24.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.888+0000 7f7af651d640 1 --2- 172.21.15.29:0/2725642292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7adc0047c0 0x7f7adc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.888+0000 7f7af651d640 1 -- 172.21.15.29:0/2725642292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7adc005180 msgr2=0x7f7adc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:24.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.888+0000 7f7af651d640 1 --2- 172.21.15.29:0/2725642292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7adc005180 0x7f7adc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.888+0000 7f7af6d1e640 1 -- 172.21.15.29:0/2725642292 reap_dead start 2024-01-25T15:05:24.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.888+0000 7f7af651d640 1 -- 172.21.15.29:0/2725642292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc003520 con 0x7f7adc0039e0 2024-01-25T15:05:24.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.889+0000 7f7af651d640 1 --2- 172.21.15.29:0/2725642292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7adc0039e0 0x7f7adc003e00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7aec009ac0 tx=0x7f7adc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ed7324ae8f9f3a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:24.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.889+0000 7f7af551b640 1 -- 172.21.15.29:0/2725642292 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec02c6b0 con 0x7f7adc0039e0 2024-01-25T15:05:24.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.889+0000 7f7af551b640 1 -- 172.21.15.29:0/2725642292 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aec02c810 con 0x7f7adc0039e0 2024-01-25T15:05:24.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.889+0000 7f7af551b640 1 -- 172.21.15.29:0/2725642292 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec02cba0 con 0x7f7adc0039e0 2024-01-25T15:05:24.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.889+0000 7f7af8781640 1 -- 172.21.15.29:0/2725642292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7adc0039e0 msgr2=0x7f7adc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.889+0000 7f7af8781640 1 --2- 172.21.15.29:0/2725642292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7adc0039e0 0x7f7adc003e00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7aec009ac0 tx=0x7f7adc0057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.889+0000 7f7af8781640 1 -- 172.21.15.29:0/2725642292 shutdown_connections 2024-01-25T15:05:24.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.889+0000 7f7af8781640 1 --2- 172.21.15.29:0/2725642292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7adc0039e0 0x7f7adc003e00 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.889+0000 7f7af8781640 1 -- 172.21.15.29:0/2725642292 >> 172.21.15.29:0/2725642292 conn(0x7f7af00c7f10 msgr2=0x7f7af00c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:24.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.889+0000 7f7af8781640 1 -- 172.21.15.29:0/2725642292 shutdown_connections 2024-01-25T15:05:24.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.889+0000 7f7af8781640 1 -- 172.21.15.29:0/2725642292 wait complete. 2024-01-25T15:05:24.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.890+0000 7f7af8781640 1 Processor -- start 2024-01-25T15:05:24.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.890+0000 7f7af8781640 1 -- start start 2024-01-25T15:05:24.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.891+0000 7f7af8781640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7adc0039e0 0x7f7af00702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.891+0000 7f7af8781640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af014f580 0x7f7af014e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.891+0000 7f7af8781640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7af01e18c0 0x7f7af014ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.891+0000 7f7af8781640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af0155040 con 0x7f7af01e18c0 2024-01-25T15:05:24.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.891+0000 7f7af8781640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af014f050 con 0x7f7af014f580 2024-01-25T15:05:24.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.891+0000 7f7af8781640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af0153c00 con 0x7f7adc0039e0 2024-01-25T15:05:24.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.891+0000 7f7af6d1e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7af01e18c0 0x7f7af014ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.891+0000 7f7af6d1e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7af01e18c0 0x7f7af014ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50158/0 (socket says 172.21.15.29:50158) 2024-01-25T15:05:24.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.891+0000 7f7af6d1e640 1 -- 172.21.15.29:0/3701957292 learned_addr learned my addr 172.21.15.29:0/3701957292 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:24.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.891+0000 7f7af651d640 1 --2- 172.21.15.29:0/3701957292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7adc0039e0 0x7f7af00702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.891+0000 7f7af5d1c640 1 --2- 172.21.15.29:0/3701957292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af014f580 0x7f7af014e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.892+0000 7f7af6d1e640 1 -- 172.21.15.29:0/3701957292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7adc0039e0 msgr2=0x7f7af00702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.892+0000 7f7af6d1e640 1 --2- 172.21.15.29:0/3701957292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7adc0039e0 0x7f7af00702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.892+0000 7f7af6d1e640 1 -- 172.21.15.29:0/3701957292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af014f580 msgr2=0x7f7af014e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.892+0000 7f7af6d1e640 1 --2- 172.21.15.29:0/3701957292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af014f580 0x7f7af014e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.892+0000 7f7af6d1e640 1 -- 172.21.15.29:0/3701957292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af014f2a0 con 0x7f7af01e18c0 2024-01-25T15:05:24.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.892+0000 7f7af6d1e640 1 --2- 172.21.15.29:0/3701957292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7af01e18c0 0x7f7af014ea20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7af00c3290 tx=0x7f7ae8007b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:24.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.892+0000 7f7ae6ffd640 1 -- 172.21.15.29:0/3701957292 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae8004d70 con 0x7f7af01e18c0 2024-01-25T15:05:24.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.892+0000 7f7ae6ffd640 1 -- 172.21.15.29:0/3701957292 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae800e830 con 0x7f7af01e18c0 2024-01-25T15:05:24.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.892+0000 7f7ae6ffd640 1 -- 172.21.15.29:0/3701957292 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae800ebe0 con 0x7f7af01e18c0 2024-01-25T15:05:24.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.892+0000 7f7af8781640 1 -- 172.21.15.29:0/3701957292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af01ee170 con 0x7f7af01e18c0 2024-01-25T15:05:24.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.892+0000 7f7af8781640 1 -- 172.21.15.29:0/3701957292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af0154b20 con 0x7f7af01e18c0 2024-01-25T15:05:24.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.893+0000 7f7af8781640 1 -- 172.21.15.29:0/3701957292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af004eb10 con 0x7f7af01e18c0 2024-01-25T15:05:24.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.893+0000 7f7ae6ffd640 1 -- 172.21.15.29:0/3701957292 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7ae800ed40 con 0x7f7af01e18c0 2024-01-25T15:05:24.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.894+0000 7f7ae6ffd640 1 --2- 172.21.15.29:0/3701957292 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7ad406aed0 0x7f7ad406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.894+0000 7f7ae6ffd640 1 -- 172.21.15.29:0/3701957292 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7ae8089130 con 0x7f7af01e18c0 2024-01-25T15:05:24.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.894+0000 7f7af651d640 1 --2- 172.21.15.29:0/3701957292 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7ad406aed0 0x7f7ad406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.894+0000 7f7af651d640 1 --2- 172.21.15.29:0/3701957292 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7ad406aed0 0x7f7ad406d390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7aec036000 tx=0x7f7aec030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:24.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:24.898+0000 7f7ae6ffd640 1 -- 172.21.15.29:0/3701957292 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7ae80542a0 con 0x7f7af01e18c0 2024-01-25T15:05:25.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.079+0000 7f7af8781640 1 -- 172.21.15.29:0/3701957292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7af01ee690 con 0x7f7af01e18c0 2024-01-25T15:05:25.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.201+0000 7f7ae6ffd640 1 -- 172.21.15.29:0/3701957292 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7ae80578c0 con 0x7f7af01e18c0 2024-01-25T15:05:25.201 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' created 2024-01-25T15:05:25.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.203+0000 7f7af8781640 1 -- 172.21.15.29:0/3701957292 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7ad406aed0 msgr2=0x7f7ad406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:25.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.203+0000 7f7af8781640 1 --2- 172.21.15.29:0/3701957292 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7ad406aed0 0x7f7ad406d390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7aec036000 tx=0x7f7aec030000 comp rx=0 tx=0).stop 2024-01-25T15:05:25.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.203+0000 7f7af8781640 1 -- 172.21.15.29:0/3701957292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7af01e18c0 msgr2=0x7f7af014ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:25.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.203+0000 7f7af8781640 1 --2- 172.21.15.29:0/3701957292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7af01e18c0 0x7f7af014ea20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7af00c3290 tx=0x7f7ae8007b50 comp rx=0 tx=0).stop 2024-01-25T15:05:25.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.203+0000 7f7af8781640 1 -- 172.21.15.29:0/3701957292 shutdown_connections 2024-01-25T15:05:25.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.203+0000 7f7af8781640 1 --2- 172.21.15.29:0/3701957292 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7ad406aed0 0x7f7ad406d390 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:25.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.203+0000 7f7af8781640 1 --2- 172.21.15.29:0/3701957292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7af01e18c0 0x7f7af014ea20 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:25.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.203+0000 7f7af8781640 1 --2- 172.21.15.29:0/3701957292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7af014f580 0x7f7af014e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:25.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.203+0000 7f7af8781640 1 --2- 172.21.15.29:0/3701957292 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7adc0039e0 0x7f7af00702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:25.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.203+0000 7f7af8781640 1 -- 172.21.15.29:0/3701957292 >> 172.21.15.29:0/3701957292 conn(0x7f7af00c7f10 msgr2=0x7f7af00c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:25.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.203+0000 7f7af8781640 1 -- 172.21.15.29:0/3701957292 shutdown_connections 2024-01-25T15:05:25.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.203+0000 7f7af8781640 1 -- 172.21.15.29:0/3701957292 wait complete. 2024-01-25T15:05:25.218 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-25T15:05:25.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.325+0000 7f6a6504e640 1 Processor -- start 2024-01-25T15:05:25.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.325+0000 7f6a6504e640 1 -- start start 2024-01-25T15:05:25.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.326+0000 7f6a6504e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6a60151d80 0x7f6a60155120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:25.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.326+0000 7f6a6504e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6a6006b2b0 0x7f6a6006b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:25.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.326+0000 7f6a6504e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a600c58c0 con 0x7f6a600c5d50 2024-01-25T15:05:25.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.326+0000 7f6a6504e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a6006c0a0 con 0x7f6a60151d80 2024-01-25T15:05:25.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.326+0000 7f6a6504e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a600c7f10 con 0x7f6a6006b2b0 2024-01-25T15:05:25.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.326+0000 7f6a5ed9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6a60151d80 0x7f6a60155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:25.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.326+0000 7f6a5ed9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6a60151d80 0x7f6a60155120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50164/0 (socket says 172.21.15.29:50164) 2024-01-25T15:05:25.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.326+0000 7f6a5ed9d640 1 -- 172.21.15.29:0/146205102 learned_addr learned my addr 172.21.15.29:0/146205102 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:25.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.327+0000 7f6a5e59c640 1 --2- 172.21.15.29:0/146205102 >> v2:172.21.15.52:3300/0 conn(0x7f6a6006b2b0 0x7f6a6006b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:25.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.327+0000 7f6a5ed9d640 1 -- 172.21.15.29:0/146205102 >> v2:172.21.15.52:3300/0 conn(0x7f6a6006b2b0 msgr2=0x7f6a6006b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:25.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.327+0000 7f6a5ed9d640 1 --2- 172.21.15.29:0/146205102 >> v2:172.21.15.52:3300/0 conn(0x7f6a6006b2b0 0x7f6a6006b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:25.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.327+0000 7f6a5ed9d640 1 -- 172.21.15.29:0/146205102 >> v1:172.21.15.52:6789/0 conn(0x7f6a600c5d50 legacy=0x7f6a600c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:25.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.327+0000 7f6a5ed9d640 1 -- 172.21.15.29:0/146205102 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a600c4990 con 0x7f6a60151d80 2024-01-25T15:05:25.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.327+0000 7f6a5e59c640 1 --2- 172.21.15.29:0/146205102 >> v2:172.21.15.52:3300/0 conn(0x7f6a6006b2b0 0x7f6a6006b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:25.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.327+0000 7f6a5ed9d640 1 --2- 172.21.15.29:0/146205102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a60151d80 0x7f6a60155120 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009870 tx=0x7f6a5002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f72ee582730f377 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:25.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.327+0000 7f6a5dd9b640 1 -- 172.21.15.29:0/146205102 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a500317e0 con 0x7f6a60151d80 2024-01-25T15:05:25.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.327+0000 7f6a5dd9b640 1 -- 172.21.15.29:0/146205102 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a50031940 con 0x7f6a60151d80 2024-01-25T15:05:25.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.328+0000 7f6a5dd9b640 1 -- 172.21.15.29:0/146205102 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a50031cd0 con 0x7f6a60151d80 2024-01-25T15:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.328+0000 7f6a6504e640 1 -- 172.21.15.29:0/146205102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a60151d80 msgr2=0x7f6a60155120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.328+0000 7f6a6504e640 1 --2- 172.21.15.29:0/146205102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a60151d80 0x7f6a60155120 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009870 tx=0x7f6a5002b880 comp rx=0 tx=0).stop 2024-01-25T15:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.328+0000 7f6a6504e640 1 -- 172.21.15.29:0/146205102 shutdown_connections 2024-01-25T15:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.328+0000 7f6a6504e640 1 --2- 172.21.15.29:0/146205102 >> v2:172.21.15.52:3300/0 conn(0x7f6a6006b2b0 0x7f6a6006b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.328+0000 7f6a6504e640 1 --2- 172.21.15.29:0/146205102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a60151d80 0x7f6a60155120 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.328+0000 7f6a6504e640 1 -- 172.21.15.29:0/146205102 >> 172.21.15.29:0/146205102 conn(0x7f6a600ca1f0 msgr2=0x7f6a600ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.328+0000 7f6a6504e640 1 -- 172.21.15.29:0/146205102 shutdown_connections 2024-01-25T15:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.328+0000 7f6a6504e640 1 -- 172.21.15.29:0/146205102 wait complete. 2024-01-25T15:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.329+0000 7f6a6504e640 1 Processor -- start 2024-01-25T15:05:25.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.329+0000 7f6a6504e640 1 -- start start 2024-01-25T15:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.330+0000 7f6a6504e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6a6006b2b0 0x7f6a601ed540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.330+0000 7f6a6504e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a600c5d50 0x7f6a601eb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.330+0000 7f6a6504e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a60151d80 0x7f6a601eb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.330+0000 7f6a6504e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a601535e0 con 0x7f6a600c5d50 2024-01-25T15:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.330+0000 7f6a6504e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a601ee2a0 con 0x7f6a60151d80 2024-01-25T15:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.330+0000 7f6a6504e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a60152cc0 con 0x7f6a6006b2b0 2024-01-25T15:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.330+0000 7f6a5e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a600c5d50 0x7f6a601eb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.330+0000 7f6a5e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a600c5d50 0x7f6a601eb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50172/0 (socket says 172.21.15.29:50172) 2024-01-25T15:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.330+0000 7f6a5e59c640 1 -- 172.21.15.29:0/1341733163 learned_addr learned my addr 172.21.15.29:0/1341733163 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.330+0000 7f6a5ed9d640 1 --2- 172.21.15.29:0/1341733163 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6a6006b2b0 0x7f6a601ed540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.330+0000 7f6a5f59e640 1 --2- 172.21.15.29:0/1341733163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a60151d80 0x7f6a601eb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.331+0000 7f6a5e59c640 1 -- 172.21.15.29:0/1341733163 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6a6006b2b0 msgr2=0x7f6a601ed540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.331+0000 7f6a5e59c640 1 --2- 172.21.15.29:0/1341733163 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6a6006b2b0 0x7f6a601ed540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:25.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.331+0000 7f6a5e59c640 1 -- 172.21.15.29:0/1341733163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a60151d80 msgr2=0x7f6a601eb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:25.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.331+0000 7f6a5e59c640 1 --2- 172.21.15.29:0/1341733163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a60151d80 0x7f6a601eb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:25.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.331+0000 7f6a5e59c640 1 -- 172.21.15.29:0/1341733163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a500094d0 con 0x7f6a600c5d50 2024-01-25T15:05:25.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.331+0000 7f6a5e59c640 1 --2- 172.21.15.29:0/1341733163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a600c5d50 0x7f6a601eb1d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400c820 tx=0x7f6a5400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:25.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.331+0000 7f6a477fe640 1 -- 172.21.15.29:0/1341733163 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54004230 con 0x7f6a600c5d50 2024-01-25T15:05:25.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.331+0000 7f6a477fe640 1 -- 172.21.15.29:0/1341733163 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a54004390 con 0x7f6a600c5d50 2024-01-25T15:05:25.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.331+0000 7f6a477fe640 1 -- 172.21.15.29:0/1341733163 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54007a70 con 0x7f6a600c5d50 2024-01-25T15:05:25.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.331+0000 7f6a6504e640 1 -- 172.21.15.29:0/1341733163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a60152f60 con 0x7f6a600c5d50 2024-01-25T15:05:25.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.331+0000 7f6a6504e640 1 -- 172.21.15.29:0/1341733163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a60153200 con 0x7f6a600c5d50 2024-01-25T15:05:25.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.332+0000 7f6a6504e640 1 -- 172.21.15.29:0/1341733163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a60067be0 con 0x7f6a600c5d50 2024-01-25T15:05:25.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.333+0000 7f6a477fe640 1 -- 172.21.15.29:0/1341733163 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6a54007bd0 con 0x7f6a600c5d50 2024-01-25T15:05:25.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.333+0000 7f6a477fe640 1 --2- 172.21.15.29:0/1341733163 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6a4c06aed0 0x7f6a4c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:25.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.334+0000 7f6a477fe640 1 -- 172.21.15.29:0/1341733163 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f6a54089860 con 0x7f6a600c5d50 2024-01-25T15:05:25.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.334+0000 7f6a5ed9d640 1 --2- 172.21.15.29:0/1341733163 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6a4c06aed0 0x7f6a4c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:25.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.334+0000 7f6a5ed9d640 1 --2- 172.21.15.29:0/1341733163 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6a4c06aed0 0x7f6a4c06d390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6a50036000 tx=0x7f6a5003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:25.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.337+0000 7f6a477fe640 1 -- 172.21.15.29:0/1341733163 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6a54054940 con 0x7f6a600c5d50 2024-01-25T15:05:25.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:25.518+0000 7f6a6504e640 1 -- 172.21.15.29:0/1341733163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6a60074010 con 0x7f6a600c5d50 2024-01-25T15:05:26.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.203+0000 7f6a477fe640 1 -- 172.21.15.29:0/1341733163 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6a5401e0d0 con 0x7f6a600c5d50 2024-01-25T15:05:26.204 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' created 2024-01-25T15:05:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.206+0000 7f6a6504e640 1 -- 172.21.15.29:0/1341733163 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6a4c06aed0 msgr2=0x7f6a4c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.206+0000 7f6a6504e640 1 --2- 172.21.15.29:0/1341733163 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6a4c06aed0 0x7f6a4c06d390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6a50036000 tx=0x7f6a5003d040 comp rx=0 tx=0).stop 2024-01-25T15:05:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.206+0000 7f6a6504e640 1 -- 172.21.15.29:0/1341733163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a600c5d50 msgr2=0x7f6a601eb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.206+0000 7f6a6504e640 1 --2- 172.21.15.29:0/1341733163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a600c5d50 0x7f6a601eb1d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400c820 tx=0x7f6a5400cce0 comp rx=0 tx=0).stop 2024-01-25T15:05:26.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.207+0000 7f6a6504e640 1 -- 172.21.15.29:0/1341733163 shutdown_connections 2024-01-25T15:05:26.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.207+0000 7f6a6504e640 1 --2- 172.21.15.29:0/1341733163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a60151d80 0x7f6a601eb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:26.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.207+0000 7f6a6504e640 1 --2- 172.21.15.29:0/1341733163 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6a4c06aed0 0x7f6a4c06d390 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:26.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.207+0000 7f6a6504e640 1 --2- 172.21.15.29:0/1341733163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a600c5d50 0x7f6a601eb1d0 secure :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400c820 tx=0x7f6a5400cce0 comp rx=0 tx=0).stop 2024-01-25T15:05:26.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.207+0000 7f6a6504e640 1 --2- 172.21.15.29:0/1341733163 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6a6006b2b0 0x7f6a601ed540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:26.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.207+0000 7f6a6504e640 1 -- 172.21.15.29:0/1341733163 >> 172.21.15.29:0/1341733163 conn(0x7f6a600ca1f0 msgr2=0x7f6a600ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:26.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.208+0000 7f6a6504e640 1 -- 172.21.15.29:0/1341733163 shutdown_connections 2024-01-25T15:05:26.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.208+0000 7f6a6504e640 1 -- 172.21.15.29:0/1341733163 wait complete. 2024-01-25T15:05:26.236 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-25T15:05:26.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.344+0000 7f52b4cd5640 1 Processor -- start 2024-01-25T15:05:26.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.345+0000 7f52b4cd5640 1 -- start start 2024-01-25T15:05:26.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.345+0000 7f52b4cd5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f52b006d560 0x7f52b006b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:26.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.345+0000 7f52b4cd5640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b00afaa0 con 0x7f52b00af6c0 2024-01-25T15:05:26.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.345+0000 7f52b4cd5640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b00c6060 con 0x7f52b00c4fe0 2024-01-25T15:05:26.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.345+0000 7f52b4cd5640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52b006c480 con 0x7f52b006d560 2024-01-25T15:05:26.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.345+0000 7f52a7fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f52b006d560 0x7f52b006b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:26.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.345+0000 7f52ae59c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f52b00af6c0 0x7f52b00c5530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35004/0 (socket says 172.21.15.29:35004) 2024-01-25T15:05:26.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.345+0000 7f52ae59c640 1 -- 172.21.15.29:0/834033452 learned_addr learned my addr 172.21.15.29:0/834033452 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:26.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.346+0000 7f52a7fff640 1 -- 172.21.15.29:0/834033452 >> v1:172.21.15.52:6789/0 conn(0x7f52b00c4fe0 legacy=0x7f52b006b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:26.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.346+0000 7f52a7fff640 1 -- 172.21.15.29:0/834033452 >> v1:172.21.15.29:6789/0 conn(0x7f52b00af6c0 legacy=0x7f52b00c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:26.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.346+0000 7f52a7fff640 1 -- 172.21.15.29:0/834033452 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b0155480 con 0x7f52b006d560 2024-01-25T15:05:26.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.346+0000 7f52add9b640 1 -- 172.21.15.29:0/834033452 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148825218 0 0) 0x7f52b00afaa0 con 0x7f52b00af6c0 2024-01-25T15:05:26.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.346+0000 7f52a7fff640 1 --2- 172.21.15.29:0/834033452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52b006d560 0x7f52b006b220 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f52980097a0 tx=0x7f529802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e07e6c3095ebcfee server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:26.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.347+0000 7f52add9b640 1 -- 172.21.15.29:0/834033452 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5298031830 con 0x7f52b006d560 2024-01-25T15:05:26.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.347+0000 7f52add9b640 1 -- 172.21.15.29:0/834033452 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5298031990 con 0x7f52b006d560 2024-01-25T15:05:26.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.347+0000 7f52add9b640 1 -- 172.21.15.29:0/834033452 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5298031d20 con 0x7f52b006d560 2024-01-25T15:05:26.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.347+0000 7f52b4cd5640 1 -- 172.21.15.29:0/834033452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52b006d560 msgr2=0x7f52b006b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:26.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.347+0000 7f52b4cd5640 1 --2- 172.21.15.29:0/834033452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52b006d560 0x7f52b006b220 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f52980097a0 tx=0x7f529802b8d0 comp rx=0 tx=0).stop 2024-01-25T15:05:26.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.347+0000 7f52b4cd5640 1 -- 172.21.15.29:0/834033452 shutdown_connections 2024-01-25T15:05:26.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.347+0000 7f52b4cd5640 1 --2- 172.21.15.29:0/834033452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52b006d560 0x7f52b006b220 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:26.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.347+0000 7f52b4cd5640 1 -- 172.21.15.29:0/834033452 >> 172.21.15.29:0/834033452 conn(0x7f52b00c6ca0 msgr2=0x7f52b00c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:26.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.347+0000 7f52b4cd5640 1 -- 172.21.15.29:0/834033452 shutdown_connections 2024-01-25T15:05:26.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.347+0000 7f52b4cd5640 1 -- 172.21.15.29:0/834033452 wait complete. 2024-01-25T15:05:26.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.348+0000 7f52b4cd5640 1 Processor -- start 2024-01-25T15:05:26.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.348+0000 7f52b4cd5640 1 -- start start 2024-01-25T15:05:26.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.349+0000 7f52b4cd5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52b006d560 0x7f52b01ddde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:26.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.349+0000 7f52b4cd5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52b00af6c0 0x7f52b01f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:26.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.349+0000 7f52b4cd5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52b00c4fe0 0x7f52b0157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:26.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.349+0000 7f52b4cd5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b01584d0 con 0x7f52b00af6c0 2024-01-25T15:05:26.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.349+0000 7f52b4cd5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b00c3c50 con 0x7f52b006d560 2024-01-25T15:05:26.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.349+0000 7f52b4cd5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b01565b0 con 0x7f52b00c4fe0 2024-01-25T15:05:26.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.349+0000 7f52a7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52b00af6c0 0x7f52b01f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:26.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.349+0000 7f52a7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52b00af6c0 0x7f52b01f1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33262/0 (socket says 172.21.15.29:33262) 2024-01-25T15:05:26.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.349+0000 7f52a7fff640 1 -- 172.21.15.29:0/3573074692 learned_addr learned my addr 172.21.15.29:0/3573074692 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:26.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.349+0000 7f52aed9d640 1 --2- 172.21.15.29:0/3573074692 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52b00c4fe0 0x7f52b0157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:26.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.350+0000 7f52ae59c640 1 --2- 172.21.15.29:0/3573074692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52b006d560 0x7f52b01ddde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:26.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.350+0000 7f52a7fff640 1 -- 172.21.15.29:0/3573074692 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52b00c4fe0 msgr2=0x7f52b0157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:26.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.350+0000 7f52a7fff640 1 --2- 172.21.15.29:0/3573074692 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52b00c4fe0 0x7f52b0157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:26.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.350+0000 7f52a7fff640 1 -- 172.21.15.29:0/3573074692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52b006d560 msgr2=0x7f52b01ddde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:26.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.350+0000 7f52a7fff640 1 --2- 172.21.15.29:0/3573074692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52b006d560 0x7f52b01ddde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:26.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.350+0000 7f52a7fff640 1 -- 172.21.15.29:0/3573074692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5298009400 con 0x7f52b00af6c0 2024-01-25T15:05:26.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.350+0000 7f52aed9d640 1 --2- 172.21.15.29:0/3573074692 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52b00c4fe0 0x7f52b0157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:26.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.350+0000 7f52ae59c640 1 --2- 172.21.15.29:0/3573074692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52b006d560 0x7f52b01ddde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:26.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.350+0000 7f52a7fff640 1 --2- 172.21.15.29:0/3573074692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52b00af6c0 0x7f52b01f1ef0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f52980098c0 tx=0x7f52980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:26.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.350+0000 7f52a6ffd640 1 -- 172.21.15.29:0/3573074692 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529803ba70 con 0x7f52b00af6c0 2024-01-25T15:05:26.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.350+0000 7f52a6ffd640 1 -- 172.21.15.29:0/3573074692 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529803bbd0 con 0x7f52b00af6c0 2024-01-25T15:05:26.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.350+0000 7f52b4cd5640 1 -- 172.21.15.29:0/3573074692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b01f2730 con 0x7f52b00af6c0 2024-01-25T15:05:26.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.350+0000 7f52a6ffd640 1 -- 172.21.15.29:0/3573074692 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52980453f0 con 0x7f52b00af6c0 2024-01-25T15:05:26.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.350+0000 7f52b4cd5640 1 -- 172.21.15.29:0/3573074692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b0156830 con 0x7f52b00af6c0 2024-01-25T15:05:26.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.351+0000 7f52b4cd5640 1 -- 172.21.15.29:0/3573074692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b0074010 con 0x7f52b00af6c0 2024-01-25T15:05:26.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.351+0000 7f52a6ffd640 1 -- 172.21.15.29:0/3573074692 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f5298045550 con 0x7f52b00af6c0 2024-01-25T15:05:26.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.352+0000 7f52a6ffd640 1 --2- 172.21.15.29:0/3573074692 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f529006aed0 0x7f529006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:26.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.352+0000 7f52a6ffd640 1 -- 172.21.15.29:0/3573074692 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f52980ab9f0 con 0x7f52b00af6c0 2024-01-25T15:05:26.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.352+0000 7f52ae59c640 1 --2- 172.21.15.29:0/3573074692 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f529006aed0 0x7f529006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:26.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.353+0000 7f52ae59c640 1 --2- 172.21.15.29:0/3573074692 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f529006aed0 0x7f529006d390 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f52a0000f60 tx=0x7f52a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:26.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.356+0000 7f52a6ffd640 1 -- 172.21.15.29:0/3573074692 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f52980767e0 con 0x7f52b00af6c0 2024-01-25T15:05:26.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:26.575+0000 7f52b4cd5640 1 -- 172.21.15.29:0/3573074692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f52b0154570 con 0x7f52b00af6c0 2024-01-25T15:05:27.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.213+0000 7f52a6ffd640 1 -- 172.21.15.29:0/3573074692 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5298079e00 con 0x7f52b00af6c0 2024-01-25T15:05:27.214 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 5 and data pool 6 2024-01-25T15:05:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.218+0000 7f52b4cd5640 1 -- 172.21.15.29:0/3573074692 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f529006aed0 msgr2=0x7f529006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.218+0000 7f52b4cd5640 1 --2- 172.21.15.29:0/3573074692 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f529006aed0 0x7f529006d390 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f52a0000f60 tx=0x7f52a0009040 comp rx=0 tx=0).stop 2024-01-25T15:05:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.218+0000 7f52b4cd5640 1 -- 172.21.15.29:0/3573074692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52b00af6c0 msgr2=0x7f52b01f1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.218+0000 7f52b4cd5640 1 --2- 172.21.15.29:0/3573074692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52b00af6c0 0x7f52b01f1ef0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f52980098c0 tx=0x7f52980046c0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.223+0000 7f52b4cd5640 1 -- 172.21.15.29:0/3573074692 shutdown_connections 2024-01-25T15:05:27.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.223+0000 7f52b4cd5640 1 --2- 172.21.15.29:0/3573074692 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52b00c4fe0 0x7f52b0157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.223+0000 7f52b4cd5640 1 --2- 172.21.15.29:0/3573074692 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f529006aed0 0x7f529006d390 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.223+0000 7f52b4cd5640 1 --2- 172.21.15.29:0/3573074692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52b00af6c0 0x7f52b01f1ef0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.223+0000 7f52b4cd5640 1 --2- 172.21.15.29:0/3573074692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52b006d560 0x7f52b01ddde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.223+0000 7f52b4cd5640 1 -- 172.21.15.29:0/3573074692 >> 172.21.15.29:0/3573074692 conn(0x7f52b00c6ca0 msgr2=0x7f52b01e0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:27.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.224+0000 7f52b4cd5640 1 -- 172.21.15.29:0/3573074692 shutdown_connections 2024-01-25T15:05:27.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.224+0000 7f52b4cd5640 1 -- 172.21.15.29:0/3573074692 wait complete. 2024-01-25T15:05:27.247 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:27.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.349+0000 7fdabea23640 1 Processor -- start 2024-01-25T15:05:27.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.349+0000 7fdabea23640 1 -- start start 2024-01-25T15:05:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.350+0000 7fdabea23640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdab8152160 0x7fdab806bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.350+0000 7fdabea23640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdab80c7f10 0x7fdab80c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.350+0000 7fdabea23640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab8155430 con 0x7fdab80c4990 2024-01-25T15:05:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.350+0000 7fdabea23640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab8154b40 con 0x7fdab8152160 2024-01-25T15:05:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.350+0000 7fdabea23640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab8152540 con 0x7fdab80c7f10 2024-01-25T15:05:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.350+0000 7fdab7fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdab8152160 0x7fdab806bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.350+0000 7fdab7fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdab8152160 0x7fdab806bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33278/0 (socket says 172.21.15.29:33278) 2024-01-25T15:05:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.350+0000 7fdab7fff640 1 -- 172.21.15.29:0/370614177 learned_addr learned my addr 172.21.15.29:0/370614177 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.351+0000 7fdab7fff640 1 -- 172.21.15.29:0/370614177 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdab80c7f10 msgr2=0x7fdab80c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.351+0000 7fdabcfc0640 1 --2- 172.21.15.29:0/370614177 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdab80c7f10 0x7fdab80c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:27.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.351+0000 7fdab7fff640 1 --2- 172.21.15.29:0/370614177 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdab80c7f10 0x7fdab80c83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.351+0000 7fdab7fff640 1 -- 172.21.15.29:0/370614177 >> v1:172.21.15.52:6789/0 conn(0x7fdab80c4990 legacy=0x7fdab80c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:27.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.351+0000 7fdab7fff640 1 -- 172.21.15.29:0/370614177 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab80c64b0 con 0x7fdab8152160 2024-01-25T15:05:27.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.351+0000 7fdab7fff640 1 --2- 172.21.15.29:0/370614177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdab8152160 0x7fdab806bc00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8009870 tx=0x7fdaa802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ae7b14376d2579 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:27.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.351+0000 7fdab6ffd640 1 -- 172.21.15.29:0/370614177 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa80317c0 con 0x7fdab8152160 2024-01-25T15:05:27.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.352+0000 7fdab6ffd640 1 -- 172.21.15.29:0/370614177 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa8031920 con 0x7fdab8152160 2024-01-25T15:05:27.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.352+0000 7fdab6ffd640 1 -- 172.21.15.29:0/370614177 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8031cb0 con 0x7fdab8152160 2024-01-25T15:05:27.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.352+0000 7fdabea23640 1 -- 172.21.15.29:0/370614177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdab8152160 msgr2=0x7fdab806bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:27.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.352+0000 7fdabea23640 1 --2- 172.21.15.29:0/370614177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdab8152160 0x7fdab806bc00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8009870 tx=0x7fdaa802b860 comp rx=0 tx=0).stop 2024-01-25T15:05:27.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.352+0000 7fdabea23640 1 -- 172.21.15.29:0/370614177 shutdown_connections 2024-01-25T15:05:27.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.352+0000 7fdabea23640 1 --2- 172.21.15.29:0/370614177 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdab80c7f10 0x7fdab80c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.352+0000 7fdabea23640 1 --2- 172.21.15.29:0/370614177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdab8152160 0x7fdab806bc00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.352+0000 7fdabea23640 1 -- 172.21.15.29:0/370614177 >> 172.21.15.29:0/370614177 conn(0x7fdab80ca1f0 msgr2=0x7fdab80ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:27.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.352+0000 7fdabea23640 1 -- 172.21.15.29:0/370614177 shutdown_connections 2024-01-25T15:05:27.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.352+0000 7fdabea23640 1 -- 172.21.15.29:0/370614177 wait complete. 2024-01-25T15:05:27.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.353+0000 7fdabea23640 1 Processor -- start 2024-01-25T15:05:27.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.353+0000 7fdabea23640 1 -- start start 2024-01-25T15:05:27.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.354+0000 7fdabea23640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdab80c4990 0x7fdab814d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:27.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.354+0000 7fdabea23640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdab80c7f10 0x7fdab8148650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:27.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.354+0000 7fdabea23640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdab8152160 0x7fdab81ee330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:27.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.354+0000 7fdabea23640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab814f430 con 0x7fdab8152160 2024-01-25T15:05:27.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.354+0000 7fdabea23640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab814d040 con 0x7fdab80c4990 2024-01-25T15:05:27.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.354+0000 7fdabea23640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab81eef60 con 0x7fdab80c7f10 2024-01-25T15:05:27.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.354+0000 7fdabcfc0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdab8152160 0x7fdab81ee330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:27.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.354+0000 7fdabcfc0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdab8152160 0x7fdab81ee330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33288/0 (socket says 172.21.15.29:33288) 2024-01-25T15:05:27.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.354+0000 7fdabcfc0640 1 -- 172.21.15.29:0/93753910 learned_addr learned my addr 172.21.15.29:0/93753910 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:27.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.354+0000 7fdab7fff640 1 --2- 172.21.15.29:0/93753910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdab80c4990 0x7fdab814d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:27.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.354+0000 7fdab77fe640 1 --2- 172.21.15.29:0/93753910 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdab80c7f10 0x7fdab8148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:27.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.355+0000 7fdabcfc0640 1 -- 172.21.15.29:0/93753910 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdab80c7f10 msgr2=0x7fdab8148650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:27.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.355+0000 7fdabcfc0640 1 --2- 172.21.15.29:0/93753910 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdab80c7f10 0x7fdab8148650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.355+0000 7fdabcfc0640 1 -- 172.21.15.29:0/93753910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdab80c4990 msgr2=0x7fdab814d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:27.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.355+0000 7fdabcfc0640 1 --2- 172.21.15.29:0/93753910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdab80c4990 0x7fdab814d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.355+0000 7fdabcfc0640 1 -- 172.21.15.29:0/93753910 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa80094d0 con 0x7fdab8152160 2024-01-25T15:05:27.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.355+0000 7fdabcfc0640 1 --2- 172.21.15.29:0/93753910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdab8152160 0x7fdab81ee330 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdab000cd70 tx=0x7fdab000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:27.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.355+0000 7fdab4ff9640 1 -- 172.21.15.29:0/93753910 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab0003b90 con 0x7fdab8152160 2024-01-25T15:05:27.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.355+0000 7fdab4ff9640 1 -- 172.21.15.29:0/93753910 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab0003cf0 con 0x7fdab8152160 2024-01-25T15:05:27.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.355+0000 7fdabea23640 1 -- 172.21.15.29:0/93753910 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab814ee70 con 0x7fdab8152160 2024-01-25T15:05:27.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.355+0000 7fdab4ff9640 1 -- 172.21.15.29:0/93753910 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab0004240 con 0x7fdab8152160 2024-01-25T15:05:27.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.355+0000 7fdabea23640 1 -- 172.21.15.29:0/93753910 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab80c0940 con 0x7fdab8152160 2024-01-25T15:05:27.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.356+0000 7fdabea23640 1 -- 172.21.15.29:0/93753910 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab814d1f0 con 0x7fdab8152160 2024-01-25T15:05:27.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.356+0000 7fdab4ff9640 1 -- 172.21.15.29:0/93753910 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fdab00043a0 con 0x7fdab8152160 2024-01-25T15:05:27.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.357+0000 7fdab4ff9640 1 --2- 172.21.15.29:0/93753910 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdaa406aed0 0x7fdaa406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:27.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.357+0000 7fdab4ff9640 1 -- 172.21.15.29:0/93753910 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdab0012070 con 0x7fdab8152160 2024-01-25T15:05:27.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.357+0000 7fdab7fff640 1 --2- 172.21.15.29:0/93753910 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdaa406aed0 0x7fdaa406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:27.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.357+0000 7fdab7fff640 1 --2- 172.21.15.29:0/93753910 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdaa406aed0 0x7fdaa406d390 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8036000 tx=0x7fdaa803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:27.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.361+0000 7fdab4ff9640 1 -- 172.21.15.29:0/93753910 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fdab814d1f0 con 0x7fdab8152160 2024-01-25T15:05:27.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.542+0000 7fdabea23640 1 -- 172.21.15.29:0/93753910 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdab80a97d0 con 0x7fdab8152160 2024-01-25T15:05:27.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.543+0000 7fdab4ff9640 1 -- 172.21.15.29:0/93753910 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16752 (secure 0 0 0) 0x7fdab0054f10 con 0x7fdab8152160 2024-01-25T15:05:27.544 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:27.544 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":37,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:05:26.577006+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:05:25.099043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-25T15:05:25.537967+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:27.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.545+0000 7fdabea23640 1 -- 172.21.15.29:0/93753910 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdaa406aed0 msgr2=0x7fdaa406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:27.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.545+0000 7fdabea23640 1 --2- 172.21.15.29:0/93753910 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdaa406aed0 0x7fdaa406d390 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8036000 tx=0x7fdaa803d040 comp rx=0 tx=0).stop 2024-01-25T15:05:27.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.545+0000 7fdabea23640 1 -- 172.21.15.29:0/93753910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdab8152160 msgr2=0x7fdab81ee330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:27.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.545+0000 7fdabea23640 1 --2- 172.21.15.29:0/93753910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdab8152160 0x7fdab81ee330 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdab000cd70 tx=0x7fdab000a660 comp rx=0 tx=0).stop 2024-01-25T15:05:27.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.545+0000 7fdabea23640 1 -- 172.21.15.29:0/93753910 shutdown_connections 2024-01-25T15:05:27.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.545+0000 7fdabea23640 1 --2- 172.21.15.29:0/93753910 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdaa406aed0 0x7fdaa406d390 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.545+0000 7fdabea23640 1 --2- 172.21.15.29:0/93753910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdab8152160 0x7fdab81ee330 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.545+0000 7fdabea23640 1 --2- 172.21.15.29:0/93753910 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdab80c7f10 0x7fdab8148650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.545+0000 7fdabea23640 1 --2- 172.21.15.29:0/93753910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdab80c4990 0x7fdab814d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.545+0000 7fdabea23640 1 -- 172.21.15.29:0/93753910 >> 172.21.15.29:0/93753910 conn(0x7fdab80ca1f0 msgr2=0x7fdab80ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:27.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.545+0000 7fdabea23640 1 -- 172.21.15.29:0/93753910 shutdown_connections 2024-01-25T15:05:27.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.545+0000 7fdabea23640 1 -- 172.21.15.29:0/93753910 wait complete. 2024-01-25T15:05:27.557 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.657+0000 7fe121773640 1 Processor -- start 2024-01-25T15:05:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.658+0000 7fe121773640 1 -- start start 2024-01-25T15:05:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.658+0000 7fe121773640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe11c0c4990 0x7fe11c06bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.658+0000 7fe121773640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c155430 con 0x7fe11c0c7f10 2024-01-25T15:05:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.658+0000 7fe121773640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c154b40 con 0x7fe11c152160 2024-01-25T15:05:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.658+0000 7fe121773640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c152540 con 0x7fe11c0c4990 2024-01-25T15:05:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.658+0000 7fe11b7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe11c0c7f10 0x7fe11c15f3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35006/0 (socket says 172.21.15.29:35006) 2024-01-25T15:05:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.658+0000 7fe11b7fe640 1 -- 172.21.15.29:0/929004288 learned_addr learned my addr 172.21.15.29:0/929004288 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe119ffb640 1 -- 172.21.15.29:0/929004288 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765203237 0 0) 0x7fe11c155430 con 0x7fe11c0c7f10 2024-01-25T15:05:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe11a7fc640 1 --2- 172.21.15.29:0/929004288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe11c0c4990 0x7fe11c06bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe119ffb640 1 -- 172.21.15.29:0/929004288 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe108003520 con 0x7fe11c0c7f10 2024-01-25T15:05:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe119ffb640 1 -- 172.21.15.29:0/929004288 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 728312416 0 0) 0x7fe108003520 con 0x7fe11c0c7f10 2024-01-25T15:05:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe119ffb640 1 -- 172.21.15.29:0/929004288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe11c0c4990 msgr2=0x7fe11c06bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:27.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe119ffb640 1 --2- 172.21.15.29:0/929004288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe11c0c4990 0x7fe11c06bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe119ffb640 1 -- 172.21.15.29:0/929004288 >> v1:172.21.15.52:6789/0 conn(0x7fe11c152160 legacy=0x7fe11c0c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe119ffb640 1 -- 172.21.15.29:0/929004288 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c0c64b0 con 0x7fe11c0c7f10 2024-01-25T15:05:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe119ffb640 1 -- 172.21.15.29:0/929004288 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7fe10c0019f0 con 0x7fe11c0c7f10 2024-01-25T15:05:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe119ffb640 1 -- 172.21.15.29:0/929004288 >> v1:172.21.15.29:6789/0 conn(0x7fe11c0c7f10 legacy=0x7fe11c15f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe119ffb640 1 --2- 172.21.15.29:0/929004288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1080039a0 0x7fe108003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe119ffb640 1 --2- 172.21.15.29:0/929004288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1080047c0 0x7fe108004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe119ffb640 1 --2- 172.21.15.29:0/929004288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe11c0c4990 0x7fe1080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe119ffb640 1 -- 172.21.15.29:0/929004288 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c152540 con 0x7fe1080047c0 2024-01-25T15:05:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe119ffb640 1 -- 172.21.15.29:0/929004288 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10800bab0 con 0x7fe1080039a0 2024-01-25T15:05:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe119ffb640 1 -- 172.21.15.29:0/929004288 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10800bc70 con 0x7fe11c0c4990 2024-01-25T15:05:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe11a7fc640 1 --2- 172.21.15.29:0/929004288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1080047c0 0x7fe108004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe11affd640 1 --2- 172.21.15.29:0/929004288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1080039a0 0x7fe108003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe11b7fe640 1 --2- 172.21.15.29:0/929004288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe11c0c4990 0x7fe1080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe11a7fc640 1 -- 172.21.15.29:0/929004288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe11c0c4990 msgr2=0x7fe1080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe11a7fc640 1 --2- 172.21.15.29:0/929004288 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe11c0c4990 0x7fe1080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe11a7fc640 1 -- 172.21.15.29:0/929004288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1080039a0 msgr2=0x7fe108003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:27.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe11a7fc640 1 --2- 172.21.15.29:0/929004288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1080039a0 0x7fe108003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe11a7fc640 1 -- 172.21.15.29:0/929004288 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe108003520 con 0x7fe1080047c0 2024-01-25T15:05:27.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.659+0000 7fe11affd640 1 --2- 172.21.15.29:0/929004288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1080039a0 0x7fe108003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:27.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.660+0000 7fe11a7fc640 1 --2- 172.21.15.29:0/929004288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1080047c0 0x7fe108004c40 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe104009a90 tx=0x7fe1080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d9d950d730be9f server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:27.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.660+0000 7fe119ffb640 1 -- 172.21.15.29:0/929004288 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10402c680 con 0x7fe1080047c0 2024-01-25T15:05:27.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.660+0000 7fe119ffb640 1 -- 172.21.15.29:0/929004288 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10402c7e0 con 0x7fe1080047c0 2024-01-25T15:05:27.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.660+0000 7fe119ffb640 1 -- 172.21.15.29:0/929004288 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10402cb70 con 0x7fe1080047c0 2024-01-25T15:05:27.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.661+0000 7fe121773640 1 -- 172.21.15.29:0/929004288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1080047c0 msgr2=0x7fe108004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:27.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.661+0000 7fe121773640 1 --2- 172.21.15.29:0/929004288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1080047c0 0x7fe108004c40 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe104009a90 tx=0x7fe1080057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.661+0000 7fe11b7fe640 1 -- 172.21.15.29:0/929004288 reap_dead start 2024-01-25T15:05:27.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.661+0000 7fe121773640 1 -- 172.21.15.29:0/929004288 shutdown_connections 2024-01-25T15:05:27.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.661+0000 7fe121773640 1 -- 172.21.15.29:0/929004288 >> 172.21.15.29:0/929004288 conn(0x7fe11c0ca1f0 msgr2=0x7fe11c0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:27.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.661+0000 7fe121773640 1 -- 172.21.15.29:0/929004288 shutdown_connections 2024-01-25T15:05:27.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.661+0000 7fe121773640 1 -- 172.21.15.29:0/929004288 wait complete. 2024-01-25T15:05:27.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.662+0000 7fe121773640 1 Processor -- start 2024-01-25T15:05:27.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.662+0000 7fe121773640 1 -- start start 2024-01-25T15:05:27.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.663+0000 7fe121773640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1080047c0 0x7fe11c1ee120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:27.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.663+0000 7fe121773640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe11c1ee660 0x7fe11c14cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:27.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.663+0000 7fe121773640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe11c157490 0x7fe11c14d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:27.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.663+0000 7fe121773640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c14f050 con 0x7fe1080047c0 2024-01-25T15:05:27.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.663+0000 7fe121773640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c157000 con 0x7fe11c157490 2024-01-25T15:05:27.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.663+0000 7fe121773640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c1eedf0 con 0x7fe11c1ee660 2024-01-25T15:05:27.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.663+0000 7fe11affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1080047c0 0x7fe11c1ee120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:27.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.663+0000 7fe11affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1080047c0 0x7fe11c1ee120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33304/0 (socket says 172.21.15.29:33304) 2024-01-25T15:05:27.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.663+0000 7fe11affd640 1 -- 172.21.15.29:0/44512200 learned_addr learned my addr 172.21.15.29:0/44512200 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:27.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.663+0000 7fe11a7fc640 1 --2- 172.21.15.29:0/44512200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe11c1ee660 0x7fe11c14cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:27.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.663+0000 7fe11b7fe640 1 --2- 172.21.15.29:0/44512200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe11c157490 0x7fe11c14d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:27.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.663+0000 7fe11affd640 1 -- 172.21.15.29:0/44512200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe11c1ee660 msgr2=0x7fe11c14cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:27.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.663+0000 7fe11affd640 1 --2- 172.21.15.29:0/44512200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe11c1ee660 0x7fe11c14cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.663+0000 7fe11affd640 1 -- 172.21.15.29:0/44512200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe11c157490 msgr2=0x7fe11c14d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:27.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.663+0000 7fe11affd640 1 --2- 172.21.15.29:0/44512200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe11c157490 0x7fe11c14d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.663+0000 7fe11affd640 1 -- 172.21.15.29:0/44512200 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c1eeb10 con 0x7fe1080047c0 2024-01-25T15:05:27.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.663+0000 7fe11b7fe640 1 --2- 172.21.15.29:0/44512200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe11c157490 0x7fe11c14d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:27.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.663+0000 7fe11affd640 1 --2- 172.21.15.29:0/44512200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1080047c0 0x7fe11c1ee120 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe11400e660 tx=0x7fe11400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:27.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.664+0000 7fe1137fe640 1 -- 172.21.15.29:0/44512200 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1140050d0 con 0x7fe1080047c0 2024-01-25T15:05:27.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.664+0000 7fe1137fe640 1 -- 172.21.15.29:0/44512200 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe114005230 con 0x7fe1080047c0 2024-01-25T15:05:27.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.664+0000 7fe121773640 1 -- 172.21.15.29:0/44512200 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11c1569b0 con 0x7fe1080047c0 2024-01-25T15:05:27.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.664+0000 7fe1137fe640 1 -- 172.21.15.29:0/44512200 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11400c6c0 con 0x7fe1080047c0 2024-01-25T15:05:27.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.664+0000 7fe121773640 1 -- 172.21.15.29:0/44512200 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c1579e0 con 0x7fe1080047c0 2024-01-25T15:05:27.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.665+0000 7fe121773640 1 -- 172.21.15.29:0/44512200 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11c1558c0 con 0x7fe1080047c0 2024-01-25T15:05:27.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.665+0000 7fe1137fe640 1 -- 172.21.15.29:0/44512200 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fe11400c820 con 0x7fe1080047c0 2024-01-25T15:05:27.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.665+0000 7fe1137fe640 1 --2- 172.21.15.29:0/44512200 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe0fc06aed0 0x7fe0fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:27.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.665+0000 7fe1137fe640 1 -- 172.21.15.29:0/44512200 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe114089560 con 0x7fe1080047c0 2024-01-25T15:05:27.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.666+0000 7fe11a7fc640 1 --2- 172.21.15.29:0/44512200 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe0fc06aed0 0x7fe0fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:27.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.666+0000 7fe11a7fc640 1 --2- 172.21.15.29:0/44512200 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe0fc06aed0 0x7fe0fc06d390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe104036000 tx=0x7fe104030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:27.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.670+0000 7fe1137fe640 1 -- 172.21.15.29:0/44512200 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fe1140542e0 con 0x7fe1080047c0 2024-01-25T15:05:27.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.851+0000 7fe121773640 1 -- 172.21.15.29:0/44512200 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe11c0a97d0 con 0x7fe1080047c0 2024-01-25T15:05:27.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.852+0000 7fe1137fe640 1 -- 172.21.15.29:0/44512200 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16752 (secure 0 0 0) 0x7fe114057900 con 0x7fe1080047c0 2024-01-25T15:05:27.852 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:27.853 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":37,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:05:26.577006+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:05:25.099043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-25T15:05:25.537967+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:27.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.853+0000 7fe121773640 1 -- 172.21.15.29:0/44512200 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe0fc06aed0 msgr2=0x7fe0fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:27.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.853+0000 7fe121773640 1 --2- 172.21.15.29:0/44512200 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe0fc06aed0 0x7fe0fc06d390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe104036000 tx=0x7fe104030000 comp rx=0 tx=0).stop 2024-01-25T15:05:27.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.853+0000 7fe121773640 1 -- 172.21.15.29:0/44512200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1080047c0 msgr2=0x7fe11c1ee120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:27.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.853+0000 7fe121773640 1 --2- 172.21.15.29:0/44512200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1080047c0 0x7fe11c1ee120 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe11400e660 tx=0x7fe11400eb20 comp rx=0 tx=0).stop 2024-01-25T15:05:27.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.854+0000 7fe121773640 1 -- 172.21.15.29:0/44512200 shutdown_connections 2024-01-25T15:05:27.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.854+0000 7fe121773640 1 --2- 172.21.15.29:0/44512200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe11c157490 0x7fe11c14d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.854+0000 7fe121773640 1 --2- 172.21.15.29:0/44512200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe11c1ee660 0x7fe11c14cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.854+0000 7fe121773640 1 --2- 172.21.15.29:0/44512200 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe0fc06aed0 0x7fe0fc06d390 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.854+0000 7fe121773640 1 --2- 172.21.15.29:0/44512200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1080047c0 0x7fe11c1ee120 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.854+0000 7fe121773640 1 -- 172.21.15.29:0/44512200 >> 172.21.15.29:0/44512200 conn(0x7fe11c0ca1f0 msgr2=0x7fe11c1543b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:27.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.854+0000 7fe121773640 1 -- 172.21.15.29:0/44512200 shutdown_connections 2024-01-25T15:05:27.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.854+0000 7fe121773640 1 -- 172.21.15.29:0/44512200 wait complete. 2024-01-25T15:05:27.865 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-25T15:05:27.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.969+0000 7effda5de640 1 Processor -- start 2024-01-25T15:05:27.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.969+0000 7effda5de640 1 -- start start 2024-01-25T15:05:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.970+0000 7effda5de640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7effd40af6c0 0x7effd40c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.970+0000 7effda5de640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effd406d560 0x7effd406b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.970+0000 7effda5de640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd40afaa0 con 0x7effd40c5a70 2024-01-25T15:05:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.970+0000 7effda5de640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd406c480 con 0x7effd40af6c0 2024-01-25T15:05:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.970+0000 7effda5de640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd4155290 con 0x7effd406d560 2024-01-25T15:05:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.970+0000 7effd3fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7effd40af6c0 0x7effd40c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.970+0000 7effd3fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7effd40af6c0 0x7effd40c5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33308/0 (socket says 172.21.15.29:33308) 2024-01-25T15:05:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.970+0000 7effd3fff640 1 -- 172.21.15.29:0/4081654125 learned_addr learned my addr 172.21.15.29:0/4081654125 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.970+0000 7effd37fe640 1 --2- 172.21.15.29:0/4081654125 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effd406d560 0x7effd406b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.970+0000 7effd3fff640 1 -- 172.21.15.29:0/4081654125 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effd406d560 msgr2=0x7effd406b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.970+0000 7effd3fff640 1 --2- 172.21.15.29:0/4081654125 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effd406d560 0x7effd406b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.970+0000 7effd3fff640 1 -- 172.21.15.29:0/4081654125 >> v1:172.21.15.52:6789/0 conn(0x7effd40c5a70 legacy=0x7effd406b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:27.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.970+0000 7effd3fff640 1 -- 172.21.15.29:0/4081654125 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd40c6060 con 0x7effd40af6c0 2024-01-25T15:05:27.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.971+0000 7effd3fff640 1 --2- 172.21.15.29:0/4081654125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effd40af6c0 0x7effd40c5530 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7effc4009870 tx=0x7effc402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b0e4b4282ce1d8 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:27.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.971+0000 7effd2ffd640 1 -- 172.21.15.29:0/4081654125 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4030840 con 0x7effd40af6c0 2024-01-25T15:05:27.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.971+0000 7effd2ffd640 1 -- 172.21.15.29:0/4081654125 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc40309a0 con 0x7effd40af6c0 2024-01-25T15:05:27.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.971+0000 7effd2ffd640 1 -- 172.21.15.29:0/4081654125 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4030d30 con 0x7effd40af6c0 2024-01-25T15:05:27.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.972+0000 7effda5de640 1 -- 172.21.15.29:0/4081654125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effd40af6c0 msgr2=0x7effd40c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:27.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.972+0000 7effda5de640 1 --2- 172.21.15.29:0/4081654125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effd40af6c0 0x7effd40c5530 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7effc4009870 tx=0x7effc402b980 comp rx=0 tx=0).stop 2024-01-25T15:05:27.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.972+0000 7effda5de640 1 -- 172.21.15.29:0/4081654125 shutdown_connections 2024-01-25T15:05:27.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.972+0000 7effda5de640 1 --2- 172.21.15.29:0/4081654125 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effd406d560 0x7effd406b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.972+0000 7effda5de640 1 --2- 172.21.15.29:0/4081654125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effd40af6c0 0x7effd40c5530 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.972+0000 7effda5de640 1 -- 172.21.15.29:0/4081654125 >> 172.21.15.29:0/4081654125 conn(0x7effd40c6ca0 msgr2=0x7effd40c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:27.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.972+0000 7effda5de640 1 -- 172.21.15.29:0/4081654125 shutdown_connections 2024-01-25T15:05:27.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.972+0000 7effda5de640 1 -- 172.21.15.29:0/4081654125 wait complete. 2024-01-25T15:05:27.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.973+0000 7effda5de640 1 Processor -- start 2024-01-25T15:05:27.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.973+0000 7effda5de640 1 -- start start 2024-01-25T15:05:27.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.974+0000 7effda5de640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effd406d560 0x7effd40c1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:27.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.974+0000 7effda5de640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effd40af6c0 0x7effd414f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:27.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.974+0000 7effda5de640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effd40c5a70 0x7effd40c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:27.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.974+0000 7effda5de640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd4158b30 con 0x7effd40c5a70 2024-01-25T15:05:27.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.974+0000 7effda5de640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd41eae40 con 0x7effd40af6c0 2024-01-25T15:05:27.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.974+0000 7effda5de640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd41eb370 con 0x7effd406d560 2024-01-25T15:05:27.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.974+0000 7effd8b7b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effd40c5a70 0x7effd40c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:27.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.974+0000 7effd8b7b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effd40c5a70 0x7effd40c0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33318/0 (socket says 172.21.15.29:33318) 2024-01-25T15:05:27.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.974+0000 7effd3fff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effd406d560 0x7effd40c1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:27.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.974+0000 7effd8b7b640 1 -- 172.21.15.29:0/4075178543 learned_addr learned my addr 172.21.15.29:0/4075178543 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:27.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.974+0000 7effd37fe640 1 --2- 172.21.15.29:0/4075178543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effd40af6c0 0x7effd414f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:27.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.974+0000 7effd8b7b640 1 -- 172.21.15.29:0/4075178543 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effd406d560 msgr2=0x7effd40c1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:27.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.974+0000 7effd8b7b640 1 --2- 172.21.15.29:0/4075178543 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effd406d560 0x7effd40c1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.974+0000 7effd8b7b640 1 -- 172.21.15.29:0/4075178543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effd40af6c0 msgr2=0x7effd414f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:27.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.974+0000 7effd8b7b640 1 --2- 172.21.15.29:0/4075178543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effd40af6c0 0x7effd414f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:27.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.974+0000 7effd8b7b640 1 -- 172.21.15.29:0/4075178543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc40094d0 con 0x7effd40c5a70 2024-01-25T15:05:27.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.974+0000 7effd8b7b640 1 --2- 172.21.15.29:0/4075178543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effd40c5a70 0x7effd40c0a40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7effcc00c6b0 tx=0x7effcc00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:27.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.974+0000 7effd0ff9640 1 -- 172.21.15.29:0/4075178543 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc003b70 con 0x7effd40c5a70 2024-01-25T15:05:27.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.975+0000 7effd0ff9640 1 -- 172.21.15.29:0/4075178543 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effcc003cd0 con 0x7effd40c5a70 2024-01-25T15:05:27.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.975+0000 7effda5de640 1 -- 172.21.15.29:0/4075178543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd41eb090 con 0x7effd40c5a70 2024-01-25T15:05:27.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.975+0000 7effd0ff9640 1 -- 172.21.15.29:0/4075178543 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc005310 con 0x7effd40c5a70 2024-01-25T15:05:27.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.975+0000 7effda5de640 1 -- 172.21.15.29:0/4075178543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd4158850 con 0x7effd40c5a70 2024-01-25T15:05:27.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.975+0000 7effda5de640 1 -- 172.21.15.29:0/4075178543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd4074010 con 0x7effd40c5a70 2024-01-25T15:05:27.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.976+0000 7effd0ff9640 1 -- 172.21.15.29:0/4075178543 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7effcc005470 con 0x7effd40c5a70 2024-01-25T15:05:27.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.976+0000 7effd0ff9640 1 --2- 172.21.15.29:0/4075178543 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7effb406aed0 0x7effb406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:27.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.977+0000 7effd0ff9640 1 -- 172.21.15.29:0/4075178543 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7effcc0893a0 con 0x7effd40c5a70 2024-01-25T15:05:27.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.977+0000 7effd3fff640 1 --2- 172.21.15.29:0/4075178543 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7effb406aed0 0x7effb406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:27.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.977+0000 7effd3fff640 1 --2- 172.21.15.29:0/4075178543 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7effb406aed0 0x7effb406d390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7effc4036000 tx=0x7effc4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:27.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:27.981+0000 7effd0ff9640 1 -- 172.21.15.29:0/4075178543 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7effcc0541d0 con 0x7effd40c5a70 2024-01-25T15:05:28.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.199+0000 7effda5de640 1 -- 172.21.15.29:0/4075178543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7effd40ac880 con 0x7effd40c5a70 2024-01-25T15:05:28.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.527+0000 7effd0ff9640 1 -- 172.21.15.29:0/4075178543 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7effcc0577f0 con 0x7effd40c5a70 2024-01-25T15:05:28.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.530+0000 7effda5de640 1 -- 172.21.15.29:0/4075178543 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7effb406aed0 msgr2=0x7effb406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:28.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.530+0000 7effda5de640 1 --2- 172.21.15.29:0/4075178543 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7effb406aed0 0x7effb406d390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7effc4036000 tx=0x7effc4008030 comp rx=0 tx=0).stop 2024-01-25T15:05:28.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.530+0000 7effda5de640 1 -- 172.21.15.29:0/4075178543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effd40c5a70 msgr2=0x7effd40c0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:28.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.530+0000 7effda5de640 1 --2- 172.21.15.29:0/4075178543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effd40c5a70 0x7effd40c0a40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7effcc00c6b0 tx=0x7effcc00cb70 comp rx=0 tx=0).stop 2024-01-25T15:05:28.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.530+0000 7effda5de640 1 -- 172.21.15.29:0/4075178543 shutdown_connections 2024-01-25T15:05:28.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.530+0000 7effda5de640 1 --2- 172.21.15.29:0/4075178543 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7effb406aed0 0x7effb406d390 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:28.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.530+0000 7effda5de640 1 --2- 172.21.15.29:0/4075178543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effd40c5a70 0x7effd40c0a40 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:28.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.530+0000 7effda5de640 1 --2- 172.21.15.29:0/4075178543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effd40af6c0 0x7effd414f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:28.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.530+0000 7effda5de640 1 --2- 172.21.15.29:0/4075178543 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7effd406d560 0x7effd40c1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:28.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.530+0000 7effda5de640 1 -- 172.21.15.29:0/4075178543 >> 172.21.15.29:0/4075178543 conn(0x7effd40c6ca0 msgr2=0x7effd40abcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:28.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.530+0000 7effda5de640 1 -- 172.21.15.29:0/4075178543 shutdown_connections 2024-01-25T15:05:28.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.530+0000 7effda5de640 1 -- 172.21.15.29:0/4075178543 wait complete. 2024-01-25T15:05:28.542 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-25T15:05:28.542 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-25T15:05:28.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.647+0000 7fab68fe3640 1 Processor -- start 2024-01-25T15:05:28.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.647+0000 7fab68fe3640 1 -- start start 2024-01-25T15:05:28.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.648+0000 7fab68fe3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fab640c4fe0 0x7fab6406b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:28.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.648+0000 7fab68fe3640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab640afaa0 con 0x7fab640af6c0 2024-01-25T15:05:28.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.648+0000 7fab68fe3640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab640c6060 con 0x7fab6406d560 2024-01-25T15:05:28.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.648+0000 7fab68fe3640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6406c480 con 0x7fab640c4fe0 2024-01-25T15:05:28.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.648+0000 7fab6259c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fab640af6c0 0x7fab640c5530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35012/0 (socket says 172.21.15.29:35012) 2024-01-25T15:05:28.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.648+0000 7fab6259c640 1 -- 172.21.15.29:0/2757308563 learned_addr learned my addr 172.21.15.29:0/2757308563 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:28.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab6159a640 1 -- 172.21.15.29:0/2757308563 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820361443 0 0) 0x7fab640afaa0 con 0x7fab640af6c0 2024-01-25T15:05:28.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab62d9d640 1 --2- 172.21.15.29:0/2757308563 >> v2:172.21.15.52:3300/0 conn(0x7fab640c4fe0 0x7fab6406b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:28.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab6159a640 1 -- 172.21.15.29:0/2757308563 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab50003520 con 0x7fab640af6c0 2024-01-25T15:05:28.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab6159a640 1 -- 172.21.15.29:0/2757308563 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4264934635 0 0) 0x7fab50003520 con 0x7fab640af6c0 2024-01-25T15:05:28.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab6159a640 1 -- 172.21.15.29:0/2757308563 >> v2:172.21.15.52:3300/0 conn(0x7fab640c4fe0 msgr2=0x7fab6406b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab6159a640 1 --2- 172.21.15.29:0/2757308563 >> v2:172.21.15.52:3300/0 conn(0x7fab640c4fe0 0x7fab6406b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab6159a640 1 -- 172.21.15.29:0/2757308563 >> v1:172.21.15.52:6789/0 conn(0x7fab6406d560 legacy=0x7fab6406b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab6159a640 1 -- 172.21.15.29:0/2757308563 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab64155480 con 0x7fab640af6c0 2024-01-25T15:05:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab6159a640 1 -- 172.21.15.29:0/2757308563 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7fab5c001670 con 0x7fab640af6c0 2024-01-25T15:05:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab6159a640 1 -- 172.21.15.29:0/2757308563 >> v1:172.21.15.29:6789/0 conn(0x7fab640af6c0 legacy=0x7fab640c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab6159a640 1 --2- 172.21.15.29:0/2757308563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab500039e0 0x7fab50003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab6159a640 1 --2- 172.21.15.29:0/2757308563 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab500047c0 0x7fab50004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab6159a640 1 --2- 172.21.15.29:0/2757308563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab50005180 0x7fab5000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab6159a640 1 -- 172.21.15.29:0/2757308563 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6406c480 con 0x7fab500039e0 2024-01-25T15:05:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab6159a640 1 -- 172.21.15.29:0/2757308563 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5000c0b0 con 0x7fab50005180 2024-01-25T15:05:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab6159a640 1 -- 172.21.15.29:0/2757308563 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5000c270 con 0x7fab500047c0 2024-01-25T15:05:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab6259c640 1 --2- 172.21.15.29:0/2757308563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab500039e0 0x7fab50003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab61d9b640 1 --2- 172.21.15.29:0/2757308563 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab500047c0 0x7fab50004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:28.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab62d9d640 1 --2- 172.21.15.29:0/2757308563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab50005180 0x7fab5000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:28.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab6259c640 1 -- 172.21.15.29:0/2757308563 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab500047c0 msgr2=0x7fab50004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:28.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab6259c640 1 --2- 172.21.15.29:0/2757308563 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab500047c0 0x7fab50004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:28.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab6259c640 1 -- 172.21.15.29:0/2757308563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab50005180 msgr2=0x7fab5000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:28.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab6259c640 1 --2- 172.21.15.29:0/2757308563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab50005180 0x7fab5000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:28.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab6259c640 1 -- 172.21.15.29:0/2757308563 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab50003520 con 0x7fab500039e0 2024-01-25T15:05:28.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab62d9d640 1 --2- 172.21.15.29:0/2757308563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab50005180 0x7fab5000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:28.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.649+0000 7fab62d9d640 1 -- 172.21.15.29:0/2757308563 reap_dead start 2024-01-25T15:05:28.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.650+0000 7fab6259c640 1 --2- 172.21.15.29:0/2757308563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab500039e0 0x7fab50003e00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00c190 tx=0x7fab500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a53177b010a0d64 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:28.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.650+0000 7fab6159a640 1 -- 172.21.15.29:0/2757308563 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c005ad0 con 0x7fab500039e0 2024-01-25T15:05:28.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.650+0000 7fab6159a640 1 -- 172.21.15.29:0/2757308563 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5c005c30 con 0x7fab500039e0 2024-01-25T15:05:28.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.650+0000 7fab6159a640 1 -- 172.21.15.29:0/2757308563 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c02cab0 con 0x7fab500039e0 2024-01-25T15:05:28.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.651+0000 7fab68fe3640 1 -- 172.21.15.29:0/2757308563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab500039e0 msgr2=0x7fab50003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:28.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.651+0000 7fab68fe3640 1 --2- 172.21.15.29:0/2757308563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab500039e0 0x7fab50003e00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00c190 tx=0x7fab500057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:28.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.651+0000 7fab68fe3640 1 -- 172.21.15.29:0/2757308563 shutdown_connections 2024-01-25T15:05:28.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.651+0000 7fab68fe3640 1 --2- 172.21.15.29:0/2757308563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab500039e0 0x7fab50003e00 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:28.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.651+0000 7fab68fe3640 1 -- 172.21.15.29:0/2757308563 >> 172.21.15.29:0/2757308563 conn(0x7fab640c6ca0 msgr2=0x7fab640c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:28.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.651+0000 7fab68fe3640 1 -- 172.21.15.29:0/2757308563 shutdown_connections 2024-01-25T15:05:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.651+0000 7fab68fe3640 1 -- 172.21.15.29:0/2757308563 wait complete. 2024-01-25T15:05:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.652+0000 7fab68fe3640 1 Processor -- start 2024-01-25T15:05:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.652+0000 7fab68fe3640 1 -- start start 2024-01-25T15:05:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.653+0000 7fab68fe3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab500039e0 0x7fab64153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.653+0000 7fab68fe3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab640c42f0 0x7fab640bbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.653+0000 7fab68fe3640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab640bc510 0x7fab64158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.653+0000 7fab68fe3640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab64157be0 con 0x7fab640c42f0 2024-01-25T15:05:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.653+0000 7fab68fe3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab641eacf0 con 0x7fab500039e0 2024-01-25T15:05:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.653+0000 7fab68fe3640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab640c3380 con 0x7fab640bc510 2024-01-25T15:05:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.653+0000 7fab61d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab640c42f0 0x7fab640bbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.653+0000 7fab61d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab640c42f0 0x7fab640bbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33336/0 (socket says 172.21.15.29:33336) 2024-01-25T15:05:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.653+0000 7fab61d9b640 1 -- 172.21.15.29:0/3967479949 learned_addr learned my addr 172.21.15.29:0/3967479949 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.653+0000 7fab62d9d640 1 --2- 172.21.15.29:0/3967479949 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab640bc510 0x7fab64158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:28.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.653+0000 7fab6259c640 1 --2- 172.21.15.29:0/3967479949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab500039e0 0x7fab64153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:28.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.653+0000 7fab61d9b640 1 -- 172.21.15.29:0/3967479949 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab640bc510 msgr2=0x7fab64158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:28.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.653+0000 7fab61d9b640 1 --2- 172.21.15.29:0/3967479949 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab640bc510 0x7fab64158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:28.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.653+0000 7fab61d9b640 1 -- 172.21.15.29:0/3967479949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab500039e0 msgr2=0x7fab64153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:28.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.653+0000 7fab61d9b640 1 --2- 172.21.15.29:0/3967479949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab500039e0 0x7fab64153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:28.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.653+0000 7fab61d9b640 1 -- 172.21.15.29:0/3967479949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab640c3660 con 0x7fab640c42f0 2024-01-25T15:05:28.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.653+0000 7fab61d9b640 1 --2- 172.21.15.29:0/3967479949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab640c42f0 0x7fab640bbfd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00f820 tx=0x7fab4c00fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:28.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.654+0000 7fab5affd640 1 -- 172.21.15.29:0/3967479949 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c0050d0 con 0x7fab640c42f0 2024-01-25T15:05:28.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.654+0000 7fab5affd640 1 -- 172.21.15.29:0/3967479949 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c005230 con 0x7fab640c42f0 2024-01-25T15:05:28.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.654+0000 7fab68fe3640 1 -- 172.21.15.29:0/3967479949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab640c3940 con 0x7fab640c42f0 2024-01-25T15:05:28.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.654+0000 7fab5affd640 1 -- 172.21.15.29:0/3967479949 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c00d730 con 0x7fab640c42f0 2024-01-25T15:05:28.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.654+0000 7fab68fe3640 1 -- 172.21.15.29:0/3967479949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab640bc9a0 con 0x7fab640c42f0 2024-01-25T15:05:28.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.655+0000 7fab68fe3640 1 -- 172.21.15.29:0/3967479949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab64074010 con 0x7fab640c42f0 2024-01-25T15:05:28.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.655+0000 7fab5affd640 1 -- 172.21.15.29:0/3967479949 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fab4c00d890 con 0x7fab640c42f0 2024-01-25T15:05:28.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.655+0000 7fab5affd640 1 --2- 172.21.15.29:0/3967479949 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fab4406af00 0x7fab4406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:28.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.656+0000 7fab5affd640 1 -- 172.21.15.29:0/3967479949 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fab4c089690 con 0x7fab640c42f0 2024-01-25T15:05:28.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.656+0000 7fab6259c640 1 --2- 172.21.15.29:0/3967479949 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fab4406af00 0x7fab4406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:28.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.656+0000 7fab6259c640 1 --2- 172.21.15.29:0/3967479949 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fab4406af00 0x7fab4406d3c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fab5c034000 tx=0x7fab5c009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:28.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.660+0000 7fab5affd640 1 -- 172.21.15.29:0/3967479949 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fab4c054420 con 0x7fab640c42f0 2024-01-25T15:05:28.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:28.880+0000 7fab68fe3640 1 -- 172.21.15.29:0/3967479949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fab640aacf0 con 0x7fab640c42f0 2024-01-25T15:05:29.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.531+0000 7fab5affd640 1 -- 172.21.15.29:0/3967479949 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fab4c057a40 con 0x7fab640c42f0 2024-01-25T15:05:29.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.534+0000 7fab68fe3640 1 -- 172.21.15.29:0/3967479949 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fab4406af00 msgr2=0x7fab4406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:29.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.534+0000 7fab68fe3640 1 --2- 172.21.15.29:0/3967479949 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fab4406af00 0x7fab4406d3c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fab5c034000 tx=0x7fab5c009030 comp rx=0 tx=0).stop 2024-01-25T15:05:29.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.534+0000 7fab68fe3640 1 -- 172.21.15.29:0/3967479949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab640c42f0 msgr2=0x7fab640bbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:29.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.534+0000 7fab68fe3640 1 --2- 172.21.15.29:0/3967479949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab640c42f0 0x7fab640bbfd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00f820 tx=0x7fab4c00fce0 comp rx=0 tx=0).stop 2024-01-25T15:05:29.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.534+0000 7fab68fe3640 1 -- 172.21.15.29:0/3967479949 shutdown_connections 2024-01-25T15:05:29.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.534+0000 7fab68fe3640 1 --2- 172.21.15.29:0/3967479949 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fab640bc510 0x7fab64158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:29.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.534+0000 7fab68fe3640 1 --2- 172.21.15.29:0/3967479949 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fab4406af00 0x7fab4406d3c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:29.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.534+0000 7fab68fe3640 1 --2- 172.21.15.29:0/3967479949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab640c42f0 0x7fab640bbfd0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:29.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.534+0000 7fab68fe3640 1 --2- 172.21.15.29:0/3967479949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab500039e0 0x7fab64153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:29.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.534+0000 7fab68fe3640 1 -- 172.21.15.29:0/3967479949 >> 172.21.15.29:0/3967479949 conn(0x7fab640c6ca0 msgr2=0x7fab640c7080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:29.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.534+0000 7fab68fe3640 1 -- 172.21.15.29:0/3967479949 shutdown_connections 2024-01-25T15:05:29.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.534+0000 7fab68fe3640 1 -- 172.21.15.29:0/3967479949 wait complete. 2024-01-25T15:05:29.549 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-25T15:05:29.549 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:05:29.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.655+0000 7f1271b73640 1 Processor -- start 2024-01-25T15:05:29.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.656+0000 7f1271b73640 1 -- start start 2024-01-25T15:05:29.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.656+0000 7f1271b73640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f126c1520b0 0x7f126c155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:29.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.656+0000 7f1271b73640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f126c0c55e0 0x7f126c0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:29.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.656+0000 7f1271b73640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f126c0c66c0 con 0x7f126c0c4f00 2024-01-25T15:05:29.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.656+0000 7f1271b73640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c06cfc0 con 0x7f126c0c55e0 2024-01-25T15:05:29.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.656+0000 7f1271b73640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c152490 con 0x7f126c1520b0 2024-01-25T15:05:29.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.656+0000 7f126affd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f126c0c55e0 0x7f126c0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:29.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.656+0000 7f126affd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f126c0c55e0 0x7f126c0c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33350/0 (socket says 172.21.15.29:33350) 2024-01-25T15:05:29.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.656+0000 7f126affd640 1 -- 172.21.15.29:0/521684609 learned_addr learned my addr 172.21.15.29:0/521684609 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:29.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.657+0000 7f126b7fe640 1 --2- 172.21.15.29:0/521684609 >> v2:172.21.15.52:3300/0 conn(0x7f126c1520b0 0x7f126c155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:29.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.657+0000 7f126affd640 1 -- 172.21.15.29:0/521684609 >> v2:172.21.15.52:3300/0 conn(0x7f126c1520b0 msgr2=0x7f126c155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:29.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.657+0000 7f126affd640 1 --2- 172.21.15.29:0/521684609 >> v2:172.21.15.52:3300/0 conn(0x7f126c1520b0 0x7f126c155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:29.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.657+0000 7f126affd640 1 -- 172.21.15.29:0/521684609 >> v1:172.21.15.52:6789/0 conn(0x7f126c0c4f00 legacy=0x7f126c0c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:29.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.657+0000 7f126affd640 1 -- 172.21.15.29:0/521684609 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c0c6910 con 0x7f126c0c55e0 2024-01-25T15:05:29.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.657+0000 7f126b7fe640 1 --2- 172.21.15.29:0/521684609 >> v2:172.21.15.52:3300/0 conn(0x7f126c1520b0 0x7f126c155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:29.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.658+0000 7f126affd640 1 --2- 172.21.15.29:0/521684609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f126c0c55e0 0x7f126c0c8120 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f126c08bbe0 tx=0x7f126002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882e10abefdb2cf3 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:29.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.658+0000 7f126a7fc640 1 -- 172.21.15.29:0/521684609 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12600317e0 con 0x7f126c0c55e0 2024-01-25T15:05:29.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.658+0000 7f126a7fc640 1 -- 172.21.15.29:0/521684609 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1260031940 con 0x7f126c0c55e0 2024-01-25T15:05:29.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.658+0000 7f126a7fc640 1 -- 172.21.15.29:0/521684609 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260031cd0 con 0x7f126c0c55e0 2024-01-25T15:05:29.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.658+0000 7f1271b73640 1 -- 172.21.15.29:0/521684609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f126c0c55e0 msgr2=0x7f126c0c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:29.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.658+0000 7f1271b73640 1 --2- 172.21.15.29:0/521684609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f126c0c55e0 0x7f126c0c8120 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f126c08bbe0 tx=0x7f126002b880 comp rx=0 tx=0).stop 2024-01-25T15:05:29.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.658+0000 7f1271b73640 1 -- 172.21.15.29:0/521684609 shutdown_connections 2024-01-25T15:05:29.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.658+0000 7f1271b73640 1 --2- 172.21.15.29:0/521684609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f126c0c55e0 0x7f126c0c8120 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:29.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.658+0000 7f1271b73640 1 --2- 172.21.15.29:0/521684609 >> v2:172.21.15.52:3300/0 conn(0x7f126c1520b0 0x7f126c155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:29.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.658+0000 7f1271b73640 1 -- 172.21.15.29:0/521684609 >> 172.21.15.29:0/521684609 conn(0x7f126c0ca220 msgr2=0x7f126c0ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:29.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.658+0000 7f1271b73640 1 -- 172.21.15.29:0/521684609 shutdown_connections 2024-01-25T15:05:29.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.658+0000 7f1271b73640 1 -- 172.21.15.29:0/521684609 wait complete. 2024-01-25T15:05:29.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.659+0000 7f1271b73640 1 Processor -- start 2024-01-25T15:05:29.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.660+0000 7f1271b73640 1 -- start start 2024-01-25T15:05:29.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.660+0000 7f1271b73640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f126c0c4f00 0x7f126c14ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:29.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.660+0000 7f1271b73640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f126c1520b0 0x7f126c0ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:29.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.660+0000 7f1271b73640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f126c0ade70 0x7f126c1ed430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:29.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.660+0000 7f1271b73640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c0c3ad0 con 0x7f126c0c4f00 2024-01-25T15:05:29.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.660+0000 7f1271b73640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c0afea0 con 0x7f126c0ade70 2024-01-25T15:05:29.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.660+0000 7f1271b73640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c152e80 con 0x7f126c1520b0 2024-01-25T15:05:29.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.660+0000 7f126b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f126c0c4f00 0x7f126c14ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:29.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.660+0000 7f126b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f126c0c4f00 0x7f126c14ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33358/0 (socket says 172.21.15.29:33358) 2024-01-25T15:05:29.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.660+0000 7f126b7fe640 1 -- 172.21.15.29:0/525630442 learned_addr learned my addr 172.21.15.29:0/525630442 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:29.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.661+0000 7f126affd640 1 --2- 172.21.15.29:0/525630442 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f126c1520b0 0x7f126c0ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:29.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.661+0000 7f126bfff640 1 --2- 172.21.15.29:0/525630442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f126c0ade70 0x7f126c1ed430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:29.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.661+0000 7f126b7fe640 1 -- 172.21.15.29:0/525630442 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f126c1520b0 msgr2=0x7f126c0ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:29.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.661+0000 7f126b7fe640 1 --2- 172.21.15.29:0/525630442 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f126c1520b0 0x7f126c0ad930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:29.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.661+0000 7f126b7fe640 1 -- 172.21.15.29:0/525630442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f126c0ade70 msgr2=0x7f126c1ed430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:29.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.661+0000 7f126b7fe640 1 --2- 172.21.15.29:0/525630442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f126c0ade70 0x7f126c1ed430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:29.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.661+0000 7f126b7fe640 1 -- 172.21.15.29:0/525630442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12600094d0 con 0x7f126c0c4f00 2024-01-25T15:05:29.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.661+0000 7f126bfff640 1 --2- 172.21.15.29:0/525630442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f126c0ade70 0x7f126c1ed430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:29.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.661+0000 7f126affd640 1 --2- 172.21.15.29:0/525630442 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f126c1520b0 0x7f126c0ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:29.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.661+0000 7f126b7fe640 1 --2- 172.21.15.29:0/525630442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f126c0c4f00 0x7f126c14ba70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f125c00c7f0 tx=0x7f125c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:29.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.661+0000 7f1253fff640 1 -- 172.21.15.29:0/525630442 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c007a30 con 0x7f126c0c4f00 2024-01-25T15:05:29.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.661+0000 7f1253fff640 1 -- 172.21.15.29:0/525630442 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c007b90 con 0x7f126c0c4f00 2024-01-25T15:05:29.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.661+0000 7f1271b73640 1 -- 172.21.15.29:0/525630442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126c0c0cf0 con 0x7f126c0c4f00 2024-01-25T15:05:29.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.661+0000 7f1253fff640 1 -- 172.21.15.29:0/525630442 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c00ce40 con 0x7f126c0c4f00 2024-01-25T15:05:29.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.661+0000 7f1271b73640 1 -- 172.21.15.29:0/525630442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126c0af850 con 0x7f126c0c4f00 2024-01-25T15:05:29.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.662+0000 7f1271b73640 1 -- 172.21.15.29:0/525630442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126c074080 con 0x7f126c0c4f00 2024-01-25T15:05:29.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.663+0000 7f1253fff640 1 -- 172.21.15.29:0/525630442 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f125c0113f0 con 0x7f126c0c4f00 2024-01-25T15:05:29.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.663+0000 7f1253fff640 1 --2- 172.21.15.29:0/525630442 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f125806aed0 0x7f125806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:29.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.663+0000 7f1253fff640 1 -- 172.21.15.29:0/525630442 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f125c089840 con 0x7f126c0c4f00 2024-01-25T15:05:29.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.663+0000 7f126affd640 1 --2- 172.21.15.29:0/525630442 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f125806aed0 0x7f125806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:29.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.664+0000 7f126affd640 1 --2- 172.21.15.29:0/525630442 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f125806aed0 0x7f125806d390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1260036000 tx=0x7f126003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:29.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.667+0000 7f1253fff640 1 -- 172.21.15.29:0/525630442 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f125c054660 con 0x7f126c0c4f00 2024-01-25T15:05:29.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.887+0000 7f1271b73640 1 -- 172.21.15.29:0/525630442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f126c158d10 con 0x7f126c0c4f00 2024-01-25T15:05:29.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.887+0000 7f1253fff640 1 -- 172.21.15.29:0/525630442 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f125c01f090 con 0x7f126c0c4f00 2024-01-25T15:05:29.889 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:29.889 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/3901576943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6835","nonce":3901576943},{"type":"v1","addr":"172.21.15.52:6837","nonce":3901576943}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6836/1878395580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1878395580},{"type":"v1","addr":"172.21.15.52:6836","nonce":1878395580}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1607449141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1607449141},{"type":"v1","addr":"172.21.15.29:6834","nonce":1607449141}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:05:26.577307+0000","modified":"2024-01-25T15:05:28.881837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3222226893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3222226893},{"type":"v1","addr":"172.21.15.29:6835","nonce":3222226893}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-25T15:05:29.889 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 17 2024-01-25T15:05:29.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.889+0000 7f1271b73640 1 -- 172.21.15.29:0/525630442 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f125806aed0 msgr2=0x7f125806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:29.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.889+0000 7f1271b73640 1 --2- 172.21.15.29:0/525630442 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f125806aed0 0x7f125806d390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1260036000 tx=0x7f126003d040 comp rx=0 tx=0).stop 2024-01-25T15:05:29.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.889+0000 7f1271b73640 1 -- 172.21.15.29:0/525630442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f126c0c4f00 msgr2=0x7f126c14ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:29.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.889+0000 7f1271b73640 1 --2- 172.21.15.29:0/525630442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f126c0c4f00 0x7f126c14ba70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f125c00c7f0 tx=0x7f125c00cbf0 comp rx=0 tx=0).stop 2024-01-25T15:05:29.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.889+0000 7f1271b73640 1 -- 172.21.15.29:0/525630442 shutdown_connections 2024-01-25T15:05:29.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.889+0000 7f1271b73640 1 --2- 172.21.15.29:0/525630442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f126c0ade70 0x7f126c1ed430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:29.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.889+0000 7f1271b73640 1 --2- 172.21.15.29:0/525630442 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f126c1520b0 0x7f126c0ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:29.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.889+0000 7f1271b73640 1 --2- 172.21.15.29:0/525630442 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f125806aed0 0x7f125806d390 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:29.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.889+0000 7f1271b73640 1 --2- 172.21.15.29:0/525630442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f126c0c4f00 0x7f126c14ba70 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:29.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.889+0000 7f1271b73640 1 -- 172.21.15.29:0/525630442 >> 172.21.15.29:0/525630442 conn(0x7f126c0ca220 msgr2=0x7f126c0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:29.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.889+0000 7f1271b73640 1 -- 172.21.15.29:0/525630442 shutdown_connections 2024-01-25T15:05:29.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:29.889+0000 7f1271b73640 1 -- 172.21.15.29:0/525630442 wait complete. 2024-01-25T15:05:29.902 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:30.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.001+0000 7f52f0664640 1 Processor -- start 2024-01-25T15:05:30.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.001+0000 7f52f0664640 1 -- start start 2024-01-25T15:05:30.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.002+0000 7f52f0664640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f52e814fea0 0x7f52e81566b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:30.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.002+0000 7f52f0664640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f52e80a71e0 0x7f52e80c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:30.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.002+0000 7f52f0664640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e8156bf0 con 0x7f52e80c4120 2024-01-25T15:05:30.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.002+0000 7f52f0664640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e80ad3f0 con 0x7f52e814fea0 2024-01-25T15:05:30.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.002+0000 7f52f0664640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e80acf60 con 0x7f52e80a71e0 2024-01-25T15:05:30.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.002+0000 7f52ee400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f52e814fea0 0x7f52e81566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:30.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.002+0000 7f52ee400640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f52e814fea0 0x7f52e81566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33364/0 (socket says 172.21.15.29:33364) 2024-01-25T15:05:30.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.002+0000 7f52ee400640 1 -- 172.21.15.29:0/2878653367 learned_addr learned my addr 172.21.15.29:0/2878653367 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:30.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.002+0000 7f52edbff640 1 --2- 172.21.15.29:0/2878653367 >> v2:172.21.15.52:3300/0 conn(0x7f52e80a71e0 0x7f52e80c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:30.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.003+0000 7f52ee400640 1 -- 172.21.15.29:0/2878653367 >> v2:172.21.15.52:3300/0 conn(0x7f52e80a71e0 msgr2=0x7f52e80c3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:30.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.003+0000 7f52ee400640 1 --2- 172.21.15.29:0/2878653367 >> v2:172.21.15.52:3300/0 conn(0x7f52e80a71e0 0x7f52e80c3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.003+0000 7f52ee400640 1 -- 172.21.15.29:0/2878653367 >> v1:172.21.15.29:6789/0 conn(0x7f52e80c4120 legacy=0x7f52e80c2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:30.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.003+0000 7f52ee400640 1 -- 172.21.15.29:0/2878653367 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e80c8cf0 con 0x7f52e814fea0 2024-01-25T15:05:30.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.003+0000 7f52ed3fe640 1 -- 172.21.15.29:0/2878653367 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003188681 0 0) 0x7f52e8156bf0 con 0x7f52e80c4120 2024-01-25T15:05:30.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.003+0000 7f52ee400640 1 --2- 172.21.15.29:0/2878653367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52e814fea0 0x7f52e81566b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f52e80a79e0 tx=0x7f52d802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f559034f79f5b8 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:30.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.004+0000 7f52ed3fe640 1 -- 172.21.15.29:0/2878653367 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d8031870 con 0x7f52e814fea0 2024-01-25T15:05:30.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.004+0000 7f52ed3fe640 1 -- 172.21.15.29:0/2878653367 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d80319d0 con 0x7f52e814fea0 2024-01-25T15:05:30.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.004+0000 7f52ed3fe640 1 -- 172.21.15.29:0/2878653367 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d8031d60 con 0x7f52e814fea0 2024-01-25T15:05:30.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.004+0000 7f52f0664640 1 -- 172.21.15.29:0/2878653367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52e814fea0 msgr2=0x7f52e81566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:30.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.004+0000 7f52f0664640 1 --2- 172.21.15.29:0/2878653367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52e814fea0 0x7f52e81566b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f52e80a79e0 tx=0x7f52d802b910 comp rx=0 tx=0).stop 2024-01-25T15:05:30.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.004+0000 7f52f0664640 1 -- 172.21.15.29:0/2878653367 shutdown_connections 2024-01-25T15:05:30.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.004+0000 7f52f0664640 1 --2- 172.21.15.29:0/2878653367 >> v2:172.21.15.52:3300/0 conn(0x7f52e80a71e0 0x7f52e80c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.004+0000 7f52f0664640 1 --2- 172.21.15.29:0/2878653367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52e814fea0 0x7f52e81566b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.004+0000 7f52f0664640 1 -- 172.21.15.29:0/2878653367 >> 172.21.15.29:0/2878653367 conn(0x7f52e80a9bc0 msgr2=0x7f52e80a9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:30.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.004+0000 7f52f0664640 1 -- 172.21.15.29:0/2878653367 shutdown_connections 2024-01-25T15:05:30.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.004+0000 7f52f0664640 1 -- 172.21.15.29:0/2878653367 wait complete. 2024-01-25T15:05:30.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.005+0000 7f52f0664640 1 Processor -- start 2024-01-25T15:05:30.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.006+0000 7f52f0664640 1 -- start start 2024-01-25T15:05:30.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.006+0000 7f52f0664640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52e80a71e0 0x7f52e81566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:30.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.006+0000 7f52f0664640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52e80c4120 0x7f52e81eb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:30.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.006+0000 7f52f0664640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52e814fea0 0x7f52e81eb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:30.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.006+0000 7f52f0664640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e8156c30 con 0x7f52e80a71e0 2024-01-25T15:05:30.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.006+0000 7f52f0664640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e8151f70 con 0x7f52e80c4120 2024-01-25T15:05:30.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.006+0000 7f52f0664640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e81ebfc0 con 0x7f52e814fea0 2024-01-25T15:05:30.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.006+0000 7f52ee400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52e80a71e0 0x7f52e81566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:30.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.006+0000 7f52ee400640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52e80a71e0 0x7f52e81566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33372/0 (socket says 172.21.15.29:33372) 2024-01-25T15:05:30.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.006+0000 7f52ee400640 1 -- 172.21.15.29:0/604254061 learned_addr learned my addr 172.21.15.29:0/604254061 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:30.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.006+0000 7f52eec01640 1 --2- 172.21.15.29:0/604254061 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52e814fea0 0x7f52e81eb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:30.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.006+0000 7f52edbff640 1 --2- 172.21.15.29:0/604254061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52e80c4120 0x7f52e81eb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:30.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.007+0000 7f52ee400640 1 -- 172.21.15.29:0/604254061 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52e814fea0 msgr2=0x7f52e81eb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:30.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.007+0000 7f52ee400640 1 --2- 172.21.15.29:0/604254061 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52e814fea0 0x7f52e81eb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.007+0000 7f52ee400640 1 -- 172.21.15.29:0/604254061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52e80c4120 msgr2=0x7f52e81eb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:30.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.007+0000 7f52ee400640 1 --2- 172.21.15.29:0/604254061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52e80c4120 0x7f52e81eb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.007+0000 7f52ee400640 1 -- 172.21.15.29:0/604254061 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d80094d0 con 0x7f52e80a71e0 2024-01-25T15:05:30.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.007+0000 7f52ee400640 1 --2- 172.21.15.29:0/604254061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52e80a71e0 0x7f52e81566f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f52d8000c00 tx=0x7f52d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:30.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.007+0000 7f52e6ffd640 1 -- 172.21.15.29:0/604254061 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d8004230 con 0x7f52e80a71e0 2024-01-25T15:05:30.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.007+0000 7f52e6ffd640 1 -- 172.21.15.29:0/604254061 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d80043b0 con 0x7f52e80a71e0 2024-01-25T15:05:30.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.007+0000 7f52f0664640 1 -- 172.21.15.29:0/604254061 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e81521d0 con 0x7f52e80a71e0 2024-01-25T15:05:30.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.007+0000 7f52e6ffd640 1 -- 172.21.15.29:0/604254061 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d8004520 con 0x7f52e80a71e0 2024-01-25T15:05:30.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.007+0000 7f52f0664640 1 -- 172.21.15.29:0/604254061 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e8152790 con 0x7f52e80a71e0 2024-01-25T15:05:30.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.008+0000 7f52f0664640 1 -- 172.21.15.29:0/604254061 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e80a9980 con 0x7f52e80a71e0 2024-01-25T15:05:30.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.008+0000 7f52e6ffd640 1 -- 172.21.15.29:0/604254061 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f52d8043070 con 0x7f52e80a71e0 2024-01-25T15:05:30.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.009+0000 7f52e6ffd640 1 --2- 172.21.15.29:0/604254061 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f52d406aed0 0x7f52d406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:30.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.009+0000 7f52e6ffd640 1 -- 172.21.15.29:0/604254061 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f52d802d040 con 0x7f52e80a71e0 2024-01-25T15:05:30.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.009+0000 7f52edbff640 1 --2- 172.21.15.29:0/604254061 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f52d406aed0 0x7f52d406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:30.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.010+0000 7f52edbff640 1 --2- 172.21.15.29:0/604254061 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f52d406aed0 0x7f52d406d390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f52e80c76b0 tx=0x7f52dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:30.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.013+0000 7f52e6ffd640 1 -- 172.21.15.29:0/604254061 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f52d80766e0 con 0x7f52e80a71e0 2024-01-25T15:05:30.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.195+0000 7f52f0664640 1 -- 172.21.15.29:0/604254061 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52e8074080 con 0x7f52e80a71e0 2024-01-25T15:05:30.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.197+0000 7f52e6ffd640 1 -- 172.21.15.29:0/604254061 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16739 (secure 0 0 0) 0x7f52d8035090 con 0x7f52e80a71e0 2024-01-25T15:05:30.199 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:30.199 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":38,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:05:28.223439+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:05:25.099043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-25T15:05:25.537967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:30.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.199+0000 7f52f0664640 1 -- 172.21.15.29:0/604254061 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f52d406aed0 msgr2=0x7f52d406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:30.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.199+0000 7f52f0664640 1 --2- 172.21.15.29:0/604254061 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f52d406aed0 0x7f52d406d390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f52e80c76b0 tx=0x7f52dc008040 comp rx=0 tx=0).stop 2024-01-25T15:05:30.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.199+0000 7f52f0664640 1 -- 172.21.15.29:0/604254061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52e80a71e0 msgr2=0x7f52e81566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:30.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.199+0000 7f52f0664640 1 --2- 172.21.15.29:0/604254061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52e80a71e0 0x7f52e81566f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f52d8000c00 tx=0x7f52d80046c0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.199+0000 7f52f0664640 1 -- 172.21.15.29:0/604254061 shutdown_connections 2024-01-25T15:05:30.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.199+0000 7f52f0664640 1 --2- 172.21.15.29:0/604254061 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f52e814fea0 0x7f52e81eb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.199+0000 7f52f0664640 1 --2- 172.21.15.29:0/604254061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52e80c4120 0x7f52e81eb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.199+0000 7f52f0664640 1 --2- 172.21.15.29:0/604254061 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f52d406aed0 0x7f52d406d390 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.199+0000 7f52f0664640 1 --2- 172.21.15.29:0/604254061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52e80a71e0 0x7f52e81566f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.199+0000 7f52f0664640 1 -- 172.21.15.29:0/604254061 >> 172.21.15.29:0/604254061 conn(0x7f52e80a9bc0 msgr2=0x7f52e80a9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:30.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.199+0000 7f52f0664640 1 -- 172.21.15.29:0/604254061 shutdown_connections 2024-01-25T15:05:30.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.199+0000 7f52f0664640 1 -- 172.21.15.29:0/604254061 wait complete. 2024-01-25T15:05:30.211 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-25T15:05:30.212 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-25T15:05:30.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.312+0000 7f179ea48640 1 Processor -- start 2024-01-25T15:05:30.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.312+0000 7f179ea48640 1 -- start start 2024-01-25T15:05:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.313+0000 7f179ea48640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1798151d10 0x7f1798155370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.313+0000 7f179ea48640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f17980c5e10 0x7f17980c6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.313+0000 7f179ea48640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17980c7d10 con 0x7f17980c75a0 2024-01-25T15:05:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.313+0000 7f179ea48640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1798158cb0 con 0x7f17980c5e10 2024-01-25T15:05:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.313+0000 7f179ea48640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1798157ef0 con 0x7f1798151d10 2024-01-25T15:05:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.313+0000 7f179cfe5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f17980c5e10 0x7f17980c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.313+0000 7f179cfe5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f17980c5e10 0x7f17980c6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33388/0 (socket says 172.21.15.29:33388) 2024-01-25T15:05:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.313+0000 7f17977fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f17980c75a0 0x7f17980c48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35026/0 (socket says 172.21.15.29:35026) 2024-01-25T15:05:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.313+0000 7f179cfe5640 1 -- 172.21.15.29:0/3269759976 learned_addr learned my addr 172.21.15.29:0/3269759976 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.313+0000 7f1797fff640 1 --2- 172.21.15.29:0/3269759976 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1798151d10 0x7f1798155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.313+0000 7f179cfe5640 1 -- 172.21.15.29:0/3269759976 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1798151d10 msgr2=0x7f1798155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.313+0000 7f179cfe5640 1 --2- 172.21.15.29:0/3269759976 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1798151d10 0x7f1798155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.313+0000 7f179cfe5640 1 -- 172.21.15.29:0/3269759976 >> v1:172.21.15.29:6789/0 conn(0x7f17980c75a0 legacy=0x7f17980c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.313+0000 7f179cfe5640 1 -- 172.21.15.29:0/3269759976 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17981581d0 con 0x7f17980c5e10 2024-01-25T15:05:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.313+0000 7f1796ffd640 1 -- 172.21.15.29:0/3269759976 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112106110 0 0) 0x7f17980c7d10 con 0x7f17980c75a0 2024-01-25T15:05:30.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.314+0000 7f179cfe5640 1 --2- 172.21.15.29:0/3269759976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17980c5e10 0x7f17980c6260 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1790009e50 tx=0x7f179002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d200a69b0974e1c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:30.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.314+0000 7f1796ffd640 1 -- 172.21.15.29:0/3269759976 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179002cb00 con 0x7f17980c5e10 2024-01-25T15:05:30.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.314+0000 7f1796ffd640 1 -- 172.21.15.29:0/3269759976 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179002cc60 con 0x7f17980c5e10 2024-01-25T15:05:30.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.314+0000 7f1796ffd640 1 -- 172.21.15.29:0/3269759976 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17900343f0 con 0x7f17980c5e10 2024-01-25T15:05:30.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.315+0000 7f179ea48640 1 -- 172.21.15.29:0/3269759976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17980c5e10 msgr2=0x7f17980c6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:30.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.315+0000 7f179ea48640 1 --2- 172.21.15.29:0/3269759976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17980c5e10 0x7f17980c6260 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1790009e50 tx=0x7f179002bf60 comp rx=0 tx=0).stop 2024-01-25T15:05:30.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.315+0000 7f179ea48640 1 -- 172.21.15.29:0/3269759976 shutdown_connections 2024-01-25T15:05:30.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.315+0000 7f179ea48640 1 --2- 172.21.15.29:0/3269759976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17980c5e10 0x7f17980c6260 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.315+0000 7f179ea48640 1 --2- 172.21.15.29:0/3269759976 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1798151d10 0x7f1798155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.315+0000 7f179ea48640 1 -- 172.21.15.29:0/3269759976 >> 172.21.15.29:0/3269759976 conn(0x7f17980c7f10 msgr2=0x7f17980c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:30.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.315+0000 7f179ea48640 1 -- 172.21.15.29:0/3269759976 shutdown_connections 2024-01-25T15:05:30.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.315+0000 7f179ea48640 1 -- 172.21.15.29:0/3269759976 wait complete. 2024-01-25T15:05:30.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.316+0000 7f179ea48640 1 Processor -- start 2024-01-25T15:05:30.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.316+0000 7f179ea48640 1 -- start start 2024-01-25T15:05:30.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.317+0000 7f179ea48640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17980c5e10 0x7f1798156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:30.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.317+0000 7f179ea48640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17980c75a0 0x7f17980ab780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:30.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.317+0000 7f179ea48640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1798151d10 0x7f17980ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:30.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.317+0000 7f179ea48640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1798156530 con 0x7f17980c75a0 2024-01-25T15:05:30.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.317+0000 7f179ea48640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1798099df0 con 0x7f17980c5e10 2024-01-25T15:05:30.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.317+0000 7f179ea48640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1798155940 con 0x7f1798151d10 2024-01-25T15:05:30.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.317+0000 7f17977fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17980c75a0 0x7f17980ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:30.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.317+0000 7f17977fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17980c75a0 0x7f17980ab780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33390/0 (socket says 172.21.15.29:33390) 2024-01-25T15:05:30.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.317+0000 7f17977fe640 1 -- 172.21.15.29:0/259977675 learned_addr learned my addr 172.21.15.29:0/259977675 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:30.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.317+0000 7f1797fff640 1 --2- 172.21.15.29:0/259977675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17980c5e10 0x7f1798156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:30.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.317+0000 7f179cfe5640 1 --2- 172.21.15.29:0/259977675 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1798151d10 0x7f17980ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:30.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.317+0000 7f17977fe640 1 -- 172.21.15.29:0/259977675 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1798151d10 msgr2=0x7f17980ac670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:30.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.317+0000 7f17977fe640 1 --2- 172.21.15.29:0/259977675 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1798151d10 0x7f17980ac670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.317+0000 7f17977fe640 1 -- 172.21.15.29:0/259977675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17980c5e10 msgr2=0x7f1798156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:30.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.317+0000 7f17977fe640 1 --2- 172.21.15.29:0/259977675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17980c5e10 0x7f1798156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.317+0000 7f17977fe640 1 -- 172.21.15.29:0/259977675 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1790009b30 con 0x7f17980c75a0 2024-01-25T15:05:30.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.317+0000 7f17977fe640 1 --2- 172.21.15.29:0/259977675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17980c75a0 0x7f17980ab780 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f178800c4d0 tx=0x7f178800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:30.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.317+0000 7f1794ff9640 1 -- 172.21.15.29:0/259977675 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17880074e0 con 0x7f17980c75a0 2024-01-25T15:05:30.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.317+0000 7f1794ff9640 1 -- 172.21.15.29:0/259977675 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1788007660 con 0x7f17980c75a0 2024-01-25T15:05:30.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.317+0000 7f1794ff9640 1 -- 172.21.15.29:0/259977675 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1788004a20 con 0x7f17980c75a0 2024-01-25T15:05:30.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.317+0000 7f179ea48640 1 -- 172.21.15.29:0/259977675 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1798155c00 con 0x7f17980c75a0 2024-01-25T15:05:30.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.318+0000 7f179ea48640 1 -- 172.21.15.29:0/259977675 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17981561c0 con 0x7f17980c75a0 2024-01-25T15:05:30.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.318+0000 7f179ea48640 1 -- 172.21.15.29:0/259977675 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179804eb10 con 0x7f17980c75a0 2024-01-25T15:05:30.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.319+0000 7f1794ff9640 1 -- 172.21.15.29:0/259977675 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f1788004b80 con 0x7f17980c75a0 2024-01-25T15:05:30.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.319+0000 7f1794ff9640 1 --2- 172.21.15.29:0/259977675 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f177806aed0 0x7f177806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:30.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.319+0000 7f1794ff9640 1 -- 172.21.15.29:0/259977675 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1788088b30 con 0x7f17980c75a0 2024-01-25T15:05:30.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.319+0000 7f1797fff640 1 --2- 172.21.15.29:0/259977675 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f177806aed0 0x7f177806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:30.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.320+0000 7f1797fff640 1 --2- 172.21.15.29:0/259977675 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f177806aed0 0x7f177806d390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1780009b40 tx=0x7f1780009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:30.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.323+0000 7f1794ff9640 1 -- 172.21.15.29:0/259977675 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f1788053a00 con 0x7f17980c75a0 2024-01-25T15:05:30.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.498+0000 7f179ea48640 1 -- 172.21.15.29:0/259977675 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1798158790 con 0x7f177806aed0 2024-01-25T15:05:30.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.506+0000 7f1794ff9640 1 -- 172.21.15.29:0/259977675 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274104 (secure 0 0 0) 0x7f1780011a60 con 0x7f177806aed0 2024-01-25T15:05:30.510 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:30.511 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-25T15:05:30.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.509+0000 7f179ea48640 1 -- 172.21.15.29:0/259977675 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f177806aed0 msgr2=0x7f177806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:30.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.509+0000 7f179ea48640 1 --2- 172.21.15.29:0/259977675 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f177806aed0 0x7f177806d390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1780009b40 tx=0x7f1780009190 comp rx=0 tx=0).stop 2024-01-25T15:05:30.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.509+0000 7f179ea48640 1 -- 172.21.15.29:0/259977675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17980c75a0 msgr2=0x7f17980ab780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:30.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.509+0000 7f179ea48640 1 --2- 172.21.15.29:0/259977675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17980c75a0 0x7f17980ab780 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f178800c4d0 tx=0x7f178800c990 comp rx=0 tx=0).stop 2024-01-25T15:05:30.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.509+0000 7f179ea48640 1 -- 172.21.15.29:0/259977675 shutdown_connections 2024-01-25T15:05:30.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.509+0000 7f179ea48640 1 --2- 172.21.15.29:0/259977675 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1798151d10 0x7f17980ac670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.509+0000 7f179ea48640 1 --2- 172.21.15.29:0/259977675 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f177806aed0 0x7f177806d390 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.509+0000 7f179ea48640 1 --2- 172.21.15.29:0/259977675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17980c75a0 0x7f17980ab780 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.509+0000 7f179ea48640 1 --2- 172.21.15.29:0/259977675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17980c5e10 0x7f1798156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.509+0000 7f179ea48640 1 -- 172.21.15.29:0/259977675 >> 172.21.15.29:0/259977675 conn(0x7f17980c7f10 msgr2=0x7f179806d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:30.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.509+0000 7f179ea48640 1 -- 172.21.15.29:0/259977675 shutdown_connections 2024-01-25T15:05:30.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.509+0000 7f179ea48640 1 -- 172.21.15.29:0/259977675 wait complete. 2024-01-25T15:05:30.523 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-01-25T15:05:28.930853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":249532,"kb_used_data":4200,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754725188,"statfs":{"total":773094113280,"available":772838592512,"internally_reserved":0,"allocated":4300800,"data_stored":2478264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000785"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":193,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-25T15:05:21.211300+0000","last_change":"2024-01-25T15:04:16.181635+0000","last_active":"2024-01-25T15:05:21.211300+0000","last_peered":"2024-01-25T15:05:21.211300+0000","last_clean":"2024-01-25T15:05:21.211300+0000","last_became_active":"2024-01-25T15:04:16.179890+0000","last_became_peered":"2024-01-25T15:04:16.179890+0000","last_unstale":"2024-01-25T15:05:21.211300+0000","last_undegraded":"2024-01-25T15:05:21.211300+0000","last_fullsized":"2024-01-25T15:05:21.211300+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_clean_scrub_stamp":"2024-01-25T15:04:14.956188+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:49:00.618327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":983040,"data_stored":752559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.878},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.71399999999999997}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.83599999999999997}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.629},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.79800000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31568,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":389120,"data_stored":162191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.66200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":162191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.627},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.504},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.64200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31572,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":389120,"data_stored":162191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.497},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.748}]},{"osd":3,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.629},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.66600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":162191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":3.3559999999999999,"5min":3.3559999999999999,"15min":3.3559999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.26800000000000002}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.4209999999999998,"5min":3.4209999999999998,"15min":3.4209999999999998},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.4689999999999999,"5min":3.4689999999999999,"15min":3.4689999999999999},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":3.508,"5min":3.508,"15min":3.508},"last":0.498},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.435},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.5449999999999999,"5min":3.5449999999999999,"15min":3.5449999999999999},"last":0.56000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31560,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":389120,"data_stored":162191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.318}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.69999999999999996}]},{"osd":5,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.79700000000000004}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.83099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":162191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.30599999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.755}]},{"osd":7,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.69899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":752559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.36599999999999999}]},{"osd":2,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.317}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.499},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.48599999999999999}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.54100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:05:30.528 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-25T15:05:30.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.662+0000 7feba2a1e640 1 Processor -- start 2024-01-25T15:05:30.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.662+0000 7feba2a1e640 1 -- start start 2024-01-25T15:05:30.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.662+0000 7feba2a1e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feb9c151c90 0x7feb9c06b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:30.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.662+0000 7feba2a1e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb9c0c8270 0x7feb9c0c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:30.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.662+0000 7feba2a1e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9c0c5920 con 0x7feb9c155140 2024-01-25T15:05:30.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.662+0000 7feba2a1e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9c0c2d70 con 0x7feb9c151c90 2024-01-25T15:05:30.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.662+0000 7feba2a1e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0c4730 con 0x7feb9c0c8270 2024-01-25T15:05:30.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.662+0000 7feb9bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feb9c151c90 0x7feb9c06b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:30.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.663+0000 7feb9bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feb9c151c90 0x7feb9c06b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33406/0 (socket says 172.21.15.29:33406) 2024-01-25T15:05:30.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.663+0000 7feb9bfff640 1 -- 172.21.15.29:0/144400154 learned_addr learned my addr 172.21.15.29:0/144400154 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:30.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.663+0000 7feba0fbb640 1 --2- 172.21.15.29:0/144400154 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb9c0c8270 0x7feb9c0c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:30.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.663+0000 7feb9bfff640 1 -- 172.21.15.29:0/144400154 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb9c0c8270 msgr2=0x7feb9c0c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:30.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.663+0000 7feb9bfff640 1 --2- 172.21.15.29:0/144400154 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb9c0c8270 0x7feb9c0c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.663+0000 7feb9bfff640 1 -- 172.21.15.29:0/144400154 >> v1:172.21.15.52:6789/0 conn(0x7feb9c155140 legacy=0x7feb9c0c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:30.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.663+0000 7feb9bfff640 1 -- 172.21.15.29:0/144400154 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c0c4a10 con 0x7feb9c151c90 2024-01-25T15:05:30.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.664+0000 7feb9bfff640 1 --2- 172.21.15.29:0/144400154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb9c151c90 0x7feb9c06b7d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009870 tx=0x7feb8c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f281879ae1d94eb1 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:30.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.664+0000 7feb9affd640 1 -- 172.21.15.29:0/144400154 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c0317c0 con 0x7feb9c151c90 2024-01-25T15:05:30.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.664+0000 7feb9affd640 1 -- 172.21.15.29:0/144400154 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c031920 con 0x7feb9c151c90 2024-01-25T15:05:30.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.664+0000 7feb9affd640 1 -- 172.21.15.29:0/144400154 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c031cb0 con 0x7feb9c151c90 2024-01-25T15:05:30.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.664+0000 7feba2a1e640 1 -- 172.21.15.29:0/144400154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb9c151c90 msgr2=0x7feb9c06b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:30.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.664+0000 7feba2a1e640 1 --2- 172.21.15.29:0/144400154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb9c151c90 0x7feb9c06b7d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009870 tx=0x7feb8c02b860 comp rx=0 tx=0).stop 2024-01-25T15:05:30.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.664+0000 7feba2a1e640 1 -- 172.21.15.29:0/144400154 shutdown_connections 2024-01-25T15:05:30.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.664+0000 7feba2a1e640 1 --2- 172.21.15.29:0/144400154 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb9c0c8270 0x7feb9c0c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.664+0000 7feba2a1e640 1 --2- 172.21.15.29:0/144400154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb9c151c90 0x7feb9c06b7d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.664+0000 7feba2a1e640 1 -- 172.21.15.29:0/144400154 >> 172.21.15.29:0/144400154 conn(0x7feb9c06a8a0 msgr2=0x7feb9c06acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:30.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.664+0000 7feba2a1e640 1 -- 172.21.15.29:0/144400154 shutdown_connections 2024-01-25T15:05:30.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.664+0000 7feba2a1e640 1 -- 172.21.15.29:0/144400154 wait complete. 2024-01-25T15:05:30.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.665+0000 7feba2a1e640 1 Processor -- start 2024-01-25T15:05:30.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.666+0000 7feba2a1e640 1 -- start start 2024-01-25T15:05:30.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.666+0000 7feba2a1e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb9c0c8270 0x7feb9c14dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:30.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.666+0000 7feba2a1e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb9c151c90 0x7feb9c06e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:30.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.666+0000 7feba2a1e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb9c155140 0x7feb9c146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:30.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.666+0000 7feba2a1e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c1ed790 con 0x7feb9c0c8270 2024-01-25T15:05:30.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.666+0000 7feba2a1e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0c6b10 con 0x7feb9c151c90 2024-01-25T15:05:30.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.666+0000 7feba2a1e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0c6df0 con 0x7feb9c155140 2024-01-25T15:05:30.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.666+0000 7feb9bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb9c0c8270 0x7feb9c14dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:30.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.666+0000 7feb9bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb9c0c8270 0x7feb9c14dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33414/0 (socket says 172.21.15.29:33414) 2024-01-25T15:05:30.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.666+0000 7feb9bfff640 1 -- 172.21.15.29:0/2432190794 learned_addr learned my addr 172.21.15.29:0/2432190794 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:30.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.667+0000 7feba0fbb640 1 --2- 172.21.15.29:0/2432190794 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb9c155140 0x7feb9c146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:30.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.667+0000 7feb9b7fe640 1 --2- 172.21.15.29:0/2432190794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb9c151c90 0x7feb9c06e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:30.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.667+0000 7feb9bfff640 1 -- 172.21.15.29:0/2432190794 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb9c155140 msgr2=0x7feb9c146d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:30.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.667+0000 7feb9bfff640 1 --2- 172.21.15.29:0/2432190794 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb9c155140 0x7feb9c146d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.667+0000 7feb9bfff640 1 -- 172.21.15.29:0/2432190794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb9c151c90 msgr2=0x7feb9c06e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:30.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.667+0000 7feb9bfff640 1 --2- 172.21.15.29:0/2432190794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb9c151c90 0x7feb9c06e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.667+0000 7feb9bfff640 1 -- 172.21.15.29:0/2432190794 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c0094d0 con 0x7feb9c0c8270 2024-01-25T15:05:30.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.667+0000 7feba0fbb640 1 --2- 172.21.15.29:0/2432190794 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb9c155140 0x7feb9c146d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:30.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.667+0000 7feb9b7fe640 1 --2- 172.21.15.29:0/2432190794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb9c151c90 0x7feb9c06e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:30.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.667+0000 7feb9bfff640 1 --2- 172.21.15.29:0/2432190794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb9c0c8270 0x7feb9c14dce0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7feb8c000c00 tx=0x7feb8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:30.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.667+0000 7feb98ff9640 1 -- 172.21.15.29:0/2432190794 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c032860 con 0x7feb9c0c8270 2024-01-25T15:05:30.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.667+0000 7feb98ff9640 1 -- 172.21.15.29:0/2432190794 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c0329c0 con 0x7feb9c0c8270 2024-01-25T15:05:30.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.667+0000 7feba2a1e640 1 -- 172.21.15.29:0/2432190794 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9c0c70d0 con 0x7feb9c0c8270 2024-01-25T15:05:30.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.667+0000 7feb98ff9640 1 -- 172.21.15.29:0/2432190794 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c032d70 con 0x7feb9c0c8270 2024-01-25T15:05:30.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.667+0000 7feba2a1e640 1 -- 172.21.15.29:0/2432190794 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9c14e220 con 0x7feb9c0c8270 2024-01-25T15:05:30.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.668+0000 7feba2a1e640 1 -- 172.21.15.29:0/2432190794 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9c155560 con 0x7feb9c0c8270 2024-01-25T15:05:30.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.668+0000 7feb98ff9640 1 -- 172.21.15.29:0/2432190794 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7feb8c04e450 con 0x7feb9c0c8270 2024-01-25T15:05:30.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.669+0000 7feb98ff9640 1 --2- 172.21.15.29:0/2432190794 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7feb8806af00 0x7feb8806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:30.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.669+0000 7feb98ff9640 1 -- 172.21.15.29:0/2432190794 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7feb8c0ab9f0 con 0x7feb9c0c8270 2024-01-25T15:05:30.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.669+0000 7feb9b7fe640 1 --2- 172.21.15.29:0/2432190794 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7feb8806af00 0x7feb8806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:30.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.670+0000 7feb9b7fe640 1 --2- 172.21.15.29:0/2432190794 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7feb8806af00 0x7feb8806d3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0c4fa0 tx=0x7feb90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:30.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.673+0000 7feb98ff9640 1 -- 172.21.15.29:0/2432190794 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7feb9c155560 con 0x7feb9c0c8270 2024-01-25T15:05:30.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.851+0000 7feba2a1e640 1 -- 172.21.15.29:0/2432190794 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feb9c152070 con 0x7feb8806af00 2024-01-25T15:05:30.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.859+0000 7feb98ff9640 1 -- 172.21.15.29:0/2432190794 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274104 (secure 0 0 0) 0x7feb90001cd0 con 0x7feb8806af00 2024-01-25T15:05:30.863 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:30.864 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-25T15:05:30.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.861+0000 7feba2a1e640 1 -- 172.21.15.29:0/2432190794 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7feb8806af00 msgr2=0x7feb8806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:30.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.861+0000 7feba2a1e640 1 --2- 172.21.15.29:0/2432190794 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7feb8806af00 0x7feb8806d3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0c4fa0 tx=0x7feb90009040 comp rx=0 tx=0).stop 2024-01-25T15:05:30.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.861+0000 7feba2a1e640 1 -- 172.21.15.29:0/2432190794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb9c0c8270 msgr2=0x7feb9c14dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:30.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.861+0000 7feba2a1e640 1 --2- 172.21.15.29:0/2432190794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb9c0c8270 0x7feb9c14dce0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7feb8c000c00 tx=0x7feb8c0046c0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.862+0000 7feba2a1e640 1 -- 172.21.15.29:0/2432190794 shutdown_connections 2024-01-25T15:05:30.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.862+0000 7feba2a1e640 1 --2- 172.21.15.29:0/2432190794 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7feb9c155140 0x7feb9c146d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.862+0000 7feba2a1e640 1 --2- 172.21.15.29:0/2432190794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb9c151c90 0x7feb9c06e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.862+0000 7feba2a1e640 1 --2- 172.21.15.29:0/2432190794 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7feb8806af00 0x7feb8806d3c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.862+0000 7feba2a1e640 1 --2- 172.21.15.29:0/2432190794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb9c0c8270 0x7feb9c14dce0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:30.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.862+0000 7feba2a1e640 1 -- 172.21.15.29:0/2432190794 >> 172.21.15.29:0/2432190794 conn(0x7feb9c06a8a0 msgr2=0x7feb9c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:30.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.862+0000 7feba2a1e640 1 -- 172.21.15.29:0/2432190794 shutdown_connections 2024-01-25T15:05:30.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:30.862+0000 7feba2a1e640 1 -- 172.21.15.29:0/2432190794 wait complete. 2024-01-25T15:05:30.874 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-01-25T15:05:28.930853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":249532,"kb_used_data":4200,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754725188,"statfs":{"total":773094113280,"available":772838592512,"internally_reserved":0,"allocated":4300800,"data_stored":2478264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000785"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:26.202048+0000","last_change":"2024-01-25T15:05:26.202048+0000","last_active":"2024-01-25T15:05:26.202048+0000","last_peered":"2024-01-25T15:05:26.202048+0000","last_clean":"2024-01-25T15:05:26.202048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:26.202048+0000","last_undegraded":"2024-01-25T15:05:26.202048+0000","last_fullsized":"2024-01-25T15:05:26.202048+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-25T15:05:25.198167+0000","last_change":"2024-01-25T15:05:25.198167+0000","last_active":"2024-01-25T15:05:25.198167+0000","last_peered":"2024-01-25T15:05:25.198167+0000","last_clean":"2024-01-25T15:05:25.198167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-25T15:05:25.198167+0000","last_undegraded":"2024-01-25T15:05:25.198167+0000","last_fullsized":"2024-01-25T15:05:25.198167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":193,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-25T15:05:21.211300+0000","last_change":"2024-01-25T15:04:16.181635+0000","last_active":"2024-01-25T15:05:21.211300+0000","last_peered":"2024-01-25T15:05:21.211300+0000","last_clean":"2024-01-25T15:05:21.211300+0000","last_became_active":"2024-01-25T15:04:16.179890+0000","last_became_peered":"2024-01-25T15:04:16.179890+0000","last_unstale":"2024-01-25T15:05:21.211300+0000","last_undegraded":"2024-01-25T15:05:21.211300+0000","last_fullsized":"2024-01-25T15:05:21.211300+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_clean_scrub_stamp":"2024-01-25T15:04:14.956188+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:49:00.618327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":983040,"data_stored":752559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.878},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.71399999999999997}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.83599999999999997}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.629},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.79800000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31568,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":389120,"data_stored":162191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.66200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":162191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.627},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.504},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.64200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31572,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":389120,"data_stored":162191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.497},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.748}]},{"osd":3,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.629},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.66600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":162191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":3.3559999999999999,"5min":3.3559999999999999,"15min":3.3559999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.26800000000000002}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.4209999999999998,"5min":3.4209999999999998,"15min":3.4209999999999998},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.4689999999999999,"5min":3.4689999999999999,"15min":3.4689999999999999},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":3.508,"5min":3.508,"15min":3.508},"last":0.498},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.435},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.5449999999999999,"5min":3.5449999999999999,"15min":3.5449999999999999},"last":0.56000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31560,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":389120,"data_stored":162191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.318}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.69999999999999996}]},{"osd":5,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.79700000000000004}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.83099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":162191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.30599999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.755}]},{"osd":7,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.69899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":752559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.36599999999999999}]},{"osd":2,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.317}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.499},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.48599999999999999}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.54100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:05:30.878 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-25T15:05:30.945 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-25T15:05:30.960 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-25T15:05:31.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.014+0000 7fa6c5664640 1 Processor -- start 2024-01-25T15:05:31.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.015+0000 7fa6c5664640 1 -- start start 2024-01-25T15:05:31.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.015+0000 7fa6c5664640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa6c0151d10 0x7fa6c0155370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:31.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.015+0000 7fa6c5664640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6c00c75a0 0x7fa6c00c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:31.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.015+0000 7fa6c5664640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c00c7d10 con 0x7fa6c00c4e30 2024-01-25T15:05:31.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.015+0000 7fa6c5664640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c0158cb0 con 0x7fa6c0151d10 2024-01-25T15:05:31.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.015+0000 7fa6c5664640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c0157ef0 con 0x7fa6c00c75a0 2024-01-25T15:05:31.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.016+0000 7fa6be7fc640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6c00c75a0 0x7fa6c00c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:31.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.016+0000 7fa6beffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa6c0151d10 0x7fa6c0155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:31.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.016+0000 7fa6be7fc640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6c00c75a0 0x7fa6c00c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:39924/0 (socket says 172.21.15.29:39924) 2024-01-25T15:05:31.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.016+0000 7fa6be7fc640 1 -- 172.21.15.29:0/1180904192 learned_addr learned my addr 172.21.15.29:0/1180904192 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:31.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.016+0000 7fa6beffd640 1 -- 172.21.15.29:0/1180904192 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6c00c75a0 msgr2=0x7fa6c00c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:31.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.016+0000 7fa6beffd640 1 --2- 172.21.15.29:0/1180904192 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6c00c75a0 0x7fa6c00c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.016+0000 7fa6beffd640 1 -- 172.21.15.29:0/1180904192 >> v1:172.21.15.52:6789/0 conn(0x7fa6c00c4e30 legacy=0x7fa6c00c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:31.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.016+0000 7fa6beffd640 1 -- 172.21.15.29:0/1180904192 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c01581d0 con 0x7fa6c0151d10 2024-01-25T15:05:31.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.016+0000 7fa6be7fc640 1 --2- 172.21.15.29:0/1180904192 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6c00c75a0 0x7fa6c00c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:05:31.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.017+0000 7fa6beffd640 1 --2- 172.21.15.29:0/1180904192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6c0151d10 0x7fa6c0155370 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80097a0 tx=0x7fa6b802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3f3300175e0b30 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:31.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.017+0000 7fa6bdffb640 1 -- 172.21.15.29:0/1180904192 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8031830 con 0x7fa6c0151d10 2024-01-25T15:05:31.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.017+0000 7fa6bdffb640 1 -- 172.21.15.29:0/1180904192 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b8031990 con 0x7fa6c0151d10 2024-01-25T15:05:31.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.017+0000 7fa6bdffb640 1 -- 172.21.15.29:0/1180904192 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8031d20 con 0x7fa6c0151d10 2024-01-25T15:05:31.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.017+0000 7fa6c5664640 1 -- 172.21.15.29:0/1180904192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6c0151d10 msgr2=0x7fa6c0155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:31.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.017+0000 7fa6c5664640 1 --2- 172.21.15.29:0/1180904192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6c0151d10 0x7fa6c0155370 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80097a0 tx=0x7fa6b802b8d0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.018+0000 7fa6c5664640 1 -- 172.21.15.29:0/1180904192 shutdown_connections 2024-01-25T15:05:31.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.018+0000 7fa6c5664640 1 --2- 172.21.15.29:0/1180904192 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6c00c75a0 0x7fa6c00c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.018+0000 7fa6c5664640 1 --2- 172.21.15.29:0/1180904192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6c0151d10 0x7fa6c0155370 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.018+0000 7fa6c5664640 1 -- 172.21.15.29:0/1180904192 >> 172.21.15.29:0/1180904192 conn(0x7fa6c00c7f10 msgr2=0x7fa6c00c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:31.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.018+0000 7fa6c5664640 1 -- 172.21.15.29:0/1180904192 shutdown_connections 2024-01-25T15:05:31.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.018+0000 7fa6c5664640 1 -- 172.21.15.29:0/1180904192 wait complete. 2024-01-25T15:05:31.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.019+0000 7fa6c5664640 1 Processor -- start 2024-01-25T15:05:31.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.019+0000 7fa6c5664640 1 -- start start 2024-01-25T15:05:31.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.019+0000 7fa6c5664640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6c00c4e30 0x7fa6c014a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:31.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.019+0000 7fa6c5664640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6c00c75a0 0x7fa6c01ea700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:31.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.019+0000 7fa6c5664640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6c0151d10 0x7fa6c00ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:31.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.020+0000 7fa6c5664640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c014ace0 con 0x7fa6c0151d10 2024-01-25T15:05:31.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.020+0000 7fa6c5664640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c0157100 con 0x7fa6c00c75a0 2024-01-25T15:05:31.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.020+0000 7fa6c5664640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c01eac40 con 0x7fa6c00c4e30 2024-01-25T15:05:31.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.020+0000 7fa6bf7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6c0151d10 0x7fa6c00ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:31.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.020+0000 7fa6beffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6c00c4e30 0x7fa6c014a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:31.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.020+0000 7fa6bf7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6c0151d10 0x7fa6c00ac9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33424/0 (socket says 172.21.15.29:33424) 2024-01-25T15:05:31.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.020+0000 7fa6bf7fe640 1 -- 172.21.15.29:0/2050321597 learned_addr learned my addr 172.21.15.29:0/2050321597 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:31.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.020+0000 7fa6be7fc640 1 --2- 172.21.15.29:0/2050321597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6c00c75a0 0x7fa6c01ea700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:31.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.020+0000 7fa6bf7fe640 1 -- 172.21.15.29:0/2050321597 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6c00c4e30 msgr2=0x7fa6c014a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:31.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.020+0000 7fa6bf7fe640 1 --2- 172.21.15.29:0/2050321597 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6c00c4e30 0x7fa6c014a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.020+0000 7fa6bf7fe640 1 -- 172.21.15.29:0/2050321597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6c00c75a0 msgr2=0x7fa6c01ea700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:31.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.020+0000 7fa6bf7fe640 1 --2- 172.21.15.29:0/2050321597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6c00c75a0 0x7fa6c01ea700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.020+0000 7fa6bf7fe640 1 -- 172.21.15.29:0/2050321597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a80094d0 con 0x7fa6c0151d10 2024-01-25T15:05:31.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.020+0000 7fa6bf7fe640 1 --2- 172.21.15.29:0/2050321597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6c0151d10 0x7fa6c00ac9a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000c6b0 tx=0x7fa6b000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:31.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.020+0000 7fa6b77fe640 1 -- 172.21.15.29:0/2050321597 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0003b70 con 0x7fa6c0151d10 2024-01-25T15:05:31.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.020+0000 7fa6b77fe640 1 -- 172.21.15.29:0/2050321597 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b0003cf0 con 0x7fa6c0151d10 2024-01-25T15:05:31.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.020+0000 7fa6c5664640 1 -- 172.21.15.29:0/2050321597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b8009400 con 0x7fa6c0151d10 2024-01-25T15:05:31.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.020+0000 7fa6b77fe640 1 -- 172.21.15.29:0/2050321597 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0003ea0 con 0x7fa6c0151d10 2024-01-25T15:05:31.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.020+0000 7fa6c5664640 1 -- 172.21.15.29:0/2050321597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c0157680 con 0x7fa6c0151d10 2024-01-25T15:05:31.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.021+0000 7fa6c5664640 1 -- 172.21.15.29:0/2050321597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c004eb10 con 0x7fa6c0151d10 2024-01-25T15:05:31.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.022+0000 7fa6b77fe640 1 -- 172.21.15.29:0/2050321597 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fa6b0005310 con 0x7fa6c0151d10 2024-01-25T15:05:31.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.022+0000 7fa6b77fe640 1 --2- 172.21.15.29:0/2050321597 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa6a006af00 0x7fa6a006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:31.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.022+0000 7fa6b77fe640 1 -- 172.21.15.29:0/2050321597 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa6b0089390 con 0x7fa6c0151d10 2024-01-25T15:05:31.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.022+0000 7fa6beffd640 1 --2- 172.21.15.29:0/2050321597 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa6a006af00 0x7fa6a006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:31.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.023+0000 7fa6beffd640 1 --2- 172.21.15.29:0/2050321597 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa6a006af00 0x7fa6a006d3c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8036000 tx=0x7fa6b803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:31.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.026+0000 7fa6b77fe640 1 -- 172.21.15.29:0/2050321597 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fa6b00541d0 con 0x7fa6c0151d10 2024-01-25T15:05:31.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.201+0000 7fa6c5664640 1 -- 172.21.15.29:0/2050321597 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa6c0158790 con 0x7fa6a006af00 2024-01-25T15:05:31.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.210+0000 7fa6b77fe640 1 -- 172.21.15.29:0/2050321597 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288872 (secure 0 0 0) 0x7fa6b8045410 con 0x7fa6a006af00 2024-01-25T15:05:31.214 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:31.215 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-25T15:05:31.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.212+0000 7fa6c5664640 1 -- 172.21.15.29:0/2050321597 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa6a006af00 msgr2=0x7fa6a006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:31.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.212+0000 7fa6c5664640 1 --2- 172.21.15.29:0/2050321597 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa6a006af00 0x7fa6a006d3c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8036000 tx=0x7fa6b803c040 comp rx=0 tx=0).stop 2024-01-25T15:05:31.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.213+0000 7fa6c5664640 1 -- 172.21.15.29:0/2050321597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6c0151d10 msgr2=0x7fa6c00ac9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:31.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.213+0000 7fa6c5664640 1 --2- 172.21.15.29:0/2050321597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6c0151d10 0x7fa6c00ac9a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000c6b0 tx=0x7fa6b000cb70 comp rx=0 tx=0).stop 2024-01-25T15:05:31.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.213+0000 7fa6c5664640 1 -- 172.21.15.29:0/2050321597 shutdown_connections 2024-01-25T15:05:31.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.213+0000 7fa6c5664640 1 --2- 172.21.15.29:0/2050321597 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa6a006af00 0x7fa6a006d3c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.213+0000 7fa6c5664640 1 --2- 172.21.15.29:0/2050321597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6c0151d10 0x7fa6c00ac9a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.213+0000 7fa6c5664640 1 --2- 172.21.15.29:0/2050321597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6c00c75a0 0x7fa6c01ea700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.213+0000 7fa6c5664640 1 --2- 172.21.15.29:0/2050321597 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa6c00c4e30 0x7fa6c014a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.213+0000 7fa6c5664640 1 -- 172.21.15.29:0/2050321597 >> 172.21.15.29:0/2050321597 conn(0x7fa6c00c7f10 msgr2=0x7fa6c0152640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:31.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.213+0000 7fa6c5664640 1 -- 172.21.15.29:0/2050321597 shutdown_connections 2024-01-25T15:05:31.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.213+0000 7fa6c5664640 1 -- 172.21.15.29:0/2050321597 wait complete. 2024-01-25T15:05:31.225 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-01-25T15:05:30.931393+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254056,"kb_used_data":4576,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720664,"statfs":{"total":773094113280,"available":772833959936,"internally_reserved":0,"allocated":4685824,"data_stored":2654940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.728529"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230015+0000","last_change":"2024-01-25T15:05:27.231656+0000","last_active":"2024-01-25T15:05:28.230015+0000","last_peered":"2024-01-25T15:05:28.230015+0000","last_clean":"2024-01-25T15:05:28.230015+0000","last_became_active":"2024-01-25T15:05:27.228184+0000","last_became_peered":"2024-01-25T15:05:27.228184+0000","last_unstale":"2024-01-25T15:05:28.230015+0000","last_undegraded":"2024-01-25T15:05:28.230015+0000","last_fullsized":"2024-01-25T15:05:28.230015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:44:26.334164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229740+0000","last_change":"2024-01-25T15:05:27.235003+0000","last_active":"2024-01-25T15:05:28.229740+0000","last_peered":"2024-01-25T15:05:28.229740+0000","last_clean":"2024-01-25T15:05:28.229740+0000","last_became_active":"2024-01-25T15:05:27.234734+0000","last_became_peered":"2024-01-25T15:05:27.234734+0000","last_unstale":"2024-01-25T15:05:28.229740+0000","last_undegraded":"2024-01-25T15:05:28.229740+0000","last_fullsized":"2024-01-25T15:05:28.229740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:55:46.833186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834190+0000","last_change":"2024-01-25T15:05:27.239434+0000","last_active":"2024-01-25T15:05:28.834190+0000","last_peered":"2024-01-25T15:05:28.834190+0000","last_clean":"2024-01-25T15:05:28.834190+0000","last_became_active":"2024-01-25T15:05:27.239182+0000","last_became_peered":"2024-01-25T15:05:27.239182+0000","last_unstale":"2024-01-25T15:05:28.834190+0000","last_undegraded":"2024-01-25T15:05:28.834190+0000","last_fullsized":"2024-01-25T15:05:28.834190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:02:27.702949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847185+0000","last_change":"2024-01-25T15:05:27.243839+0000","last_active":"2024-01-25T15:05:28.847185+0000","last_peered":"2024-01-25T15:05:28.847185+0000","last_clean":"2024-01-25T15:05:28.847185+0000","last_became_active":"2024-01-25T15:05:27.243563+0000","last_became_peered":"2024-01-25T15:05:27.243563+0000","last_unstale":"2024-01-25T15:05:28.847185+0000","last_undegraded":"2024-01-25T15:05:28.847185+0000","last_fullsized":"2024-01-25T15:05:28.847185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:18:52.758791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847057+0000","last_change":"2024-01-25T15:05:27.230988+0000","last_active":"2024-01-25T15:05:28.847057+0000","last_peered":"2024-01-25T15:05:28.847057+0000","last_clean":"2024-01-25T15:05:28.847057+0000","last_became_active":"2024-01-25T15:05:27.230740+0000","last_became_peered":"2024-01-25T15:05:27.230740+0000","last_unstale":"2024-01-25T15:05:28.847057+0000","last_undegraded":"2024-01-25T15:05:28.847057+0000","last_fullsized":"2024-01-25T15:05:28.847057+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:22:36.224608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494090+0000","last_change":"2024-01-25T15:05:27.239531+0000","last_active":"2024-01-25T15:05:28.494090+0000","last_peered":"2024-01-25T15:05:28.494090+0000","last_clean":"2024-01-25T15:05:28.494090+0000","last_became_active":"2024-01-25T15:05:27.238884+0000","last_became_peered":"2024-01-25T15:05:27.238884+0000","last_unstale":"2024-01-25T15:05:28.494090+0000","last_undegraded":"2024-01-25T15:05:28.494090+0000","last_fullsized":"2024-01-25T15:05:28.494090+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:26:19.413150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847428+0000","last_change":"2024-01-25T15:05:27.236157+0000","last_active":"2024-01-25T15:05:28.847428+0000","last_peered":"2024-01-25T15:05:28.847428+0000","last_clean":"2024-01-25T15:05:28.847428+0000","last_became_active":"2024-01-25T15:05:27.235882+0000","last_became_peered":"2024-01-25T15:05:27.235882+0000","last_unstale":"2024-01-25T15:05:28.847428+0000","last_undegraded":"2024-01-25T15:05:28.847428+0000","last_fullsized":"2024-01-25T15:05:28.847428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:53:45.905579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229462+0000","last_change":"2024-01-25T15:05:27.242301+0000","last_active":"2024-01-25T15:05:28.229462+0000","last_peered":"2024-01-25T15:05:28.229462+0000","last_clean":"2024-01-25T15:05:28.229462+0000","last_became_active":"2024-01-25T15:05:27.242077+0000","last_became_peered":"2024-01-25T15:05:27.242077+0000","last_unstale":"2024-01-25T15:05:28.229462+0000","last_undegraded":"2024-01-25T15:05:28.229462+0000","last_fullsized":"2024-01-25T15:05:28.229462+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:17:07.138969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834487+0000","last_change":"2024-01-25T15:05:27.236734+0000","last_active":"2024-01-25T15:05:28.834487+0000","last_peered":"2024-01-25T15:05:28.834487+0000","last_clean":"2024-01-25T15:05:28.834487+0000","last_became_active":"2024-01-25T15:05:27.236377+0000","last_became_peered":"2024-01-25T15:05:27.236377+0000","last_unstale":"2024-01-25T15:05:28.834487+0000","last_undegraded":"2024-01-25T15:05:28.834487+0000","last_fullsized":"2024-01-25T15:05:28.834487+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:02:27.622813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847961+0000","last_change":"2024-01-25T15:05:27.244798+0000","last_active":"2024-01-25T15:05:28.847961+0000","last_peered":"2024-01-25T15:05:28.847961+0000","last_clean":"2024-01-25T15:05:28.847961+0000","last_became_active":"2024-01-25T15:05:27.244547+0000","last_became_peered":"2024-01-25T15:05:27.244547+0000","last_unstale":"2024-01-25T15:05:28.847961+0000","last_undegraded":"2024-01-25T15:05:28.847961+0000","last_fullsized":"2024-01-25T15:05:28.847961+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:47:01.188072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847909+0000","last_change":"2024-01-25T15:05:27.238399+0000","last_active":"2024-01-25T15:05:28.847909+0000","last_peered":"2024-01-25T15:05:28.847909+0000","last_clean":"2024-01-25T15:05:28.847909+0000","last_became_active":"2024-01-25T15:05:27.237999+0000","last_became_peered":"2024-01-25T15:05:27.237999+0000","last_unstale":"2024-01-25T15:05:28.847909+0000","last_undegraded":"2024-01-25T15:05:28.847909+0000","last_fullsized":"2024-01-25T15:05:28.847909+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:43:33.136506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834150+0000","last_change":"2024-01-25T15:05:27.230234+0000","last_active":"2024-01-25T15:05:28.834150+0000","last_peered":"2024-01-25T15:05:28.834150+0000","last_clean":"2024-01-25T15:05:28.834150+0000","last_became_active":"2024-01-25T15:05:27.229945+0000","last_became_peered":"2024-01-25T15:05:27.229945+0000","last_unstale":"2024-01-25T15:05:28.834150+0000","last_undegraded":"2024-01-25T15:05:28.834150+0000","last_fullsized":"2024-01-25T15:05:28.834150+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:10.931099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847698+0000","last_change":"2024-01-25T15:05:27.244146+0000","last_active":"2024-01-25T15:05:28.847698+0000","last_peered":"2024-01-25T15:05:28.847698+0000","last_clean":"2024-01-25T15:05:28.847698+0000","last_became_active":"2024-01-25T15:05:27.243861+0000","last_became_peered":"2024-01-25T15:05:27.243861+0000","last_unstale":"2024-01-25T15:05:28.847698+0000","last_undegraded":"2024-01-25T15:05:28.847698+0000","last_fullsized":"2024-01-25T15:05:28.847698+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:06:14.777919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.715673+0000","last_change":"2024-01-25T15:05:27.236676+0000","last_active":"2024-01-25T15:05:28.715673+0000","last_peered":"2024-01-25T15:05:28.715673+0000","last_clean":"2024-01-25T15:05:28.715673+0000","last_became_active":"2024-01-25T15:05:27.236411+0000","last_became_peered":"2024-01-25T15:05:27.236411+0000","last_unstale":"2024-01-25T15:05:28.715673+0000","last_undegraded":"2024-01-25T15:05:28.715673+0000","last_fullsized":"2024-01-25T15:05:28.715673+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:43:59.664529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847494+0000","last_change":"2024-01-25T15:05:27.234767+0000","last_active":"2024-01-25T15:05:28.847494+0000","last_peered":"2024-01-25T15:05:28.847494+0000","last_clean":"2024-01-25T15:05:28.847494+0000","last_became_active":"2024-01-25T15:05:27.234370+0000","last_became_peered":"2024-01-25T15:05:27.234370+0000","last_unstale":"2024-01-25T15:05:28.847494+0000","last_undegraded":"2024-01-25T15:05:28.847494+0000","last_fullsized":"2024-01-25T15:05:28.847494+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:24:11.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230576+0000","last_change":"2024-01-25T15:05:27.246760+0000","last_active":"2024-01-25T15:05:28.230576+0000","last_peered":"2024-01-25T15:05:28.230576+0000","last_clean":"2024-01-25T15:05:28.230576+0000","last_became_active":"2024-01-25T15:05:27.246482+0000","last_became_peered":"2024-01-25T15:05:27.246482+0000","last_unstale":"2024-01-25T15:05:28.230576+0000","last_undegraded":"2024-01-25T15:05:28.230576+0000","last_fullsized":"2024-01-25T15:05:28.230576+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:10.931099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231687+0000","last_change":"2024-01-25T15:05:27.246282+0000","last_active":"2024-01-25T15:05:28.231687+0000","last_peered":"2024-01-25T15:05:28.231687+0000","last_clean":"2024-01-25T15:05:28.231687+0000","last_became_active":"2024-01-25T15:05:27.245958+0000","last_became_peered":"2024-01-25T15:05:27.245958+0000","last_unstale":"2024-01-25T15:05:28.231687+0000","last_undegraded":"2024-01-25T15:05:28.231687+0000","last_fullsized":"2024-01-25T15:05:28.231687+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:06:14.777919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231213+0000","last_change":"2024-01-25T15:05:27.229020+0000","last_active":"2024-01-25T15:05:28.231213+0000","last_peered":"2024-01-25T15:05:28.231213+0000","last_clean":"2024-01-25T15:05:28.231213+0000","last_became_active":"2024-01-25T15:05:27.228749+0000","last_became_peered":"2024-01-25T15:05:27.228749+0000","last_unstale":"2024-01-25T15:05:28.231213+0000","last_undegraded":"2024-01-25T15:05:28.231213+0000","last_fullsized":"2024-01-25T15:05:28.231213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:49:29.672511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847186+0000","last_change":"2024-01-25T15:05:27.244605+0000","last_active":"2024-01-25T15:05:28.847186+0000","last_peered":"2024-01-25T15:05:28.847186+0000","last_clean":"2024-01-25T15:05:28.847186+0000","last_became_active":"2024-01-25T15:05:27.244345+0000","last_became_peered":"2024-01-25T15:05:27.244345+0000","last_unstale":"2024-01-25T15:05:28.847186+0000","last_undegraded":"2024-01-25T15:05:28.847186+0000","last_fullsized":"2024-01-25T15:05:28.847186+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:23:26.096821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230958+0000","last_change":"2024-01-25T15:05:27.229918+0000","last_active":"2024-01-25T15:05:28.230958+0000","last_peered":"2024-01-25T15:05:28.230958+0000","last_clean":"2024-01-25T15:05:28.230958+0000","last_became_active":"2024-01-25T15:05:27.229636+0000","last_became_peered":"2024-01-25T15:05:27.229636+0000","last_unstale":"2024-01-25T15:05:28.230958+0000","last_undegraded":"2024-01-25T15:05:28.230958+0000","last_fullsized":"2024-01-25T15:05:28.230958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:31.002968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847655+0000","last_change":"2024-01-25T15:05:27.240952+0000","last_active":"2024-01-25T15:05:28.847655+0000","last_peered":"2024-01-25T15:05:28.847655+0000","last_clean":"2024-01-25T15:05:28.847655+0000","last_became_active":"2024-01-25T15:05:27.240683+0000","last_became_peered":"2024-01-25T15:05:27.240683+0000","last_unstale":"2024-01-25T15:05:28.847655+0000","last_undegraded":"2024-01-25T15:05:28.847655+0000","last_fullsized":"2024-01-25T15:05:28.847655+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:44:30.520452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.716058+0000","last_change":"2024-01-25T15:05:27.235172+0000","last_active":"2024-01-25T15:05:28.716058+0000","last_peered":"2024-01-25T15:05:28.716058+0000","last_clean":"2024-01-25T15:05:28.716058+0000","last_became_active":"2024-01-25T15:05:27.234884+0000","last_became_peered":"2024-01-25T15:05:27.234884+0000","last_unstale":"2024-01-25T15:05:28.716058+0000","last_undegraded":"2024-01-25T15:05:28.716058+0000","last_fullsized":"2024-01-25T15:05:28.716058+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:14:28.578562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230886+0000","last_change":"2024-01-25T15:05:27.233225+0000","last_active":"2024-01-25T15:05:28.230886+0000","last_peered":"2024-01-25T15:05:28.230886+0000","last_clean":"2024-01-25T15:05:28.230886+0000","last_became_active":"2024-01-25T15:05:27.232731+0000","last_became_peered":"2024-01-25T15:05:27.232731+0000","last_unstale":"2024-01-25T15:05:28.230886+0000","last_undegraded":"2024-01-25T15:05:28.230886+0000","last_fullsized":"2024-01-25T15:05:28.230886+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:53:45.905579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.846926+0000","last_change":"2024-01-25T15:05:27.226292+0000","last_active":"2024-01-25T15:05:28.846926+0000","last_peered":"2024-01-25T15:05:28.846926+0000","last_clean":"2024-01-25T15:05:28.846926+0000","last_became_active":"2024-01-25T15:05:27.226037+0000","last_became_peered":"2024-01-25T15:05:27.226037+0000","last_unstale":"2024-01-25T15:05:28.846926+0000","last_undegraded":"2024-01-25T15:05:28.846926+0000","last_fullsized":"2024-01-25T15:05:28.846926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:35:20.251170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231572+0000","last_change":"2024-01-25T15:05:27.229896+0000","last_active":"2024-01-25T15:05:28.231572+0000","last_peered":"2024-01-25T15:05:28.231572+0000","last_clean":"2024-01-25T15:05:28.231572+0000","last_became_active":"2024-01-25T15:05:27.229558+0000","last_became_peered":"2024-01-25T15:05:27.229558+0000","last_unstale":"2024-01-25T15:05:28.231572+0000","last_undegraded":"2024-01-25T15:05:28.231572+0000","last_fullsized":"2024-01-25T15:05:28.231572+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:43:59.664529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494329+0000","last_change":"2024-01-25T15:05:27.242603+0000","last_active":"2024-01-25T15:05:28.494329+0000","last_peered":"2024-01-25T15:05:28.494329+0000","last_clean":"2024-01-25T15:05:28.494329+0000","last_became_active":"2024-01-25T15:05:27.241732+0000","last_became_peered":"2024-01-25T15:05:27.241732+0000","last_unstale":"2024-01-25T15:05:28.494329+0000","last_undegraded":"2024-01-25T15:05:28.494329+0000","last_fullsized":"2024-01-25T15:05:28.494329+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:14:28.578562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231565+0000","last_change":"2024-01-25T15:05:27.229445+0000","last_active":"2024-01-25T15:05:28.231565+0000","last_peered":"2024-01-25T15:05:28.231565+0000","last_clean":"2024-01-25T15:05:28.231565+0000","last_became_active":"2024-01-25T15:05:27.229198+0000","last_became_peered":"2024-01-25T15:05:27.229198+0000","last_unstale":"2024-01-25T15:05:28.231565+0000","last_undegraded":"2024-01-25T15:05:28.231565+0000","last_fullsized":"2024-01-25T15:05:28.231565+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:26:19.413150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847739+0000","last_change":"2024-01-25T15:05:27.238720+0000","last_active":"2024-01-25T15:05:28.847739+0000","last_peered":"2024-01-25T15:05:28.847739+0000","last_clean":"2024-01-25T15:05:28.847739+0000","last_became_active":"2024-01-25T15:05:27.238362+0000","last_became_peered":"2024-01-25T15:05:27.238362+0000","last_unstale":"2024-01-25T15:05:28.847739+0000","last_undegraded":"2024-01-25T15:05:28.847739+0000","last_fullsized":"2024-01-25T15:05:28.847739+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:36.810625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231222+0000","last_change":"2024-01-25T15:05:27.229034+0000","last_active":"2024-01-25T15:05:28.231222+0000","last_peered":"2024-01-25T15:05:28.231222+0000","last_clean":"2024-01-25T15:05:28.231222+0000","last_became_active":"2024-01-25T15:05:27.227681+0000","last_became_peered":"2024-01-25T15:05:27.227681+0000","last_unstale":"2024-01-25T15:05:28.231222+0000","last_undegraded":"2024-01-25T15:05:28.231222+0000","last_fullsized":"2024-01-25T15:05:28.231222+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:33:05.014284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230846+0000","last_change":"2024-01-25T15:05:27.227464+0000","last_active":"2024-01-25T15:05:28.230846+0000","last_peered":"2024-01-25T15:05:28.230846+0000","last_clean":"2024-01-25T15:05:28.230846+0000","last_became_active":"2024-01-25T15:05:27.227162+0000","last_became_peered":"2024-01-25T15:05:27.227162+0000","last_unstale":"2024-01-25T15:05:28.230846+0000","last_undegraded":"2024-01-25T15:05:28.230846+0000","last_fullsized":"2024-01-25T15:05:28.230846+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:16:31.883434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231298+0000","last_change":"2024-01-25T15:05:27.233301+0000","last_active":"2024-01-25T15:05:28.231298+0000","last_peered":"2024-01-25T15:05:28.231298+0000","last_clean":"2024-01-25T15:05:28.231298+0000","last_became_active":"2024-01-25T15:05:27.233035+0000","last_became_peered":"2024-01-25T15:05:27.233035+0000","last_unstale":"2024-01-25T15:05:28.231298+0000","last_undegraded":"2024-01-25T15:05:28.231298+0000","last_fullsized":"2024-01-25T15:05:28.231298+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:02:27.622813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494014+0000","last_change":"2024-01-25T15:05:27.237586+0000","last_active":"2024-01-25T15:05:28.494014+0000","last_peered":"2024-01-25T15:05:28.494014+0000","last_clean":"2024-01-25T15:05:28.494014+0000","last_became_active":"2024-01-25T15:05:27.237334+0000","last_became_peered":"2024-01-25T15:05:27.237334+0000","last_unstale":"2024-01-25T15:05:28.494014+0000","last_undegraded":"2024-01-25T15:05:28.494014+0000","last_fullsized":"2024-01-25T15:05:28.494014+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:33:05.014284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230712+0000","last_change":"2024-01-25T15:05:27.247070+0000","last_active":"2024-01-25T15:05:28.230712+0000","last_peered":"2024-01-25T15:05:28.230712+0000","last_clean":"2024-01-25T15:05:28.230712+0000","last_became_active":"2024-01-25T15:05:27.246793+0000","last_became_peered":"2024-01-25T15:05:27.246793+0000","last_unstale":"2024-01-25T15:05:28.230712+0000","last_undegraded":"2024-01-25T15:05:28.230712+0000","last_fullsized":"2024-01-25T15:05:28.230712+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:13:38.590014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231524+0000","last_change":"2024-01-25T15:05:26.223571+0000","last_active":"2024-01-25T15:05:28.231524+0000","last_peered":"2024-01-25T15:05:28.231524+0000","last_clean":"2024-01-25T15:05:28.231524+0000","last_became_active":"2024-01-25T15:05:26.223239+0000","last_became_peered":"2024-01-25T15:05:26.223239+0000","last_unstale":"2024-01-25T15:05:28.231524+0000","last_undegraded":"2024-01-25T15:05:28.231524+0000","last_fullsized":"2024-01-25T15:05:28.231524+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:23:25.092941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494308+0000","last_change":"2024-01-25T15:05:27.243468+0000","last_active":"2024-01-25T15:05:28.494308+0000","last_peered":"2024-01-25T15:05:28.494308+0000","last_clean":"2024-01-25T15:05:28.494308+0000","last_became_active":"2024-01-25T15:05:27.241288+0000","last_became_peered":"2024-01-25T15:05:27.241288+0000","last_unstale":"2024-01-25T15:05:28.494308+0000","last_undegraded":"2024-01-25T15:05:28.494308+0000","last_fullsized":"2024-01-25T15:05:28.494308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:46:52.035987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834381+0000","last_change":"2024-01-25T15:05:26.222363+0000","last_active":"2024-01-25T15:05:28.834381+0000","last_peered":"2024-01-25T15:05:28.834381+0000","last_clean":"2024-01-25T15:05:28.834381+0000","last_became_active":"2024-01-25T15:05:26.222076+0000","last_became_peered":"2024-01-25T15:05:26.222076+0000","last_unstale":"2024-01-25T15:05:28.834381+0000","last_undegraded":"2024-01-25T15:05:28.834381+0000","last_fullsized":"2024-01-25T15:05:28.834381+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:25:54.998838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.716074+0000","last_change":"2024-01-25T15:05:27.236309+0000","last_active":"2024-01-25T15:05:28.716074+0000","last_peered":"2024-01-25T15:05:28.716074+0000","last_clean":"2024-01-25T15:05:28.716074+0000","last_became_active":"2024-01-25T15:05:27.236051+0000","last_became_peered":"2024-01-25T15:05:27.236051+0000","last_unstale":"2024-01-25T15:05:28.716074+0000","last_undegraded":"2024-01-25T15:05:28.716074+0000","last_fullsized":"2024-01-25T15:05:28.716074+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:16:02.607369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494388+0000","last_change":"2024-01-25T15:05:26.222345+0000","last_active":"2024-01-25T15:05:28.494388+0000","last_peered":"2024-01-25T15:05:28.494388+0000","last_clean":"2024-01-25T15:05:28.494388+0000","last_became_active":"2024-01-25T15:05:26.221552+0000","last_became_peered":"2024-01-25T15:05:26.221552+0000","last_unstale":"2024-01-25T15:05:28.494388+0000","last_undegraded":"2024-01-25T15:05:28.494388+0000","last_fullsized":"2024-01-25T15:05:28.494388+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:31:52.278724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229975+0000","last_change":"2024-01-25T15:05:27.224791+0000","last_active":"2024-01-25T15:05:28.229975+0000","last_peered":"2024-01-25T15:05:28.229975+0000","last_clean":"2024-01-25T15:05:28.229975+0000","last_became_active":"2024-01-25T15:05:27.224542+0000","last_became_peered":"2024-01-25T15:05:27.224542+0000","last_unstale":"2024-01-25T15:05:28.229975+0000","last_undegraded":"2024-01-25T15:05:28.229975+0000","last_fullsized":"2024-01-25T15:05:28.229975+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:22:13.913722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.715925+0000","last_change":"2024-01-25T15:05:26.217509+0000","last_active":"2024-01-25T15:05:28.715925+0000","last_peered":"2024-01-25T15:05:28.715925+0000","last_clean":"2024-01-25T15:05:28.715925+0000","last_became_active":"2024-01-25T15:05:26.217198+0000","last_became_peered":"2024-01-25T15:05:26.217198+0000","last_unstale":"2024-01-25T15:05:28.715925+0000","last_undegraded":"2024-01-25T15:05:28.715925+0000","last_fullsized":"2024-01-25T15:05:28.715925+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:23:25.092941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834219+0000","last_change":"2024-01-25T15:05:27.241011+0000","last_active":"2024-01-25T15:05:28.834219+0000","last_peered":"2024-01-25T15:05:28.834219+0000","last_clean":"2024-01-25T15:05:28.834219+0000","last_became_active":"2024-01-25T15:05:27.240732+0000","last_became_peered":"2024-01-25T15:05:27.240732+0000","last_unstale":"2024-01-25T15:05:28.834219+0000","last_undegraded":"2024-01-25T15:05:28.834219+0000","last_fullsized":"2024-01-25T15:05:28.834219+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:53:45.905579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847814+0000","last_change":"2024-01-25T15:05:26.224826+0000","last_active":"2024-01-25T15:05:28.847814+0000","last_peered":"2024-01-25T15:05:28.847814+0000","last_clean":"2024-01-25T15:05:28.847814+0000","last_became_active":"2024-01-25T15:05:26.224517+0000","last_became_peered":"2024-01-25T15:05:26.224517+0000","last_unstale":"2024-01-25T15:05:28.847814+0000","last_undegraded":"2024-01-25T15:05:28.847814+0000","last_fullsized":"2024-01-25T15:05:28.847814+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:00:52.590768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847706+0000","last_change":"2024-01-25T15:05:27.243054+0000","last_active":"2024-01-25T15:05:28.847706+0000","last_peered":"2024-01-25T15:05:28.847706+0000","last_clean":"2024-01-25T15:05:28.847706+0000","last_became_active":"2024-01-25T15:05:27.240995+0000","last_became_peered":"2024-01-25T15:05:27.240995+0000","last_unstale":"2024-01-25T15:05:28.847706+0000","last_undegraded":"2024-01-25T15:05:28.847706+0000","last_fullsized":"2024-01-25T15:05:28.847706+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:17:07.138969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231228+0000","last_change":"2024-01-25T15:05:26.220260+0000","last_active":"2024-01-25T15:05:28.231228+0000","last_peered":"2024-01-25T15:05:28.231228+0000","last_clean":"2024-01-25T15:05:28.231228+0000","last_became_active":"2024-01-25T15:05:26.219815+0000","last_became_peered":"2024-01-25T15:05:26.219815+0000","last_unstale":"2024-01-25T15:05:28.231228+0000","last_undegraded":"2024-01-25T15:05:28.231228+0000","last_fullsized":"2024-01-25T15:05:28.231228+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:25:54.998838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.715908+0000","last_change":"2024-01-25T15:05:27.241873+0000","last_active":"2024-01-25T15:05:28.715908+0000","last_peered":"2024-01-25T15:05:28.715908+0000","last_clean":"2024-01-25T15:05:28.715908+0000","last_became_active":"2024-01-25T15:05:27.241586+0000","last_became_peered":"2024-01-25T15:05:27.241586+0000","last_unstale":"2024-01-25T15:05:28.715908+0000","last_undegraded":"2024-01-25T15:05:28.715908+0000","last_fullsized":"2024-01-25T15:05:28.715908+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:54:18.204207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494085+0000","last_change":"2024-01-25T15:05:26.223828+0000","last_active":"2024-01-25T15:05:28.494085+0000","last_peered":"2024-01-25T15:05:28.494085+0000","last_clean":"2024-01-25T15:05:28.494085+0000","last_became_active":"2024-01-25T15:05:26.223568+0000","last_became_peered":"2024-01-25T15:05:26.223568+0000","last_unstale":"2024-01-25T15:05:28.494085+0000","last_undegraded":"2024-01-25T15:05:28.494085+0000","last_fullsized":"2024-01-25T15:05:28.494085+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:22:35.220728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229556+0000","last_change":"2024-01-25T15:05:27.230178+0000","last_active":"2024-01-25T15:05:28.229556+0000","last_peered":"2024-01-25T15:05:28.229556+0000","last_clean":"2024-01-25T15:05:28.229556+0000","last_became_active":"2024-01-25T15:05:27.229928+0000","last_became_peered":"2024-01-25T15:05:27.229928+0000","last_unstale":"2024-01-25T15:05:28.229556+0000","last_undegraded":"2024-01-25T15:05:28.229556+0000","last_fullsized":"2024-01-25T15:05:28.229556+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:43:33.136506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.715600+0000","last_change":"2024-01-25T15:05:26.221805+0000","last_active":"2024-01-25T15:05:28.715600+0000","last_peered":"2024-01-25T15:05:28.715600+0000","last_clean":"2024-01-25T15:05:28.715600+0000","last_became_active":"2024-01-25T15:05:26.221380+0000","last_became_peered":"2024-01-25T15:05:26.221380+0000","last_unstale":"2024-01-25T15:05:28.715600+0000","last_undegraded":"2024-01-25T15:05:28.715600+0000","last_fullsized":"2024-01-25T15:05:28.715600+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:22:35.220728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847210+0000","last_change":"2024-01-25T15:05:27.243866+0000","last_active":"2024-01-25T15:05:28.847210+0000","last_peered":"2024-01-25T15:05:28.847210+0000","last_clean":"2024-01-25T15:05:28.847210+0000","last_became_active":"2024-01-25T15:05:27.243596+0000","last_became_peered":"2024-01-25T15:05:27.243596+0000","last_unstale":"2024-01-25T15:05:28.847210+0000","last_undegraded":"2024-01-25T15:05:28.847210+0000","last_fullsized":"2024-01-25T15:05:28.847210+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:31:53.282604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230023+0000","last_change":"2024-01-25T15:05:26.219579+0000","last_active":"2024-01-25T15:05:28.230023+0000","last_peered":"2024-01-25T15:05:28.230023+0000","last_clean":"2024-01-25T15:05:28.230023+0000","last_became_active":"2024-01-25T15:05:26.219276+0000","last_became_peered":"2024-01-25T15:05:26.219276+0000","last_unstale":"2024-01-25T15:05:28.230023+0000","last_undegraded":"2024-01-25T15:05:28.230023+0000","last_fullsized":"2024-01-25T15:05:28.230023+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:26:18.409269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231917+0000","last_change":"2024-01-25T15:05:27.241962+0000","last_active":"2024-01-25T15:05:28.231917+0000","last_peered":"2024-01-25T15:05:28.231917+0000","last_clean":"2024-01-25T15:05:28.231917+0000","last_became_active":"2024-01-25T15:05:27.241674+0000","last_became_peered":"2024-01-25T15:05:27.241674+0000","last_unstale":"2024-01-25T15:05:28.231917+0000","last_undegraded":"2024-01-25T15:05:28.231917+0000","last_fullsized":"2024-01-25T15:05:28.231917+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:36.810625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.848145+0000","last_change":"2024-01-25T15:05:26.223146+0000","last_active":"2024-01-25T15:05:28.848145+0000","last_peered":"2024-01-25T15:05:28.848145+0000","last_clean":"2024-01-25T15:05:28.848145+0000","last_became_active":"2024-01-25T15:05:26.222888+0000","last_became_peered":"2024-01-25T15:05:26.222888+0000","last_unstale":"2024-01-25T15:05:28.848145+0000","last_undegraded":"2024-01-25T15:05:28.848145+0000","last_fullsized":"2024-01-25T15:05:28.848145+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:05:05.431051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834381+0000","last_change":"2024-01-25T15:05:27.235466+0000","last_active":"2024-01-25T15:05:28.834381+0000","last_peered":"2024-01-25T15:05:28.834381+0000","last_clean":"2024-01-25T15:05:28.834381+0000","last_became_active":"2024-01-25T15:05:27.235043+0000","last_became_peered":"2024-01-25T15:05:27.235043+0000","last_unstale":"2024-01-25T15:05:28.834381+0000","last_undegraded":"2024-01-25T15:05:28.834381+0000","last_fullsized":"2024-01-25T15:05:28.834381+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:24:11.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.848064+0000","last_change":"2024-01-25T15:05:26.227418+0000","last_active":"2024-01-25T15:05:28.848064+0000","last_peered":"2024-01-25T15:05:28.848064+0000","last_clean":"2024-01-25T15:05:28.848064+0000","last_became_active":"2024-01-25T15:05:26.227133+0000","last_became_peered":"2024-01-25T15:05:26.227133+0000","last_unstale":"2024-01-25T15:05:28.848064+0000","last_undegraded":"2024-01-25T15:05:28.848064+0000","last_fullsized":"2024-01-25T15:05:28.848064+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:25:54.998838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.716142+0000","last_change":"2024-01-25T15:05:27.235111+0000","last_active":"2024-01-25T15:05:28.716142+0000","last_peered":"2024-01-25T15:05:28.716142+0000","last_clean":"2024-01-25T15:05:28.716142+0000","last_became_active":"2024-01-25T15:05:27.234825+0000","last_became_peered":"2024-01-25T15:05:27.234825+0000","last_unstale":"2024-01-25T15:05:28.716142+0000","last_undegraded":"2024-01-25T15:05:28.716142+0000","last_fullsized":"2024-01-25T15:05:28.716142+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:10.931099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229789+0000","last_change":"2024-01-25T15:05:26.213663+0000","last_active":"2024-01-25T15:05:28.229789+0000","last_peered":"2024-01-25T15:05:28.229789+0000","last_clean":"2024-01-25T15:05:28.229789+0000","last_became_active":"2024-01-25T15:05:26.213360+0000","last_became_peered":"2024-01-25T15:05:26.213360+0000","last_unstale":"2024-01-25T15:05:28.229789+0000","last_undegraded":"2024-01-25T15:05:28.229789+0000","last_fullsized":"2024-01-25T15:05:28.229789+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:43:58.660649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834062+0000","last_change":"2024-01-25T15:05:27.244333+0000","last_active":"2024-01-25T15:05:28.834062+0000","last_peered":"2024-01-25T15:05:28.834062+0000","last_clean":"2024-01-25T15:05:28.834062+0000","last_became_active":"2024-01-25T15:05:27.244050+0000","last_became_peered":"2024-01-25T15:05:27.244050+0000","last_unstale":"2024-01-25T15:05:28.834062+0000","last_undegraded":"2024-01-25T15:05:28.834062+0000","last_fullsized":"2024-01-25T15:05:28.834062+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:14:28.578562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229803+0000","last_change":"2024-01-25T15:05:26.224736+0000","last_active":"2024-01-25T15:05:28.229803+0000","last_peered":"2024-01-25T15:05:28.229803+0000","last_clean":"2024-01-25T15:05:28.229803+0000","last_became_active":"2024-01-25T15:05:26.224440+0000","last_became_peered":"2024-01-25T15:05:26.224440+0000","last_unstale":"2024-01-25T15:05:28.229803+0000","last_undegraded":"2024-01-25T15:05:28.229803+0000","last_fullsized":"2024-01-25T15:05:28.229803+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:54:17.200327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229452+0000","last_change":"2024-01-25T15:05:27.225582+0000","last_active":"2024-01-25T15:05:28.229452+0000","last_peered":"2024-01-25T15:05:28.229452+0000","last_clean":"2024-01-25T15:05:28.229452+0000","last_became_active":"2024-01-25T15:05:27.225337+0000","last_became_peered":"2024-01-25T15:05:27.225337+0000","last_unstale":"2024-01-25T15:05:28.229452+0000","last_undegraded":"2024-01-25T15:05:28.229452+0000","last_fullsized":"2024-01-25T15:05:28.229452+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:06:14.777919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494099+0000","last_change":"2024-01-25T15:05:26.224964+0000","last_active":"2024-01-25T15:05:28.494099+0000","last_peered":"2024-01-25T15:05:28.494099+0000","last_clean":"2024-01-25T15:05:28.494099+0000","last_became_active":"2024-01-25T15:05:26.224350+0000","last_became_peered":"2024-01-25T15:05:26.224350+0000","last_unstale":"2024-01-25T15:05:28.494099+0000","last_undegraded":"2024-01-25T15:05:28.494099+0000","last_fullsized":"2024-01-25T15:05:28.494099+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:23:25.092941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230682+0000","last_change":"2024-01-25T15:05:27.230302+0000","last_active":"2024-01-25T15:05:28.230682+0000","last_peered":"2024-01-25T15:05:28.230682+0000","last_clean":"2024-01-25T15:05:28.230682+0000","last_became_active":"2024-01-25T15:05:27.230047+0000","last_became_peered":"2024-01-25T15:05:27.230047+0000","last_unstale":"2024-01-25T15:05:28.230682+0000","last_undegraded":"2024-01-25T15:05:28.230682+0000","last_fullsized":"2024-01-25T15:05:28.230682+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:02:27.702949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230589+0000","last_change":"2024-01-25T15:05:26.223718+0000","last_active":"2024-01-25T15:05:28.230589+0000","last_peered":"2024-01-25T15:05:28.230589+0000","last_clean":"2024-01-25T15:05:28.230589+0000","last_became_active":"2024-01-25T15:05:26.222346+0000","last_became_peered":"2024-01-25T15:05:26.222346+0000","last_unstale":"2024-01-25T15:05:28.230589+0000","last_undegraded":"2024-01-25T15:05:28.230589+0000","last_fullsized":"2024-01-25T15:05:28.230589+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:35:19.247290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229554+0000","last_change":"2024-01-25T15:05:27.226239+0000","last_active":"2024-01-25T15:05:28.229554+0000","last_peered":"2024-01-25T15:05:28.229554+0000","last_clean":"2024-01-25T15:05:28.229554+0000","last_became_active":"2024-01-25T15:05:27.225978+0000","last_became_peered":"2024-01-25T15:05:27.225978+0000","last_unstale":"2024-01-25T15:05:28.229554+0000","last_undegraded":"2024-01-25T15:05:28.229554+0000","last_fullsized":"2024-01-25T15:05:28.229554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:36.810625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231481+0000","last_change":"2024-01-25T15:05:26.222694+0000","last_active":"2024-01-25T15:05:28.231481+0000","last_peered":"2024-01-25T15:05:28.231481+0000","last_clean":"2024-01-25T15:05:28.231481+0000","last_became_active":"2024-01-25T15:05:26.222439+0000","last_became_peered":"2024-01-25T15:05:26.222439+0000","last_unstale":"2024-01-25T15:05:28.231481+0000","last_undegraded":"2024-01-25T15:05:28.231481+0000","last_fullsized":"2024-01-25T15:05:28.231481+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:48:18.501092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229768+0000","last_change":"2024-01-25T15:05:27.233916+0000","last_active":"2024-01-25T15:05:28.229768+0000","last_peered":"2024-01-25T15:05:28.229768+0000","last_clean":"2024-01-25T15:05:28.229768+0000","last_became_active":"2024-01-25T15:05:27.233305+0000","last_became_peered":"2024-01-25T15:05:27.233305+0000","last_unstale":"2024-01-25T15:05:28.229768+0000","last_undegraded":"2024-01-25T15:05:28.229768+0000","last_fullsized":"2024-01-25T15:05:28.229768+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:00:27.744795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.848123+0000","last_change":"2024-01-25T15:05:26.225673+0000","last_active":"2024-01-25T15:05:28.848123+0000","last_peered":"2024-01-25T15:05:28.848123+0000","last_clean":"2024-01-25T15:05:28.848123+0000","last_became_active":"2024-01-25T15:05:26.225411+0000","last_became_peered":"2024-01-25T15:05:26.225411+0000","last_unstale":"2024-01-25T15:05:28.848123+0000","last_undegraded":"2024-01-25T15:05:28.848123+0000","last_fullsized":"2024-01-25T15:05:28.848123+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:16:30.879553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.848063+0000","last_change":"2024-01-25T15:05:27.247875+0000","last_active":"2024-01-25T15:05:28.848063+0000","last_peered":"2024-01-25T15:05:28.848063+0000","last_clean":"2024-01-25T15:05:28.848063+0000","last_became_active":"2024-01-25T15:05:27.247493+0000","last_became_peered":"2024-01-25T15:05:27.247493+0000","last_unstale":"2024-01-25T15:05:28.848063+0000","last_undegraded":"2024-01-25T15:05:28.848063+0000","last_fullsized":"2024-01-25T15:05:28.848063+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:01:33.031259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.716141+0000","last_change":"2024-01-25T15:05:26.220907+0000","last_active":"2024-01-25T15:05:28.716141+0000","last_peered":"2024-01-25T15:05:28.716141+0000","last_clean":"2024-01-25T15:05:28.716141+0000","last_became_active":"2024-01-25T15:05:26.220539+0000","last_became_peered":"2024-01-25T15:05:26.220539+0000","last_unstale":"2024-01-25T15:05:28.716141+0000","last_undegraded":"2024-01-25T15:05:28.716141+0000","last_fullsized":"2024-01-25T15:05:28.716141+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:18:51.754911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.716049+0000","last_change":"2024-01-25T15:05:27.242875+0000","last_active":"2024-01-25T15:05:28.716049+0000","last_peered":"2024-01-25T15:05:28.716049+0000","last_clean":"2024-01-25T15:05:28.716049+0000","last_became_active":"2024-01-25T15:05:27.241953+0000","last_became_peered":"2024-01-25T15:05:27.241953+0000","last_unstale":"2024-01-25T15:05:28.716049+0000","last_undegraded":"2024-01-25T15:05:28.716049+0000","last_fullsized":"2024-01-25T15:05:28.716049+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:46:52.035987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847211+0000","last_change":"2024-01-25T15:05:26.218250+0000","last_active":"2024-01-25T15:05:28.847211+0000","last_peered":"2024-01-25T15:05:28.847211+0000","last_clean":"2024-01-25T15:05:28.847211+0000","last_became_active":"2024-01-25T15:05:26.217965+0000","last_became_peered":"2024-01-25T15:05:26.217965+0000","last_unstale":"2024-01-25T15:05:28.847211+0000","last_undegraded":"2024-01-25T15:05:28.847211+0000","last_fullsized":"2024-01-25T15:05:28.847211+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:03:01.180813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847330+0000","last_change":"2024-01-25T15:05:27.236656+0000","last_active":"2024-01-25T15:05:28.847330+0000","last_peered":"2024-01-25T15:05:28.847330+0000","last_clean":"2024-01-25T15:05:28.847330+0000","last_became_active":"2024-01-25T15:05:27.236391+0000","last_became_peered":"2024-01-25T15:05:27.236391+0000","last_unstale":"2024-01-25T15:05:28.847330+0000","last_undegraded":"2024-01-25T15:05:28.847330+0000","last_fullsized":"2024-01-25T15:05:28.847330+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:48:19.504972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494205+0000","last_change":"2024-01-25T15:05:26.218267+0000","last_active":"2024-01-25T15:05:28.494205+0000","last_peered":"2024-01-25T15:05:28.494205+0000","last_clean":"2024-01-25T15:05:28.494205+0000","last_became_active":"2024-01-25T15:05:26.217935+0000","last_became_peered":"2024-01-25T15:05:26.217935+0000","last_unstale":"2024-01-25T15:05:28.494205+0000","last_undegraded":"2024-01-25T15:05:28.494205+0000","last_fullsized":"2024-01-25T15:05:28.494205+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:18:51.754911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231629+0000","last_change":"2024-01-25T15:05:27.229184+0000","last_active":"2024-01-25T15:05:28.231629+0000","last_peered":"2024-01-25T15:05:28.231629+0000","last_clean":"2024-01-25T15:05:28.231629+0000","last_became_active":"2024-01-25T15:05:27.228691+0000","last_became_peered":"2024-01-25T15:05:27.228691+0000","last_unstale":"2024-01-25T15:05:28.231629+0000","last_undegraded":"2024-01-25T15:05:28.231629+0000","last_fullsized":"2024-01-25T15:05:28.231629+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:44:30.520452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847042+0000","last_change":"2024-01-25T15:05:26.224643+0000","last_active":"2024-01-25T15:05:28.847042+0000","last_peered":"2024-01-25T15:05:28.847042+0000","last_clean":"2024-01-25T15:05:28.847042+0000","last_became_active":"2024-01-25T15:05:26.224395+0000","last_became_peered":"2024-01-25T15:05:26.224395+0000","last_unstale":"2024-01-25T15:05:28.847042+0000","last_undegraded":"2024-01-25T15:05:28.847042+0000","last_fullsized":"2024-01-25T15:05:28.847042+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:12:44.093299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834130+0000","last_change":"2024-01-25T15:05:27.235292+0000","last_active":"2024-01-25T15:05:28.834130+0000","last_peered":"2024-01-25T15:05:28.834130+0000","last_clean":"2024-01-25T15:05:28.834130+0000","last_became_active":"2024-01-25T15:05:27.234825+0000","last_became_peered":"2024-01-25T15:05:27.234825+0000","last_unstale":"2024-01-25T15:05:28.834130+0000","last_undegraded":"2024-01-25T15:05:28.834130+0000","last_fullsized":"2024-01-25T15:05:28.834130+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:16:02.607369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847014+0000","last_change":"2024-01-25T15:05:26.227384+0000","last_active":"2024-01-25T15:05:28.847014+0000","last_peered":"2024-01-25T15:05:28.847014+0000","last_clean":"2024-01-25T15:05:28.847014+0000","last_became_active":"2024-01-25T15:05:26.227112+0000","last_became_peered":"2024-01-25T15:05:26.227112+0000","last_unstale":"2024-01-25T15:05:28.847014+0000","last_undegraded":"2024-01-25T15:05:28.847014+0000","last_fullsized":"2024-01-25T15:05:28.847014+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:05:00.172648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847623+0000","last_change":"2024-01-25T15:05:27.245885+0000","last_active":"2024-01-25T15:05:28.847623+0000","last_peered":"2024-01-25T15:05:28.847623+0000","last_clean":"2024-01-25T15:05:28.847623+0000","last_became_active":"2024-01-25T15:05:27.245616+0000","last_became_peered":"2024-01-25T15:05:27.245616+0000","last_unstale":"2024-01-25T15:05:28.847623+0000","last_undegraded":"2024-01-25T15:05:28.847623+0000","last_fullsized":"2024-01-25T15:05:28.847623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:02:27.622813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231405+0000","last_change":"2024-01-25T15:05:26.221180+0000","last_active":"2024-01-25T15:05:28.231405+0000","last_peered":"2024-01-25T15:05:28.231405+0000","last_clean":"2024-01-25T15:05:28.231405+0000","last_became_active":"2024-01-25T15:05:26.220911+0000","last_became_peered":"2024-01-25T15:05:26.220911+0000","last_unstale":"2024-01-25T15:05:28.231405+0000","last_undegraded":"2024-01-25T15:05:28.231405+0000","last_fullsized":"2024-01-25T15:05:28.231405+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:00:52.590768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229724+0000","last_change":"2024-01-25T15:05:27.229523+0000","last_active":"2024-01-25T15:05:28.229724+0000","last_peered":"2024-01-25T15:05:28.229724+0000","last_clean":"2024-01-25T15:05:28.229724+0000","last_became_active":"2024-01-25T15:05:27.229254+0000","last_became_peered":"2024-01-25T15:05:27.229254+0000","last_unstale":"2024-01-25T15:05:28.229724+0000","last_undegraded":"2024-01-25T15:05:28.229724+0000","last_fullsized":"2024-01-25T15:05:28.229724+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:47:01.188072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.846942+0000","last_change":"2024-01-25T15:05:26.220823+0000","last_active":"2024-01-25T15:05:28.846942+0000","last_peered":"2024-01-25T15:05:28.846942+0000","last_clean":"2024-01-25T15:05:28.846942+0000","last_became_active":"2024-01-25T15:05:26.220552+0000","last_became_peered":"2024-01-25T15:05:26.220552+0000","last_unstale":"2024-01-25T15:05:28.846942+0000","last_undegraded":"2024-01-25T15:05:28.846942+0000","last_fullsized":"2024-01-25T15:05:28.846942+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:27:08.783181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494190+0000","last_change":"2024-01-25T15:05:27.242991+0000","last_active":"2024-01-25T15:05:28.494190+0000","last_peered":"2024-01-25T15:05:28.494190+0000","last_clean":"2024-01-25T15:05:28.494190+0000","last_became_active":"2024-01-25T15:05:27.241347+0000","last_became_peered":"2024-01-25T15:05:27.241347+0000","last_unstale":"2024-01-25T15:05:28.494190+0000","last_undegraded":"2024-01-25T15:05:28.494190+0000","last_fullsized":"2024-01-25T15:05:28.494190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:54:18.204207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.848184+0000","last_change":"2024-01-25T15:05:26.227334+0000","last_active":"2024-01-25T15:05:28.848184+0000","last_peered":"2024-01-25T15:05:28.848184+0000","last_clean":"2024-01-25T15:05:28.848184+0000","last_became_active":"2024-01-25T15:05:26.227016+0000","last_became_peered":"2024-01-25T15:05:26.227016+0000","last_unstale":"2024-01-25T15:05:28.848184+0000","last_undegraded":"2024-01-25T15:05:28.848184+0000","last_fullsized":"2024-01-25T15:05:28.848184+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:29.999087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231917+0000","last_change":"2024-01-25T15:05:27.242175+0000","last_active":"2024-01-25T15:05:28.231917+0000","last_peered":"2024-01-25T15:05:28.231917+0000","last_clean":"2024-01-25T15:05:28.231917+0000","last_became_active":"2024-01-25T15:05:27.241892+0000","last_became_peered":"2024-01-25T15:05:27.241892+0000","last_unstale":"2024-01-25T15:05:28.231917+0000","last_undegraded":"2024-01-25T15:05:28.231917+0000","last_fullsized":"2024-01-25T15:05:28.231917+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:17:07.138969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847215+0000","last_change":"2024-01-25T15:05:26.220140+0000","last_active":"2024-01-25T15:05:28.847215+0000","last_peered":"2024-01-25T15:05:28.847215+0000","last_clean":"2024-01-25T15:05:28.847215+0000","last_became_active":"2024-01-25T15:05:26.219823+0000","last_became_peered":"2024-01-25T15:05:26.219823+0000","last_unstale":"2024-01-25T15:05:28.847215+0000","last_undegraded":"2024-01-25T15:05:28.847215+0000","last_fullsized":"2024-01-25T15:05:28.847215+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:53:24.322574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229759+0000","last_change":"2024-01-25T15:05:27.229536+0000","last_active":"2024-01-25T15:05:28.229759+0000","last_peered":"2024-01-25T15:05:28.229759+0000","last_clean":"2024-01-25T15:05:28.229759+0000","last_became_active":"2024-01-25T15:05:27.228565+0000","last_became_peered":"2024-01-25T15:05:27.228565+0000","last_unstale":"2024-01-25T15:05:28.229759+0000","last_undegraded":"2024-01-25T15:05:28.229759+0000","last_fullsized":"2024-01-25T15:05:28.229759+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:01:33.031259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834270+0000","last_change":"2024-01-25T15:05:26.225379+0000","last_active":"2024-01-25T15:05:28.834270+0000","last_peered":"2024-01-25T15:05:28.834270+0000","last_clean":"2024-01-25T15:05:28.834270+0000","last_became_active":"2024-01-25T15:05:26.225106+0000","last_became_peered":"2024-01-25T15:05:26.225106+0000","last_unstale":"2024-01-25T15:05:28.834270+0000","last_undegraded":"2024-01-25T15:05:28.834270+0000","last_fullsized":"2024-01-25T15:05:28.834270+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:21:43.851971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834208+0000","last_change":"2024-01-25T15:05:27.229007+0000","last_active":"2024-01-25T15:05:28.834208+0000","last_peered":"2024-01-25T15:05:28.834208+0000","last_clean":"2024-01-25T15:05:28.834208+0000","last_became_active":"2024-01-25T15:05:27.228729+0000","last_became_peered":"2024-01-25T15:05:27.228729+0000","last_unstale":"2024-01-25T15:05:28.834208+0000","last_undegraded":"2024-01-25T15:05:28.834208+0000","last_fullsized":"2024-01-25T15:05:28.834208+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:13:38.590014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834307+0000","last_change":"2024-01-25T15:05:26.226470+0000","last_active":"2024-01-25T15:05:28.834307+0000","last_peered":"2024-01-25T15:05:28.834307+0000","last_clean":"2024-01-25T15:05:28.834307+0000","last_became_active":"2024-01-25T15:05:26.226185+0000","last_became_peered":"2024-01-25T15:05:26.226185+0000","last_unstale":"2024-01-25T15:05:28.834307+0000","last_undegraded":"2024-01-25T15:05:28.834307+0000","last_fullsized":"2024-01-25T15:05:28.834307+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:00:52.590768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494056+0000","last_change":"2024-01-25T15:05:27.236625+0000","last_active":"2024-01-25T15:05:28.494056+0000","last_peered":"2024-01-25T15:05:28.494056+0000","last_clean":"2024-01-25T15:05:28.494056+0000","last_became_active":"2024-01-25T15:05:27.236387+0000","last_became_peered":"2024-01-25T15:05:27.236387+0000","last_unstale":"2024-01-25T15:05:28.494056+0000","last_undegraded":"2024-01-25T15:05:28.494056+0000","last_fullsized":"2024-01-25T15:05:28.494056+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:43:59.664529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230946+0000","last_change":"2024-01-25T15:05:26.224342+0000","last_active":"2024-01-25T15:05:28.230946+0000","last_peered":"2024-01-25T15:05:28.230946+0000","last_clean":"2024-01-25T15:05:28.230946+0000","last_became_active":"2024-01-25T15:05:26.224074+0000","last_became_peered":"2024-01-25T15:05:26.224074+0000","last_unstale":"2024-01-25T15:05:28.230946+0000","last_undegraded":"2024-01-25T15:05:28.230946+0000","last_fullsized":"2024-01-25T15:05:28.230946+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:22:35.220728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.715707+0000","last_change":"2024-01-25T15:05:27.234553+0000","last_active":"2024-01-25T15:05:28.715707+0000","last_peered":"2024-01-25T15:05:28.715707+0000","last_clean":"2024-01-25T15:05:28.715707+0000","last_became_active":"2024-01-25T15:05:27.234266+0000","last_became_peered":"2024-01-25T15:05:27.234266+0000","last_unstale":"2024-01-25T15:05:28.715707+0000","last_undegraded":"2024-01-25T15:05:28.715707+0000","last_fullsized":"2024-01-25T15:05:28.715707+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:26:19.413150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.715581+0000","last_change":"2024-01-25T15:05:26.210731+0000","last_active":"2024-01-25T15:05:28.715581+0000","last_peered":"2024-01-25T15:05:28.715581+0000","last_clean":"2024-01-25T15:05:28.715581+0000","last_became_active":"2024-01-25T15:05:26.210193+0000","last_became_peered":"2024-01-25T15:05:26.210193+0000","last_unstale":"2024-01-25T15:05:28.715581+0000","last_undegraded":"2024-01-25T15:05:28.715581+0000","last_fullsized":"2024-01-25T15:05:28.715581+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:35:19.247290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231127+0000","last_change":"2024-01-25T15:05:27.240670+0000","last_active":"2024-01-25T15:05:28.231127+0000","last_peered":"2024-01-25T15:05:28.231127+0000","last_clean":"2024-01-25T15:05:28.231127+0000","last_became_active":"2024-01-25T15:05:27.240409+0000","last_became_peered":"2024-01-25T15:05:27.240409+0000","last_unstale":"2024-01-25T15:05:28.231127+0000","last_undegraded":"2024-01-25T15:05:28.231127+0000","last_fullsized":"2024-01-25T15:05:28.231127+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:24:11.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229491+0000","last_change":"2024-01-25T15:05:26.215779+0000","last_active":"2024-01-25T15:05:28.229491+0000","last_peered":"2024-01-25T15:05:28.229491+0000","last_clean":"2024-01-25T15:05:28.229491+0000","last_became_active":"2024-01-25T15:05:26.215521+0000","last_became_peered":"2024-01-25T15:05:26.215521+0000","last_unstale":"2024-01-25T15:05:28.229491+0000","last_undegraded":"2024-01-25T15:05:28.229491+0000","last_fullsized":"2024-01-25T15:05:28.229491+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:33:04.010404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.848039+0000","last_change":"2024-01-25T15:05:27.236929+0000","last_active":"2024-01-25T15:05:28.848039+0000","last_peered":"2024-01-25T15:05:28.848039+0000","last_clean":"2024-01-25T15:05:28.848039+0000","last_became_active":"2024-01-25T15:05:27.236388+0000","last_became_peered":"2024-01-25T15:05:27.236388+0000","last_unstale":"2024-01-25T15:05:28.848039+0000","last_undegraded":"2024-01-25T15:05:28.848039+0000","last_fullsized":"2024-01-25T15:05:28.848039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:55:46.833186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231417+0000","last_change":"2024-01-25T15:05:26.221948+0000","last_active":"2024-01-25T15:05:28.231417+0000","last_peered":"2024-01-25T15:05:28.231417+0000","last_clean":"2024-01-25T15:05:28.231417+0000","last_became_active":"2024-01-25T15:05:26.221678+0000","last_became_peered":"2024-01-25T15:05:26.221678+0000","last_unstale":"2024-01-25T15:05:28.231417+0000","last_undegraded":"2024-01-25T15:05:28.231417+0000","last_fullsized":"2024-01-25T15:05:28.231417+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:21:43.851971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":201,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231691+0000","last_change":"2024-01-25T15:04:16.181635+0000","last_active":"2024-01-25T15:05:28.231691+0000","last_peered":"2024-01-25T15:05:28.231691+0000","last_clean":"2024-01-25T15:05:28.231691+0000","last_became_active":"2024-01-25T15:04:16.179890+0000","last_became_peered":"2024-01-25T15:04:16.179890+0000","last_unstale":"2024-01-25T15:05:28.231691+0000","last_undegraded":"2024-01-25T15:05:28.231691+0000","last_fullsized":"2024-01-25T15:05:28.231691+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_clean_scrub_stamp":"2024-01-25T15:04:14.956188+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:49:00.618327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":780688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.68500000000000005}]},{"osd":3,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.62}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.58399999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":442368,"data_stored":189220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.432},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.69799999999999995}]},{"osd":4,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.71899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":434176,"data_stored":182130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":10.814},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":2.327}]},{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":10.016999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":2.2850000000000001}]},{"osd":2,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":3.8610000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":10.221}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":5.6440000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":10.092000000000001}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":5.5970000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":10.124000000000001}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":2.222},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":10.057}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":2.8170000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":8.9179999999999993}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":434176,"data_stored":182622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.74299999999999999}]},{"osd":3,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.75900000000000001}]},{"osd":5,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.876},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.97899999999999998}]},{"osd":7,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.83299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":442368,"data_stored":183664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.30499999999999999}]},{"osd":1,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":3.3559999999999999,"5min":3.3559999999999999,"15min":3.3559999999999999},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.25800000000000001}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.4209999999999998,"5min":3.4209999999999998,"15min":3.4209999999999998},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.4689999999999999,"5min":3.4689999999999999,"15min":3.4689999999999999},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":3.508,"5min":3.508,"15min":3.508},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.505}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.5449999999999999,"5min":3.5449999999999999,"15min":3.5449999999999999},"last":0.48499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":430080,"data_stored":182088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.26700000000000002}]},{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.315}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.53500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":430080,"data_stored":182108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.27600000000000002}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.311}]},{"osd":3,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.64900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1024000,"data_stored":772420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.436}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.45100000000000001}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.50700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:05:31.230 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-25T15:05:31.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.364+0000 7f1a8b62b640 1 Processor -- start 2024-01-25T15:05:31.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.364+0000 7f1a8b62b640 1 -- start start 2024-01-25T15:05:31.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.365+0000 7f1a8b62b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a840c4990 0x7f1a8406bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:31.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.365+0000 7f1a8b62b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1a840c7f10 0x7f1a840c8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:31.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.365+0000 7f1a8b62b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a84155430 con 0x7f1a84152160 2024-01-25T15:05:31.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.365+0000 7f1a8b62b640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a840c88d0 con 0x7f1a840c7f10 2024-01-25T15:05:31.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.365+0000 7f1a8b62b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a84154b40 con 0x7f1a840c4990 2024-01-25T15:05:31.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.365+0000 7f1a89bc8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1a840c7f10 0x7f1a840c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:31.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.365+0000 7f1a893c7640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1a84152160 0x7f1a840c4ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35028/0 (socket says 172.21.15.29:35028) 2024-01-25T15:05:31.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.365+0000 7f1a893c7640 1 -- 172.21.15.29:0/2513453828 learned_addr learned my addr 172.21.15.29:0/2513453828 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:31.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.365+0000 7f1a88bc6640 1 --2- 172.21.15.29:0/2513453828 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a840c4990 0x7f1a8406bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:31.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.366+0000 7f1a89bc8640 1 -- 172.21.15.29:0/2513453828 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a840c4990 msgr2=0x7f1a8406bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:31.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.366+0000 7f1a89bc8640 1 --2- 172.21.15.29:0/2513453828 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a840c4990 0x7f1a8406bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.366+0000 7f1a89bc8640 1 -- 172.21.15.29:0/2513453828 >> v1:172.21.15.29:6789/0 conn(0x7f1a84152160 legacy=0x7f1a840c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:31.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.366+0000 7f1a7bfff640 1 -- 172.21.15.29:0/2513453828 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070117010 0 0) 0x7f1a84155430 con 0x7f1a84152160 2024-01-25T15:05:31.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.366+0000 7f1a89bc8640 1 -- 172.21.15.29:0/2513453828 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a84152540 con 0x7f1a840c7f10 2024-01-25T15:05:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.366+0000 7f1a89bc8640 1 --2- 172.21.15.29:0/2513453828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a840c7f10 0x7f1a840c8390 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1a800097a0 tx=0x7f1a8002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323b3bd1d4bc7787 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.366+0000 7f1a7bfff640 1 -- 172.21.15.29:0/2513453828 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8002e070 con 0x7f1a840c7f10 2024-01-25T15:05:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.366+0000 7f1a7bfff640 1 -- 172.21.15.29:0/2513453828 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a800315a0 con 0x7f1a840c7f10 2024-01-25T15:05:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.366+0000 7f1a7bfff640 1 -- 172.21.15.29:0/2513453828 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a80031930 con 0x7f1a840c7f10 2024-01-25T15:05:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.367+0000 7f1a8b62b640 1 -- 172.21.15.29:0/2513453828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a840c7f10 msgr2=0x7f1a840c8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.367+0000 7f1a8b62b640 1 --2- 172.21.15.29:0/2513453828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a840c7f10 0x7f1a840c8390 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1a800097a0 tx=0x7f1a8002b840 comp rx=0 tx=0).stop 2024-01-25T15:05:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.367+0000 7f1a8b62b640 1 -- 172.21.15.29:0/2513453828 shutdown_connections 2024-01-25T15:05:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.367+0000 7f1a8b62b640 1 --2- 172.21.15.29:0/2513453828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a840c7f10 0x7f1a840c8390 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.367+0000 7f1a8b62b640 1 --2- 172.21.15.29:0/2513453828 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a840c4990 0x7f1a8406bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.367+0000 7f1a8b62b640 1 -- 172.21.15.29:0/2513453828 >> 172.21.15.29:0/2513453828 conn(0x7f1a840ca1f0 msgr2=0x7f1a840ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.367+0000 7f1a8b62b640 1 -- 172.21.15.29:0/2513453828 shutdown_connections 2024-01-25T15:05:31.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.367+0000 7f1a8b62b640 1 -- 172.21.15.29:0/2513453828 wait complete. 2024-01-25T15:05:31.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.368+0000 7f1a8b62b640 1 Processor -- start 2024-01-25T15:05:31.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.368+0000 7f1a8b62b640 1 -- start start 2024-01-25T15:05:31.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.369+0000 7f1a8b62b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a840c4990 0x7f1a84146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:31.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.369+0000 7f1a8b62b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a840c7f10 0x7f1a84156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:31.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.369+0000 7f1a8b62b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a84152160 0x7f1a841574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:31.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.369+0000 7f1a8b62b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840aa740 con 0x7f1a840c7f10 2024-01-25T15:05:31.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.369+0000 7f1a8b62b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840aaa20 con 0x7f1a84152160 2024-01-25T15:05:31.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.369+0000 7f1a8b62b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840aad00 con 0x7f1a840c4990 2024-01-25T15:05:31.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.369+0000 7f1a88bc6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a840c7f10 0x7f1a84156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:31.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.369+0000 7f1a88bc6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a840c7f10 0x7f1a84156f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33440/0 (socket says 172.21.15.29:33440) 2024-01-25T15:05:31.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.369+0000 7f1a88bc6640 1 -- 172.21.15.29:0/112670735 learned_addr learned my addr 172.21.15.29:0/112670735 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:31.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.369+0000 7f1a893c7640 1 --2- 172.21.15.29:0/112670735 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a840c4990 0x7f1a84146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:31.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.369+0000 7f1a89bc8640 1 --2- 172.21.15.29:0/112670735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a84152160 0x7f1a841574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:31.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.369+0000 7f1a88bc6640 1 -- 172.21.15.29:0/112670735 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a840c4990 msgr2=0x7f1a84146bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:31.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.369+0000 7f1a88bc6640 1 --2- 172.21.15.29:0/112670735 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a840c4990 0x7f1a84146bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.369+0000 7f1a88bc6640 1 -- 172.21.15.29:0/112670735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a84152160 msgr2=0x7f1a841574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:31.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.369+0000 7f1a88bc6640 1 --2- 172.21.15.29:0/112670735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a84152160 0x7f1a841574b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.369+0000 7f1a88bc6640 1 -- 172.21.15.29:0/112670735 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a80009400 con 0x7f1a840c7f10 2024-01-25T15:05:31.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.369+0000 7f1a88bc6640 1 --2- 172.21.15.29:0/112670735 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a840c7f10 0x7f1a84156f70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400d7d0 tx=0x7f1a7400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:31.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.369+0000 7f1a79ffb640 1 -- 172.21.15.29:0/112670735 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7400b6c0 con 0x7f1a840c7f10 2024-01-25T15:05:31.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.370+0000 7f1a79ffb640 1 -- 172.21.15.29:0/112670735 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7400b840 con 0x7f1a840c7f10 2024-01-25T15:05:31.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.370+0000 7f1a8b62b640 1 -- 172.21.15.29:0/112670735 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a840aafe0 con 0x7f1a840c7f10 2024-01-25T15:05:31.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.370+0000 7f1a79ffb640 1 -- 172.21.15.29:0/112670735 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7400bbf0 con 0x7f1a840c7f10 2024-01-25T15:05:31.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.370+0000 7f1a8b62b640 1 -- 172.21.15.29:0/112670735 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a840ab5a0 con 0x7f1a840c7f10 2024-01-25T15:05:31.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.371+0000 7f1a8b62b640 1 -- 172.21.15.29:0/112670735 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a840c6180 con 0x7f1a840c7f10 2024-01-25T15:05:31.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.371+0000 7f1a79ffb640 1 -- 172.21.15.29:0/112670735 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f1a7400bd50 con 0x7f1a840c7f10 2024-01-25T15:05:31.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.371+0000 7f1a79ffb640 1 --2- 172.21.15.29:0/112670735 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1a6806af00 0x7f1a6806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:31.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.372+0000 7f1a79ffb640 1 -- 172.21.15.29:0/112670735 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1a74089d80 con 0x7f1a840c7f10 2024-01-25T15:05:31.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.372+0000 7f1a893c7640 1 --2- 172.21.15.29:0/112670735 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1a6806af00 0x7f1a6806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:31.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.372+0000 7f1a893c7640 1 --2- 172.21.15.29:0/112670735 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1a6806af00 0x7f1a6806d3c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c0012e0 tx=0x7f1a7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:31.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.376+0000 7f1a79ffb640 1 -- 172.21.15.29:0/112670735 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f1a74054a80 con 0x7f1a840c7f10 2024-01-25T15:05:31.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.624+0000 7f1a8b62b640 1 -- 172.21.15.29:0/112670735 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1a84074080 con 0x7f1a840c7f10 2024-01-25T15:05:31.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.625+0000 7f1a79ffb640 1 -- 172.21.15.29:0/112670735 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1431 (secure 0 0 0) 0x7f1a740580a0 con 0x7f1a840c7f10 2024-01-25T15:05:31.627 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:31.627 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":88,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":38,"num_osds":8,"num_up_osds":8,"osd_up_since":1706195053,"num_in_osds":8,"osd_in_since":1706195044,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":260153344,"bytes_avail":772833959936,"bytes_total":773094113280,"write_bytes_sec":2502,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5250}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-01-25T15:05:20.929241+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-25T15:05:31.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.627+0000 7f1a8b62b640 1 -- 172.21.15.29:0/112670735 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1a6806af00 msgr2=0x7f1a6806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:31.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.627+0000 7f1a8b62b640 1 --2- 172.21.15.29:0/112670735 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1a6806af00 0x7f1a6806d3c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c0012e0 tx=0x7f1a7c009040 comp rx=0 tx=0).stop 2024-01-25T15:05:31.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.627+0000 7f1a8b62b640 1 -- 172.21.15.29:0/112670735 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a840c7f10 msgr2=0x7f1a84156f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:31.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.627+0000 7f1a8b62b640 1 --2- 172.21.15.29:0/112670735 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a840c7f10 0x7f1a84156f70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400d7d0 tx=0x7f1a7400dc90 comp rx=0 tx=0).stop 2024-01-25T15:05:31.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.627+0000 7f1a8b62b640 1 -- 172.21.15.29:0/112670735 shutdown_connections 2024-01-25T15:05:31.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.627+0000 7f1a8b62b640 1 --2- 172.21.15.29:0/112670735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a84152160 0x7f1a841574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.627+0000 7f1a8b62b640 1 --2- 172.21.15.29:0/112670735 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1a6806af00 0x7f1a6806d3c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.627+0000 7f1a8b62b640 1 --2- 172.21.15.29:0/112670735 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a840c7f10 0x7f1a84156f70 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.627+0000 7f1a8b62b640 1 --2- 172.21.15.29:0/112670735 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a840c4990 0x7f1a84146bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.627+0000 7f1a8b62b640 1 -- 172.21.15.29:0/112670735 >> 172.21.15.29:0/112670735 conn(0x7f1a840ca1f0 msgr2=0x7f1a84151360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:31.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.627+0000 7f1a8b62b640 1 -- 172.21.15.29:0/112670735 shutdown_connections 2024-01-25T15:05:31.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.627+0000 7f1a8b62b640 1 -- 172.21.15.29:0/112670735 wait complete. 2024-01-25T15:05:31.639 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-25T15:05:31.639 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-25T15:05:31.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.739+0000 7f6eed9cf640 1 Processor -- start 2024-01-25T15:05:31.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.739+0000 7f6eed9cf640 1 -- start start 2024-01-25T15:05:31.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.740+0000 7f6eed9cf640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6ee8151f30 0x7f6ee80c04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:31.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.740+0000 7f6eed9cf640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ee80a8490 0x7f6ee80c0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:31.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.740+0000 7f6eed9cf640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee8152310 con 0x7f6ee806a6c0 2024-01-25T15:05:31.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.740+0000 7f6eed9cf640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee80c1a90 con 0x7f6ee8151f30 2024-01-25T15:05:31.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.740+0000 7f6eed9cf640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee80c1d70 con 0x7f6ee80a8490 2024-01-25T15:05:31.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.740+0000 7f6ee6ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6ee8151f30 0x7f6ee80c04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:31.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.740+0000 7f6ee6ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6ee8151f30 0x7f6ee80c04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33450/0 (socket says 172.21.15.29:33450) 2024-01-25T15:05:31.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.740+0000 7f6ee6ffd640 1 -- 172.21.15.29:0/3038186656 learned_addr learned my addr 172.21.15.29:0/3038186656 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:31.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.740+0000 7f6ee67fc640 1 --2- 172.21.15.29:0/3038186656 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ee80a8490 0x7f6ee80c0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:31.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.740+0000 7f6ee6ffd640 1 -- 172.21.15.29:0/3038186656 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ee80a8490 msgr2=0x7f6ee80c0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:31.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.740+0000 7f6ee6ffd640 1 --2- 172.21.15.29:0/3038186656 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ee80a8490 0x7f6ee80c0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.740+0000 7f6ee6ffd640 1 -- 172.21.15.29:0/3038186656 >> v1:172.21.15.52:6789/0 conn(0x7f6ee806a6c0 legacy=0x7f6ee806ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:31.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.740+0000 7f6ee6ffd640 1 -- 172.21.15.29:0/3038186656 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee80c2200 con 0x7f6ee8151f30 2024-01-25T15:05:31.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.741+0000 7f6ee6ffd640 1 --2- 172.21.15.29:0/3038186656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee8151f30 0x7f6ee80c04c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009870 tx=0x7f6ee002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5da250e920aab3 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:31.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.741+0000 7f6ee5ffb640 1 -- 172.21.15.29:0/3038186656 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0031740 con 0x7f6ee8151f30 2024-01-25T15:05:31.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.741+0000 7f6ee5ffb640 1 -- 172.21.15.29:0/3038186656 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee00318a0 con 0x7f6ee8151f30 2024-01-25T15:05:31.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.741+0000 7f6ee5ffb640 1 -- 172.21.15.29:0/3038186656 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0031c30 con 0x7f6ee8151f30 2024-01-25T15:05:31.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.742+0000 7f6eed9cf640 1 -- 172.21.15.29:0/3038186656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee8151f30 msgr2=0x7f6ee80c04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:31.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.742+0000 7f6eed9cf640 1 --2- 172.21.15.29:0/3038186656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee8151f30 0x7f6ee80c04c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009870 tx=0x7f6ee002b7e0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.742+0000 7f6eed9cf640 1 -- 172.21.15.29:0/3038186656 shutdown_connections 2024-01-25T15:05:31.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.742+0000 7f6eed9cf640 1 --2- 172.21.15.29:0/3038186656 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ee80a8490 0x7f6ee80c0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.742+0000 7f6eed9cf640 1 --2- 172.21.15.29:0/3038186656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee8151f30 0x7f6ee80c04c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.742+0000 7f6eed9cf640 1 -- 172.21.15.29:0/3038186656 >> 172.21.15.29:0/3038186656 conn(0x7f6ee80c3b90 msgr2=0x7f6ee80c3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:31.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.742+0000 7f6eed9cf640 1 -- 172.21.15.29:0/3038186656 shutdown_connections 2024-01-25T15:05:31.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.742+0000 7f6eed9cf640 1 -- 172.21.15.29:0/3038186656 wait complete. 2024-01-25T15:05:31.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.743+0000 7f6eed9cf640 1 Processor -- start 2024-01-25T15:05:31.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.743+0000 7f6eed9cf640 1 -- start start 2024-01-25T15:05:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.744+0000 7f6eed9cf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ee806a6c0 0x7f6ee814a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.744+0000 7f6eed9cf640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ee80a8490 0x7f6ee814cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.744+0000 7f6eed9cf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee8151f30 0x7f6ee8152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.744+0000 7f6eed9cf640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee80ad1a0 con 0x7f6ee8151f30 2024-01-25T15:05:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.744+0000 7f6eed9cf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee80accb0 con 0x7f6ee806a6c0 2024-01-25T15:05:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.744+0000 7f6eed9cf640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee81526e0 con 0x7f6ee80a8490 2024-01-25T15:05:31.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.744+0000 7f6ee77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee8151f30 0x7f6ee8152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:31.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.744+0000 7f6ee77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee8151f30 0x7f6ee8152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33456/0 (socket says 172.21.15.29:33456) 2024-01-25T15:05:31.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.744+0000 7f6ee77fe640 1 -- 172.21.15.29:0/2208185963 learned_addr learned my addr 172.21.15.29:0/2208185963 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:31.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.744+0000 7f6ee6ffd640 1 --2- 172.21.15.29:0/2208185963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ee806a6c0 0x7f6ee814a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:31.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.744+0000 7f6ee67fc640 1 --2- 172.21.15.29:0/2208185963 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ee80a8490 0x7f6ee814cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:31.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.744+0000 7f6ee77fe640 1 -- 172.21.15.29:0/2208185963 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ee80a8490 msgr2=0x7f6ee814cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:31.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.744+0000 7f6ee77fe640 1 --2- 172.21.15.29:0/2208185963 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ee80a8490 0x7f6ee814cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.744+0000 7f6ee77fe640 1 -- 172.21.15.29:0/2208185963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ee806a6c0 msgr2=0x7f6ee814a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:31.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.744+0000 7f6ee77fe640 1 --2- 172.21.15.29:0/2208185963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ee806a6c0 0x7f6ee814a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.744+0000 7f6ee77fe640 1 -- 172.21.15.29:0/2208185963 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee00094d0 con 0x7f6ee8151f30 2024-01-25T15:05:31.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.744+0000 7f6ee67fc640 1 --2- 172.21.15.29:0/2208185963 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ee80a8490 0x7f6ee814cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:31.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.744+0000 7f6ee6ffd640 1 --2- 172.21.15.29:0/2208185963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ee806a6c0 0x7f6ee814a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:31.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.744+0000 7f6ee77fe640 1 --2- 172.21.15.29:0/2208185963 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee8151f30 0x7f6ee8152b70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800c7b0 tx=0x7f6ed800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:31.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.744+0000 7f6ecffff640 1 -- 172.21.15.29:0/2208185963 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8004b60 con 0x7f6ee8151f30 2024-01-25T15:05:31.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.744+0000 7f6ecffff640 1 -- 172.21.15.29:0/2208185963 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed8004cc0 con 0x7f6ee8151f30 2024-01-25T15:05:31.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.745+0000 7f6eed9cf640 1 -- 172.21.15.29:0/2208185963 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee814a680 con 0x7f6ee8151f30 2024-01-25T15:05:31.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.745+0000 7f6ecffff640 1 -- 172.21.15.29:0/2208185963 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed800aa90 con 0x7f6ee8151f30 2024-01-25T15:05:31.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.745+0000 7f6eed9cf640 1 -- 172.21.15.29:0/2208185963 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee814d180 con 0x7f6ee8151f30 2024-01-25T15:05:31.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.745+0000 7f6eed9cf640 1 -- 172.21.15.29:0/2208185963 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee81524b0 con 0x7f6ee8151f30 2024-01-25T15:05:31.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.746+0000 7f6ecffff640 1 -- 172.21.15.29:0/2208185963 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6ed800abf0 con 0x7f6ee8151f30 2024-01-25T15:05:31.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.746+0000 7f6ecffff640 1 --2- 172.21.15.29:0/2208185963 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6ed406aed0 0x7f6ed406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:31.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.746+0000 7f6ecffff640 1 -- 172.21.15.29:0/2208185963 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6ed8089910 con 0x7f6ee8151f30 2024-01-25T15:05:31.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.747+0000 7f6ee6ffd640 1 --2- 172.21.15.29:0/2208185963 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6ed406aed0 0x7f6ed406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:31.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.747+0000 7f6ee6ffd640 1 --2- 172.21.15.29:0/2208185963 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6ed406aed0 0x7f6ed406d390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0035000 tx=0x7f6ee0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:31.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.750+0000 7f6ecffff640 1 -- 172.21.15.29:0/2208185963 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6ee81524b0 con 0x7f6ee8151f30 2024-01-25T15:05:31.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.930+0000 7f6eed9cf640 1 -- 172.21.15.29:0/2208185963 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ee8155160 con 0x7f6ed406aed0 2024-01-25T15:05:31.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.938+0000 7f6ecffff640 1 -- 172.21.15.29:0/2208185963 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288872 (secure 0 0 0) 0x7f6ee0041070 con 0x7f6ed406aed0 2024-01-25T15:05:31.942 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:31.944 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-25T15:05:31.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.941+0000 7f6eed9cf640 1 -- 172.21.15.29:0/2208185963 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6ed406aed0 msgr2=0x7f6ed406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:31.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.941+0000 7f6eed9cf640 1 --2- 172.21.15.29:0/2208185963 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6ed406aed0 0x7f6ed406d390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0035000 tx=0x7f6ee0008030 comp rx=0 tx=0).stop 2024-01-25T15:05:31.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.941+0000 7f6eed9cf640 1 -- 172.21.15.29:0/2208185963 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee8151f30 msgr2=0x7f6ee8152b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:31.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.941+0000 7f6eed9cf640 1 --2- 172.21.15.29:0/2208185963 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee8151f30 0x7f6ee8152b70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800c7b0 tx=0x7f6ed800cc70 comp rx=0 tx=0).stop 2024-01-25T15:05:31.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.941+0000 7f6eed9cf640 1 -- 172.21.15.29:0/2208185963 shutdown_connections 2024-01-25T15:05:31.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.941+0000 7f6eed9cf640 1 --2- 172.21.15.29:0/2208185963 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6ed406aed0 0x7f6ed406d390 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.941+0000 7f6eed9cf640 1 --2- 172.21.15.29:0/2208185963 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee8151f30 0x7f6ee8152b70 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.941+0000 7f6eed9cf640 1 --2- 172.21.15.29:0/2208185963 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ee80a8490 0x7f6ee814cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.941+0000 7f6eed9cf640 1 --2- 172.21.15.29:0/2208185963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ee806a6c0 0x7f6ee814a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:31.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.941+0000 7f6eed9cf640 1 -- 172.21.15.29:0/2208185963 >> 172.21.15.29:0/2208185963 conn(0x7f6ee80c3b90 msgr2=0x7f6ee80c3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:31.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.941+0000 7f6eed9cf640 1 -- 172.21.15.29:0/2208185963 shutdown_connections 2024-01-25T15:05:31.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:31.941+0000 7f6eed9cf640 1 -- 172.21.15.29:0/2208185963 wait complete. 2024-01-25T15:05:31.953 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-01-25T15:05:30.931393+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254056,"kb_used_data":4576,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720664,"statfs":{"total":773094113280,"available":772833959936,"internally_reserved":0,"allocated":4685824,"data_stored":2654940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.728529"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230015+0000","last_change":"2024-01-25T15:05:27.231656+0000","last_active":"2024-01-25T15:05:28.230015+0000","last_peered":"2024-01-25T15:05:28.230015+0000","last_clean":"2024-01-25T15:05:28.230015+0000","last_became_active":"2024-01-25T15:05:27.228184+0000","last_became_peered":"2024-01-25T15:05:27.228184+0000","last_unstale":"2024-01-25T15:05:28.230015+0000","last_undegraded":"2024-01-25T15:05:28.230015+0000","last_fullsized":"2024-01-25T15:05:28.230015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:44:26.334164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229740+0000","last_change":"2024-01-25T15:05:27.235003+0000","last_active":"2024-01-25T15:05:28.229740+0000","last_peered":"2024-01-25T15:05:28.229740+0000","last_clean":"2024-01-25T15:05:28.229740+0000","last_became_active":"2024-01-25T15:05:27.234734+0000","last_became_peered":"2024-01-25T15:05:27.234734+0000","last_unstale":"2024-01-25T15:05:28.229740+0000","last_undegraded":"2024-01-25T15:05:28.229740+0000","last_fullsized":"2024-01-25T15:05:28.229740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:55:46.833186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834190+0000","last_change":"2024-01-25T15:05:27.239434+0000","last_active":"2024-01-25T15:05:28.834190+0000","last_peered":"2024-01-25T15:05:28.834190+0000","last_clean":"2024-01-25T15:05:28.834190+0000","last_became_active":"2024-01-25T15:05:27.239182+0000","last_became_peered":"2024-01-25T15:05:27.239182+0000","last_unstale":"2024-01-25T15:05:28.834190+0000","last_undegraded":"2024-01-25T15:05:28.834190+0000","last_fullsized":"2024-01-25T15:05:28.834190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:02:27.702949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847185+0000","last_change":"2024-01-25T15:05:27.243839+0000","last_active":"2024-01-25T15:05:28.847185+0000","last_peered":"2024-01-25T15:05:28.847185+0000","last_clean":"2024-01-25T15:05:28.847185+0000","last_became_active":"2024-01-25T15:05:27.243563+0000","last_became_peered":"2024-01-25T15:05:27.243563+0000","last_unstale":"2024-01-25T15:05:28.847185+0000","last_undegraded":"2024-01-25T15:05:28.847185+0000","last_fullsized":"2024-01-25T15:05:28.847185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:18:52.758791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847057+0000","last_change":"2024-01-25T15:05:27.230988+0000","last_active":"2024-01-25T15:05:28.847057+0000","last_peered":"2024-01-25T15:05:28.847057+0000","last_clean":"2024-01-25T15:05:28.847057+0000","last_became_active":"2024-01-25T15:05:27.230740+0000","last_became_peered":"2024-01-25T15:05:27.230740+0000","last_unstale":"2024-01-25T15:05:28.847057+0000","last_undegraded":"2024-01-25T15:05:28.847057+0000","last_fullsized":"2024-01-25T15:05:28.847057+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:22:36.224608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494090+0000","last_change":"2024-01-25T15:05:27.239531+0000","last_active":"2024-01-25T15:05:28.494090+0000","last_peered":"2024-01-25T15:05:28.494090+0000","last_clean":"2024-01-25T15:05:28.494090+0000","last_became_active":"2024-01-25T15:05:27.238884+0000","last_became_peered":"2024-01-25T15:05:27.238884+0000","last_unstale":"2024-01-25T15:05:28.494090+0000","last_undegraded":"2024-01-25T15:05:28.494090+0000","last_fullsized":"2024-01-25T15:05:28.494090+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:26:19.413150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847428+0000","last_change":"2024-01-25T15:05:27.236157+0000","last_active":"2024-01-25T15:05:28.847428+0000","last_peered":"2024-01-25T15:05:28.847428+0000","last_clean":"2024-01-25T15:05:28.847428+0000","last_became_active":"2024-01-25T15:05:27.235882+0000","last_became_peered":"2024-01-25T15:05:27.235882+0000","last_unstale":"2024-01-25T15:05:28.847428+0000","last_undegraded":"2024-01-25T15:05:28.847428+0000","last_fullsized":"2024-01-25T15:05:28.847428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:53:45.905579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229462+0000","last_change":"2024-01-25T15:05:27.242301+0000","last_active":"2024-01-25T15:05:28.229462+0000","last_peered":"2024-01-25T15:05:28.229462+0000","last_clean":"2024-01-25T15:05:28.229462+0000","last_became_active":"2024-01-25T15:05:27.242077+0000","last_became_peered":"2024-01-25T15:05:27.242077+0000","last_unstale":"2024-01-25T15:05:28.229462+0000","last_undegraded":"2024-01-25T15:05:28.229462+0000","last_fullsized":"2024-01-25T15:05:28.229462+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:17:07.138969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834487+0000","last_change":"2024-01-25T15:05:27.236734+0000","last_active":"2024-01-25T15:05:28.834487+0000","last_peered":"2024-01-25T15:05:28.834487+0000","last_clean":"2024-01-25T15:05:28.834487+0000","last_became_active":"2024-01-25T15:05:27.236377+0000","last_became_peered":"2024-01-25T15:05:27.236377+0000","last_unstale":"2024-01-25T15:05:28.834487+0000","last_undegraded":"2024-01-25T15:05:28.834487+0000","last_fullsized":"2024-01-25T15:05:28.834487+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:02:27.622813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847961+0000","last_change":"2024-01-25T15:05:27.244798+0000","last_active":"2024-01-25T15:05:28.847961+0000","last_peered":"2024-01-25T15:05:28.847961+0000","last_clean":"2024-01-25T15:05:28.847961+0000","last_became_active":"2024-01-25T15:05:27.244547+0000","last_became_peered":"2024-01-25T15:05:27.244547+0000","last_unstale":"2024-01-25T15:05:28.847961+0000","last_undegraded":"2024-01-25T15:05:28.847961+0000","last_fullsized":"2024-01-25T15:05:28.847961+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:47:01.188072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847909+0000","last_change":"2024-01-25T15:05:27.238399+0000","last_active":"2024-01-25T15:05:28.847909+0000","last_peered":"2024-01-25T15:05:28.847909+0000","last_clean":"2024-01-25T15:05:28.847909+0000","last_became_active":"2024-01-25T15:05:27.237999+0000","last_became_peered":"2024-01-25T15:05:27.237999+0000","last_unstale":"2024-01-25T15:05:28.847909+0000","last_undegraded":"2024-01-25T15:05:28.847909+0000","last_fullsized":"2024-01-25T15:05:28.847909+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:43:33.136506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834150+0000","last_change":"2024-01-25T15:05:27.230234+0000","last_active":"2024-01-25T15:05:28.834150+0000","last_peered":"2024-01-25T15:05:28.834150+0000","last_clean":"2024-01-25T15:05:28.834150+0000","last_became_active":"2024-01-25T15:05:27.229945+0000","last_became_peered":"2024-01-25T15:05:27.229945+0000","last_unstale":"2024-01-25T15:05:28.834150+0000","last_undegraded":"2024-01-25T15:05:28.834150+0000","last_fullsized":"2024-01-25T15:05:28.834150+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:10.931099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847698+0000","last_change":"2024-01-25T15:05:27.244146+0000","last_active":"2024-01-25T15:05:28.847698+0000","last_peered":"2024-01-25T15:05:28.847698+0000","last_clean":"2024-01-25T15:05:28.847698+0000","last_became_active":"2024-01-25T15:05:27.243861+0000","last_became_peered":"2024-01-25T15:05:27.243861+0000","last_unstale":"2024-01-25T15:05:28.847698+0000","last_undegraded":"2024-01-25T15:05:28.847698+0000","last_fullsized":"2024-01-25T15:05:28.847698+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:06:14.777919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.715673+0000","last_change":"2024-01-25T15:05:27.236676+0000","last_active":"2024-01-25T15:05:28.715673+0000","last_peered":"2024-01-25T15:05:28.715673+0000","last_clean":"2024-01-25T15:05:28.715673+0000","last_became_active":"2024-01-25T15:05:27.236411+0000","last_became_peered":"2024-01-25T15:05:27.236411+0000","last_unstale":"2024-01-25T15:05:28.715673+0000","last_undegraded":"2024-01-25T15:05:28.715673+0000","last_fullsized":"2024-01-25T15:05:28.715673+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:43:59.664529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847494+0000","last_change":"2024-01-25T15:05:27.234767+0000","last_active":"2024-01-25T15:05:28.847494+0000","last_peered":"2024-01-25T15:05:28.847494+0000","last_clean":"2024-01-25T15:05:28.847494+0000","last_became_active":"2024-01-25T15:05:27.234370+0000","last_became_peered":"2024-01-25T15:05:27.234370+0000","last_unstale":"2024-01-25T15:05:28.847494+0000","last_undegraded":"2024-01-25T15:05:28.847494+0000","last_fullsized":"2024-01-25T15:05:28.847494+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:24:11.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230576+0000","last_change":"2024-01-25T15:05:27.246760+0000","last_active":"2024-01-25T15:05:28.230576+0000","last_peered":"2024-01-25T15:05:28.230576+0000","last_clean":"2024-01-25T15:05:28.230576+0000","last_became_active":"2024-01-25T15:05:27.246482+0000","last_became_peered":"2024-01-25T15:05:27.246482+0000","last_unstale":"2024-01-25T15:05:28.230576+0000","last_undegraded":"2024-01-25T15:05:28.230576+0000","last_fullsized":"2024-01-25T15:05:28.230576+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:10.931099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231687+0000","last_change":"2024-01-25T15:05:27.246282+0000","last_active":"2024-01-25T15:05:28.231687+0000","last_peered":"2024-01-25T15:05:28.231687+0000","last_clean":"2024-01-25T15:05:28.231687+0000","last_became_active":"2024-01-25T15:05:27.245958+0000","last_became_peered":"2024-01-25T15:05:27.245958+0000","last_unstale":"2024-01-25T15:05:28.231687+0000","last_undegraded":"2024-01-25T15:05:28.231687+0000","last_fullsized":"2024-01-25T15:05:28.231687+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:06:14.777919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231213+0000","last_change":"2024-01-25T15:05:27.229020+0000","last_active":"2024-01-25T15:05:28.231213+0000","last_peered":"2024-01-25T15:05:28.231213+0000","last_clean":"2024-01-25T15:05:28.231213+0000","last_became_active":"2024-01-25T15:05:27.228749+0000","last_became_peered":"2024-01-25T15:05:27.228749+0000","last_unstale":"2024-01-25T15:05:28.231213+0000","last_undegraded":"2024-01-25T15:05:28.231213+0000","last_fullsized":"2024-01-25T15:05:28.231213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:49:29.672511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847186+0000","last_change":"2024-01-25T15:05:27.244605+0000","last_active":"2024-01-25T15:05:28.847186+0000","last_peered":"2024-01-25T15:05:28.847186+0000","last_clean":"2024-01-25T15:05:28.847186+0000","last_became_active":"2024-01-25T15:05:27.244345+0000","last_became_peered":"2024-01-25T15:05:27.244345+0000","last_unstale":"2024-01-25T15:05:28.847186+0000","last_undegraded":"2024-01-25T15:05:28.847186+0000","last_fullsized":"2024-01-25T15:05:28.847186+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:23:26.096821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230958+0000","last_change":"2024-01-25T15:05:27.229918+0000","last_active":"2024-01-25T15:05:28.230958+0000","last_peered":"2024-01-25T15:05:28.230958+0000","last_clean":"2024-01-25T15:05:28.230958+0000","last_became_active":"2024-01-25T15:05:27.229636+0000","last_became_peered":"2024-01-25T15:05:27.229636+0000","last_unstale":"2024-01-25T15:05:28.230958+0000","last_undegraded":"2024-01-25T15:05:28.230958+0000","last_fullsized":"2024-01-25T15:05:28.230958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:31.002968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847655+0000","last_change":"2024-01-25T15:05:27.240952+0000","last_active":"2024-01-25T15:05:28.847655+0000","last_peered":"2024-01-25T15:05:28.847655+0000","last_clean":"2024-01-25T15:05:28.847655+0000","last_became_active":"2024-01-25T15:05:27.240683+0000","last_became_peered":"2024-01-25T15:05:27.240683+0000","last_unstale":"2024-01-25T15:05:28.847655+0000","last_undegraded":"2024-01-25T15:05:28.847655+0000","last_fullsized":"2024-01-25T15:05:28.847655+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:44:30.520452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.716058+0000","last_change":"2024-01-25T15:05:27.235172+0000","last_active":"2024-01-25T15:05:28.716058+0000","last_peered":"2024-01-25T15:05:28.716058+0000","last_clean":"2024-01-25T15:05:28.716058+0000","last_became_active":"2024-01-25T15:05:27.234884+0000","last_became_peered":"2024-01-25T15:05:27.234884+0000","last_unstale":"2024-01-25T15:05:28.716058+0000","last_undegraded":"2024-01-25T15:05:28.716058+0000","last_fullsized":"2024-01-25T15:05:28.716058+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:14:28.578562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230886+0000","last_change":"2024-01-25T15:05:27.233225+0000","last_active":"2024-01-25T15:05:28.230886+0000","last_peered":"2024-01-25T15:05:28.230886+0000","last_clean":"2024-01-25T15:05:28.230886+0000","last_became_active":"2024-01-25T15:05:27.232731+0000","last_became_peered":"2024-01-25T15:05:27.232731+0000","last_unstale":"2024-01-25T15:05:28.230886+0000","last_undegraded":"2024-01-25T15:05:28.230886+0000","last_fullsized":"2024-01-25T15:05:28.230886+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:53:45.905579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.846926+0000","last_change":"2024-01-25T15:05:27.226292+0000","last_active":"2024-01-25T15:05:28.846926+0000","last_peered":"2024-01-25T15:05:28.846926+0000","last_clean":"2024-01-25T15:05:28.846926+0000","last_became_active":"2024-01-25T15:05:27.226037+0000","last_became_peered":"2024-01-25T15:05:27.226037+0000","last_unstale":"2024-01-25T15:05:28.846926+0000","last_undegraded":"2024-01-25T15:05:28.846926+0000","last_fullsized":"2024-01-25T15:05:28.846926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:35:20.251170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231572+0000","last_change":"2024-01-25T15:05:27.229896+0000","last_active":"2024-01-25T15:05:28.231572+0000","last_peered":"2024-01-25T15:05:28.231572+0000","last_clean":"2024-01-25T15:05:28.231572+0000","last_became_active":"2024-01-25T15:05:27.229558+0000","last_became_peered":"2024-01-25T15:05:27.229558+0000","last_unstale":"2024-01-25T15:05:28.231572+0000","last_undegraded":"2024-01-25T15:05:28.231572+0000","last_fullsized":"2024-01-25T15:05:28.231572+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:43:59.664529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494329+0000","last_change":"2024-01-25T15:05:27.242603+0000","last_active":"2024-01-25T15:05:28.494329+0000","last_peered":"2024-01-25T15:05:28.494329+0000","last_clean":"2024-01-25T15:05:28.494329+0000","last_became_active":"2024-01-25T15:05:27.241732+0000","last_became_peered":"2024-01-25T15:05:27.241732+0000","last_unstale":"2024-01-25T15:05:28.494329+0000","last_undegraded":"2024-01-25T15:05:28.494329+0000","last_fullsized":"2024-01-25T15:05:28.494329+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:14:28.578562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231565+0000","last_change":"2024-01-25T15:05:27.229445+0000","last_active":"2024-01-25T15:05:28.231565+0000","last_peered":"2024-01-25T15:05:28.231565+0000","last_clean":"2024-01-25T15:05:28.231565+0000","last_became_active":"2024-01-25T15:05:27.229198+0000","last_became_peered":"2024-01-25T15:05:27.229198+0000","last_unstale":"2024-01-25T15:05:28.231565+0000","last_undegraded":"2024-01-25T15:05:28.231565+0000","last_fullsized":"2024-01-25T15:05:28.231565+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:26:19.413150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847739+0000","last_change":"2024-01-25T15:05:27.238720+0000","last_active":"2024-01-25T15:05:28.847739+0000","last_peered":"2024-01-25T15:05:28.847739+0000","last_clean":"2024-01-25T15:05:28.847739+0000","last_became_active":"2024-01-25T15:05:27.238362+0000","last_became_peered":"2024-01-25T15:05:27.238362+0000","last_unstale":"2024-01-25T15:05:28.847739+0000","last_undegraded":"2024-01-25T15:05:28.847739+0000","last_fullsized":"2024-01-25T15:05:28.847739+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:36.810625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231222+0000","last_change":"2024-01-25T15:05:27.229034+0000","last_active":"2024-01-25T15:05:28.231222+0000","last_peered":"2024-01-25T15:05:28.231222+0000","last_clean":"2024-01-25T15:05:28.231222+0000","last_became_active":"2024-01-25T15:05:27.227681+0000","last_became_peered":"2024-01-25T15:05:27.227681+0000","last_unstale":"2024-01-25T15:05:28.231222+0000","last_undegraded":"2024-01-25T15:05:28.231222+0000","last_fullsized":"2024-01-25T15:05:28.231222+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:33:05.014284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230846+0000","last_change":"2024-01-25T15:05:27.227464+0000","last_active":"2024-01-25T15:05:28.230846+0000","last_peered":"2024-01-25T15:05:28.230846+0000","last_clean":"2024-01-25T15:05:28.230846+0000","last_became_active":"2024-01-25T15:05:27.227162+0000","last_became_peered":"2024-01-25T15:05:27.227162+0000","last_unstale":"2024-01-25T15:05:28.230846+0000","last_undegraded":"2024-01-25T15:05:28.230846+0000","last_fullsized":"2024-01-25T15:05:28.230846+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:16:31.883434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231298+0000","last_change":"2024-01-25T15:05:27.233301+0000","last_active":"2024-01-25T15:05:28.231298+0000","last_peered":"2024-01-25T15:05:28.231298+0000","last_clean":"2024-01-25T15:05:28.231298+0000","last_became_active":"2024-01-25T15:05:27.233035+0000","last_became_peered":"2024-01-25T15:05:27.233035+0000","last_unstale":"2024-01-25T15:05:28.231298+0000","last_undegraded":"2024-01-25T15:05:28.231298+0000","last_fullsized":"2024-01-25T15:05:28.231298+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:02:27.622813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494014+0000","last_change":"2024-01-25T15:05:27.237586+0000","last_active":"2024-01-25T15:05:28.494014+0000","last_peered":"2024-01-25T15:05:28.494014+0000","last_clean":"2024-01-25T15:05:28.494014+0000","last_became_active":"2024-01-25T15:05:27.237334+0000","last_became_peered":"2024-01-25T15:05:27.237334+0000","last_unstale":"2024-01-25T15:05:28.494014+0000","last_undegraded":"2024-01-25T15:05:28.494014+0000","last_fullsized":"2024-01-25T15:05:28.494014+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:33:05.014284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230712+0000","last_change":"2024-01-25T15:05:27.247070+0000","last_active":"2024-01-25T15:05:28.230712+0000","last_peered":"2024-01-25T15:05:28.230712+0000","last_clean":"2024-01-25T15:05:28.230712+0000","last_became_active":"2024-01-25T15:05:27.246793+0000","last_became_peered":"2024-01-25T15:05:27.246793+0000","last_unstale":"2024-01-25T15:05:28.230712+0000","last_undegraded":"2024-01-25T15:05:28.230712+0000","last_fullsized":"2024-01-25T15:05:28.230712+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:13:38.590014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231524+0000","last_change":"2024-01-25T15:05:26.223571+0000","last_active":"2024-01-25T15:05:28.231524+0000","last_peered":"2024-01-25T15:05:28.231524+0000","last_clean":"2024-01-25T15:05:28.231524+0000","last_became_active":"2024-01-25T15:05:26.223239+0000","last_became_peered":"2024-01-25T15:05:26.223239+0000","last_unstale":"2024-01-25T15:05:28.231524+0000","last_undegraded":"2024-01-25T15:05:28.231524+0000","last_fullsized":"2024-01-25T15:05:28.231524+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:23:25.092941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494308+0000","last_change":"2024-01-25T15:05:27.243468+0000","last_active":"2024-01-25T15:05:28.494308+0000","last_peered":"2024-01-25T15:05:28.494308+0000","last_clean":"2024-01-25T15:05:28.494308+0000","last_became_active":"2024-01-25T15:05:27.241288+0000","last_became_peered":"2024-01-25T15:05:27.241288+0000","last_unstale":"2024-01-25T15:05:28.494308+0000","last_undegraded":"2024-01-25T15:05:28.494308+0000","last_fullsized":"2024-01-25T15:05:28.494308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:46:52.035987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834381+0000","last_change":"2024-01-25T15:05:26.222363+0000","last_active":"2024-01-25T15:05:28.834381+0000","last_peered":"2024-01-25T15:05:28.834381+0000","last_clean":"2024-01-25T15:05:28.834381+0000","last_became_active":"2024-01-25T15:05:26.222076+0000","last_became_peered":"2024-01-25T15:05:26.222076+0000","last_unstale":"2024-01-25T15:05:28.834381+0000","last_undegraded":"2024-01-25T15:05:28.834381+0000","last_fullsized":"2024-01-25T15:05:28.834381+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:25:54.998838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.716074+0000","last_change":"2024-01-25T15:05:27.236309+0000","last_active":"2024-01-25T15:05:28.716074+0000","last_peered":"2024-01-25T15:05:28.716074+0000","last_clean":"2024-01-25T15:05:28.716074+0000","last_became_active":"2024-01-25T15:05:27.236051+0000","last_became_peered":"2024-01-25T15:05:27.236051+0000","last_unstale":"2024-01-25T15:05:28.716074+0000","last_undegraded":"2024-01-25T15:05:28.716074+0000","last_fullsized":"2024-01-25T15:05:28.716074+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:16:02.607369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494388+0000","last_change":"2024-01-25T15:05:26.222345+0000","last_active":"2024-01-25T15:05:28.494388+0000","last_peered":"2024-01-25T15:05:28.494388+0000","last_clean":"2024-01-25T15:05:28.494388+0000","last_became_active":"2024-01-25T15:05:26.221552+0000","last_became_peered":"2024-01-25T15:05:26.221552+0000","last_unstale":"2024-01-25T15:05:28.494388+0000","last_undegraded":"2024-01-25T15:05:28.494388+0000","last_fullsized":"2024-01-25T15:05:28.494388+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:31:52.278724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229975+0000","last_change":"2024-01-25T15:05:27.224791+0000","last_active":"2024-01-25T15:05:28.229975+0000","last_peered":"2024-01-25T15:05:28.229975+0000","last_clean":"2024-01-25T15:05:28.229975+0000","last_became_active":"2024-01-25T15:05:27.224542+0000","last_became_peered":"2024-01-25T15:05:27.224542+0000","last_unstale":"2024-01-25T15:05:28.229975+0000","last_undegraded":"2024-01-25T15:05:28.229975+0000","last_fullsized":"2024-01-25T15:05:28.229975+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:22:13.913722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.715925+0000","last_change":"2024-01-25T15:05:26.217509+0000","last_active":"2024-01-25T15:05:28.715925+0000","last_peered":"2024-01-25T15:05:28.715925+0000","last_clean":"2024-01-25T15:05:28.715925+0000","last_became_active":"2024-01-25T15:05:26.217198+0000","last_became_peered":"2024-01-25T15:05:26.217198+0000","last_unstale":"2024-01-25T15:05:28.715925+0000","last_undegraded":"2024-01-25T15:05:28.715925+0000","last_fullsized":"2024-01-25T15:05:28.715925+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:23:25.092941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834219+0000","last_change":"2024-01-25T15:05:27.241011+0000","last_active":"2024-01-25T15:05:28.834219+0000","last_peered":"2024-01-25T15:05:28.834219+0000","last_clean":"2024-01-25T15:05:28.834219+0000","last_became_active":"2024-01-25T15:05:27.240732+0000","last_became_peered":"2024-01-25T15:05:27.240732+0000","last_unstale":"2024-01-25T15:05:28.834219+0000","last_undegraded":"2024-01-25T15:05:28.834219+0000","last_fullsized":"2024-01-25T15:05:28.834219+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:53:45.905579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847814+0000","last_change":"2024-01-25T15:05:26.224826+0000","last_active":"2024-01-25T15:05:28.847814+0000","last_peered":"2024-01-25T15:05:28.847814+0000","last_clean":"2024-01-25T15:05:28.847814+0000","last_became_active":"2024-01-25T15:05:26.224517+0000","last_became_peered":"2024-01-25T15:05:26.224517+0000","last_unstale":"2024-01-25T15:05:28.847814+0000","last_undegraded":"2024-01-25T15:05:28.847814+0000","last_fullsized":"2024-01-25T15:05:28.847814+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:00:52.590768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847706+0000","last_change":"2024-01-25T15:05:27.243054+0000","last_active":"2024-01-25T15:05:28.847706+0000","last_peered":"2024-01-25T15:05:28.847706+0000","last_clean":"2024-01-25T15:05:28.847706+0000","last_became_active":"2024-01-25T15:05:27.240995+0000","last_became_peered":"2024-01-25T15:05:27.240995+0000","last_unstale":"2024-01-25T15:05:28.847706+0000","last_undegraded":"2024-01-25T15:05:28.847706+0000","last_fullsized":"2024-01-25T15:05:28.847706+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:17:07.138969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231228+0000","last_change":"2024-01-25T15:05:26.220260+0000","last_active":"2024-01-25T15:05:28.231228+0000","last_peered":"2024-01-25T15:05:28.231228+0000","last_clean":"2024-01-25T15:05:28.231228+0000","last_became_active":"2024-01-25T15:05:26.219815+0000","last_became_peered":"2024-01-25T15:05:26.219815+0000","last_unstale":"2024-01-25T15:05:28.231228+0000","last_undegraded":"2024-01-25T15:05:28.231228+0000","last_fullsized":"2024-01-25T15:05:28.231228+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:25:54.998838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.715908+0000","last_change":"2024-01-25T15:05:27.241873+0000","last_active":"2024-01-25T15:05:28.715908+0000","last_peered":"2024-01-25T15:05:28.715908+0000","last_clean":"2024-01-25T15:05:28.715908+0000","last_became_active":"2024-01-25T15:05:27.241586+0000","last_became_peered":"2024-01-25T15:05:27.241586+0000","last_unstale":"2024-01-25T15:05:28.715908+0000","last_undegraded":"2024-01-25T15:05:28.715908+0000","last_fullsized":"2024-01-25T15:05:28.715908+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:54:18.204207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494085+0000","last_change":"2024-01-25T15:05:26.223828+0000","last_active":"2024-01-25T15:05:28.494085+0000","last_peered":"2024-01-25T15:05:28.494085+0000","last_clean":"2024-01-25T15:05:28.494085+0000","last_became_active":"2024-01-25T15:05:26.223568+0000","last_became_peered":"2024-01-25T15:05:26.223568+0000","last_unstale":"2024-01-25T15:05:28.494085+0000","last_undegraded":"2024-01-25T15:05:28.494085+0000","last_fullsized":"2024-01-25T15:05:28.494085+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:22:35.220728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229556+0000","last_change":"2024-01-25T15:05:27.230178+0000","last_active":"2024-01-25T15:05:28.229556+0000","last_peered":"2024-01-25T15:05:28.229556+0000","last_clean":"2024-01-25T15:05:28.229556+0000","last_became_active":"2024-01-25T15:05:27.229928+0000","last_became_peered":"2024-01-25T15:05:27.229928+0000","last_unstale":"2024-01-25T15:05:28.229556+0000","last_undegraded":"2024-01-25T15:05:28.229556+0000","last_fullsized":"2024-01-25T15:05:28.229556+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:43:33.136506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.715600+0000","last_change":"2024-01-25T15:05:26.221805+0000","last_active":"2024-01-25T15:05:28.715600+0000","last_peered":"2024-01-25T15:05:28.715600+0000","last_clean":"2024-01-25T15:05:28.715600+0000","last_became_active":"2024-01-25T15:05:26.221380+0000","last_became_peered":"2024-01-25T15:05:26.221380+0000","last_unstale":"2024-01-25T15:05:28.715600+0000","last_undegraded":"2024-01-25T15:05:28.715600+0000","last_fullsized":"2024-01-25T15:05:28.715600+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:22:35.220728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847210+0000","last_change":"2024-01-25T15:05:27.243866+0000","last_active":"2024-01-25T15:05:28.847210+0000","last_peered":"2024-01-25T15:05:28.847210+0000","last_clean":"2024-01-25T15:05:28.847210+0000","last_became_active":"2024-01-25T15:05:27.243596+0000","last_became_peered":"2024-01-25T15:05:27.243596+0000","last_unstale":"2024-01-25T15:05:28.847210+0000","last_undegraded":"2024-01-25T15:05:28.847210+0000","last_fullsized":"2024-01-25T15:05:28.847210+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:31:53.282604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230023+0000","last_change":"2024-01-25T15:05:26.219579+0000","last_active":"2024-01-25T15:05:28.230023+0000","last_peered":"2024-01-25T15:05:28.230023+0000","last_clean":"2024-01-25T15:05:28.230023+0000","last_became_active":"2024-01-25T15:05:26.219276+0000","last_became_peered":"2024-01-25T15:05:26.219276+0000","last_unstale":"2024-01-25T15:05:28.230023+0000","last_undegraded":"2024-01-25T15:05:28.230023+0000","last_fullsized":"2024-01-25T15:05:28.230023+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:26:18.409269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231917+0000","last_change":"2024-01-25T15:05:27.241962+0000","last_active":"2024-01-25T15:05:28.231917+0000","last_peered":"2024-01-25T15:05:28.231917+0000","last_clean":"2024-01-25T15:05:28.231917+0000","last_became_active":"2024-01-25T15:05:27.241674+0000","last_became_peered":"2024-01-25T15:05:27.241674+0000","last_unstale":"2024-01-25T15:05:28.231917+0000","last_undegraded":"2024-01-25T15:05:28.231917+0000","last_fullsized":"2024-01-25T15:05:28.231917+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:36.810625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.848145+0000","last_change":"2024-01-25T15:05:26.223146+0000","last_active":"2024-01-25T15:05:28.848145+0000","last_peered":"2024-01-25T15:05:28.848145+0000","last_clean":"2024-01-25T15:05:28.848145+0000","last_became_active":"2024-01-25T15:05:26.222888+0000","last_became_peered":"2024-01-25T15:05:26.222888+0000","last_unstale":"2024-01-25T15:05:28.848145+0000","last_undegraded":"2024-01-25T15:05:28.848145+0000","last_fullsized":"2024-01-25T15:05:28.848145+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:05:05.431051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834381+0000","last_change":"2024-01-25T15:05:27.235466+0000","last_active":"2024-01-25T15:05:28.834381+0000","last_peered":"2024-01-25T15:05:28.834381+0000","last_clean":"2024-01-25T15:05:28.834381+0000","last_became_active":"2024-01-25T15:05:27.235043+0000","last_became_peered":"2024-01-25T15:05:27.235043+0000","last_unstale":"2024-01-25T15:05:28.834381+0000","last_undegraded":"2024-01-25T15:05:28.834381+0000","last_fullsized":"2024-01-25T15:05:28.834381+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:24:11.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.848064+0000","last_change":"2024-01-25T15:05:26.227418+0000","last_active":"2024-01-25T15:05:28.848064+0000","last_peered":"2024-01-25T15:05:28.848064+0000","last_clean":"2024-01-25T15:05:28.848064+0000","last_became_active":"2024-01-25T15:05:26.227133+0000","last_became_peered":"2024-01-25T15:05:26.227133+0000","last_unstale":"2024-01-25T15:05:28.848064+0000","last_undegraded":"2024-01-25T15:05:28.848064+0000","last_fullsized":"2024-01-25T15:05:28.848064+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:25:54.998838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.716142+0000","last_change":"2024-01-25T15:05:27.235111+0000","last_active":"2024-01-25T15:05:28.716142+0000","last_peered":"2024-01-25T15:05:28.716142+0000","last_clean":"2024-01-25T15:05:28.716142+0000","last_became_active":"2024-01-25T15:05:27.234825+0000","last_became_peered":"2024-01-25T15:05:27.234825+0000","last_unstale":"2024-01-25T15:05:28.716142+0000","last_undegraded":"2024-01-25T15:05:28.716142+0000","last_fullsized":"2024-01-25T15:05:28.716142+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:10.931099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229789+0000","last_change":"2024-01-25T15:05:26.213663+0000","last_active":"2024-01-25T15:05:28.229789+0000","last_peered":"2024-01-25T15:05:28.229789+0000","last_clean":"2024-01-25T15:05:28.229789+0000","last_became_active":"2024-01-25T15:05:26.213360+0000","last_became_peered":"2024-01-25T15:05:26.213360+0000","last_unstale":"2024-01-25T15:05:28.229789+0000","last_undegraded":"2024-01-25T15:05:28.229789+0000","last_fullsized":"2024-01-25T15:05:28.229789+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:43:58.660649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834062+0000","last_change":"2024-01-25T15:05:27.244333+0000","last_active":"2024-01-25T15:05:28.834062+0000","last_peered":"2024-01-25T15:05:28.834062+0000","last_clean":"2024-01-25T15:05:28.834062+0000","last_became_active":"2024-01-25T15:05:27.244050+0000","last_became_peered":"2024-01-25T15:05:27.244050+0000","last_unstale":"2024-01-25T15:05:28.834062+0000","last_undegraded":"2024-01-25T15:05:28.834062+0000","last_fullsized":"2024-01-25T15:05:28.834062+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:14:28.578562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229803+0000","last_change":"2024-01-25T15:05:26.224736+0000","last_active":"2024-01-25T15:05:28.229803+0000","last_peered":"2024-01-25T15:05:28.229803+0000","last_clean":"2024-01-25T15:05:28.229803+0000","last_became_active":"2024-01-25T15:05:26.224440+0000","last_became_peered":"2024-01-25T15:05:26.224440+0000","last_unstale":"2024-01-25T15:05:28.229803+0000","last_undegraded":"2024-01-25T15:05:28.229803+0000","last_fullsized":"2024-01-25T15:05:28.229803+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:54:17.200327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229452+0000","last_change":"2024-01-25T15:05:27.225582+0000","last_active":"2024-01-25T15:05:28.229452+0000","last_peered":"2024-01-25T15:05:28.229452+0000","last_clean":"2024-01-25T15:05:28.229452+0000","last_became_active":"2024-01-25T15:05:27.225337+0000","last_became_peered":"2024-01-25T15:05:27.225337+0000","last_unstale":"2024-01-25T15:05:28.229452+0000","last_undegraded":"2024-01-25T15:05:28.229452+0000","last_fullsized":"2024-01-25T15:05:28.229452+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:06:14.777919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494099+0000","last_change":"2024-01-25T15:05:26.224964+0000","last_active":"2024-01-25T15:05:28.494099+0000","last_peered":"2024-01-25T15:05:28.494099+0000","last_clean":"2024-01-25T15:05:28.494099+0000","last_became_active":"2024-01-25T15:05:26.224350+0000","last_became_peered":"2024-01-25T15:05:26.224350+0000","last_unstale":"2024-01-25T15:05:28.494099+0000","last_undegraded":"2024-01-25T15:05:28.494099+0000","last_fullsized":"2024-01-25T15:05:28.494099+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:23:25.092941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230682+0000","last_change":"2024-01-25T15:05:27.230302+0000","last_active":"2024-01-25T15:05:28.230682+0000","last_peered":"2024-01-25T15:05:28.230682+0000","last_clean":"2024-01-25T15:05:28.230682+0000","last_became_active":"2024-01-25T15:05:27.230047+0000","last_became_peered":"2024-01-25T15:05:27.230047+0000","last_unstale":"2024-01-25T15:05:28.230682+0000","last_undegraded":"2024-01-25T15:05:28.230682+0000","last_fullsized":"2024-01-25T15:05:28.230682+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:02:27.702949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230589+0000","last_change":"2024-01-25T15:05:26.223718+0000","last_active":"2024-01-25T15:05:28.230589+0000","last_peered":"2024-01-25T15:05:28.230589+0000","last_clean":"2024-01-25T15:05:28.230589+0000","last_became_active":"2024-01-25T15:05:26.222346+0000","last_became_peered":"2024-01-25T15:05:26.222346+0000","last_unstale":"2024-01-25T15:05:28.230589+0000","last_undegraded":"2024-01-25T15:05:28.230589+0000","last_fullsized":"2024-01-25T15:05:28.230589+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:35:19.247290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229554+0000","last_change":"2024-01-25T15:05:27.226239+0000","last_active":"2024-01-25T15:05:28.229554+0000","last_peered":"2024-01-25T15:05:28.229554+0000","last_clean":"2024-01-25T15:05:28.229554+0000","last_became_active":"2024-01-25T15:05:27.225978+0000","last_became_peered":"2024-01-25T15:05:27.225978+0000","last_unstale":"2024-01-25T15:05:28.229554+0000","last_undegraded":"2024-01-25T15:05:28.229554+0000","last_fullsized":"2024-01-25T15:05:28.229554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:36.810625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231481+0000","last_change":"2024-01-25T15:05:26.222694+0000","last_active":"2024-01-25T15:05:28.231481+0000","last_peered":"2024-01-25T15:05:28.231481+0000","last_clean":"2024-01-25T15:05:28.231481+0000","last_became_active":"2024-01-25T15:05:26.222439+0000","last_became_peered":"2024-01-25T15:05:26.222439+0000","last_unstale":"2024-01-25T15:05:28.231481+0000","last_undegraded":"2024-01-25T15:05:28.231481+0000","last_fullsized":"2024-01-25T15:05:28.231481+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:48:18.501092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229768+0000","last_change":"2024-01-25T15:05:27.233916+0000","last_active":"2024-01-25T15:05:28.229768+0000","last_peered":"2024-01-25T15:05:28.229768+0000","last_clean":"2024-01-25T15:05:28.229768+0000","last_became_active":"2024-01-25T15:05:27.233305+0000","last_became_peered":"2024-01-25T15:05:27.233305+0000","last_unstale":"2024-01-25T15:05:28.229768+0000","last_undegraded":"2024-01-25T15:05:28.229768+0000","last_fullsized":"2024-01-25T15:05:28.229768+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:00:27.744795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.848123+0000","last_change":"2024-01-25T15:05:26.225673+0000","last_active":"2024-01-25T15:05:28.848123+0000","last_peered":"2024-01-25T15:05:28.848123+0000","last_clean":"2024-01-25T15:05:28.848123+0000","last_became_active":"2024-01-25T15:05:26.225411+0000","last_became_peered":"2024-01-25T15:05:26.225411+0000","last_unstale":"2024-01-25T15:05:28.848123+0000","last_undegraded":"2024-01-25T15:05:28.848123+0000","last_fullsized":"2024-01-25T15:05:28.848123+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:16:30.879553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.848063+0000","last_change":"2024-01-25T15:05:27.247875+0000","last_active":"2024-01-25T15:05:28.848063+0000","last_peered":"2024-01-25T15:05:28.848063+0000","last_clean":"2024-01-25T15:05:28.848063+0000","last_became_active":"2024-01-25T15:05:27.247493+0000","last_became_peered":"2024-01-25T15:05:27.247493+0000","last_unstale":"2024-01-25T15:05:28.848063+0000","last_undegraded":"2024-01-25T15:05:28.848063+0000","last_fullsized":"2024-01-25T15:05:28.848063+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:01:33.031259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.716141+0000","last_change":"2024-01-25T15:05:26.220907+0000","last_active":"2024-01-25T15:05:28.716141+0000","last_peered":"2024-01-25T15:05:28.716141+0000","last_clean":"2024-01-25T15:05:28.716141+0000","last_became_active":"2024-01-25T15:05:26.220539+0000","last_became_peered":"2024-01-25T15:05:26.220539+0000","last_unstale":"2024-01-25T15:05:28.716141+0000","last_undegraded":"2024-01-25T15:05:28.716141+0000","last_fullsized":"2024-01-25T15:05:28.716141+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:18:51.754911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.716049+0000","last_change":"2024-01-25T15:05:27.242875+0000","last_active":"2024-01-25T15:05:28.716049+0000","last_peered":"2024-01-25T15:05:28.716049+0000","last_clean":"2024-01-25T15:05:28.716049+0000","last_became_active":"2024-01-25T15:05:27.241953+0000","last_became_peered":"2024-01-25T15:05:27.241953+0000","last_unstale":"2024-01-25T15:05:28.716049+0000","last_undegraded":"2024-01-25T15:05:28.716049+0000","last_fullsized":"2024-01-25T15:05:28.716049+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:46:52.035987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847211+0000","last_change":"2024-01-25T15:05:26.218250+0000","last_active":"2024-01-25T15:05:28.847211+0000","last_peered":"2024-01-25T15:05:28.847211+0000","last_clean":"2024-01-25T15:05:28.847211+0000","last_became_active":"2024-01-25T15:05:26.217965+0000","last_became_peered":"2024-01-25T15:05:26.217965+0000","last_unstale":"2024-01-25T15:05:28.847211+0000","last_undegraded":"2024-01-25T15:05:28.847211+0000","last_fullsized":"2024-01-25T15:05:28.847211+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:03:01.180813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847330+0000","last_change":"2024-01-25T15:05:27.236656+0000","last_active":"2024-01-25T15:05:28.847330+0000","last_peered":"2024-01-25T15:05:28.847330+0000","last_clean":"2024-01-25T15:05:28.847330+0000","last_became_active":"2024-01-25T15:05:27.236391+0000","last_became_peered":"2024-01-25T15:05:27.236391+0000","last_unstale":"2024-01-25T15:05:28.847330+0000","last_undegraded":"2024-01-25T15:05:28.847330+0000","last_fullsized":"2024-01-25T15:05:28.847330+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:48:19.504972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494205+0000","last_change":"2024-01-25T15:05:26.218267+0000","last_active":"2024-01-25T15:05:28.494205+0000","last_peered":"2024-01-25T15:05:28.494205+0000","last_clean":"2024-01-25T15:05:28.494205+0000","last_became_active":"2024-01-25T15:05:26.217935+0000","last_became_peered":"2024-01-25T15:05:26.217935+0000","last_unstale":"2024-01-25T15:05:28.494205+0000","last_undegraded":"2024-01-25T15:05:28.494205+0000","last_fullsized":"2024-01-25T15:05:28.494205+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:18:51.754911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231629+0000","last_change":"2024-01-25T15:05:27.229184+0000","last_active":"2024-01-25T15:05:28.231629+0000","last_peered":"2024-01-25T15:05:28.231629+0000","last_clean":"2024-01-25T15:05:28.231629+0000","last_became_active":"2024-01-25T15:05:27.228691+0000","last_became_peered":"2024-01-25T15:05:27.228691+0000","last_unstale":"2024-01-25T15:05:28.231629+0000","last_undegraded":"2024-01-25T15:05:28.231629+0000","last_fullsized":"2024-01-25T15:05:28.231629+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:44:30.520452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847042+0000","last_change":"2024-01-25T15:05:26.224643+0000","last_active":"2024-01-25T15:05:28.847042+0000","last_peered":"2024-01-25T15:05:28.847042+0000","last_clean":"2024-01-25T15:05:28.847042+0000","last_became_active":"2024-01-25T15:05:26.224395+0000","last_became_peered":"2024-01-25T15:05:26.224395+0000","last_unstale":"2024-01-25T15:05:28.847042+0000","last_undegraded":"2024-01-25T15:05:28.847042+0000","last_fullsized":"2024-01-25T15:05:28.847042+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:12:44.093299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834130+0000","last_change":"2024-01-25T15:05:27.235292+0000","last_active":"2024-01-25T15:05:28.834130+0000","last_peered":"2024-01-25T15:05:28.834130+0000","last_clean":"2024-01-25T15:05:28.834130+0000","last_became_active":"2024-01-25T15:05:27.234825+0000","last_became_peered":"2024-01-25T15:05:27.234825+0000","last_unstale":"2024-01-25T15:05:28.834130+0000","last_undegraded":"2024-01-25T15:05:28.834130+0000","last_fullsized":"2024-01-25T15:05:28.834130+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:16:02.607369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847014+0000","last_change":"2024-01-25T15:05:26.227384+0000","last_active":"2024-01-25T15:05:28.847014+0000","last_peered":"2024-01-25T15:05:28.847014+0000","last_clean":"2024-01-25T15:05:28.847014+0000","last_became_active":"2024-01-25T15:05:26.227112+0000","last_became_peered":"2024-01-25T15:05:26.227112+0000","last_unstale":"2024-01-25T15:05:28.847014+0000","last_undegraded":"2024-01-25T15:05:28.847014+0000","last_fullsized":"2024-01-25T15:05:28.847014+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:05:00.172648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847623+0000","last_change":"2024-01-25T15:05:27.245885+0000","last_active":"2024-01-25T15:05:28.847623+0000","last_peered":"2024-01-25T15:05:28.847623+0000","last_clean":"2024-01-25T15:05:28.847623+0000","last_became_active":"2024-01-25T15:05:27.245616+0000","last_became_peered":"2024-01-25T15:05:27.245616+0000","last_unstale":"2024-01-25T15:05:28.847623+0000","last_undegraded":"2024-01-25T15:05:28.847623+0000","last_fullsized":"2024-01-25T15:05:28.847623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:02:27.622813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231405+0000","last_change":"2024-01-25T15:05:26.221180+0000","last_active":"2024-01-25T15:05:28.231405+0000","last_peered":"2024-01-25T15:05:28.231405+0000","last_clean":"2024-01-25T15:05:28.231405+0000","last_became_active":"2024-01-25T15:05:26.220911+0000","last_became_peered":"2024-01-25T15:05:26.220911+0000","last_unstale":"2024-01-25T15:05:28.231405+0000","last_undegraded":"2024-01-25T15:05:28.231405+0000","last_fullsized":"2024-01-25T15:05:28.231405+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:00:52.590768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229724+0000","last_change":"2024-01-25T15:05:27.229523+0000","last_active":"2024-01-25T15:05:28.229724+0000","last_peered":"2024-01-25T15:05:28.229724+0000","last_clean":"2024-01-25T15:05:28.229724+0000","last_became_active":"2024-01-25T15:05:27.229254+0000","last_became_peered":"2024-01-25T15:05:27.229254+0000","last_unstale":"2024-01-25T15:05:28.229724+0000","last_undegraded":"2024-01-25T15:05:28.229724+0000","last_fullsized":"2024-01-25T15:05:28.229724+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:47:01.188072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.846942+0000","last_change":"2024-01-25T15:05:26.220823+0000","last_active":"2024-01-25T15:05:28.846942+0000","last_peered":"2024-01-25T15:05:28.846942+0000","last_clean":"2024-01-25T15:05:28.846942+0000","last_became_active":"2024-01-25T15:05:26.220552+0000","last_became_peered":"2024-01-25T15:05:26.220552+0000","last_unstale":"2024-01-25T15:05:28.846942+0000","last_undegraded":"2024-01-25T15:05:28.846942+0000","last_fullsized":"2024-01-25T15:05:28.846942+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:27:08.783181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494190+0000","last_change":"2024-01-25T15:05:27.242991+0000","last_active":"2024-01-25T15:05:28.494190+0000","last_peered":"2024-01-25T15:05:28.494190+0000","last_clean":"2024-01-25T15:05:28.494190+0000","last_became_active":"2024-01-25T15:05:27.241347+0000","last_became_peered":"2024-01-25T15:05:27.241347+0000","last_unstale":"2024-01-25T15:05:28.494190+0000","last_undegraded":"2024-01-25T15:05:28.494190+0000","last_fullsized":"2024-01-25T15:05:28.494190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:54:18.204207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.848184+0000","last_change":"2024-01-25T15:05:26.227334+0000","last_active":"2024-01-25T15:05:28.848184+0000","last_peered":"2024-01-25T15:05:28.848184+0000","last_clean":"2024-01-25T15:05:28.848184+0000","last_became_active":"2024-01-25T15:05:26.227016+0000","last_became_peered":"2024-01-25T15:05:26.227016+0000","last_unstale":"2024-01-25T15:05:28.848184+0000","last_undegraded":"2024-01-25T15:05:28.848184+0000","last_fullsized":"2024-01-25T15:05:28.848184+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:29.999087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231917+0000","last_change":"2024-01-25T15:05:27.242175+0000","last_active":"2024-01-25T15:05:28.231917+0000","last_peered":"2024-01-25T15:05:28.231917+0000","last_clean":"2024-01-25T15:05:28.231917+0000","last_became_active":"2024-01-25T15:05:27.241892+0000","last_became_peered":"2024-01-25T15:05:27.241892+0000","last_unstale":"2024-01-25T15:05:28.231917+0000","last_undegraded":"2024-01-25T15:05:28.231917+0000","last_fullsized":"2024-01-25T15:05:28.231917+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:17:07.138969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847215+0000","last_change":"2024-01-25T15:05:26.220140+0000","last_active":"2024-01-25T15:05:28.847215+0000","last_peered":"2024-01-25T15:05:28.847215+0000","last_clean":"2024-01-25T15:05:28.847215+0000","last_became_active":"2024-01-25T15:05:26.219823+0000","last_became_peered":"2024-01-25T15:05:26.219823+0000","last_unstale":"2024-01-25T15:05:28.847215+0000","last_undegraded":"2024-01-25T15:05:28.847215+0000","last_fullsized":"2024-01-25T15:05:28.847215+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:53:24.322574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229759+0000","last_change":"2024-01-25T15:05:27.229536+0000","last_active":"2024-01-25T15:05:28.229759+0000","last_peered":"2024-01-25T15:05:28.229759+0000","last_clean":"2024-01-25T15:05:28.229759+0000","last_became_active":"2024-01-25T15:05:27.228565+0000","last_became_peered":"2024-01-25T15:05:27.228565+0000","last_unstale":"2024-01-25T15:05:28.229759+0000","last_undegraded":"2024-01-25T15:05:28.229759+0000","last_fullsized":"2024-01-25T15:05:28.229759+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:01:33.031259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834270+0000","last_change":"2024-01-25T15:05:26.225379+0000","last_active":"2024-01-25T15:05:28.834270+0000","last_peered":"2024-01-25T15:05:28.834270+0000","last_clean":"2024-01-25T15:05:28.834270+0000","last_became_active":"2024-01-25T15:05:26.225106+0000","last_became_peered":"2024-01-25T15:05:26.225106+0000","last_unstale":"2024-01-25T15:05:28.834270+0000","last_undegraded":"2024-01-25T15:05:28.834270+0000","last_fullsized":"2024-01-25T15:05:28.834270+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:21:43.851971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834208+0000","last_change":"2024-01-25T15:05:27.229007+0000","last_active":"2024-01-25T15:05:28.834208+0000","last_peered":"2024-01-25T15:05:28.834208+0000","last_clean":"2024-01-25T15:05:28.834208+0000","last_became_active":"2024-01-25T15:05:27.228729+0000","last_became_peered":"2024-01-25T15:05:27.228729+0000","last_unstale":"2024-01-25T15:05:28.834208+0000","last_undegraded":"2024-01-25T15:05:28.834208+0000","last_fullsized":"2024-01-25T15:05:28.834208+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:13:38.590014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834307+0000","last_change":"2024-01-25T15:05:26.226470+0000","last_active":"2024-01-25T15:05:28.834307+0000","last_peered":"2024-01-25T15:05:28.834307+0000","last_clean":"2024-01-25T15:05:28.834307+0000","last_became_active":"2024-01-25T15:05:26.226185+0000","last_became_peered":"2024-01-25T15:05:26.226185+0000","last_unstale":"2024-01-25T15:05:28.834307+0000","last_undegraded":"2024-01-25T15:05:28.834307+0000","last_fullsized":"2024-01-25T15:05:28.834307+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:00:52.590768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494056+0000","last_change":"2024-01-25T15:05:27.236625+0000","last_active":"2024-01-25T15:05:28.494056+0000","last_peered":"2024-01-25T15:05:28.494056+0000","last_clean":"2024-01-25T15:05:28.494056+0000","last_became_active":"2024-01-25T15:05:27.236387+0000","last_became_peered":"2024-01-25T15:05:27.236387+0000","last_unstale":"2024-01-25T15:05:28.494056+0000","last_undegraded":"2024-01-25T15:05:28.494056+0000","last_fullsized":"2024-01-25T15:05:28.494056+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:43:59.664529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230946+0000","last_change":"2024-01-25T15:05:26.224342+0000","last_active":"2024-01-25T15:05:28.230946+0000","last_peered":"2024-01-25T15:05:28.230946+0000","last_clean":"2024-01-25T15:05:28.230946+0000","last_became_active":"2024-01-25T15:05:26.224074+0000","last_became_peered":"2024-01-25T15:05:26.224074+0000","last_unstale":"2024-01-25T15:05:28.230946+0000","last_undegraded":"2024-01-25T15:05:28.230946+0000","last_fullsized":"2024-01-25T15:05:28.230946+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:22:35.220728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.715707+0000","last_change":"2024-01-25T15:05:27.234553+0000","last_active":"2024-01-25T15:05:28.715707+0000","last_peered":"2024-01-25T15:05:28.715707+0000","last_clean":"2024-01-25T15:05:28.715707+0000","last_became_active":"2024-01-25T15:05:27.234266+0000","last_became_peered":"2024-01-25T15:05:27.234266+0000","last_unstale":"2024-01-25T15:05:28.715707+0000","last_undegraded":"2024-01-25T15:05:28.715707+0000","last_fullsized":"2024-01-25T15:05:28.715707+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:26:19.413150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.715581+0000","last_change":"2024-01-25T15:05:26.210731+0000","last_active":"2024-01-25T15:05:28.715581+0000","last_peered":"2024-01-25T15:05:28.715581+0000","last_clean":"2024-01-25T15:05:28.715581+0000","last_became_active":"2024-01-25T15:05:26.210193+0000","last_became_peered":"2024-01-25T15:05:26.210193+0000","last_unstale":"2024-01-25T15:05:28.715581+0000","last_undegraded":"2024-01-25T15:05:28.715581+0000","last_fullsized":"2024-01-25T15:05:28.715581+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:35:19.247290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231127+0000","last_change":"2024-01-25T15:05:27.240670+0000","last_active":"2024-01-25T15:05:28.231127+0000","last_peered":"2024-01-25T15:05:28.231127+0000","last_clean":"2024-01-25T15:05:28.231127+0000","last_became_active":"2024-01-25T15:05:27.240409+0000","last_became_peered":"2024-01-25T15:05:27.240409+0000","last_unstale":"2024-01-25T15:05:28.231127+0000","last_undegraded":"2024-01-25T15:05:28.231127+0000","last_fullsized":"2024-01-25T15:05:28.231127+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:24:11.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229491+0000","last_change":"2024-01-25T15:05:26.215779+0000","last_active":"2024-01-25T15:05:28.229491+0000","last_peered":"2024-01-25T15:05:28.229491+0000","last_clean":"2024-01-25T15:05:28.229491+0000","last_became_active":"2024-01-25T15:05:26.215521+0000","last_became_peered":"2024-01-25T15:05:26.215521+0000","last_unstale":"2024-01-25T15:05:28.229491+0000","last_undegraded":"2024-01-25T15:05:28.229491+0000","last_fullsized":"2024-01-25T15:05:28.229491+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:33:04.010404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.848039+0000","last_change":"2024-01-25T15:05:27.236929+0000","last_active":"2024-01-25T15:05:28.848039+0000","last_peered":"2024-01-25T15:05:28.848039+0000","last_clean":"2024-01-25T15:05:28.848039+0000","last_became_active":"2024-01-25T15:05:27.236388+0000","last_became_peered":"2024-01-25T15:05:27.236388+0000","last_unstale":"2024-01-25T15:05:28.848039+0000","last_undegraded":"2024-01-25T15:05:28.848039+0000","last_fullsized":"2024-01-25T15:05:28.848039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:55:46.833186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231417+0000","last_change":"2024-01-25T15:05:26.221948+0000","last_active":"2024-01-25T15:05:28.231417+0000","last_peered":"2024-01-25T15:05:28.231417+0000","last_clean":"2024-01-25T15:05:28.231417+0000","last_became_active":"2024-01-25T15:05:26.221678+0000","last_became_peered":"2024-01-25T15:05:26.221678+0000","last_unstale":"2024-01-25T15:05:28.231417+0000","last_undegraded":"2024-01-25T15:05:28.231417+0000","last_fullsized":"2024-01-25T15:05:28.231417+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:21:43.851971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":201,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231691+0000","last_change":"2024-01-25T15:04:16.181635+0000","last_active":"2024-01-25T15:05:28.231691+0000","last_peered":"2024-01-25T15:05:28.231691+0000","last_clean":"2024-01-25T15:05:28.231691+0000","last_became_active":"2024-01-25T15:04:16.179890+0000","last_became_peered":"2024-01-25T15:04:16.179890+0000","last_unstale":"2024-01-25T15:05:28.231691+0000","last_undegraded":"2024-01-25T15:05:28.231691+0000","last_fullsized":"2024-01-25T15:05:28.231691+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_clean_scrub_stamp":"2024-01-25T15:04:14.956188+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:49:00.618327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":780688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.68500000000000005}]},{"osd":3,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.62}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.58399999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":442368,"data_stored":189220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.432},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.69799999999999995}]},{"osd":4,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.71899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":434176,"data_stored":182130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":10.814},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":2.327}]},{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":10.016999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":2.2850000000000001}]},{"osd":2,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":3.8610000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":10.221}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":5.6440000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":10.092000000000001}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":5.5970000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":10.124000000000001}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":2.222},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":10.057}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":2.8170000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":8.9179999999999993}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":434176,"data_stored":182622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.74299999999999999}]},{"osd":3,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.75900000000000001}]},{"osd":5,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.876},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.97899999999999998}]},{"osd":7,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.83299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":442368,"data_stored":183664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.30499999999999999}]},{"osd":1,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":3.3559999999999999,"5min":3.3559999999999999,"15min":3.3559999999999999},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.25800000000000001}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.4209999999999998,"5min":3.4209999999999998,"15min":3.4209999999999998},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.4689999999999999,"5min":3.4689999999999999,"15min":3.4689999999999999},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":3.508,"5min":3.508,"15min":3.508},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.505}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.5449999999999999,"5min":3.5449999999999999,"15min":3.5449999999999999},"last":0.48499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":430080,"data_stored":182088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.26700000000000002}]},{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.315}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.53500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":430080,"data_stored":182108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.27600000000000002}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.311}]},{"osd":3,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.64900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1024000,"data_stored":772420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.436}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.45100000000000001}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.50700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:05:32.197 INFO:tasks.ceph.mds.c.smithi029.stderr:2024-01-25T15:05:32.196+0000 7f760b4ea640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-25T15:05:34.959 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-25T15:05:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.072+0000 7f264d5d1640 1 Processor -- start 2024-01-25T15:05:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.072+0000 7f264d5d1640 1 -- start start 2024-01-25T15:05:35.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.073+0000 7f264d5d1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f264814c6f0 0x7f26481530b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:35.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.073+0000 7f264d5d1640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26480c3c30 0x7f26480c8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:35.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.073+0000 7f264d5d1640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26480c3100 con 0x7f26480c6980 2024-01-25T15:05:35.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.073+0000 7f264d5d1640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26480c41d0 con 0x7f264814c6f0 2024-01-25T15:05:35.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.073+0000 7f264d5d1640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26481525d0 con 0x7f26480c3c30 2024-01-25T15:05:35.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.073+0000 7f2646ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f264814c6f0 0x7f26481530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:35.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.073+0000 7f26467fc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f26480c6980 0x7f26480c29f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35040/0 (socket says 172.21.15.29:35040) 2024-01-25T15:05:35.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.073+0000 7f26467fc640 1 -- 172.21.15.29:0/2842694502 learned_addr learned my addr 172.21.15.29:0/2842694502 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:35.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.074+0000 7f2645ffb640 1 -- 172.21.15.29:0/2842694502 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2481084349 0 0) 0x7f26480c3100 con 0x7f26480c6980 2024-01-25T15:05:35.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.074+0000 7f26477fe640 1 --2- 172.21.15.29:0/2842694502 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26480c3c30 0x7f26480c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:35.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.074+0000 7f2645ffb640 1 -- 172.21.15.29:0/2842694502 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2634003520 con 0x7f26480c6980 2024-01-25T15:05:35.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.074+0000 7f2646ffd640 1 -- 172.21.15.29:0/2842694502 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26480c3c30 msgr2=0x7f26480c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:35.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.074+0000 7f2646ffd640 1 --2- 172.21.15.29:0/2842694502 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26480c3c30 0x7f26480c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.074+0000 7f2646ffd640 1 -- 172.21.15.29:0/2842694502 >> v1:172.21.15.29:6789/0 conn(0x7f26480c6980 legacy=0x7f26480c29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:35.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.074+0000 7f2646ffd640 1 -- 172.21.15.29:0/2842694502 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26481528b0 con 0x7f264814c6f0 2024-01-25T15:05:35.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.074+0000 7f26477fe640 1 --2- 172.21.15.29:0/2842694502 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26480c3c30 0x7f26480c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:35.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.074+0000 7f2646ffd640 1 --2- 172.21.15.29:0/2842694502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f264814c6f0 0x7f26481530b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f26400097a0 tx=0x7f264002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39b6516afa9258c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:35.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.075+0000 7f2645ffb640 1 -- 172.21.15.29:0/2842694502 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640031830 con 0x7f264814c6f0 2024-01-25T15:05:35.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.075+0000 7f2645ffb640 1 -- 172.21.15.29:0/2842694502 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2640031990 con 0x7f264814c6f0 2024-01-25T15:05:35.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.075+0000 7f2645ffb640 1 -- 172.21.15.29:0/2842694502 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640031d20 con 0x7f264814c6f0 2024-01-25T15:05:35.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.075+0000 7f264d5d1640 1 -- 172.21.15.29:0/2842694502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f264814c6f0 msgr2=0x7f26481530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:35.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.075+0000 7f264d5d1640 1 --2- 172.21.15.29:0/2842694502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f264814c6f0 0x7f26481530b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f26400097a0 tx=0x7f264002b8d0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.075+0000 7f264d5d1640 1 -- 172.21.15.29:0/2842694502 shutdown_connections 2024-01-25T15:05:35.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.075+0000 7f264d5d1640 1 --2- 172.21.15.29:0/2842694502 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26480c3c30 0x7f26480c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.075+0000 7f264d5d1640 1 --2- 172.21.15.29:0/2842694502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f264814c6f0 0x7f26481530b0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.075+0000 7f264d5d1640 1 -- 172.21.15.29:0/2842694502 >> 172.21.15.29:0/2842694502 conn(0x7f264806a8a0 msgr2=0x7f264806acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:35.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.075+0000 7f264d5d1640 1 -- 172.21.15.29:0/2842694502 shutdown_connections 2024-01-25T15:05:35.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.075+0000 7f264d5d1640 1 -- 172.21.15.29:0/2842694502 wait complete. 2024-01-25T15:05:35.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.076+0000 7f264d5d1640 1 Processor -- start 2024-01-25T15:05:35.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.077+0000 7f264d5d1640 1 -- start start 2024-01-25T15:05:35.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.077+0000 7f264d5d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26480c3c30 0x7f26481487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:35.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.077+0000 7f264d5d1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26480c6980 0x7f26481458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:35.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.077+0000 7f264d5d1640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f264814c6f0 0x7f2648145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:35.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.077+0000 7f264d5d1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2648146710 con 0x7f26480c3c30 2024-01-25T15:05:35.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.077+0000 7f264d5d1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264806e6c0 con 0x7f26480c6980 2024-01-25T15:05:35.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.077+0000 7f264d5d1640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264806e9a0 con 0x7f264814c6f0 2024-01-25T15:05:35.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.077+0000 7f2646ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26480c3c30 0x7f26481487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.077+0000 7f2646ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26480c3c30 0x7f26481487f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33462/0 (socket says 172.21.15.29:33462) 2024-01-25T15:05:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.077+0000 7f2646ffd640 1 -- 172.21.15.29:0/1233834330 learned_addr learned my addr 172.21.15.29:0/1233834330 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.077+0000 7f26477fe640 1 --2- 172.21.15.29:0/1233834330 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f264814c6f0 0x7f2648145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.077+0000 7f26467fc640 1 --2- 172.21.15.29:0/1233834330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26480c6980 0x7f26481458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.078+0000 7f2646ffd640 1 -- 172.21.15.29:0/1233834330 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f264814c6f0 msgr2=0x7f2648145e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.078+0000 7f2646ffd640 1 --2- 172.21.15.29:0/1233834330 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f264814c6f0 0x7f2648145e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.078+0000 7f2646ffd640 1 -- 172.21.15.29:0/1233834330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26480c6980 msgr2=0x7f26481458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.078+0000 7f2646ffd640 1 --2- 172.21.15.29:0/1233834330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26480c6980 0x7f26481458d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.078+0000 7f2646ffd640 1 -- 172.21.15.29:0/1233834330 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2640009400 con 0x7f26480c3c30 2024-01-25T15:05:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.078+0000 7f26467fc640 1 --2- 172.21.15.29:0/1233834330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26480c6980 0x7f26481458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.078+0000 7f2646ffd640 1 --2- 172.21.15.29:0/1233834330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26480c3c30 0x7f26481487f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2640034040 tx=0x7f26400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.078+0000 7f263f7fe640 1 -- 172.21.15.29:0/1233834330 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264003a8f0 con 0x7f26480c3c30 2024-01-25T15:05:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.078+0000 7f263f7fe640 1 -- 172.21.15.29:0/1233834330 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264003aa70 con 0x7f26480c3c30 2024-01-25T15:05:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.078+0000 7f264d5d1640 1 -- 172.21.15.29:0/1233834330 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264806ec80 con 0x7f26480c3c30 2024-01-25T15:05:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.078+0000 7f263f7fe640 1 -- 172.21.15.29:0/1233834330 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264003ae20 con 0x7f26480c3c30 2024-01-25T15:05:35.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.078+0000 7f264d5d1640 1 -- 172.21.15.29:0/1233834330 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2648148d30 con 0x7f26480c3c30 2024-01-25T15:05:35.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.079+0000 7f264d5d1640 1 -- 172.21.15.29:0/1233834330 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264806f1a0 con 0x7f26480c3c30 2024-01-25T15:05:35.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.080+0000 7f263f7fe640 1 -- 172.21.15.29:0/1233834330 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f264004d440 con 0x7f26480c3c30 2024-01-25T15:05:35.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.080+0000 7f263f7fe640 1 --2- 172.21.15.29:0/1233834330 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f262806aed0 0x7f262806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:35.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.080+0000 7f263f7fe640 1 -- 172.21.15.29:0/1233834330 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f26400ab770 con 0x7f26480c3c30 2024-01-25T15:05:35.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.080+0000 7f26467fc640 1 --2- 172.21.15.29:0/1233834330 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f262806aed0 0x7f262806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:35.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.081+0000 7f26467fc640 1 --2- 172.21.15.29:0/1233834330 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f262806aed0 0x7f262806d390 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2630007fd0 tx=0x7f2630009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:35.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.084+0000 7f263f7fe640 1 -- 172.21.15.29:0/1233834330 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2640076590 con 0x7f26480c3c30 2024-01-25T15:05:35.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.264+0000 7f264d5d1640 1 -- 172.21.15.29:0/1233834330 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f26480c7d10 con 0x7f262806aed0 2024-01-25T15:05:35.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.272+0000 7f263f7fe640 1 -- 172.21.15.29:0/1233834330 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288839 (secure 0 0 0) 0x7f2630001470 con 0x7f262806aed0 2024-01-25T15:05:35.275 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:35.278 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-25T15:05:35.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.275+0000 7f264d5d1640 1 -- 172.21.15.29:0/1233834330 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f262806aed0 msgr2=0x7f262806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:35.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.275+0000 7f264d5d1640 1 --2- 172.21.15.29:0/1233834330 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f262806aed0 0x7f262806d390 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2630007fd0 tx=0x7f2630009040 comp rx=0 tx=0).stop 2024-01-25T15:05:35.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.275+0000 7f264d5d1640 1 -- 172.21.15.29:0/1233834330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26480c3c30 msgr2=0x7f26481487f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:35.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.275+0000 7f264d5d1640 1 --2- 172.21.15.29:0/1233834330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26480c3c30 0x7f26481487f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2640034040 tx=0x7f26400046c0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.275+0000 7f264d5d1640 1 -- 172.21.15.29:0/1233834330 shutdown_connections 2024-01-25T15:05:35.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.275+0000 7f264d5d1640 1 --2- 172.21.15.29:0/1233834330 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f264814c6f0 0x7f2648145e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.275+0000 7f264d5d1640 1 --2- 172.21.15.29:0/1233834330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26480c6980 0x7f26481458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.275+0000 7f264d5d1640 1 --2- 172.21.15.29:0/1233834330 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f262806aed0 0x7f262806d390 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.275+0000 7f264d5d1640 1 --2- 172.21.15.29:0/1233834330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26480c3c30 0x7f26481487f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.275+0000 7f264d5d1640 1 -- 172.21.15.29:0/1233834330 >> 172.21.15.29:0/1233834330 conn(0x7f264806a8a0 msgr2=0x7f2648149f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:35.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.275+0000 7f264d5d1640 1 -- 172.21.15.29:0/1233834330 shutdown_connections 2024-01-25T15:05:35.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.275+0000 7f264d5d1640 1 -- 172.21.15.29:0/1233834330 wait complete. 2024-01-25T15:05:35.286 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2024-01-25T15:05:34.932399+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254092,"kb_used_data":4648,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720628,"statfs":{"total":773094113280,"available":772833923072,"internally_reserved":0,"allocated":4759552,"data_stored":2694660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001962"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230015+0000","last_change":"2024-01-25T15:05:27.231656+0000","last_active":"2024-01-25T15:05:28.230015+0000","last_peered":"2024-01-25T15:05:28.230015+0000","last_clean":"2024-01-25T15:05:28.230015+0000","last_became_active":"2024-01-25T15:05:27.228184+0000","last_became_peered":"2024-01-25T15:05:27.228184+0000","last_unstale":"2024-01-25T15:05:28.230015+0000","last_undegraded":"2024-01-25T15:05:28.230015+0000","last_fullsized":"2024-01-25T15:05:28.230015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:44:26.334164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229740+0000","last_change":"2024-01-25T15:05:27.235003+0000","last_active":"2024-01-25T15:05:28.229740+0000","last_peered":"2024-01-25T15:05:28.229740+0000","last_clean":"2024-01-25T15:05:28.229740+0000","last_became_active":"2024-01-25T15:05:27.234734+0000","last_became_peered":"2024-01-25T15:05:27.234734+0000","last_unstale":"2024-01-25T15:05:28.229740+0000","last_undegraded":"2024-01-25T15:05:28.229740+0000","last_fullsized":"2024-01-25T15:05:28.229740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:55:46.833186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834190+0000","last_change":"2024-01-25T15:05:27.239434+0000","last_active":"2024-01-25T15:05:28.834190+0000","last_peered":"2024-01-25T15:05:28.834190+0000","last_clean":"2024-01-25T15:05:28.834190+0000","last_became_active":"2024-01-25T15:05:27.239182+0000","last_became_peered":"2024-01-25T15:05:27.239182+0000","last_unstale":"2024-01-25T15:05:28.834190+0000","last_undegraded":"2024-01-25T15:05:28.834190+0000","last_fullsized":"2024-01-25T15:05:28.834190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:02:27.702949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847185+0000","last_change":"2024-01-25T15:05:27.243839+0000","last_active":"2024-01-25T15:05:28.847185+0000","last_peered":"2024-01-25T15:05:28.847185+0000","last_clean":"2024-01-25T15:05:28.847185+0000","last_became_active":"2024-01-25T15:05:27.243563+0000","last_became_peered":"2024-01-25T15:05:27.243563+0000","last_unstale":"2024-01-25T15:05:28.847185+0000","last_undegraded":"2024-01-25T15:05:28.847185+0000","last_fullsized":"2024-01-25T15:05:28.847185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:18:52.758791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847057+0000","last_change":"2024-01-25T15:05:27.230988+0000","last_active":"2024-01-25T15:05:28.847057+0000","last_peered":"2024-01-25T15:05:28.847057+0000","last_clean":"2024-01-25T15:05:28.847057+0000","last_became_active":"2024-01-25T15:05:27.230740+0000","last_became_peered":"2024-01-25T15:05:27.230740+0000","last_unstale":"2024-01-25T15:05:28.847057+0000","last_undegraded":"2024-01-25T15:05:28.847057+0000","last_fullsized":"2024-01-25T15:05:28.847057+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:22:36.224608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494090+0000","last_change":"2024-01-25T15:05:27.239531+0000","last_active":"2024-01-25T15:05:28.494090+0000","last_peered":"2024-01-25T15:05:28.494090+0000","last_clean":"2024-01-25T15:05:28.494090+0000","last_became_active":"2024-01-25T15:05:27.238884+0000","last_became_peered":"2024-01-25T15:05:27.238884+0000","last_unstale":"2024-01-25T15:05:28.494090+0000","last_undegraded":"2024-01-25T15:05:28.494090+0000","last_fullsized":"2024-01-25T15:05:28.494090+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:26:19.413150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847428+0000","last_change":"2024-01-25T15:05:27.236157+0000","last_active":"2024-01-25T15:05:28.847428+0000","last_peered":"2024-01-25T15:05:28.847428+0000","last_clean":"2024-01-25T15:05:28.847428+0000","last_became_active":"2024-01-25T15:05:27.235882+0000","last_became_peered":"2024-01-25T15:05:27.235882+0000","last_unstale":"2024-01-25T15:05:28.847428+0000","last_undegraded":"2024-01-25T15:05:28.847428+0000","last_fullsized":"2024-01-25T15:05:28.847428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:53:45.905579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229462+0000","last_change":"2024-01-25T15:05:27.242301+0000","last_active":"2024-01-25T15:05:28.229462+0000","last_peered":"2024-01-25T15:05:28.229462+0000","last_clean":"2024-01-25T15:05:28.229462+0000","last_became_active":"2024-01-25T15:05:27.242077+0000","last_became_peered":"2024-01-25T15:05:27.242077+0000","last_unstale":"2024-01-25T15:05:28.229462+0000","last_undegraded":"2024-01-25T15:05:28.229462+0000","last_fullsized":"2024-01-25T15:05:28.229462+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:17:07.138969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834487+0000","last_change":"2024-01-25T15:05:27.236734+0000","last_active":"2024-01-25T15:05:28.834487+0000","last_peered":"2024-01-25T15:05:28.834487+0000","last_clean":"2024-01-25T15:05:28.834487+0000","last_became_active":"2024-01-25T15:05:27.236377+0000","last_became_peered":"2024-01-25T15:05:27.236377+0000","last_unstale":"2024-01-25T15:05:28.834487+0000","last_undegraded":"2024-01-25T15:05:28.834487+0000","last_fullsized":"2024-01-25T15:05:28.834487+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:02:27.622813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847961+0000","last_change":"2024-01-25T15:05:27.244798+0000","last_active":"2024-01-25T15:05:28.847961+0000","last_peered":"2024-01-25T15:05:28.847961+0000","last_clean":"2024-01-25T15:05:28.847961+0000","last_became_active":"2024-01-25T15:05:27.244547+0000","last_became_peered":"2024-01-25T15:05:27.244547+0000","last_unstale":"2024-01-25T15:05:28.847961+0000","last_undegraded":"2024-01-25T15:05:28.847961+0000","last_fullsized":"2024-01-25T15:05:28.847961+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:47:01.188072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847909+0000","last_change":"2024-01-25T15:05:27.238399+0000","last_active":"2024-01-25T15:05:28.847909+0000","last_peered":"2024-01-25T15:05:28.847909+0000","last_clean":"2024-01-25T15:05:28.847909+0000","last_became_active":"2024-01-25T15:05:27.237999+0000","last_became_peered":"2024-01-25T15:05:27.237999+0000","last_unstale":"2024-01-25T15:05:28.847909+0000","last_undegraded":"2024-01-25T15:05:28.847909+0000","last_fullsized":"2024-01-25T15:05:28.847909+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:43:33.136506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834150+0000","last_change":"2024-01-25T15:05:27.230234+0000","last_active":"2024-01-25T15:05:28.834150+0000","last_peered":"2024-01-25T15:05:28.834150+0000","last_clean":"2024-01-25T15:05:28.834150+0000","last_became_active":"2024-01-25T15:05:27.229945+0000","last_became_peered":"2024-01-25T15:05:27.229945+0000","last_unstale":"2024-01-25T15:05:28.834150+0000","last_undegraded":"2024-01-25T15:05:28.834150+0000","last_fullsized":"2024-01-25T15:05:28.834150+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:10.931099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847698+0000","last_change":"2024-01-25T15:05:27.244146+0000","last_active":"2024-01-25T15:05:28.847698+0000","last_peered":"2024-01-25T15:05:28.847698+0000","last_clean":"2024-01-25T15:05:28.847698+0000","last_became_active":"2024-01-25T15:05:27.243861+0000","last_became_peered":"2024-01-25T15:05:27.243861+0000","last_unstale":"2024-01-25T15:05:28.847698+0000","last_undegraded":"2024-01-25T15:05:28.847698+0000","last_fullsized":"2024-01-25T15:05:28.847698+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:06:14.777919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.715673+0000","last_change":"2024-01-25T15:05:27.236676+0000","last_active":"2024-01-25T15:05:28.715673+0000","last_peered":"2024-01-25T15:05:28.715673+0000","last_clean":"2024-01-25T15:05:28.715673+0000","last_became_active":"2024-01-25T15:05:27.236411+0000","last_became_peered":"2024-01-25T15:05:27.236411+0000","last_unstale":"2024-01-25T15:05:28.715673+0000","last_undegraded":"2024-01-25T15:05:28.715673+0000","last_fullsized":"2024-01-25T15:05:28.715673+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:43:59.664529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847494+0000","last_change":"2024-01-25T15:05:27.234767+0000","last_active":"2024-01-25T15:05:28.847494+0000","last_peered":"2024-01-25T15:05:28.847494+0000","last_clean":"2024-01-25T15:05:28.847494+0000","last_became_active":"2024-01-25T15:05:27.234370+0000","last_became_peered":"2024-01-25T15:05:27.234370+0000","last_unstale":"2024-01-25T15:05:28.847494+0000","last_undegraded":"2024-01-25T15:05:28.847494+0000","last_fullsized":"2024-01-25T15:05:28.847494+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:24:11.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230576+0000","last_change":"2024-01-25T15:05:27.246760+0000","last_active":"2024-01-25T15:05:28.230576+0000","last_peered":"2024-01-25T15:05:28.230576+0000","last_clean":"2024-01-25T15:05:28.230576+0000","last_became_active":"2024-01-25T15:05:27.246482+0000","last_became_peered":"2024-01-25T15:05:27.246482+0000","last_unstale":"2024-01-25T15:05:28.230576+0000","last_undegraded":"2024-01-25T15:05:28.230576+0000","last_fullsized":"2024-01-25T15:05:28.230576+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:10.931099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231687+0000","last_change":"2024-01-25T15:05:27.246282+0000","last_active":"2024-01-25T15:05:28.231687+0000","last_peered":"2024-01-25T15:05:28.231687+0000","last_clean":"2024-01-25T15:05:28.231687+0000","last_became_active":"2024-01-25T15:05:27.245958+0000","last_became_peered":"2024-01-25T15:05:27.245958+0000","last_unstale":"2024-01-25T15:05:28.231687+0000","last_undegraded":"2024-01-25T15:05:28.231687+0000","last_fullsized":"2024-01-25T15:05:28.231687+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:06:14.777919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231213+0000","last_change":"2024-01-25T15:05:27.229020+0000","last_active":"2024-01-25T15:05:28.231213+0000","last_peered":"2024-01-25T15:05:28.231213+0000","last_clean":"2024-01-25T15:05:28.231213+0000","last_became_active":"2024-01-25T15:05:27.228749+0000","last_became_peered":"2024-01-25T15:05:27.228749+0000","last_unstale":"2024-01-25T15:05:28.231213+0000","last_undegraded":"2024-01-25T15:05:28.231213+0000","last_fullsized":"2024-01-25T15:05:28.231213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:49:29.672511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847186+0000","last_change":"2024-01-25T15:05:27.244605+0000","last_active":"2024-01-25T15:05:28.847186+0000","last_peered":"2024-01-25T15:05:28.847186+0000","last_clean":"2024-01-25T15:05:28.847186+0000","last_became_active":"2024-01-25T15:05:27.244345+0000","last_became_peered":"2024-01-25T15:05:27.244345+0000","last_unstale":"2024-01-25T15:05:28.847186+0000","last_undegraded":"2024-01-25T15:05:28.847186+0000","last_fullsized":"2024-01-25T15:05:28.847186+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:23:26.096821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230958+0000","last_change":"2024-01-25T15:05:27.229918+0000","last_active":"2024-01-25T15:05:28.230958+0000","last_peered":"2024-01-25T15:05:28.230958+0000","last_clean":"2024-01-25T15:05:28.230958+0000","last_became_active":"2024-01-25T15:05:27.229636+0000","last_became_peered":"2024-01-25T15:05:27.229636+0000","last_unstale":"2024-01-25T15:05:28.230958+0000","last_undegraded":"2024-01-25T15:05:28.230958+0000","last_fullsized":"2024-01-25T15:05:28.230958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:31.002968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847655+0000","last_change":"2024-01-25T15:05:27.240952+0000","last_active":"2024-01-25T15:05:28.847655+0000","last_peered":"2024-01-25T15:05:28.847655+0000","last_clean":"2024-01-25T15:05:28.847655+0000","last_became_active":"2024-01-25T15:05:27.240683+0000","last_became_peered":"2024-01-25T15:05:27.240683+0000","last_unstale":"2024-01-25T15:05:28.847655+0000","last_undegraded":"2024-01-25T15:05:28.847655+0000","last_fullsized":"2024-01-25T15:05:28.847655+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:44:30.520452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.716058+0000","last_change":"2024-01-25T15:05:27.235172+0000","last_active":"2024-01-25T15:05:28.716058+0000","last_peered":"2024-01-25T15:05:28.716058+0000","last_clean":"2024-01-25T15:05:28.716058+0000","last_became_active":"2024-01-25T15:05:27.234884+0000","last_became_peered":"2024-01-25T15:05:27.234884+0000","last_unstale":"2024-01-25T15:05:28.716058+0000","last_undegraded":"2024-01-25T15:05:28.716058+0000","last_fullsized":"2024-01-25T15:05:28.716058+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:14:28.578562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230886+0000","last_change":"2024-01-25T15:05:27.233225+0000","last_active":"2024-01-25T15:05:28.230886+0000","last_peered":"2024-01-25T15:05:28.230886+0000","last_clean":"2024-01-25T15:05:28.230886+0000","last_became_active":"2024-01-25T15:05:27.232731+0000","last_became_peered":"2024-01-25T15:05:27.232731+0000","last_unstale":"2024-01-25T15:05:28.230886+0000","last_undegraded":"2024-01-25T15:05:28.230886+0000","last_fullsized":"2024-01-25T15:05:28.230886+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:53:45.905579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.846926+0000","last_change":"2024-01-25T15:05:27.226292+0000","last_active":"2024-01-25T15:05:28.846926+0000","last_peered":"2024-01-25T15:05:28.846926+0000","last_clean":"2024-01-25T15:05:28.846926+0000","last_became_active":"2024-01-25T15:05:27.226037+0000","last_became_peered":"2024-01-25T15:05:27.226037+0000","last_unstale":"2024-01-25T15:05:28.846926+0000","last_undegraded":"2024-01-25T15:05:28.846926+0000","last_fullsized":"2024-01-25T15:05:28.846926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:35:20.251170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231572+0000","last_change":"2024-01-25T15:05:27.229896+0000","last_active":"2024-01-25T15:05:28.231572+0000","last_peered":"2024-01-25T15:05:28.231572+0000","last_clean":"2024-01-25T15:05:28.231572+0000","last_became_active":"2024-01-25T15:05:27.229558+0000","last_became_peered":"2024-01-25T15:05:27.229558+0000","last_unstale":"2024-01-25T15:05:28.231572+0000","last_undegraded":"2024-01-25T15:05:28.231572+0000","last_fullsized":"2024-01-25T15:05:28.231572+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:43:59.664529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494329+0000","last_change":"2024-01-25T15:05:27.242603+0000","last_active":"2024-01-25T15:05:28.494329+0000","last_peered":"2024-01-25T15:05:28.494329+0000","last_clean":"2024-01-25T15:05:28.494329+0000","last_became_active":"2024-01-25T15:05:27.241732+0000","last_became_peered":"2024-01-25T15:05:27.241732+0000","last_unstale":"2024-01-25T15:05:28.494329+0000","last_undegraded":"2024-01-25T15:05:28.494329+0000","last_fullsized":"2024-01-25T15:05:28.494329+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:14:28.578562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231565+0000","last_change":"2024-01-25T15:05:27.229445+0000","last_active":"2024-01-25T15:05:28.231565+0000","last_peered":"2024-01-25T15:05:28.231565+0000","last_clean":"2024-01-25T15:05:28.231565+0000","last_became_active":"2024-01-25T15:05:27.229198+0000","last_became_peered":"2024-01-25T15:05:27.229198+0000","last_unstale":"2024-01-25T15:05:28.231565+0000","last_undegraded":"2024-01-25T15:05:28.231565+0000","last_fullsized":"2024-01-25T15:05:28.231565+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:26:19.413150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847739+0000","last_change":"2024-01-25T15:05:27.238720+0000","last_active":"2024-01-25T15:05:28.847739+0000","last_peered":"2024-01-25T15:05:28.847739+0000","last_clean":"2024-01-25T15:05:28.847739+0000","last_became_active":"2024-01-25T15:05:27.238362+0000","last_became_peered":"2024-01-25T15:05:27.238362+0000","last_unstale":"2024-01-25T15:05:28.847739+0000","last_undegraded":"2024-01-25T15:05:28.847739+0000","last_fullsized":"2024-01-25T15:05:28.847739+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:36.810625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231222+0000","last_change":"2024-01-25T15:05:27.229034+0000","last_active":"2024-01-25T15:05:28.231222+0000","last_peered":"2024-01-25T15:05:28.231222+0000","last_clean":"2024-01-25T15:05:28.231222+0000","last_became_active":"2024-01-25T15:05:27.227681+0000","last_became_peered":"2024-01-25T15:05:27.227681+0000","last_unstale":"2024-01-25T15:05:28.231222+0000","last_undegraded":"2024-01-25T15:05:28.231222+0000","last_fullsized":"2024-01-25T15:05:28.231222+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:33:05.014284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230846+0000","last_change":"2024-01-25T15:05:27.227464+0000","last_active":"2024-01-25T15:05:28.230846+0000","last_peered":"2024-01-25T15:05:28.230846+0000","last_clean":"2024-01-25T15:05:28.230846+0000","last_became_active":"2024-01-25T15:05:27.227162+0000","last_became_peered":"2024-01-25T15:05:27.227162+0000","last_unstale":"2024-01-25T15:05:28.230846+0000","last_undegraded":"2024-01-25T15:05:28.230846+0000","last_fullsized":"2024-01-25T15:05:28.230846+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:16:31.883434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231298+0000","last_change":"2024-01-25T15:05:27.233301+0000","last_active":"2024-01-25T15:05:28.231298+0000","last_peered":"2024-01-25T15:05:28.231298+0000","last_clean":"2024-01-25T15:05:28.231298+0000","last_became_active":"2024-01-25T15:05:27.233035+0000","last_became_peered":"2024-01-25T15:05:27.233035+0000","last_unstale":"2024-01-25T15:05:28.231298+0000","last_undegraded":"2024-01-25T15:05:28.231298+0000","last_fullsized":"2024-01-25T15:05:28.231298+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:02:27.622813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494014+0000","last_change":"2024-01-25T15:05:27.237586+0000","last_active":"2024-01-25T15:05:28.494014+0000","last_peered":"2024-01-25T15:05:28.494014+0000","last_clean":"2024-01-25T15:05:28.494014+0000","last_became_active":"2024-01-25T15:05:27.237334+0000","last_became_peered":"2024-01-25T15:05:27.237334+0000","last_unstale":"2024-01-25T15:05:28.494014+0000","last_undegraded":"2024-01-25T15:05:28.494014+0000","last_fullsized":"2024-01-25T15:05:28.494014+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:33:05.014284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230712+0000","last_change":"2024-01-25T15:05:27.247070+0000","last_active":"2024-01-25T15:05:28.230712+0000","last_peered":"2024-01-25T15:05:28.230712+0000","last_clean":"2024-01-25T15:05:28.230712+0000","last_became_active":"2024-01-25T15:05:27.246793+0000","last_became_peered":"2024-01-25T15:05:27.246793+0000","last_unstale":"2024-01-25T15:05:28.230712+0000","last_undegraded":"2024-01-25T15:05:28.230712+0000","last_fullsized":"2024-01-25T15:05:28.230712+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:13:38.590014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231524+0000","last_change":"2024-01-25T15:05:26.223571+0000","last_active":"2024-01-25T15:05:28.231524+0000","last_peered":"2024-01-25T15:05:28.231524+0000","last_clean":"2024-01-25T15:05:28.231524+0000","last_became_active":"2024-01-25T15:05:26.223239+0000","last_became_peered":"2024-01-25T15:05:26.223239+0000","last_unstale":"2024-01-25T15:05:28.231524+0000","last_undegraded":"2024-01-25T15:05:28.231524+0000","last_fullsized":"2024-01-25T15:05:28.231524+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:23:25.092941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494308+0000","last_change":"2024-01-25T15:05:27.243468+0000","last_active":"2024-01-25T15:05:28.494308+0000","last_peered":"2024-01-25T15:05:28.494308+0000","last_clean":"2024-01-25T15:05:28.494308+0000","last_became_active":"2024-01-25T15:05:27.241288+0000","last_became_peered":"2024-01-25T15:05:27.241288+0000","last_unstale":"2024-01-25T15:05:28.494308+0000","last_undegraded":"2024-01-25T15:05:28.494308+0000","last_fullsized":"2024-01-25T15:05:28.494308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:46:52.035987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834381+0000","last_change":"2024-01-25T15:05:26.222363+0000","last_active":"2024-01-25T15:05:28.834381+0000","last_peered":"2024-01-25T15:05:28.834381+0000","last_clean":"2024-01-25T15:05:28.834381+0000","last_became_active":"2024-01-25T15:05:26.222076+0000","last_became_peered":"2024-01-25T15:05:26.222076+0000","last_unstale":"2024-01-25T15:05:28.834381+0000","last_undegraded":"2024-01-25T15:05:28.834381+0000","last_fullsized":"2024-01-25T15:05:28.834381+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:25:54.998838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.716074+0000","last_change":"2024-01-25T15:05:27.236309+0000","last_active":"2024-01-25T15:05:28.716074+0000","last_peered":"2024-01-25T15:05:28.716074+0000","last_clean":"2024-01-25T15:05:28.716074+0000","last_became_active":"2024-01-25T15:05:27.236051+0000","last_became_peered":"2024-01-25T15:05:27.236051+0000","last_unstale":"2024-01-25T15:05:28.716074+0000","last_undegraded":"2024-01-25T15:05:28.716074+0000","last_fullsized":"2024-01-25T15:05:28.716074+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:16:02.607369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494388+0000","last_change":"2024-01-25T15:05:26.222345+0000","last_active":"2024-01-25T15:05:28.494388+0000","last_peered":"2024-01-25T15:05:28.494388+0000","last_clean":"2024-01-25T15:05:28.494388+0000","last_became_active":"2024-01-25T15:05:26.221552+0000","last_became_peered":"2024-01-25T15:05:26.221552+0000","last_unstale":"2024-01-25T15:05:28.494388+0000","last_undegraded":"2024-01-25T15:05:28.494388+0000","last_fullsized":"2024-01-25T15:05:28.494388+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:31:52.278724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229975+0000","last_change":"2024-01-25T15:05:27.224791+0000","last_active":"2024-01-25T15:05:28.229975+0000","last_peered":"2024-01-25T15:05:28.229975+0000","last_clean":"2024-01-25T15:05:28.229975+0000","last_became_active":"2024-01-25T15:05:27.224542+0000","last_became_peered":"2024-01-25T15:05:27.224542+0000","last_unstale":"2024-01-25T15:05:28.229975+0000","last_undegraded":"2024-01-25T15:05:28.229975+0000","last_fullsized":"2024-01-25T15:05:28.229975+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:22:13.913722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.715925+0000","last_change":"2024-01-25T15:05:26.217509+0000","last_active":"2024-01-25T15:05:28.715925+0000","last_peered":"2024-01-25T15:05:28.715925+0000","last_clean":"2024-01-25T15:05:28.715925+0000","last_became_active":"2024-01-25T15:05:26.217198+0000","last_became_peered":"2024-01-25T15:05:26.217198+0000","last_unstale":"2024-01-25T15:05:28.715925+0000","last_undegraded":"2024-01-25T15:05:28.715925+0000","last_fullsized":"2024-01-25T15:05:28.715925+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:23:25.092941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834219+0000","last_change":"2024-01-25T15:05:27.241011+0000","last_active":"2024-01-25T15:05:28.834219+0000","last_peered":"2024-01-25T15:05:28.834219+0000","last_clean":"2024-01-25T15:05:28.834219+0000","last_became_active":"2024-01-25T15:05:27.240732+0000","last_became_peered":"2024-01-25T15:05:27.240732+0000","last_unstale":"2024-01-25T15:05:28.834219+0000","last_undegraded":"2024-01-25T15:05:28.834219+0000","last_fullsized":"2024-01-25T15:05:28.834219+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:53:45.905579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847814+0000","last_change":"2024-01-25T15:05:26.224826+0000","last_active":"2024-01-25T15:05:28.847814+0000","last_peered":"2024-01-25T15:05:28.847814+0000","last_clean":"2024-01-25T15:05:28.847814+0000","last_became_active":"2024-01-25T15:05:26.224517+0000","last_became_peered":"2024-01-25T15:05:26.224517+0000","last_unstale":"2024-01-25T15:05:28.847814+0000","last_undegraded":"2024-01-25T15:05:28.847814+0000","last_fullsized":"2024-01-25T15:05:28.847814+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:00:52.590768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847706+0000","last_change":"2024-01-25T15:05:27.243054+0000","last_active":"2024-01-25T15:05:28.847706+0000","last_peered":"2024-01-25T15:05:28.847706+0000","last_clean":"2024-01-25T15:05:28.847706+0000","last_became_active":"2024-01-25T15:05:27.240995+0000","last_became_peered":"2024-01-25T15:05:27.240995+0000","last_unstale":"2024-01-25T15:05:28.847706+0000","last_undegraded":"2024-01-25T15:05:28.847706+0000","last_fullsized":"2024-01-25T15:05:28.847706+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:17:07.138969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231228+0000","last_change":"2024-01-25T15:05:26.220260+0000","last_active":"2024-01-25T15:05:28.231228+0000","last_peered":"2024-01-25T15:05:28.231228+0000","last_clean":"2024-01-25T15:05:28.231228+0000","last_became_active":"2024-01-25T15:05:26.219815+0000","last_became_peered":"2024-01-25T15:05:26.219815+0000","last_unstale":"2024-01-25T15:05:28.231228+0000","last_undegraded":"2024-01-25T15:05:28.231228+0000","last_fullsized":"2024-01-25T15:05:28.231228+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:25:54.998838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.715908+0000","last_change":"2024-01-25T15:05:27.241873+0000","last_active":"2024-01-25T15:05:28.715908+0000","last_peered":"2024-01-25T15:05:28.715908+0000","last_clean":"2024-01-25T15:05:28.715908+0000","last_became_active":"2024-01-25T15:05:27.241586+0000","last_became_peered":"2024-01-25T15:05:27.241586+0000","last_unstale":"2024-01-25T15:05:28.715908+0000","last_undegraded":"2024-01-25T15:05:28.715908+0000","last_fullsized":"2024-01-25T15:05:28.715908+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:54:18.204207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494085+0000","last_change":"2024-01-25T15:05:26.223828+0000","last_active":"2024-01-25T15:05:28.494085+0000","last_peered":"2024-01-25T15:05:28.494085+0000","last_clean":"2024-01-25T15:05:28.494085+0000","last_became_active":"2024-01-25T15:05:26.223568+0000","last_became_peered":"2024-01-25T15:05:26.223568+0000","last_unstale":"2024-01-25T15:05:28.494085+0000","last_undegraded":"2024-01-25T15:05:28.494085+0000","last_fullsized":"2024-01-25T15:05:28.494085+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:22:35.220728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229556+0000","last_change":"2024-01-25T15:05:27.230178+0000","last_active":"2024-01-25T15:05:28.229556+0000","last_peered":"2024-01-25T15:05:28.229556+0000","last_clean":"2024-01-25T15:05:28.229556+0000","last_became_active":"2024-01-25T15:05:27.229928+0000","last_became_peered":"2024-01-25T15:05:27.229928+0000","last_unstale":"2024-01-25T15:05:28.229556+0000","last_undegraded":"2024-01-25T15:05:28.229556+0000","last_fullsized":"2024-01-25T15:05:28.229556+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:43:33.136506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.715600+0000","last_change":"2024-01-25T15:05:26.221805+0000","last_active":"2024-01-25T15:05:28.715600+0000","last_peered":"2024-01-25T15:05:28.715600+0000","last_clean":"2024-01-25T15:05:28.715600+0000","last_became_active":"2024-01-25T15:05:26.221380+0000","last_became_peered":"2024-01-25T15:05:26.221380+0000","last_unstale":"2024-01-25T15:05:28.715600+0000","last_undegraded":"2024-01-25T15:05:28.715600+0000","last_fullsized":"2024-01-25T15:05:28.715600+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:22:35.220728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847210+0000","last_change":"2024-01-25T15:05:27.243866+0000","last_active":"2024-01-25T15:05:28.847210+0000","last_peered":"2024-01-25T15:05:28.847210+0000","last_clean":"2024-01-25T15:05:28.847210+0000","last_became_active":"2024-01-25T15:05:27.243596+0000","last_became_peered":"2024-01-25T15:05:27.243596+0000","last_unstale":"2024-01-25T15:05:28.847210+0000","last_undegraded":"2024-01-25T15:05:28.847210+0000","last_fullsized":"2024-01-25T15:05:28.847210+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:31:53.282604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230023+0000","last_change":"2024-01-25T15:05:26.219579+0000","last_active":"2024-01-25T15:05:28.230023+0000","last_peered":"2024-01-25T15:05:28.230023+0000","last_clean":"2024-01-25T15:05:28.230023+0000","last_became_active":"2024-01-25T15:05:26.219276+0000","last_became_peered":"2024-01-25T15:05:26.219276+0000","last_unstale":"2024-01-25T15:05:28.230023+0000","last_undegraded":"2024-01-25T15:05:28.230023+0000","last_fullsized":"2024-01-25T15:05:28.230023+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:26:18.409269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231917+0000","last_change":"2024-01-25T15:05:27.241962+0000","last_active":"2024-01-25T15:05:28.231917+0000","last_peered":"2024-01-25T15:05:28.231917+0000","last_clean":"2024-01-25T15:05:28.231917+0000","last_became_active":"2024-01-25T15:05:27.241674+0000","last_became_peered":"2024-01-25T15:05:27.241674+0000","last_unstale":"2024-01-25T15:05:28.231917+0000","last_undegraded":"2024-01-25T15:05:28.231917+0000","last_fullsized":"2024-01-25T15:05:28.231917+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:36.810625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.848145+0000","last_change":"2024-01-25T15:05:26.223146+0000","last_active":"2024-01-25T15:05:28.848145+0000","last_peered":"2024-01-25T15:05:28.848145+0000","last_clean":"2024-01-25T15:05:28.848145+0000","last_became_active":"2024-01-25T15:05:26.222888+0000","last_became_peered":"2024-01-25T15:05:26.222888+0000","last_unstale":"2024-01-25T15:05:28.848145+0000","last_undegraded":"2024-01-25T15:05:28.848145+0000","last_fullsized":"2024-01-25T15:05:28.848145+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:05:05.431051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834381+0000","last_change":"2024-01-25T15:05:27.235466+0000","last_active":"2024-01-25T15:05:28.834381+0000","last_peered":"2024-01-25T15:05:28.834381+0000","last_clean":"2024-01-25T15:05:28.834381+0000","last_became_active":"2024-01-25T15:05:27.235043+0000","last_became_peered":"2024-01-25T15:05:27.235043+0000","last_unstale":"2024-01-25T15:05:28.834381+0000","last_undegraded":"2024-01-25T15:05:28.834381+0000","last_fullsized":"2024-01-25T15:05:28.834381+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:24:11.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.848064+0000","last_change":"2024-01-25T15:05:26.227418+0000","last_active":"2024-01-25T15:05:28.848064+0000","last_peered":"2024-01-25T15:05:28.848064+0000","last_clean":"2024-01-25T15:05:28.848064+0000","last_became_active":"2024-01-25T15:05:26.227133+0000","last_became_peered":"2024-01-25T15:05:26.227133+0000","last_unstale":"2024-01-25T15:05:28.848064+0000","last_undegraded":"2024-01-25T15:05:28.848064+0000","last_fullsized":"2024-01-25T15:05:28.848064+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:25:54.998838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.716142+0000","last_change":"2024-01-25T15:05:27.235111+0000","last_active":"2024-01-25T15:05:28.716142+0000","last_peered":"2024-01-25T15:05:28.716142+0000","last_clean":"2024-01-25T15:05:28.716142+0000","last_became_active":"2024-01-25T15:05:27.234825+0000","last_became_peered":"2024-01-25T15:05:27.234825+0000","last_unstale":"2024-01-25T15:05:28.716142+0000","last_undegraded":"2024-01-25T15:05:28.716142+0000","last_fullsized":"2024-01-25T15:05:28.716142+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:10.931099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229789+0000","last_change":"2024-01-25T15:05:26.213663+0000","last_active":"2024-01-25T15:05:28.229789+0000","last_peered":"2024-01-25T15:05:28.229789+0000","last_clean":"2024-01-25T15:05:28.229789+0000","last_became_active":"2024-01-25T15:05:26.213360+0000","last_became_peered":"2024-01-25T15:05:26.213360+0000","last_unstale":"2024-01-25T15:05:28.229789+0000","last_undegraded":"2024-01-25T15:05:28.229789+0000","last_fullsized":"2024-01-25T15:05:28.229789+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:43:58.660649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834062+0000","last_change":"2024-01-25T15:05:27.244333+0000","last_active":"2024-01-25T15:05:28.834062+0000","last_peered":"2024-01-25T15:05:28.834062+0000","last_clean":"2024-01-25T15:05:28.834062+0000","last_became_active":"2024-01-25T15:05:27.244050+0000","last_became_peered":"2024-01-25T15:05:27.244050+0000","last_unstale":"2024-01-25T15:05:28.834062+0000","last_undegraded":"2024-01-25T15:05:28.834062+0000","last_fullsized":"2024-01-25T15:05:28.834062+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:14:28.578562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229803+0000","last_change":"2024-01-25T15:05:26.224736+0000","last_active":"2024-01-25T15:05:28.229803+0000","last_peered":"2024-01-25T15:05:28.229803+0000","last_clean":"2024-01-25T15:05:28.229803+0000","last_became_active":"2024-01-25T15:05:26.224440+0000","last_became_peered":"2024-01-25T15:05:26.224440+0000","last_unstale":"2024-01-25T15:05:28.229803+0000","last_undegraded":"2024-01-25T15:05:28.229803+0000","last_fullsized":"2024-01-25T15:05:28.229803+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:54:17.200327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229452+0000","last_change":"2024-01-25T15:05:27.225582+0000","last_active":"2024-01-25T15:05:28.229452+0000","last_peered":"2024-01-25T15:05:28.229452+0000","last_clean":"2024-01-25T15:05:28.229452+0000","last_became_active":"2024-01-25T15:05:27.225337+0000","last_became_peered":"2024-01-25T15:05:27.225337+0000","last_unstale":"2024-01-25T15:05:28.229452+0000","last_undegraded":"2024-01-25T15:05:28.229452+0000","last_fullsized":"2024-01-25T15:05:28.229452+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:06:14.777919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494099+0000","last_change":"2024-01-25T15:05:26.224964+0000","last_active":"2024-01-25T15:05:28.494099+0000","last_peered":"2024-01-25T15:05:28.494099+0000","last_clean":"2024-01-25T15:05:28.494099+0000","last_became_active":"2024-01-25T15:05:26.224350+0000","last_became_peered":"2024-01-25T15:05:26.224350+0000","last_unstale":"2024-01-25T15:05:28.494099+0000","last_undegraded":"2024-01-25T15:05:28.494099+0000","last_fullsized":"2024-01-25T15:05:28.494099+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:23:25.092941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230682+0000","last_change":"2024-01-25T15:05:27.230302+0000","last_active":"2024-01-25T15:05:28.230682+0000","last_peered":"2024-01-25T15:05:28.230682+0000","last_clean":"2024-01-25T15:05:28.230682+0000","last_became_active":"2024-01-25T15:05:27.230047+0000","last_became_peered":"2024-01-25T15:05:27.230047+0000","last_unstale":"2024-01-25T15:05:28.230682+0000","last_undegraded":"2024-01-25T15:05:28.230682+0000","last_fullsized":"2024-01-25T15:05:28.230682+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:02:27.702949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230589+0000","last_change":"2024-01-25T15:05:26.223718+0000","last_active":"2024-01-25T15:05:28.230589+0000","last_peered":"2024-01-25T15:05:28.230589+0000","last_clean":"2024-01-25T15:05:28.230589+0000","last_became_active":"2024-01-25T15:05:26.222346+0000","last_became_peered":"2024-01-25T15:05:26.222346+0000","last_unstale":"2024-01-25T15:05:28.230589+0000","last_undegraded":"2024-01-25T15:05:28.230589+0000","last_fullsized":"2024-01-25T15:05:28.230589+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:35:19.247290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229554+0000","last_change":"2024-01-25T15:05:27.226239+0000","last_active":"2024-01-25T15:05:28.229554+0000","last_peered":"2024-01-25T15:05:28.229554+0000","last_clean":"2024-01-25T15:05:28.229554+0000","last_became_active":"2024-01-25T15:05:27.225978+0000","last_became_peered":"2024-01-25T15:05:27.225978+0000","last_unstale":"2024-01-25T15:05:28.229554+0000","last_undegraded":"2024-01-25T15:05:28.229554+0000","last_fullsized":"2024-01-25T15:05:28.229554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:36.810625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231481+0000","last_change":"2024-01-25T15:05:26.222694+0000","last_active":"2024-01-25T15:05:28.231481+0000","last_peered":"2024-01-25T15:05:28.231481+0000","last_clean":"2024-01-25T15:05:28.231481+0000","last_became_active":"2024-01-25T15:05:26.222439+0000","last_became_peered":"2024-01-25T15:05:26.222439+0000","last_unstale":"2024-01-25T15:05:28.231481+0000","last_undegraded":"2024-01-25T15:05:28.231481+0000","last_fullsized":"2024-01-25T15:05:28.231481+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:48:18.501092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229768+0000","last_change":"2024-01-25T15:05:27.233916+0000","last_active":"2024-01-25T15:05:28.229768+0000","last_peered":"2024-01-25T15:05:28.229768+0000","last_clean":"2024-01-25T15:05:28.229768+0000","last_became_active":"2024-01-25T15:05:27.233305+0000","last_became_peered":"2024-01-25T15:05:27.233305+0000","last_unstale":"2024-01-25T15:05:28.229768+0000","last_undegraded":"2024-01-25T15:05:28.229768+0000","last_fullsized":"2024-01-25T15:05:28.229768+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:00:27.744795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.848123+0000","last_change":"2024-01-25T15:05:26.225673+0000","last_active":"2024-01-25T15:05:28.848123+0000","last_peered":"2024-01-25T15:05:28.848123+0000","last_clean":"2024-01-25T15:05:28.848123+0000","last_became_active":"2024-01-25T15:05:26.225411+0000","last_became_peered":"2024-01-25T15:05:26.225411+0000","last_unstale":"2024-01-25T15:05:28.848123+0000","last_undegraded":"2024-01-25T15:05:28.848123+0000","last_fullsized":"2024-01-25T15:05:28.848123+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:16:30.879553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.848063+0000","last_change":"2024-01-25T15:05:27.247875+0000","last_active":"2024-01-25T15:05:28.848063+0000","last_peered":"2024-01-25T15:05:28.848063+0000","last_clean":"2024-01-25T15:05:28.848063+0000","last_became_active":"2024-01-25T15:05:27.247493+0000","last_became_peered":"2024-01-25T15:05:27.247493+0000","last_unstale":"2024-01-25T15:05:28.848063+0000","last_undegraded":"2024-01-25T15:05:28.848063+0000","last_fullsized":"2024-01-25T15:05:28.848063+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:01:33.031259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.716141+0000","last_change":"2024-01-25T15:05:26.220907+0000","last_active":"2024-01-25T15:05:28.716141+0000","last_peered":"2024-01-25T15:05:28.716141+0000","last_clean":"2024-01-25T15:05:28.716141+0000","last_became_active":"2024-01-25T15:05:26.220539+0000","last_became_peered":"2024-01-25T15:05:26.220539+0000","last_unstale":"2024-01-25T15:05:28.716141+0000","last_undegraded":"2024-01-25T15:05:28.716141+0000","last_fullsized":"2024-01-25T15:05:28.716141+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:18:51.754911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.716049+0000","last_change":"2024-01-25T15:05:27.242875+0000","last_active":"2024-01-25T15:05:28.716049+0000","last_peered":"2024-01-25T15:05:28.716049+0000","last_clean":"2024-01-25T15:05:28.716049+0000","last_became_active":"2024-01-25T15:05:27.241953+0000","last_became_peered":"2024-01-25T15:05:27.241953+0000","last_unstale":"2024-01-25T15:05:28.716049+0000","last_undegraded":"2024-01-25T15:05:28.716049+0000","last_fullsized":"2024-01-25T15:05:28.716049+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:46:52.035987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847211+0000","last_change":"2024-01-25T15:05:26.218250+0000","last_active":"2024-01-25T15:05:28.847211+0000","last_peered":"2024-01-25T15:05:28.847211+0000","last_clean":"2024-01-25T15:05:28.847211+0000","last_became_active":"2024-01-25T15:05:26.217965+0000","last_became_peered":"2024-01-25T15:05:26.217965+0000","last_unstale":"2024-01-25T15:05:28.847211+0000","last_undegraded":"2024-01-25T15:05:28.847211+0000","last_fullsized":"2024-01-25T15:05:28.847211+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:03:01.180813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847330+0000","last_change":"2024-01-25T15:05:27.236656+0000","last_active":"2024-01-25T15:05:28.847330+0000","last_peered":"2024-01-25T15:05:28.847330+0000","last_clean":"2024-01-25T15:05:28.847330+0000","last_became_active":"2024-01-25T15:05:27.236391+0000","last_became_peered":"2024-01-25T15:05:27.236391+0000","last_unstale":"2024-01-25T15:05:28.847330+0000","last_undegraded":"2024-01-25T15:05:28.847330+0000","last_fullsized":"2024-01-25T15:05:28.847330+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:48:19.504972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494205+0000","last_change":"2024-01-25T15:05:26.218267+0000","last_active":"2024-01-25T15:05:28.494205+0000","last_peered":"2024-01-25T15:05:28.494205+0000","last_clean":"2024-01-25T15:05:28.494205+0000","last_became_active":"2024-01-25T15:05:26.217935+0000","last_became_peered":"2024-01-25T15:05:26.217935+0000","last_unstale":"2024-01-25T15:05:28.494205+0000","last_undegraded":"2024-01-25T15:05:28.494205+0000","last_fullsized":"2024-01-25T15:05:28.494205+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:18:51.754911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231629+0000","last_change":"2024-01-25T15:05:27.229184+0000","last_active":"2024-01-25T15:05:28.231629+0000","last_peered":"2024-01-25T15:05:28.231629+0000","last_clean":"2024-01-25T15:05:28.231629+0000","last_became_active":"2024-01-25T15:05:27.228691+0000","last_became_peered":"2024-01-25T15:05:27.228691+0000","last_unstale":"2024-01-25T15:05:28.231629+0000","last_undegraded":"2024-01-25T15:05:28.231629+0000","last_fullsized":"2024-01-25T15:05:28.231629+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:44:30.520452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847042+0000","last_change":"2024-01-25T15:05:26.224643+0000","last_active":"2024-01-25T15:05:28.847042+0000","last_peered":"2024-01-25T15:05:28.847042+0000","last_clean":"2024-01-25T15:05:28.847042+0000","last_became_active":"2024-01-25T15:05:26.224395+0000","last_became_peered":"2024-01-25T15:05:26.224395+0000","last_unstale":"2024-01-25T15:05:28.847042+0000","last_undegraded":"2024-01-25T15:05:28.847042+0000","last_fullsized":"2024-01-25T15:05:28.847042+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:12:44.093299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834130+0000","last_change":"2024-01-25T15:05:27.235292+0000","last_active":"2024-01-25T15:05:28.834130+0000","last_peered":"2024-01-25T15:05:28.834130+0000","last_clean":"2024-01-25T15:05:28.834130+0000","last_became_active":"2024-01-25T15:05:27.234825+0000","last_became_peered":"2024-01-25T15:05:27.234825+0000","last_unstale":"2024-01-25T15:05:28.834130+0000","last_undegraded":"2024-01-25T15:05:28.834130+0000","last_fullsized":"2024-01-25T15:05:28.834130+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:16:02.607369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847014+0000","last_change":"2024-01-25T15:05:26.227384+0000","last_active":"2024-01-25T15:05:28.847014+0000","last_peered":"2024-01-25T15:05:28.847014+0000","last_clean":"2024-01-25T15:05:28.847014+0000","last_became_active":"2024-01-25T15:05:26.227112+0000","last_became_peered":"2024-01-25T15:05:26.227112+0000","last_unstale":"2024-01-25T15:05:28.847014+0000","last_undegraded":"2024-01-25T15:05:28.847014+0000","last_fullsized":"2024-01-25T15:05:28.847014+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:05:00.172648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.847623+0000","last_change":"2024-01-25T15:05:27.245885+0000","last_active":"2024-01-25T15:05:28.847623+0000","last_peered":"2024-01-25T15:05:28.847623+0000","last_clean":"2024-01-25T15:05:28.847623+0000","last_became_active":"2024-01-25T15:05:27.245616+0000","last_became_peered":"2024-01-25T15:05:27.245616+0000","last_unstale":"2024-01-25T15:05:28.847623+0000","last_undegraded":"2024-01-25T15:05:28.847623+0000","last_fullsized":"2024-01-25T15:05:28.847623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:02:27.622813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231405+0000","last_change":"2024-01-25T15:05:26.221180+0000","last_active":"2024-01-25T15:05:28.231405+0000","last_peered":"2024-01-25T15:05:28.231405+0000","last_clean":"2024-01-25T15:05:28.231405+0000","last_became_active":"2024-01-25T15:05:26.220911+0000","last_became_peered":"2024-01-25T15:05:26.220911+0000","last_unstale":"2024-01-25T15:05:28.231405+0000","last_undegraded":"2024-01-25T15:05:28.231405+0000","last_fullsized":"2024-01-25T15:05:28.231405+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:00:52.590768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229724+0000","last_change":"2024-01-25T15:05:27.229523+0000","last_active":"2024-01-25T15:05:28.229724+0000","last_peered":"2024-01-25T15:05:28.229724+0000","last_clean":"2024-01-25T15:05:28.229724+0000","last_became_active":"2024-01-25T15:05:27.229254+0000","last_became_peered":"2024-01-25T15:05:27.229254+0000","last_unstale":"2024-01-25T15:05:28.229724+0000","last_undegraded":"2024-01-25T15:05:28.229724+0000","last_fullsized":"2024-01-25T15:05:28.229724+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:47:01.188072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.846942+0000","last_change":"2024-01-25T15:05:26.220823+0000","last_active":"2024-01-25T15:05:28.846942+0000","last_peered":"2024-01-25T15:05:28.846942+0000","last_clean":"2024-01-25T15:05:28.846942+0000","last_became_active":"2024-01-25T15:05:26.220552+0000","last_became_peered":"2024-01-25T15:05:26.220552+0000","last_unstale":"2024-01-25T15:05:28.846942+0000","last_undegraded":"2024-01-25T15:05:28.846942+0000","last_fullsized":"2024-01-25T15:05:28.846942+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:27:08.783181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494190+0000","last_change":"2024-01-25T15:05:27.242991+0000","last_active":"2024-01-25T15:05:28.494190+0000","last_peered":"2024-01-25T15:05:28.494190+0000","last_clean":"2024-01-25T15:05:28.494190+0000","last_became_active":"2024-01-25T15:05:27.241347+0000","last_became_peered":"2024-01-25T15:05:27.241347+0000","last_unstale":"2024-01-25T15:05:28.494190+0000","last_undegraded":"2024-01-25T15:05:28.494190+0000","last_fullsized":"2024-01-25T15:05:28.494190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:54:18.204207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.848184+0000","last_change":"2024-01-25T15:05:26.227334+0000","last_active":"2024-01-25T15:05:28.848184+0000","last_peered":"2024-01-25T15:05:28.848184+0000","last_clean":"2024-01-25T15:05:28.848184+0000","last_became_active":"2024-01-25T15:05:26.227016+0000","last_became_peered":"2024-01-25T15:05:26.227016+0000","last_unstale":"2024-01-25T15:05:28.848184+0000","last_undegraded":"2024-01-25T15:05:28.848184+0000","last_fullsized":"2024-01-25T15:05:28.848184+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:29.999087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231917+0000","last_change":"2024-01-25T15:05:27.242175+0000","last_active":"2024-01-25T15:05:28.231917+0000","last_peered":"2024-01-25T15:05:28.231917+0000","last_clean":"2024-01-25T15:05:28.231917+0000","last_became_active":"2024-01-25T15:05:27.241892+0000","last_became_peered":"2024-01-25T15:05:27.241892+0000","last_unstale":"2024-01-25T15:05:28.231917+0000","last_undegraded":"2024-01-25T15:05:28.231917+0000","last_fullsized":"2024-01-25T15:05:28.231917+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:17:07.138969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.936261+0000","last_change":"2024-01-25T15:05:26.220140+0000","last_active":"2024-01-25T15:05:28.936261+0000","last_peered":"2024-01-25T15:05:28.936261+0000","last_clean":"2024-01-25T15:05:28.936261+0000","last_became_active":"2024-01-25T15:05:26.219823+0000","last_became_peered":"2024-01-25T15:05:26.219823+0000","last_unstale":"2024-01-25T15:05:28.936261+0000","last_undegraded":"2024-01-25T15:05:28.936261+0000","last_fullsized":"2024-01-25T15:05:28.936261+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:53:24.322574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229759+0000","last_change":"2024-01-25T15:05:27.229536+0000","last_active":"2024-01-25T15:05:28.229759+0000","last_peered":"2024-01-25T15:05:28.229759+0000","last_clean":"2024-01-25T15:05:28.229759+0000","last_became_active":"2024-01-25T15:05:27.228565+0000","last_became_peered":"2024-01-25T15:05:27.228565+0000","last_unstale":"2024-01-25T15:05:28.229759+0000","last_undegraded":"2024-01-25T15:05:28.229759+0000","last_fullsized":"2024-01-25T15:05:28.229759+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:01:33.031259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834270+0000","last_change":"2024-01-25T15:05:26.225379+0000","last_active":"2024-01-25T15:05:28.834270+0000","last_peered":"2024-01-25T15:05:28.834270+0000","last_clean":"2024-01-25T15:05:28.834270+0000","last_became_active":"2024-01-25T15:05:26.225106+0000","last_became_peered":"2024-01-25T15:05:26.225106+0000","last_unstale":"2024-01-25T15:05:28.834270+0000","last_undegraded":"2024-01-25T15:05:28.834270+0000","last_fullsized":"2024-01-25T15:05:28.834270+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:21:43.851971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834208+0000","last_change":"2024-01-25T15:05:27.229007+0000","last_active":"2024-01-25T15:05:28.834208+0000","last_peered":"2024-01-25T15:05:28.834208+0000","last_clean":"2024-01-25T15:05:28.834208+0000","last_became_active":"2024-01-25T15:05:27.228729+0000","last_became_peered":"2024-01-25T15:05:27.228729+0000","last_unstale":"2024-01-25T15:05:28.834208+0000","last_undegraded":"2024-01-25T15:05:28.834208+0000","last_fullsized":"2024-01-25T15:05:28.834208+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:13:38.590014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.834307+0000","last_change":"2024-01-25T15:05:26.226470+0000","last_active":"2024-01-25T15:05:28.834307+0000","last_peered":"2024-01-25T15:05:28.834307+0000","last_clean":"2024-01-25T15:05:28.834307+0000","last_became_active":"2024-01-25T15:05:26.226185+0000","last_became_peered":"2024-01-25T15:05:26.226185+0000","last_unstale":"2024-01-25T15:05:28.834307+0000","last_undegraded":"2024-01-25T15:05:28.834307+0000","last_fullsized":"2024-01-25T15:05:28.834307+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:00:52.590768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.494056+0000","last_change":"2024-01-25T15:05:27.236625+0000","last_active":"2024-01-25T15:05:28.494056+0000","last_peered":"2024-01-25T15:05:28.494056+0000","last_clean":"2024-01-25T15:05:28.494056+0000","last_became_active":"2024-01-25T15:05:27.236387+0000","last_became_peered":"2024-01-25T15:05:27.236387+0000","last_unstale":"2024-01-25T15:05:28.494056+0000","last_undegraded":"2024-01-25T15:05:28.494056+0000","last_fullsized":"2024-01-25T15:05:28.494056+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:43:59.664529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.230946+0000","last_change":"2024-01-25T15:05:26.224342+0000","last_active":"2024-01-25T15:05:28.230946+0000","last_peered":"2024-01-25T15:05:28.230946+0000","last_clean":"2024-01-25T15:05:28.230946+0000","last_became_active":"2024-01-25T15:05:26.224074+0000","last_became_peered":"2024-01-25T15:05:26.224074+0000","last_unstale":"2024-01-25T15:05:28.230946+0000","last_undegraded":"2024-01-25T15:05:28.230946+0000","last_fullsized":"2024-01-25T15:05:28.230946+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:22:35.220728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.715707+0000","last_change":"2024-01-25T15:05:27.234553+0000","last_active":"2024-01-25T15:05:28.715707+0000","last_peered":"2024-01-25T15:05:28.715707+0000","last_clean":"2024-01-25T15:05:28.715707+0000","last_became_active":"2024-01-25T15:05:27.234266+0000","last_became_peered":"2024-01-25T15:05:27.234266+0000","last_unstale":"2024-01-25T15:05:28.715707+0000","last_undegraded":"2024-01-25T15:05:28.715707+0000","last_fullsized":"2024-01-25T15:05:28.715707+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:26:19.413150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.715581+0000","last_change":"2024-01-25T15:05:26.210731+0000","last_active":"2024-01-25T15:05:28.715581+0000","last_peered":"2024-01-25T15:05:28.715581+0000","last_clean":"2024-01-25T15:05:28.715581+0000","last_became_active":"2024-01-25T15:05:26.210193+0000","last_became_peered":"2024-01-25T15:05:26.210193+0000","last_unstale":"2024-01-25T15:05:28.715581+0000","last_undegraded":"2024-01-25T15:05:28.715581+0000","last_fullsized":"2024-01-25T15:05:28.715581+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:35:19.247290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231127+0000","last_change":"2024-01-25T15:05:27.240670+0000","last_active":"2024-01-25T15:05:28.231127+0000","last_peered":"2024-01-25T15:05:28.231127+0000","last_clean":"2024-01-25T15:05:28.231127+0000","last_became_active":"2024-01-25T15:05:27.240409+0000","last_became_peered":"2024-01-25T15:05:27.240409+0000","last_unstale":"2024-01-25T15:05:28.231127+0000","last_undegraded":"2024-01-25T15:05:28.231127+0000","last_fullsized":"2024-01-25T15:05:28.231127+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:24:11.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.229491+0000","last_change":"2024-01-25T15:05:26.215779+0000","last_active":"2024-01-25T15:05:28.229491+0000","last_peered":"2024-01-25T15:05:28.229491+0000","last_clean":"2024-01-25T15:05:28.229491+0000","last_became_active":"2024-01-25T15:05:26.215521+0000","last_became_peered":"2024-01-25T15:05:26.215521+0000","last_unstale":"2024-01-25T15:05:28.229491+0000","last_undegraded":"2024-01-25T15:05:28.229491+0000","last_fullsized":"2024-01-25T15:05:28.229491+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:33:04.010404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.848039+0000","last_change":"2024-01-25T15:05:27.236929+0000","last_active":"2024-01-25T15:05:28.848039+0000","last_peered":"2024-01-25T15:05:28.848039+0000","last_clean":"2024-01-25T15:05:28.848039+0000","last_became_active":"2024-01-25T15:05:27.236388+0000","last_became_peered":"2024-01-25T15:05:27.236388+0000","last_unstale":"2024-01-25T15:05:28.848039+0000","last_undegraded":"2024-01-25T15:05:28.848039+0000","last_fullsized":"2024-01-25T15:05:28.848039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:55:46.833186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231417+0000","last_change":"2024-01-25T15:05:26.221948+0000","last_active":"2024-01-25T15:05:28.231417+0000","last_peered":"2024-01-25T15:05:28.231417+0000","last_clean":"2024-01-25T15:05:28.231417+0000","last_became_active":"2024-01-25T15:05:26.221678+0000","last_became_peered":"2024-01-25T15:05:26.221678+0000","last_unstale":"2024-01-25T15:05:28.231417+0000","last_undegraded":"2024-01-25T15:05:28.231417+0000","last_fullsized":"2024-01-25T15:05:28.231417+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:21:43.851971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":201,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-25T15:05:28.231691+0000","last_change":"2024-01-25T15:04:16.181635+0000","last_active":"2024-01-25T15:05:28.231691+0000","last_peered":"2024-01-25T15:05:28.231691+0000","last_clean":"2024-01-25T15:05:28.231691+0000","last_became_active":"2024-01-25T15:04:16.179890+0000","last_became_peered":"2024-01-25T15:04:16.179890+0000","last_unstale":"2024-01-25T15:05:28.231691+0000","last_undegraded":"2024-01-25T15:05:28.231691+0000","last_fullsized":"2024-01-25T15:05:28.231691+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_clean_scrub_stamp":"2024-01-25T15:04:14.956188+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:49:00.618327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":780688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.73399999999999999}]},{"osd":1,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.86799999999999999}]},{"osd":3,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.754}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.79700000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":442368,"data_stored":189220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.60499999999999998}]},{"osd":4,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.499},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.36599999999999999}]},{"osd":7,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.53000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31616,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340224,"statfs":{"total":96636764160,"available":96604389376,"internally_reserved":0,"allocated":446464,"data_stored":188750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.622}]},{"osd":2,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.70399999999999996}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.44500000000000001}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.47199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":446464,"data_stored":189242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.71799999999999997}]},{"osd":1,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.75600000000000001}]},{"osd":2,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.85299999999999998}]},{"osd":3,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.73799999999999999}]},{"osd":5,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.625},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.59799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":190284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.30499999999999999}]},{"osd":1,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":3.3559999999999999,"5min":3.3559999999999999,"15min":3.3559999999999999},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.25800000000000001}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.4209999999999998,"5min":3.4209999999999998,"15min":3.4209999999999998},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.4689999999999999,"5min":3.4689999999999999,"15min":3.4689999999999999},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":3.508,"5min":3.508,"15min":3.508},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.505}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.5449999999999999,"5min":3.5449999999999999,"15min":3.5449999999999999},"last":0.48499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":442368,"data_stored":188708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.53400000000000003}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.80300000000000005}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.84399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":442368,"data_stored":188728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.437}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.40300000000000002}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.58699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1036288,"data_stored":779040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.432},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.58799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:05:35.291 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-25T15:05:35.291 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-25T15:05:35.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.434+0000 7fb7f149b640 1 Processor -- start 2024-01-25T15:05:35.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.434+0000 7fb7f149b640 1 -- start start 2024-01-25T15:05:35.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.435+0000 7fb7f149b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb7ec06d600 0x7fb7ec0a8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:35.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.435+0000 7fb7f149b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb7ec0c2f80 0x7fb7ec154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:35.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.435+0000 7fb7f149b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7ec155690 con 0x7fb7ec14b2a0 2024-01-25T15:05:35.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.435+0000 7fb7f149b640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7ec0c22c0 con 0x7fb7ec06d600 2024-01-25T15:05:35.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.435+0000 7fb7f149b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7ec0c24a0 con 0x7fb7ec0c2f80 2024-01-25T15:05:35.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.435+0000 7fb7ea7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb7ec06d600 0x7fb7ec0a8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:35.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.435+0000 7fb7ea7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb7ec06d600 0x7fb7ec0a8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33478/0 (socket says 172.21.15.29:33478) 2024-01-25T15:05:35.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.435+0000 7fb7ea7fc640 1 -- 172.21.15.29:0/3471433914 learned_addr learned my addr 172.21.15.29:0/3471433914 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:35.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.435+0000 7fb7ea7fc640 1 -- 172.21.15.29:0/3471433914 >> v2:172.21.15.52:3300/0 conn(0x7fb7ec0c2f80 msgr2=0x7fb7ec154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:35.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.435+0000 7fb7eb7fe640 1 --2- 172.21.15.29:0/3471433914 >> v2:172.21.15.52:3300/0 conn(0x7fb7ec0c2f80 0x7fb7ec154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:35.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.435+0000 7fb7ea7fc640 1 --2- 172.21.15.29:0/3471433914 >> v2:172.21.15.52:3300/0 conn(0x7fb7ec0c2f80 0x7fb7ec154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.435+0000 7fb7ea7fc640 1 -- 172.21.15.29:0/3471433914 >> v1:172.21.15.52:6789/0 conn(0x7fb7ec14b2a0 legacy=0x7fb7ec06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:35.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.435+0000 7fb7ea7fc640 1 -- 172.21.15.29:0/3471433914 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec0c2780 con 0x7fb7ec06d600 2024-01-25T15:05:35.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.436+0000 7fb7ea7fc640 1 --2- 172.21.15.29:0/3471433914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ec06d600 0x7fb7ec0a8490 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0a93e0 tx=0x7fb7d402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d879db7cee8dd7ac server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:35.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.436+0000 7fb7e9ffb640 1 -- 172.21.15.29:0/3471433914 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d40317e0 con 0x7fb7ec06d600 2024-01-25T15:05:35.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.436+0000 7fb7e9ffb640 1 -- 172.21.15.29:0/3471433914 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d4031940 con 0x7fb7ec06d600 2024-01-25T15:05:35.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.436+0000 7fb7e9ffb640 1 -- 172.21.15.29:0/3471433914 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4031cd0 con 0x7fb7ec06d600 2024-01-25T15:05:35.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.437+0000 7fb7f149b640 1 -- 172.21.15.29:0/3471433914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ec06d600 msgr2=0x7fb7ec0a8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:35.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.437+0000 7fb7f149b640 1 --2- 172.21.15.29:0/3471433914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ec06d600 0x7fb7ec0a8490 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0a93e0 tx=0x7fb7d402b880 comp rx=0 tx=0).stop 2024-01-25T15:05:35.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.437+0000 7fb7f149b640 1 -- 172.21.15.29:0/3471433914 shutdown_connections 2024-01-25T15:05:35.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.437+0000 7fb7f149b640 1 --2- 172.21.15.29:0/3471433914 >> v2:172.21.15.52:3300/0 conn(0x7fb7ec0c2f80 0x7fb7ec154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.437+0000 7fb7f149b640 1 --2- 172.21.15.29:0/3471433914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ec06d600 0x7fb7ec0a8490 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.437+0000 7fb7f149b640 1 -- 172.21.15.29:0/3471433914 >> 172.21.15.29:0/3471433914 conn(0x7fb7ec0c39b0 msgr2=0x7fb7ec0c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:35.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.437+0000 7fb7f149b640 1 -- 172.21.15.29:0/3471433914 shutdown_connections 2024-01-25T15:05:35.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.437+0000 7fb7f149b640 1 -- 172.21.15.29:0/3471433914 wait complete. 2024-01-25T15:05:35.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.438+0000 7fb7f149b640 1 Processor -- start 2024-01-25T15:05:35.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.438+0000 7fb7f149b640 1 -- start start 2024-01-25T15:05:35.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.439+0000 7fb7f149b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb7ec06d600 0x7fb7ec154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:35.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.439+0000 7fb7f149b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7ec0c2f80 0x7fb7ec1df040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:35.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.439+0000 7fb7f149b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ec14b2a0 0x7fb7ec1ea120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:35.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.439+0000 7fb7f149b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec154890 con 0x7fb7ec14b2a0 2024-01-25T15:05:35.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.439+0000 7fb7f149b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec1ee0a0 con 0x7fb7ec0c2f80 2024-01-25T15:05:35.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.439+0000 7fb7f149b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec1ee5d0 con 0x7fb7ec06d600 2024-01-25T15:05:35.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.439+0000 7fb7eb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ec14b2a0 0x7fb7ec1ea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:35.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.439+0000 7fb7eb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ec14b2a0 0x7fb7ec1ea120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33480/0 (socket says 172.21.15.29:33480) 2024-01-25T15:05:35.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.439+0000 7fb7eb7fe640 1 -- 172.21.15.29:0/1573365570 learned_addr learned my addr 172.21.15.29:0/1573365570 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:35.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.439+0000 7fb7ea7fc640 1 --2- 172.21.15.29:0/1573365570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7ec0c2f80 0x7fb7ec1df040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:35.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.439+0000 7fb7eaffd640 1 --2- 172.21.15.29:0/1573365570 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb7ec06d600 0x7fb7ec154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:35.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.439+0000 7fb7eb7fe640 1 -- 172.21.15.29:0/1573365570 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb7ec06d600 msgr2=0x7fb7ec154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:35.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.439+0000 7fb7eb7fe640 1 --2- 172.21.15.29:0/1573365570 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb7ec06d600 0x7fb7ec154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.439+0000 7fb7eb7fe640 1 -- 172.21.15.29:0/1573365570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7ec0c2f80 msgr2=0x7fb7ec1df040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:35.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.439+0000 7fb7eb7fe640 1 --2- 172.21.15.29:0/1573365570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7ec0c2f80 0x7fb7ec1df040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.439+0000 7fb7eb7fe640 1 -- 172.21.15.29:0/1573365570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d40094d0 con 0x7fb7ec14b2a0 2024-01-25T15:05:35.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.439+0000 7fb7eaffd640 1 --2- 172.21.15.29:0/1573365570 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb7ec06d600 0x7fb7ec154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:35.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.439+0000 7fb7eb7fe640 1 --2- 172.21.15.29:0/1573365570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ec14b2a0 0x7fb7ec1ea120 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc00cda0 tx=0x7fb7dc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:35.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.440+0000 7fb7e37fe640 1 -- 172.21.15.29:0/1573365570 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc003b90 con 0x7fb7ec14b2a0 2024-01-25T15:05:35.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.440+0000 7fb7e37fe640 1 -- 172.21.15.29:0/1573365570 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7dc003cf0 con 0x7fb7ec14b2a0 2024-01-25T15:05:35.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.440+0000 7fb7f149b640 1 -- 172.21.15.29:0/1573365570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7ec1ee2f0 con 0x7fb7ec14b2a0 2024-01-25T15:05:35.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.440+0000 7fb7e37fe640 1 -- 172.21.15.29:0/1573365570 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc004240 con 0x7fb7ec14b2a0 2024-01-25T15:05:35.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.440+0000 7fb7f149b640 1 -- 172.21.15.29:0/1573365570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7ec1538f0 con 0x7fb7ec14b2a0 2024-01-25T15:05:35.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.441+0000 7fb7f149b640 1 -- 172.21.15.29:0/1573365570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7ec154070 con 0x7fb7ec14b2a0 2024-01-25T15:05:35.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.441+0000 7fb7e37fe640 1 -- 172.21.15.29:0/1573365570 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fb7dc0043a0 con 0x7fb7ec14b2a0 2024-01-25T15:05:35.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.441+0000 7fb7e37fe640 1 --2- 172.21.15.29:0/1573365570 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb7cc06aed0 0x7fb7cc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:35.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.441+0000 7fb7e37fe640 1 -- 172.21.15.29:0/1573365570 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb7dc012070 con 0x7fb7ec14b2a0 2024-01-25T15:05:35.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.442+0000 7fb7eaffd640 1 --2- 172.21.15.29:0/1573365570 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb7cc06aed0 0x7fb7cc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:35.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.442+0000 7fb7eaffd640 1 --2- 172.21.15.29:0/1573365570 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb7cc06aed0 0x7fb7cc06d390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec1eb250 tx=0x7fb7e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:35.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.446+0000 7fb7e37fe640 1 -- 172.21.15.29:0/1573365570 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fb7dc054f00 con 0x7fb7ec14b2a0 2024-01-25T15:05:35.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.695+0000 7fb7f149b640 1 -- 172.21.15.29:0/1573365570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb7ec074010 con 0x7fb7ec14b2a0 2024-01-25T15:05:35.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.697+0000 7fb7e37fe640 1 -- 172.21.15.29:0/1573365570 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7fb7dc058520 con 0x7fb7ec14b2a0 2024-01-25T15:05:35.697 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2024-01-25T15:05:35.697 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBFeLJlQhBmKBAAC5MC37SsgxDRQlM8EpzhHQ== 2024-01-25T15:05:35.698 INFO:teuthology.orchestra.run.smithi029.stdout: caps mds = "allow" 2024-01-25T15:05:35.698 INFO:teuthology.orchestra.run.smithi029.stdout: caps mon = "allow r" 2024-01-25T15:05:35.698 INFO:teuthology.orchestra.run.smithi029.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-01-25T15:05:35.698 INFO:teuthology.orchestra.run.smithi029.stderr:updated caps for client.0 2024-01-25T15:05:35.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.699+0000 7fb7f149b640 1 -- 172.21.15.29:0/1573365570 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb7cc06aed0 msgr2=0x7fb7cc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:35.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.699+0000 7fb7f149b640 1 --2- 172.21.15.29:0/1573365570 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb7cc06aed0 0x7fb7cc06d390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec1eb250 tx=0x7fb7e4008040 comp rx=0 tx=0).stop 2024-01-25T15:05:35.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.699+0000 7fb7f149b640 1 -- 172.21.15.29:0/1573365570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ec14b2a0 msgr2=0x7fb7ec1ea120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:35.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.699+0000 7fb7f149b640 1 --2- 172.21.15.29:0/1573365570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ec14b2a0 0x7fb7ec1ea120 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc00cda0 tx=0x7fb7dc00a660 comp rx=0 tx=0).stop 2024-01-25T15:05:35.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.699+0000 7fb7f149b640 1 -- 172.21.15.29:0/1573365570 shutdown_connections 2024-01-25T15:05:35.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.699+0000 7fb7f149b640 1 --2- 172.21.15.29:0/1573365570 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb7cc06aed0 0x7fb7cc06d390 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.699+0000 7fb7f149b640 1 --2- 172.21.15.29:0/1573365570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ec14b2a0 0x7fb7ec1ea120 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.699+0000 7fb7f149b640 1 --2- 172.21.15.29:0/1573365570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7ec0c2f80 0x7fb7ec1df040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.699+0000 7fb7f149b640 1 --2- 172.21.15.29:0/1573365570 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb7ec06d600 0x7fb7ec154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.699+0000 7fb7f149b640 1 -- 172.21.15.29:0/1573365570 >> 172.21.15.29:0/1573365570 conn(0x7fb7ec0c39b0 msgr2=0x7fb7ec149280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:35.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.699+0000 7fb7f149b640 1 -- 172.21.15.29:0/1573365570 shutdown_connections 2024-01-25T15:05:35.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.699+0000 7fb7f149b640 1 -- 172.21.15.29:0/1573365570 wait complete. 2024-01-25T15:05:35.710 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:05:35.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.811+0000 7f1399f3e640 1 Processor -- start 2024-01-25T15:05:35.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.811+0000 7f1399f3e640 1 -- start start 2024-01-25T15:05:35.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.812+0000 7f1399f3e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13941520b0 0x7f1394155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:35.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.812+0000 7f1399f3e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f13940c4f00 0x7f13940c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:35.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.812+0000 7f1399f3e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13940c66c0 con 0x7f13940c55e0 2024-01-25T15:05:35.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.812+0000 7f1399f3e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139406cfc0 con 0x7f13940c4f00 2024-01-25T15:05:35.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.812+0000 7f1399f3e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1394152490 con 0x7f13941520b0 2024-01-25T15:05:35.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.812+0000 7f13937fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13941520b0 0x7f1394155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:35.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.812+0000 7f1393fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f13940c4f00 0x7f13940c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:35.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.812+0000 7f1392ffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f13940c55e0 0x7f13940c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:56538/0 (socket says 172.21.15.29:56538) 2024-01-25T15:05:35.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.812+0000 7f1392ffd640 1 -- 172.21.15.29:0/428026092 learned_addr learned my addr 172.21.15.29:0/428026092 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:35.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.812+0000 7f13927fc640 1 -- 172.21.15.29:0/428026092 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491025264 0 0) 0x7f13940c66c0 con 0x7f13940c55e0 2024-01-25T15:05:35.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.812+0000 7f13927fc640 1 -- 172.21.15.29:0/428026092 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f137c003520 con 0x7f13940c55e0 2024-01-25T15:05:35.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.812+0000 7f1393fff640 1 -- 172.21.15.29:0/428026092 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13941520b0 msgr2=0x7f1394155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:35.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.812+0000 7f1393fff640 1 --2- 172.21.15.29:0/428026092 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13941520b0 0x7f1394155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.812+0000 7f1393fff640 1 -- 172.21.15.29:0/428026092 >> v1:172.21.15.52:6789/0 conn(0x7f13940c55e0 legacy=0x7f13940c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:35.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.812+0000 7f1393fff640 1 -- 172.21.15.29:0/428026092 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13940c8830 con 0x7f13940c4f00 2024-01-25T15:05:35.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.813+0000 7f1393fff640 1 --2- 172.21.15.29:0/428026092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13940c4f00 0x7f13940c5b30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f138c009d90 tx=0x7f138c02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d48c4239369393a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:35.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.813+0000 7f13927fc640 1 -- 172.21.15.29:0/428026092 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c02cbc0 con 0x7f13940c4f00 2024-01-25T15:05:35.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.813+0000 7f13927fc640 1 -- 172.21.15.29:0/428026092 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138c02cd20 con 0x7f13940c4f00 2024-01-25T15:05:35.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.813+0000 7f13927fc640 1 -- 172.21.15.29:0/428026092 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c034640 con 0x7f13940c4f00 2024-01-25T15:05:35.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.814+0000 7f1399f3e640 1 -- 172.21.15.29:0/428026092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13940c4f00 msgr2=0x7f13940c5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:35.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.814+0000 7f1399f3e640 1 --2- 172.21.15.29:0/428026092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13940c4f00 0x7f13940c5b30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f138c009d90 tx=0x7f138c02be10 comp rx=0 tx=0).stop 2024-01-25T15:05:35.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.814+0000 7f1399f3e640 1 -- 172.21.15.29:0/428026092 shutdown_connections 2024-01-25T15:05:35.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.814+0000 7f1399f3e640 1 --2- 172.21.15.29:0/428026092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13940c4f00 0x7f13940c5b30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.814+0000 7f1399f3e640 1 --2- 172.21.15.29:0/428026092 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13941520b0 0x7f1394155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.814+0000 7f1399f3e640 1 -- 172.21.15.29:0/428026092 >> 172.21.15.29:0/428026092 conn(0x7f13940ca220 msgr2=0x7f13940ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:35.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.814+0000 7f1399f3e640 1 -- 172.21.15.29:0/428026092 shutdown_connections 2024-01-25T15:05:35.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.814+0000 7f1399f3e640 1 -- 172.21.15.29:0/428026092 wait complete. 2024-01-25T15:05:35.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.815+0000 7f1399f3e640 1 Processor -- start 2024-01-25T15:05:35.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.815+0000 7f1399f3e640 1 -- start start 2024-01-25T15:05:35.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.816+0000 7f1399f3e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13940c4f00 0x7f1394152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:35.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.816+0000 7f1399f3e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13941520b0 0x7f1394153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:35.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.816+0000 7f1399f3e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13941482f0 0x7f1394148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:35.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.816+0000 7f1399f3e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1394148cc0 con 0x7f13941482f0 2024-01-25T15:05:35.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.816+0000 7f1399f3e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13941e99f0 con 0x7f13941520b0 2024-01-25T15:05:35.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.816+0000 7f1399f3e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13940ace20 con 0x7f13940c4f00 2024-01-25T15:05:35.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.816+0000 7f1393fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13941482f0 0x7f1394148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:35.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.816+0000 7f1393fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13941482f0 0x7f1394148780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34106/0 (socket says 172.21.15.29:34106) 2024-01-25T15:05:35.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.816+0000 7f1393fff640 1 -- 172.21.15.29:0/3955412319 learned_addr learned my addr 172.21.15.29:0/3955412319 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:35.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.816+0000 7f13937fe640 1 --2- 172.21.15.29:0/3955412319 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13940c4f00 0x7f1394152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:35.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.816+0000 7f1392ffd640 1 --2- 172.21.15.29:0/3955412319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13941520b0 0x7f1394153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:35.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.816+0000 7f1393fff640 1 -- 172.21.15.29:0/3955412319 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13940c4f00 msgr2=0x7f1394152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:35.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.816+0000 7f1393fff640 1 --2- 172.21.15.29:0/3955412319 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13940c4f00 0x7f1394152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.816+0000 7f1393fff640 1 -- 172.21.15.29:0/3955412319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13941520b0 msgr2=0x7f1394153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:35.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.816+0000 7f1393fff640 1 --2- 172.21.15.29:0/3955412319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13941520b0 0x7f1394153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:35.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.816+0000 7f1393fff640 1 -- 172.21.15.29:0/3955412319 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c009a70 con 0x7f13941482f0 2024-01-25T15:05:35.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.817+0000 7f1393fff640 1 --2- 172.21.15.29:0/3955412319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13941482f0 0x7f1394148780 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f138c009d90 tx=0x7f138c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:35.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.817+0000 7f137bfff640 1 -- 172.21.15.29:0/3955412319 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c007000 con 0x7f13941482f0 2024-01-25T15:05:35.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.817+0000 7f137bfff640 1 -- 172.21.15.29:0/3955412319 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138c02ce90 con 0x7f13941482f0 2024-01-25T15:05:35.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.817+0000 7f1399f3e640 1 -- 172.21.15.29:0/3955412319 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13941e9c00 con 0x7f13941482f0 2024-01-25T15:05:35.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.817+0000 7f137bfff640 1 -- 172.21.15.29:0/3955412319 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c0408b0 con 0x7f13941482f0 2024-01-25T15:05:35.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.817+0000 7f1399f3e640 1 -- 172.21.15.29:0/3955412319 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13940ad350 con 0x7f13941482f0 2024-01-25T15:05:35.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.818+0000 7f1399f3e640 1 -- 172.21.15.29:0/3955412319 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1394074080 con 0x7f13941482f0 2024-01-25T15:05:35.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.818+0000 7f137bfff640 1 -- 172.21.15.29:0/3955412319 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f138c040a10 con 0x7f13941482f0 2024-01-25T15:05:35.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.819+0000 7f137bfff640 1 --2- 172.21.15.29:0/3955412319 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f138006aed0 0x7f138006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:35.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.819+0000 7f137bfff640 1 -- 172.21.15.29:0/3955412319 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f138c0ac250 con 0x7f13941482f0 2024-01-25T15:05:35.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.819+0000 7f13937fe640 1 --2- 172.21.15.29:0/3955412319 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f138006aed0 0x7f138006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:35.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.820+0000 7f13937fe640 1 --2- 172.21.15.29:0/3955412319 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f138006aed0 0x7f138006d390 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f13940afcd0 tx=0x7f1384008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:35.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:35.823+0000 7f137bfff640 1 -- 172.21.15.29:0/3955412319 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f138c077130 con 0x7f13941482f0 2024-01-25T15:05:36.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.037+0000 7f1399f3e640 1 -- 172.21.15.29:0/3955412319 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13940c4ce0 con 0x7f13941482f0 2024-01-25T15:05:36.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.038+0000 7f137bfff640 1 -- 172.21.15.29:0/3955412319 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f138c009450 con 0x7f13941482f0 2024-01-25T15:05:36.039 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:36.039 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/3901576943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6835","nonce":3901576943},{"type":"v1","addr":"172.21.15.52:6837","nonce":3901576943}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6836/1878395580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1878395580},{"type":"v1","addr":"172.21.15.52:6836","nonce":1878395580}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1607449141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1607449141},{"type":"v1","addr":"172.21.15.29:6834","nonce":1607449141}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:05:26.577307+0000","modified":"2024-01-25T15:05:28.881837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3222226893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3222226893},{"type":"v1","addr":"172.21.15.29:6835","nonce":3222226893}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-25T15:05:36.039 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 17 2024-01-25T15:05:36.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.040+0000 7f1399f3e640 1 -- 172.21.15.29:0/3955412319 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f138006aed0 msgr2=0x7f138006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:36.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.040+0000 7f1399f3e640 1 --2- 172.21.15.29:0/3955412319 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f138006aed0 0x7f138006d390 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f13940afcd0 tx=0x7f1384008040 comp rx=0 tx=0).stop 2024-01-25T15:05:36.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.040+0000 7f1399f3e640 1 -- 172.21.15.29:0/3955412319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13941482f0 msgr2=0x7f1394148780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:36.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.040+0000 7f1399f3e640 1 --2- 172.21.15.29:0/3955412319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13941482f0 0x7f1394148780 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f138c009d90 tx=0x7f138c004a40 comp rx=0 tx=0).stop 2024-01-25T15:05:36.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.040+0000 7f1399f3e640 1 -- 172.21.15.29:0/3955412319 shutdown_connections 2024-01-25T15:05:36.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.040+0000 7f1399f3e640 1 --2- 172.21.15.29:0/3955412319 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f138006aed0 0x7f138006d390 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.040+0000 7f1399f3e640 1 --2- 172.21.15.29:0/3955412319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13941482f0 0x7f1394148780 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.040+0000 7f1399f3e640 1 --2- 172.21.15.29:0/3955412319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13941520b0 0x7f1394153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.040+0000 7f1399f3e640 1 --2- 172.21.15.29:0/3955412319 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13940c4f00 0x7f1394152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.040+0000 7f1399f3e640 1 -- 172.21.15.29:0/3955412319 >> 172.21.15.29:0/3955412319 conn(0x7f13940ca220 msgr2=0x7f13940c5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:36.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.040+0000 7f1399f3e640 1 -- 172.21.15.29:0/3955412319 shutdown_connections 2024-01-25T15:05:36.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.040+0000 7f1399f3e640 1 -- 172.21.15.29:0/3955412319 wait complete. 2024-01-25T15:05:36.454 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-25T15:05:26.577307+0000', 'modified': '2024-01-25T15:05:28.881837+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5250}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5250': {'gid': 5250, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.29:6835/3222226893', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6833', 'nonce': 3222226893}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 3222226893}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-25T15:05:36.454 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-25T15:05:36.454 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-25T15:05:36.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.558+0000 7fb5d57ea640 1 Processor -- start 2024-01-25T15:05:36.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.559+0000 7fb5d57ea640 1 -- start start 2024-01-25T15:05:36.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.559+0000 7fb5d57ea640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5d0151d80 0x7fb5d0155120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.559+0000 7fb5d57ea640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb5d006b710 0x7fb5d00c6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.559+0000 7fb5d57ea640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d00c58c0 con 0x7fb5d006b2b0 2024-01-25T15:05:36.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.559+0000 7fb5d57ea640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d006c0a0 con 0x7fb5d006b710 2024-01-25T15:05:36.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.559+0000 7fb5d57ea640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d00c7f10 con 0x7fb5d0151d80 2024-01-25T15:05:36.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.559+0000 7fb5ce7fc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb5d006b2b0 0x7fb5d00c5d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42582/0 (socket says 172.21.15.29:42582) 2024-01-25T15:05:36.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.559+0000 7fb5ce7fc640 1 -- 172.21.15.29:0/1399740888 learned_addr learned my addr 172.21.15.29:0/1399740888 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:36.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5ceffd640 1 --2- 172.21.15.29:0/1399740888 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5d0151d80 0x7fb5d0155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cdffb640 1 -- 172.21.15.29:0/1399740888 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875613000 0 0) 0x7fb5d00c58c0 con 0x7fb5d006b2b0 2024-01-25T15:05:36.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cf7fe640 1 --2- 172.21.15.29:0/1399740888 >> v2:172.21.15.52:3300/0 conn(0x7fb5d006b710 0x7fb5d00c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cdffb640 1 -- 172.21.15.29:0/1399740888 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5b8003520 con 0x7fb5d006b2b0 2024-01-25T15:05:36.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cdffb640 1 -- 172.21.15.29:0/1399740888 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3529785503 0 0) 0x7fb5b8003520 con 0x7fb5d006b2b0 2024-01-25T15:05:36.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cdffb640 1 -- 172.21.15.29:0/1399740888 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5d0151d80 msgr2=0x7fb5d0155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:36.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cdffb640 1 --2- 172.21.15.29:0/1399740888 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5d0151d80 0x7fb5d0155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cdffb640 1 -- 172.21.15.29:0/1399740888 >> v2:172.21.15.52:3300/0 conn(0x7fb5d006b710 msgr2=0x7fb5d00c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:36.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cdffb640 1 --2- 172.21.15.29:0/1399740888 >> v2:172.21.15.52:3300/0 conn(0x7fb5d006b710 0x7fb5d00c6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cdffb640 1 -- 172.21.15.29:0/1399740888 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d00c4990 con 0x7fb5d006b2b0 2024-01-25T15:05:36.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cdffb640 1 -- 172.21.15.29:0/1399740888 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7fb5c4001670 con 0x7fb5d006b2b0 2024-01-25T15:05:36.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cdffb640 1 -- 172.21.15.29:0/1399740888 >> v1:172.21.15.29:6789/0 conn(0x7fb5d006b2b0 legacy=0x7fb5d00c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:36.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cdffb640 1 --2- 172.21.15.29:0/1399740888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5b8003a10 0x7fb5b8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cdffb640 1 --2- 172.21.15.29:0/1399740888 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5d0151d80 0x7fb5b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cdffb640 1 --2- 172.21.15.29:0/1399740888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5b8004d00 0x7fb5b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cdffb640 1 -- 172.21.15.29:0/1399740888 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b800b980 con 0x7fb5b8004d00 2024-01-25T15:05:36.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cdffb640 1 -- 172.21.15.29:0/1399740888 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b800bac0 con 0x7fb5b8003a10 2024-01-25T15:05:36.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cdffb640 1 -- 172.21.15.29:0/1399740888 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b800bc80 con 0x7fb5d0151d80 2024-01-25T15:05:36.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cf7fe640 1 --2- 172.21.15.29:0/1399740888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5b8004d00 0x7fb5b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5ce7fc640 1 --2- 172.21.15.29:0/1399740888 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5d0151d80 0x7fb5b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5ceffd640 1 --2- 172.21.15.29:0/1399740888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5b8003a10 0x7fb5b8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cf7fe640 1 -- 172.21.15.29:0/1399740888 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5d0151d80 msgr2=0x7fb5b80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:36.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cf7fe640 1 --2- 172.21.15.29:0/1399740888 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5d0151d80 0x7fb5b80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cf7fe640 1 -- 172.21.15.29:0/1399740888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5b8003a10 msgr2=0x7fb5b8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:36.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cf7fe640 1 --2- 172.21.15.29:0/1399740888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5b8003a10 0x7fb5b8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.560+0000 7fb5cf7fe640 1 -- 172.21.15.29:0/1399740888 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b8003520 con 0x7fb5b8004d00 2024-01-25T15:05:36.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.561+0000 7fb5cf7fe640 1 --2- 172.21.15.29:0/1399740888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5b8004d00 0x7fb5b8005180 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0009fc0 tx=0x7fb5b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39cb6dcecdff696b server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:36.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.561+0000 7fb5cdffb640 1 -- 172.21.15.29:0/1399740888 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c002cc60 con 0x7fb5b8004d00 2024-01-25T15:05:36.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.561+0000 7fb5cdffb640 1 -- 172.21.15.29:0/1399740888 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c000f040 con 0x7fb5b8004d00 2024-01-25T15:05:36.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.561+0000 7fb5cdffb640 1 -- 172.21.15.29:0/1399740888 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0034440 con 0x7fb5b8004d00 2024-01-25T15:05:36.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.562+0000 7fb5d57ea640 1 -- 172.21.15.29:0/1399740888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5b8004d00 msgr2=0x7fb5b8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:36.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.562+0000 7fb5d57ea640 1 --2- 172.21.15.29:0/1399740888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5b8004d00 0x7fb5b8005180 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0009fc0 tx=0x7fb5b80057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.562+0000 7fb5cf7fe640 1 -- 172.21.15.29:0/1399740888 reap_dead start 2024-01-25T15:05:36.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.562+0000 7fb5d57ea640 1 -- 172.21.15.29:0/1399740888 shutdown_connections 2024-01-25T15:05:36.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.562+0000 7fb5d57ea640 1 -- 172.21.15.29:0/1399740888 >> 172.21.15.29:0/1399740888 conn(0x7fb5d00ca1f0 msgr2=0x7fb5d00ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:36.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.562+0000 7fb5d57ea640 1 -- 172.21.15.29:0/1399740888 shutdown_connections 2024-01-25T15:05:36.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.562+0000 7fb5d57ea640 1 -- 172.21.15.29:0/1399740888 wait complete. 2024-01-25T15:05:36.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.563+0000 7fb5d57ea640 1 Processor -- start 2024-01-25T15:05:36.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.563+0000 7fb5d57ea640 1 -- start start 2024-01-25T15:05:36.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.564+0000 7fb5d57ea640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5b8004d00 0x7fb5d01ea820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.564+0000 7fb5d57ea640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5d01eb2e0 0x7fb5d00aae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.564+0000 7fb5d57ea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d014cfa0 0x7fb5d01eda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.564+0000 7fb5d57ea640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d01ed610 con 0x7fb5d01eb2e0 2024-01-25T15:05:36.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.564+0000 7fb5d57ea640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d00c3f90 con 0x7fb5d014cfa0 2024-01-25T15:05:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.564+0000 7fb5d57ea640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d00c3730 con 0x7fb5b8004d00 2024-01-25T15:05:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.564+0000 7fb5ce7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5d01eb2e0 0x7fb5d00aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.564+0000 7fb5ce7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5d01eb2e0 0x7fb5d00aae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34124/0 (socket says 172.21.15.29:34124) 2024-01-25T15:05:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.564+0000 7fb5ce7fc640 1 -- 172.21.15.29:0/2433464016 learned_addr learned my addr 172.21.15.29:0/2433464016 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.564+0000 7fb5ceffd640 1 --2- 172.21.15.29:0/2433464016 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5b8004d00 0x7fb5d01ea820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.564+0000 7fb5cf7fe640 1 --2- 172.21.15.29:0/2433464016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d014cfa0 0x7fb5d01eda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.564+0000 7fb5ce7fc640 1 -- 172.21.15.29:0/2433464016 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5b8004d00 msgr2=0x7fb5d01ea820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.564+0000 7fb5ce7fc640 1 --2- 172.21.15.29:0/2433464016 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5b8004d00 0x7fb5d01ea820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.564+0000 7fb5ce7fc640 1 -- 172.21.15.29:0/2433464016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d014cfa0 msgr2=0x7fb5d01eda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.564+0000 7fb5ce7fc640 1 --2- 172.21.15.29:0/2433464016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d014cfa0 0x7fb5d01eda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.564+0000 7fb5ce7fc640 1 -- 172.21.15.29:0/2433464016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d01ead60 con 0x7fb5d01eb2e0 2024-01-25T15:05:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.565+0000 7fb5ce7fc640 1 --2- 172.21.15.29:0/2433464016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5d01eb2e0 0x7fb5d00aae00 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb5c40072c0 tx=0x7fb5c40076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.565+0000 7fb5b77fe640 1 -- 172.21.15.29:0/2433464016 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c400f940 con 0x7fb5d01eb2e0 2024-01-25T15:05:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.565+0000 7fb5b77fe640 1 -- 172.21.15.29:0/2433464016 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c400faa0 con 0x7fb5d01eb2e0 2024-01-25T15:05:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.565+0000 7fb5d57ea640 1 -- 172.21.15.29:0/2433464016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d00c39d0 con 0x7fb5d01eb2e0 2024-01-25T15:05:36.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.565+0000 7fb5b77fe640 1 -- 172.21.15.29:0/2433464016 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c400fe50 con 0x7fb5d01eb2e0 2024-01-25T15:05:36.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.565+0000 7fb5d57ea640 1 -- 172.21.15.29:0/2433464016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d00ab340 con 0x7fb5d01eb2e0 2024-01-25T15:05:36.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.567+0000 7fb5b77fe640 1 -- 172.21.15.29:0/2433464016 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fb5c401d360 con 0x7fb5d01eb2e0 2024-01-25T15:05:36.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.567+0000 7fb5b77fe640 1 --2- 172.21.15.29:0/2433464016 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb5bc06aed0 0x7fb5bc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.567+0000 7fb5b77fe640 1 -- 172.21.15.29:0/2433464016 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb5c4088fa0 con 0x7fb5d01eb2e0 2024-01-25T15:05:36.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.567+0000 7fb5ceffd640 1 --2- 172.21.15.29:0/2433464016 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb5bc06aed0 0x7fb5bc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.568+0000 7fb5d83bb740 1 Processor -- start 2024-01-25T15:05:36.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.568+0000 7fb5ceffd640 1 --2- 172.21.15.29:0/2433464016 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb5bc06aed0 0x7fb5bc06d390 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009b40 tx=0x7fb5c8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:36.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.568+0000 7fb5d83bb740 1 -- start start 2024-01-25T15:05:36.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.568+0000 7fb5d83bb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55adf5bb8ef0 0x55adf5bb92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.568+0000 7fb5d83bb740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bba200 0x55adf5bf5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.568+0000 7fb5d83bb740 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55adf5bf5580 0x55adf5bf35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.568+0000 7fb5d83bb740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adf5b27030 con 0x55adf5bba200 2024-01-25T15:05:36.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.569+0000 7fb5d83bb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adf5b24720 con 0x55adf5bb8ef0 2024-01-25T15:05:36.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.569+0000 7fb5d83bb740 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x55adf5b20010 con 0x55adf5bf5580 2024-01-25T15:05:36.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.569+0000 7fb5ce7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bba200 0x55adf5bf5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.569+0000 7fb5ce7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bba200 0x55adf5bf5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34136/0 (socket says 172.21.15.29:34136) 2024-01-25T15:05:36.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.569+0000 7fb5ce7fc640 1 -- 172.21.15.29:0/2108716727 learned_addr learned my addr 172.21.15.29:0/2108716727 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:36.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.569+0000 7fb5ceffd640 1 --2- 172.21.15.29:0/2108716727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55adf5bb8ef0 0x55adf5bb92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.569+0000 7fb5cf7fe640 1 --2- 172.21.15.29:0/2108716727 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55adf5bf5580 0x55adf5bf35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.569+0000 7fb5ce7fc640 1 -- 172.21.15.29:0/2108716727 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55adf5bf5580 msgr2=0x55adf5bf35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:36.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.569+0000 7fb5ce7fc640 1 --2- 172.21.15.29:0/2108716727 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55adf5bf5580 0x55adf5bf35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.569+0000 7fb5ce7fc640 1 -- 172.21.15.29:0/2108716727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55adf5bb8ef0 msgr2=0x55adf5bb92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:36.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.569+0000 7fb5ce7fc640 1 --2- 172.21.15.29:0/2108716727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55adf5bb8ef0 0x55adf5bb92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.569+0000 7fb5ce7fc640 1 -- 172.21.15.29:0/2108716727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55adf5ae2680 con 0x55adf5bba200 2024-01-25T15:05:36.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.569+0000 7fb5ce7fc640 1 --2- 172.21.15.29:0/2108716727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bba200 0x55adf5bf5040 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4087390 tx=0x7fb5c4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f697e2eb01c831 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:36.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.569+0000 7fb5b4ff9640 1 -- 172.21.15.29:0/2108716727 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c406f170 con 0x55adf5bba200 2024-01-25T15:05:36.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.569+0000 7fb5b4ff9640 1 -- 172.21.15.29:0/2108716727 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c405fd00 con 0x55adf5bba200 2024-01-25T15:05:36.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.569+0000 7fb5b4ff9640 1 -- 172.21.15.29:0/2108716727 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c40541c0 con 0x55adf5bba200 2024-01-25T15:05:36.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.570+0000 7fb5d83bb740 1 -- 172.21.15.29:0/2108716727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bba200 msgr2=0x55adf5bf5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:36.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.570+0000 7fb5d83bb740 1 --2- 172.21.15.29:0/2108716727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bba200 0x55adf5bf5040 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4087390 tx=0x7fb5c4001e70 comp rx=0 tx=0).stop 2024-01-25T15:05:36.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.570+0000 7fb5d83bb740 1 -- 172.21.15.29:0/2108716727 shutdown_connections 2024-01-25T15:05:36.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.570+0000 7fb5d83bb740 1 --2- 172.21.15.29:0/2108716727 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55adf5bf5580 0x55adf5bf35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.570+0000 7fb5d83bb740 1 --2- 172.21.15.29:0/2108716727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bba200 0x55adf5bf5040 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.570+0000 7fb5d83bb740 1 --2- 172.21.15.29:0/2108716727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55adf5bb8ef0 0x55adf5bb92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.570+0000 7fb5d83bb740 1 -- 172.21.15.29:0/2108716727 >> 172.21.15.29:0/2108716727 conn(0x55adf5bb5840 msgr2=0x55adf5bda250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:36.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.570+0000 7fb5d83bb740 1 -- 172.21.15.29:0/2108716727 shutdown_connections 2024-01-25T15:05:36.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.570+0000 7fb5d83bb740 1 -- 172.21.15.29:0/2108716727 wait complete. 2024-01-25T15:05:36.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.571+0000 7fb5d83bb740 1 -- start start 2024-01-25T15:05:36.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.571+0000 7fb5d83bb740 1 Processor -- start 2024-01-25T15:05:36.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.571+0000 7fb5d83bb740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bba200 0x55adf5bfa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.571+0000 7fb5d83bb740 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55adf5bf5580 0x55adf5bd8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.571+0000 7fb5d83bb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55adf5bdb340 0x55adf5bf1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.571+0000 7fb5d83bb740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adf5ad95f0 con 0x55adf5bba200 2024-01-25T15:05:36.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.571+0000 7fb5d83bb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adf5ad9290 con 0x55adf5bdb340 2024-01-25T15:05:36.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.571+0000 7fb5d83bb740 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x55adf5a9e300 con 0x55adf5bf5580 2024-01-25T15:05:36.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.571+0000 7fb5d83bb740 10 client.0 _ll_register_callbacks cb 0x55adf5ad4260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:05:36.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.571+0000 7fb5ceffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bba200 0x55adf5bfa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.571+0000 7fb5ceffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bba200 0x55adf5bfa060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34138/0 (socket says 172.21.15.29:34138) 2024-01-25T15:05:36.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.571+0000 7fb5ceffd640 1 -- 172.21.15.29:0/3916086081 learned_addr learned my addr 172.21.15.29:0/3916086081 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:36.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5cf7fe640 1 --2- 172.21.15.29:0/3916086081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55adf5bdb340 0x55adf5bf1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5ce7fc640 1 --2- 172.21.15.29:0/3916086081 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55adf5bf5580 0x55adf5bd8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5ceffd640 1 -- 172.21.15.29:0/3916086081 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55adf5bf5580 msgr2=0x55adf5bd8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:36.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5ceffd640 1 --2- 172.21.15.29:0/3916086081 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55adf5bf5580 0x55adf5bd8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5ceffd640 1 -- 172.21.15.29:0/3916086081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55adf5bdb340 msgr2=0x55adf5bf1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:36.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5ceffd640 1 --2- 172.21.15.29:0/3916086081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55adf5bdb340 0x55adf5bf1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5ceffd640 1 -- 172.21.15.29:0/3916086081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d00ab340 con 0x55adf5bba200 2024-01-25T15:05:36.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5ceffd640 1 --2- 172.21.15.29:0/3916086081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bba200 0x55adf5bfa060 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8003bc0 tx=0x7fb5c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb53d5b4ec9b28d8 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5adffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-01-25T15:05:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5adffb640 1 -- 172.21.15.29:0/3916086081 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8026070 con 0x55adf5bba200 2024-01-25T15:05:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5adffb640 1 -- 172.21.15.29:0/3916086081 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb5c802cc10 con 0x55adf5bba200 2024-01-25T15:05:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5d83bb740 1 -- 172.21.15.29:0/3916086081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55adf5b18ea0 con 0x55adf5bba200 2024-01-25T15:05:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5adffb640 1 -- 172.21.15.29:0/3916086081 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5c802cdd0 con 0x55adf5bba200 2024-01-25T15:05:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5d83bb740 10 client.5442 fetch_fsmap learned FSMap version 17 2024-01-25T15:05:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5d83bb740 1 -- 172.21.15.29:0/3916086081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55adf5b1e690 con 0x55adf5bba200 2024-01-25T15:05:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5adffb640 1 -- 172.21.15.29:0/3916086081 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55adf5b18ea0 con 0x55adf5bba200 2024-01-25T15:05:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5adffb640 1 -- 172.21.15.29:0/3916086081 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb5c801d040 con 0x55adf5bba200 2024-01-25T15:05:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5d83bb740 10 client.5442 fetch_fsmap finished waiting for FSMap version 17 2024-01-25T15:05:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5d83bb740 10 client.5442 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-25T15:05:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5d83bb740 20 client.5442 populate_metadata read hostname 'smithi029' 2024-01-25T15:05:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5d83bb740 1 --2- 172.21.15.29:0/3916086081 >> [v2:172.21.15.29:6833/3222226893,v1:172.21.15.29:6835/3222226893] conn(0x55adf5c08c00 0x55adf5c08fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5d83bb740 4 client.5442 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:05:36.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.572+0000 7fb5d83bb740 1 -- 172.21.15.29:0/3916086081 --> [v2:172.21.15.29:6833/3222226893,v1:172.21.15.29:6835/3222226893] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55adf5b18bc0 con 0x55adf5c08c00 2024-01-25T15:05:36.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.573+0000 7fb5ce7fc640 1 --2- 172.21.15.29:0/3916086081 >> [v2:172.21.15.29:6833/3222226893,v1:172.21.15.29:6835/3222226893] conn(0x55adf5c08c00 0x55adf5c08fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.573+0000 7fb5adffb640 10 client.5442 ms_handle_connect on v2:172.21.15.29:6833/3222226893 2024-01-25T15:05:36.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.573+0000 7fb5ce7fc640 1 --2- 172.21.15.29:0/3916086081 >> [v2:172.21.15.29:6833/3222226893,v1:172.21.15.29:6835/3222226893] conn(0x55adf5c08c00 0x55adf5c08fe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=987f7dffd256d3f8 server_cookie=7582b374599e3df5 in_seq=0 out_seq=0 2024-01-25T15:05:36.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.573+0000 7fb5adffb640 1 -- 172.21.15.29:0/3916086081 <== mds.0 v2:172.21.15.29:6833/3222226893 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55adf5b18bc0 con 0x55adf5c08c00 2024-01-25T15:05:36.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.573+0000 7fb5adffb640 10 client.5442 handle_command_reply: tid=0 2024-01-25T15:05:36.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.573+0000 7fb5d83bb740 1 client.5442 shutdown 2024-01-25T15:05:36.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.574+0000 7fb5d83bb740 1 -- 172.21.15.29:0/3916086081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bba200 msgr2=0x55adf5bfa060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:36.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.574+0000 7fb5d83bb740 1 --2- 172.21.15.29:0/3916086081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bba200 0x55adf5bfa060 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8003bc0 tx=0x7fb5c80046c0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.574+0000 7fb5d83bb740 1 -- 172.21.15.29:0/3916086081 shutdown_connections 2024-01-25T15:05:36.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.574+0000 7fb5d83bb740 1 --2- 172.21.15.29:0/3916086081 >> [v2:172.21.15.29:6833/3222226893,v1:172.21.15.29:6835/3222226893] conn(0x55adf5c08c00 0x55adf5c08fe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.574+0000 7fb5d83bb740 1 --2- 172.21.15.29:0/3916086081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55adf5bdb340 0x55adf5bf1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.574+0000 7fb5d83bb740 1 --2- 172.21.15.29:0/3916086081 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55adf5bf5580 0x55adf5bd8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.574+0000 7fb5d83bb740 1 --2- 172.21.15.29:0/3916086081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bba200 0x55adf5bfa060 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.574+0000 7fb5adffb640 0 client.5442 ms_handle_reset on v2:172.21.15.29:6833/3222226893 2024-01-25T15:05:36.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.574+0000 7fb5d83bb740 1 -- 172.21.15.29:0/3916086081 >> 172.21.15.29:0/3916086081 conn(0x55adf5bb8ef0 msgr2=0x55adf5bf3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:36.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.574+0000 7fb5d83bb740 1 -- 172.21.15.29:0/3916086081 shutdown_connections 2024-01-25T15:05:36.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.574+0000 7fb5d83bb740 1 -- 172.21.15.29:0/3916086081 wait complete. 2024-01-25T15:05:36.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.574+0000 7fb5d83bb740 20 client.5442 trim_cache size 0 max 16384 2024-01-25T15:05:36.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.590+0000 7fb5d83bb740 1 Processor -- start 2024-01-25T15:05:36.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.590+0000 7fb5d83bb740 1 -- start start 2024-01-25T15:05:36.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.590+0000 7fb5d83bb740 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55adf5bba200 0x55adf5baec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.590+0000 7fb5d83bb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55adf5bdb340 0x55adf5bf1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.590+0000 7fb5d83bb740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bf5580 0x55adf5bf1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.590+0000 7fb5d83bb740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adf5bd5270 con 0x55adf5bf5580 2024-01-25T15:05:36.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.590+0000 7fb5d83bb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adf5bd5860 con 0x55adf5bdb340 2024-01-25T15:05:36.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.590+0000 7fb5d83bb740 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x55adf5c17fa0 con 0x55adf5bba200 2024-01-25T15:05:36.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.591+0000 7fb5cf7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bf5580 0x55adf5bf1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.591+0000 7fb5cf7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bf5580 0x55adf5bf1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34148/0 (socket says 172.21.15.29:34148) 2024-01-25T15:05:36.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.591+0000 7fb5cf7fe640 1 -- 172.21.15.29:0/905028578 learned_addr learned my addr 172.21.15.29:0/905028578 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:36.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.591+0000 7fb5ceffd640 1 --2- 172.21.15.29:0/905028578 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55adf5bba200 0x55adf5baec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.591+0000 7fb5ce7fc640 1 --2- 172.21.15.29:0/905028578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55adf5bdb340 0x55adf5bf1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.591+0000 7fb5cf7fe640 1 -- 172.21.15.29:0/905028578 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55adf5bba200 msgr2=0x55adf5baec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:36.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.591+0000 7fb5cf7fe640 1 --2- 172.21.15.29:0/905028578 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55adf5bba200 0x55adf5baec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.591+0000 7fb5cf7fe640 1 -- 172.21.15.29:0/905028578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55adf5bdb340 msgr2=0x55adf5bf1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:36.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.591+0000 7fb5cf7fe640 1 --2- 172.21.15.29:0/905028578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55adf5bdb340 0x55adf5bf1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.591+0000 7fb5cf7fe640 1 -- 172.21.15.29:0/905028578 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55adf5abb390 con 0x55adf5bf5580 2024-01-25T15:05:36.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.591+0000 7fb5cf7fe640 1 --2- 172.21.15.29:0/905028578 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bf5580 0x55adf5bf1fb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0002230 tx=0x7fb5c002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf5054c808c7ca0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:36.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.591+0000 7fb5affff640 1 -- 172.21.15.29:0/905028578 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c002cda0 con 0x55adf5bf5580 2024-01-25T15:05:36.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.591+0000 7fb5affff640 1 -- 172.21.15.29:0/905028578 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c0003990 con 0x55adf5bf5580 2024-01-25T15:05:36.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.591+0000 7fb5affff640 1 -- 172.21.15.29:0/905028578 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0003d40 con 0x55adf5bf5580 2024-01-25T15:05:36.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.592+0000 7fb5d83bb740 1 -- 172.21.15.29:0/905028578 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bf5580 msgr2=0x55adf5bf1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:36.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.592+0000 7fb5d83bb740 1 --2- 172.21.15.29:0/905028578 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bf5580 0x55adf5bf1fb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0002230 tx=0x7fb5c002e070 comp rx=0 tx=0).stop 2024-01-25T15:05:36.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.592+0000 7fb5d83bb740 1 -- 172.21.15.29:0/905028578 shutdown_connections 2024-01-25T15:05:36.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.592+0000 7fb5d83bb740 1 --2- 172.21.15.29:0/905028578 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bf5580 0x55adf5bf1fb0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.592+0000 7fb5d83bb740 1 --2- 172.21.15.29:0/905028578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55adf5bdb340 0x55adf5bf1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.592+0000 7fb5d83bb740 1 --2- 172.21.15.29:0/905028578 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55adf5bba200 0x55adf5baec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.592+0000 7fb5d83bb740 1 -- 172.21.15.29:0/905028578 >> 172.21.15.29:0/905028578 conn(0x55adf5bb8ef0 msgr2=0x55adf5c0f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:36.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.592+0000 7fb5d83bb740 1 -- 172.21.15.29:0/905028578 shutdown_connections 2024-01-25T15:05:36.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.592+0000 7fb5d83bb740 1 -- 172.21.15.29:0/905028578 wait complete. 2024-01-25T15:05:36.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.592+0000 7fb5d83bb740 1 -- start start 2024-01-25T15:05:36.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.592+0000 7fb5d83bb740 1 Processor -- start 2024-01-25T15:05:36.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.593+0000 7fb5d83bb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55adf5bba200 0x55adf5bb4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.593+0000 7fb5d83bb740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bdb340 0x55adf5baf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.593+0000 7fb5d83bb740 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55adf5bf5580 0x55adf5bfdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.593+0000 7fb5d83bb740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adf5c65100 con 0x55adf5bdb340 2024-01-25T15:05:36.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.593+0000 7fb5d83bb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adf5bfed00 con 0x55adf5bba200 2024-01-25T15:05:36.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.593+0000 7fb5d83bb740 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x55adf5c02cf0 con 0x55adf5bf5580 2024-01-25T15:05:36.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.593+0000 7fb5d83bb740 10 client.0 _ll_register_callbacks cb 0x7fb5c4053e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:05:36.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.593+0000 7fb5ce7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bdb340 0x55adf5baf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.593+0000 7fb5ce7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bdb340 0x55adf5baf030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34162/0 (socket says 172.21.15.29:34162) 2024-01-25T15:05:36.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.593+0000 7fb5ce7fc640 1 -- 172.21.15.29:0/1496642022 learned_addr learned my addr 172.21.15.29:0/1496642022 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:36.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.593+0000 7fb5cf7fe640 1 --2- 172.21.15.29:0/1496642022 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55adf5bf5580 0x55adf5bfdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.593+0000 7fb5ceffd640 1 --2- 172.21.15.29:0/1496642022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55adf5bba200 0x55adf5bb4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.593+0000 7fb5ce7fc640 1 -- 172.21.15.29:0/1496642022 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55adf5bf5580 msgr2=0x55adf5bfdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:36.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.593+0000 7fb5ce7fc640 1 --2- 172.21.15.29:0/1496642022 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55adf5bf5580 0x55adf5bfdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.593+0000 7fb5ce7fc640 1 -- 172.21.15.29:0/1496642022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55adf5bba200 msgr2=0x55adf5bb4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:36.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.593+0000 7fb5ce7fc640 1 --2- 172.21.15.29:0/1496642022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55adf5bba200 0x55adf5bb4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.593+0000 7fb5ce7fc640 1 -- 172.21.15.29:0/1496642022 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b8003520 con 0x55adf5bdb340 2024-01-25T15:05:36.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.593+0000 7fb5ce7fc640 1 --2- 172.21.15.29:0/1496642022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bdb340 0x55adf5baf030 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4053fb0 tx=0x7fb5c405a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec627be739e2ca61 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:36.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.593+0000 7fb5adffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-01-25T15:05:36.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.594+0000 7fb5adffb640 1 -- 172.21.15.29:0/1496642022 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4057880 con 0x55adf5bdb340 2024-01-25T15:05:36.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.594+0000 7fb5adffb640 1 -- 172.21.15.29:0/1496642022 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb5c406cda0 con 0x55adf5bdb340 2024-01-25T15:05:36.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.594+0000 7fb5d83bb740 1 -- 172.21.15.29:0/1496642022 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb5c405fd00 con 0x55adf5bdb340 2024-01-25T15:05:36.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.594+0000 7fb5adffb640 1 -- 172.21.15.29:0/1496642022 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5c40541c0 con 0x55adf5bdb340 2024-01-25T15:05:36.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.594+0000 7fb5d83bb740 10 client.5448 fetch_fsmap learned FSMap version 17 2024-01-25T15:05:36.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.594+0000 7fb5d83bb740 1 -- 172.21.15.29:0/1496642022 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55adf5ae0ee0 con 0x55adf5bdb340 2024-01-25T15:05:36.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.594+0000 7fb5adffb640 1 -- 172.21.15.29:0/1496642022 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c405fd00 con 0x55adf5bdb340 2024-01-25T15:05:36.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.594+0000 7fb5adffb640 1 -- 172.21.15.29:0/1496642022 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb5c4012070 con 0x55adf5bdb340 2024-01-25T15:05:36.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.594+0000 7fb5d83bb740 10 client.5448 fetch_fsmap finished waiting for FSMap version 17 2024-01-25T15:05:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.594+0000 7fb5d83bb740 10 client.5448 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-25T15:05:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.594+0000 7fb5d83bb740 20 client.5448 populate_metadata read hostname 'smithi029' 2024-01-25T15:05:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.594+0000 7fb5d83bb740 1 --2- 172.21.15.29:0/1496642022 >> [v2:172.21.15.29:6833/3222226893,v1:172.21.15.29:6835/3222226893] conn(0x55adf5c49e80 0x55adf5bfa600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.594+0000 7fb5d83bb740 4 client.5448 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-25T15:05:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.594+0000 7fb5d83bb740 1 -- 172.21.15.29:0/1496642022 --> [v2:172.21.15.29:6833/3222226893,v1:172.21.15.29:6835/3222226893] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55adf581f6c0 con 0x55adf5c49e80 2024-01-25T15:05:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.594+0000 7fb5ceffd640 1 --2- 172.21.15.29:0/1496642022 >> [v2:172.21.15.29:6833/3222226893,v1:172.21.15.29:6835/3222226893] conn(0x55adf5c49e80 0x55adf5bfa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.594+0000 7fb5ceffd640 1 --2- 172.21.15.29:0/1496642022 >> [v2:172.21.15.29:6833/3222226893,v1:172.21.15.29:6835/3222226893] conn(0x55adf5c49e80 0x55adf5bfa600 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e6d4b36b9164a5b server_cookie=2f39ba0330e0019b in_seq=0 out_seq=0 2024-01-25T15:05:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.594+0000 7fb5adffb640 10 client.5448 ms_handle_connect on v2:172.21.15.29:6833/3222226893 2024-01-25T15:05:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5adffb640 1 -- 172.21.15.29:0/1496642022 <== mds.0 v2:172.21.15.29:6833/3222226893 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55adf581f6c0 con 0x55adf5c49e80 2024-01-25T15:05:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5adffb640 10 client.5448 handle_command_reply: tid=0 2024-01-25T15:05:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5d83bb740 1 client.5448 shutdown 2024-01-25T15:05:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5d83bb740 1 -- 172.21.15.29:0/1496642022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bdb340 msgr2=0x55adf5baf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5d83bb740 1 --2- 172.21.15.29:0/1496642022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bdb340 0x55adf5baf030 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4053fb0 tx=0x7fb5c405a000 comp rx=0 tx=0).stop 2024-01-25T15:05:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5d83bb740 1 -- 172.21.15.29:0/1496642022 shutdown_connections 2024-01-25T15:05:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5d83bb740 1 --2- 172.21.15.29:0/1496642022 >> [v2:172.21.15.29:6833/3222226893,v1:172.21.15.29:6835/3222226893] conn(0x55adf5c49e80 0x55adf5bfa600 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5d83bb740 1 --2- 172.21.15.29:0/1496642022 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55adf5bf5580 0x55adf5bfdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5adffb640 0 client.5448 ms_handle_reset on v2:172.21.15.29:6833/3222226893 2024-01-25T15:05:36.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5d83bb740 1 --2- 172.21.15.29:0/1496642022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55adf5bdb340 0x55adf5baf030 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5d83bb740 1 --2- 172.21.15.29:0/1496642022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55adf5bba200 0x55adf5bb4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5d83bb740 1 -- 172.21.15.29:0/1496642022 >> 172.21.15.29:0/1496642022 conn(0x55adf5bb8ef0 msgr2=0x55adf5bf3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:36.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5d83bb740 1 -- 172.21.15.29:0/1496642022 shutdown_connections 2024-01-25T15:05:36.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5d83bb740 1 -- 172.21.15.29:0/1496642022 wait complete. 2024-01-25T15:05:36.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5d83bb740 20 client.5448 trim_cache size 0 max 16384 2024-01-25T15:05:36.602 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-25T15:05:36.602 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "3f65c5fb-9e8c-471f-b2c4-a9841e901c7a", 2024-01-25T15:05:36.602 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2024-01-25T15:05:36.602 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 5250, 2024-01-25T15:05:36.602 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-01-25T15:05:36.603 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-01-25T15:05:36.603 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-01-25T15:05:36.603 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 9.3814556949999997, 2024-01-25T15:05:36.603 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 17, 2024-01-25T15:05:36.603 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 38, 2024-01-25T15:05:36.603 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 38, 2024-01-25T15:05:36.603 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 16.260412106 2024-01-25T15:05:36.603 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-25T15:05:36.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5d57ea640 1 -- 172.21.15.29:0/2433464016 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb5bc06aed0 msgr2=0x7fb5bc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:36.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5d57ea640 1 --2- 172.21.15.29:0/2433464016 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb5bc06aed0 0x7fb5bc06d390 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009b40 tx=0x7fb5c8009190 comp rx=0 tx=0).stop 2024-01-25T15:05:36.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5d57ea640 1 -- 172.21.15.29:0/2433464016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5d01eb2e0 msgr2=0x7fb5d00aae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:36.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5d57ea640 1 --2- 172.21.15.29:0/2433464016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5d01eb2e0 0x7fb5d00aae00 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb5c40072c0 tx=0x7fb5c40076c0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5d57ea640 1 -- 172.21.15.29:0/2433464016 shutdown_connections 2024-01-25T15:05:36.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5d57ea640 1 --2- 172.21.15.29:0/2433464016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d014cfa0 0x7fb5d01eda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5d57ea640 1 --2- 172.21.15.29:0/2433464016 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb5bc06aed0 0x7fb5bc06d390 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5d57ea640 1 --2- 172.21.15.29:0/2433464016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5d01eb2e0 0x7fb5d00aae00 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5d57ea640 1 --2- 172.21.15.29:0/2433464016 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb5b8004d00 0x7fb5d01ea820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.595+0000 7fb5d57ea640 1 -- 172.21.15.29:0/2433464016 >> 172.21.15.29:0/2433464016 conn(0x7fb5d00ca1f0 msgr2=0x7fb5d00c70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:36.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.596+0000 7fb5d57ea640 1 -- 172.21.15.29:0/2433464016 shutdown_connections 2024-01-25T15:05:36.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.596+0000 7fb5d57ea640 1 -- 172.21.15.29:0/2433464016 wait complete. 2024-01-25T15:05:36.607 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-25T15:05:36.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.707+0000 7fdc0052c640 1 Processor -- start 2024-01-25T15:05:36.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.707+0000 7fdc0052c640 1 -- start start 2024-01-25T15:05:36.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.708+0000 7fdc0052c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdbf8152160 0x7fdbf806bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.708+0000 7fdc0052c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdbf80c4990 0x7fdbf80c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.708+0000 7fdc0052c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf8155430 con 0x7fdbf80c53e0 2024-01-25T15:05:36.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.708+0000 7fdc0052c640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf8154b40 con 0x7fdbf8152160 2024-01-25T15:05:36.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.708+0000 7fdc0052c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf8152540 con 0x7fdbf80c4990 2024-01-25T15:05:36.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.708+0000 7fdbfeac9640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fdbf80c53e0 0x7fdbf80c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42590/0 (socket says 172.21.15.29:42590) 2024-01-25T15:05:36.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.708+0000 7fdbfeac9640 1 -- 172.21.15.29:0/2104341116 learned_addr learned my addr 172.21.15.29:0/2104341116 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:36.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.708+0000 7fdbfe2c8640 1 --2- 172.21.15.29:0/2104341116 >> v2:172.21.15.52:3300/0 conn(0x7fdbf8152160 0x7fdbf806bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.708+0000 7fdbfdac7640 1 --2- 172.21.15.29:0/2104341116 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdbf80c4990 0x7fdbf80c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.708+0000 7fdbfd2c6640 1 -- 172.21.15.29:0/2104341116 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954867730 0 0) 0x7fdbf8155430 con 0x7fdbf80c53e0 2024-01-25T15:05:36.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.708+0000 7fdbfd2c6640 1 -- 172.21.15.29:0/2104341116 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbe0003520 con 0x7fdbf80c53e0 2024-01-25T15:05:36.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.709+0000 7fdbfe2c8640 1 -- 172.21.15.29:0/2104341116 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdbf80c4990 msgr2=0x7fdbf80c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:36.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.709+0000 7fdbfe2c8640 1 --2- 172.21.15.29:0/2104341116 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdbf80c4990 0x7fdbf80c4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.709+0000 7fdbfe2c8640 1 -- 172.21.15.29:0/2104341116 >> v1:172.21.15.29:6789/0 conn(0x7fdbf80c53e0 legacy=0x7fdbf80c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:36.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.709+0000 7fdbfe2c8640 1 -- 172.21.15.29:0/2104341116 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf80c64b0 con 0x7fdbf8152160 2024-01-25T15:05:36.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.709+0000 7fdbfdac7640 1 --2- 172.21.15.29:0/2104341116 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdbf80c4990 0x7fdbf80c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:05:36.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.709+0000 7fdbfe2c8640 1 --2- 172.21.15.29:0/2104341116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbf8152160 0x7fdbf806bc00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdbf00097a0 tx=0x7fdbf002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e6eae448f2c203a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:36.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.710+0000 7fdbfd2c6640 1 -- 172.21.15.29:0/2104341116 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf002e070 con 0x7fdbf8152160 2024-01-25T15:05:36.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.710+0000 7fdbfd2c6640 1 -- 172.21.15.29:0/2104341116 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf00315a0 con 0x7fdbf8152160 2024-01-25T15:05:36.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.710+0000 7fdbfd2c6640 1 -- 172.21.15.29:0/2104341116 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0031930 con 0x7fdbf8152160 2024-01-25T15:05:36.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.710+0000 7fdc0052c640 1 -- 172.21.15.29:0/2104341116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbf8152160 msgr2=0x7fdbf806bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:36.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.710+0000 7fdc0052c640 1 --2- 172.21.15.29:0/2104341116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbf8152160 0x7fdbf806bc00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdbf00097a0 tx=0x7fdbf002b840 comp rx=0 tx=0).stop 2024-01-25T15:05:36.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.710+0000 7fdc0052c640 1 -- 172.21.15.29:0/2104341116 shutdown_connections 2024-01-25T15:05:36.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.710+0000 7fdc0052c640 1 --2- 172.21.15.29:0/2104341116 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdbf80c4990 0x7fdbf80c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.710+0000 7fdc0052c640 1 --2- 172.21.15.29:0/2104341116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbf8152160 0x7fdbf806bc00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.710+0000 7fdc0052c640 1 -- 172.21.15.29:0/2104341116 >> 172.21.15.29:0/2104341116 conn(0x7fdbf80ca1f0 msgr2=0x7fdbf80ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:36.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.710+0000 7fdc0052c640 1 -- 172.21.15.29:0/2104341116 shutdown_connections 2024-01-25T15:05:36.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.710+0000 7fdc0052c640 1 -- 172.21.15.29:0/2104341116 wait complete. 2024-01-25T15:05:36.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.711+0000 7fdc0052c640 1 Processor -- start 2024-01-25T15:05:36.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.711+0000 7fdc0052c640 1 -- start start 2024-01-25T15:05:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.712+0000 7fdc0052c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbf80c4990 0x7fdbf8148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.712+0000 7fdc0052c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf80c53e0 0x7fdbf80bfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.712+0000 7fdc0052c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdbf8152160 0x7fdbf80aab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.712+0000 7fdc0052c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf8148d70 con 0x7fdbf80c53e0 2024-01-25T15:05:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.712+0000 7fdc0052c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf814fa80 con 0x7fdbf80c4990 2024-01-25T15:05:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.712+0000 7fdc0052c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf8148550 con 0x7fdbf8152160 2024-01-25T15:05:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.712+0000 7fdbfdac7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf80c53e0 0x7fdbf80bfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.712+0000 7fdbfdac7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf80c53e0 0x7fdbf80bfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34168/0 (socket says 172.21.15.29:34168) 2024-01-25T15:05:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.712+0000 7fdbfdac7640 1 -- 172.21.15.29:0/4034320036 learned_addr learned my addr 172.21.15.29:0/4034320036 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.712+0000 7fdbfe2c8640 1 --2- 172.21.15.29:0/4034320036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbf80c4990 0x7fdbf8148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.712+0000 7fdbfeac9640 1 --2- 172.21.15.29:0/4034320036 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdbf8152160 0x7fdbf80aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.712+0000 7fdbfdac7640 1 -- 172.21.15.29:0/4034320036 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdbf8152160 msgr2=0x7fdbf80aab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.712+0000 7fdbfdac7640 1 --2- 172.21.15.29:0/4034320036 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdbf8152160 0x7fdbf80aab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.712+0000 7fdbfdac7640 1 -- 172.21.15.29:0/4034320036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbf80c4990 msgr2=0x7fdbf8148830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.712+0000 7fdbfdac7640 1 --2- 172.21.15.29:0/4034320036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbf80c4990 0x7fdbf8148830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.712+0000 7fdbfdac7640 1 -- 172.21.15.29:0/4034320036 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbec009400 con 0x7fdbf80c53e0 2024-01-25T15:05:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.712+0000 7fdbfe2c8640 1 --2- 172.21.15.29:0/4034320036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbf80c4990 0x7fdbf8148830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.713+0000 7fdbfdac7640 1 --2- 172.21.15.29:0/4034320036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf80c53e0 0x7fdbf80bfb00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00e9b0 tx=0x7fdbec00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.713+0000 7fdbf6ffd640 1 -- 172.21.15.29:0/4034320036 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec00ca00 con 0x7fdbf80c53e0 2024-01-25T15:05:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.713+0000 7fdbf6ffd640 1 -- 172.21.15.29:0/4034320036 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec00cb60 con 0x7fdbf80c53e0 2024-01-25T15:05:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.713+0000 7fdbf6ffd640 1 -- 172.21.15.29:0/4034320036 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec013470 con 0x7fdbf80c53e0 2024-01-25T15:05:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.713+0000 7fdc0052c640 1 -- 172.21.15.29:0/4034320036 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf0009400 con 0x7fdbf80c53e0 2024-01-25T15:05:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.713+0000 7fdc0052c640 1 -- 172.21.15.29:0/4034320036 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf81588b0 con 0x7fdbf80c53e0 2024-01-25T15:05:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.714+0000 7fdc0052c640 1 -- 172.21.15.29:0/4034320036 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf81558a0 con 0x7fdbf80c53e0 2024-01-25T15:05:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.714+0000 7fdbf6ffd640 1 -- 172.21.15.29:0/4034320036 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fdbec0135d0 con 0x7fdbf80c53e0 2024-01-25T15:05:36.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.715+0000 7fdbf6ffd640 1 --2- 172.21.15.29:0/4034320036 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdbe406aed0 0x7fdbe406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:36.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.715+0000 7fdbf6ffd640 1 -- 172.21.15.29:0/4034320036 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdbec0897c0 con 0x7fdbf80c53e0 2024-01-25T15:05:36.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.715+0000 7fdbfe2c8640 1 --2- 172.21.15.29:0/4034320036 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdbe406aed0 0x7fdbe406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:36.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.715+0000 7fdbfe2c8640 1 --2- 172.21.15.29:0/4034320036 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdbe406aed0 0x7fdbe406d390 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0036000 tx=0x7fdbf003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:36.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.719+0000 7fdbf6ffd640 1 -- 172.21.15.29:0/4034320036 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fdbf81558a0 con 0x7fdbf80c53e0 2024-01-25T15:05:36.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.936+0000 7fdc0052c640 1 -- 172.21.15.29:0/4034320036 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdbf81558a0 con 0x7fdbf80c53e0 2024-01-25T15:05:36.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.936+0000 7fdbf6ffd640 1 -- 172.21.15.29:0/4034320036 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdbf81558a0 con 0x7fdbf80c53e0 2024-01-25T15:05:36.937 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-25T15:05:36.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.938+0000 7fdc0052c640 1 -- 172.21.15.29:0/4034320036 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdbe406aed0 msgr2=0x7fdbe406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:36.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.938+0000 7fdc0052c640 1 --2- 172.21.15.29:0/4034320036 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdbe406aed0 0x7fdbe406d390 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0036000 tx=0x7fdbf003d040 comp rx=0 tx=0).stop 2024-01-25T15:05:36.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.938+0000 7fdc0052c640 1 -- 172.21.15.29:0/4034320036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf80c53e0 msgr2=0x7fdbf80bfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:36.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.938+0000 7fdc0052c640 1 --2- 172.21.15.29:0/4034320036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf80c53e0 0x7fdbf80bfb00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00e9b0 tx=0x7fdbec00ee70 comp rx=0 tx=0).stop 2024-01-25T15:05:36.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.938+0000 7fdc0052c640 1 -- 172.21.15.29:0/4034320036 shutdown_connections 2024-01-25T15:05:36.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.938+0000 7fdc0052c640 1 --2- 172.21.15.29:0/4034320036 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdbf8152160 0x7fdbf80aab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.938+0000 7fdc0052c640 1 --2- 172.21.15.29:0/4034320036 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdbe406aed0 0x7fdbe406d390 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.938+0000 7fdc0052c640 1 --2- 172.21.15.29:0/4034320036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf80c53e0 0x7fdbf80bfb00 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.938+0000 7fdc0052c640 1 --2- 172.21.15.29:0/4034320036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbf80c4990 0x7fdbf8148830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:36.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.938+0000 7fdc0052c640 1 -- 172.21.15.29:0/4034320036 >> 172.21.15.29:0/4034320036 conn(0x7fdbf80ca1f0 msgr2=0x7fdbf80c86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:36.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.938+0000 7fdc0052c640 1 -- 172.21.15.29:0/4034320036 shutdown_connections 2024-01-25T15:05:36.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:36.938+0000 7fdc0052c640 1 -- 172.21.15.29:0/4034320036 wait complete. 2024-01-25T15:05:36.949 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-25T15:05:36.949 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-25T15:05:36.949 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-01-25T15:05:36.949 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-25T15:05:36.949 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-25T15:05:36.949 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-25T15:05:36.950 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-25T15:05:36.950 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-25T15:05:36.950 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-25T15:05:36.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:36.950 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-01-25T15:05:36.965 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-25T15:05:36.965 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-25T15:05:36.965 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-01-25T15:05:36.965 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:36.965 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-01-25T15:05:36.965 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:36.965 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:05:36.966 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-01-25T15:05:36.966 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2024-01-25T15:05:36.966 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:05:36.966 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-01-25T15:05:36.966 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2024-01-25T15:05:36.966 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-25T15:05:36.966 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-01-25T15:05:36.966 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2024-01-25T15:05:36.966 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-01-25T15:05:36.966 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42650sec preferred_lft 42650sec 2024-01-25T15:05:36.966 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link noprefixroute 2024-01-25T15:05:36.966 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:36.966 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:05:36.966 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-01-25T15:05:36.966 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2024-01-25T15:05:36.967 INFO:teuthology.orchestra.run.smithi029.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-25T15:05:36.967 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether f2:5a:78:7f:5a:d7 brd ff:ff:ff:ff:ff:ff 2024-01-25T15:05:36.967 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-25T15:05:36.967 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:36.967 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::24f2:8aff:fe6e:4acd/64 scope link 2024-01-25T15:05:36.967 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:36.967 INFO:teuthology.orchestra.run.smithi029.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-25T15:05:36.967 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether f2:5a:78:7f:5a:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-25T15:05:36.967 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::f05a:78ff:fe7f:5ad7/64 scope link 2024-01-25T15:05:36.967 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:36.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:36.968 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-25T15:05:37.031 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-01-25T15:05:37.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:37.032 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-01-25T15:05:37.088 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-01-25T15:05:37.088 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-25T15:05:37.088 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-01-25T15:05:37.088 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-01-25T15:05:37.088 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-25T15:05:37.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:37.091 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-25T15:05:37.091 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-25T15:05:37.091 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-25T15:05:37.092 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-25T15:05:37.092 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-25T15:05:37.092 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-25T15:05:37.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:37.184 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-01-25T15:05:37.198 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-25T15:05:37.198 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-25T15:05:37.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:37.199 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2024-01-25T15:05:37.265 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-25T15:05:37.265 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-25T15:05:37.320 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-25T15:05:37.320 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-25T15:05:37.321 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-25T15:05:37.374 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-01-25T15:05:37.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:37.375 DEBUG:teuthology.orchestra.run.smithi029:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-25T15:05:37.459 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-25T15:05:37.459 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-25T15:05:37.469 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-25T15:05:37.469 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-25T15:05:37.469 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.52:3300,172.21.15.52:3301" 2024-01-25T15:05:37.469 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with new device syntax: 0@3f65c5fb-9e8c-471f-b2c4-a9841e901c7a.cephfs=/ 2024-01-25T15:05:37.470 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.29:3300/172.21.15.52:3300/172.21.15.52:3301" will pass to kernel 2024-01-25T15:05:37.470 INFO:teuthology.orchestra.run.smithi029.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-01-25T15:05:37.470 INFO:teuthology.orchestra.run.smithi029.stdout: You just mounted a file system that supports labels which does not 2024-01-25T15:05:37.470 INFO:teuthology.orchestra.run.smithi029.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-25T15:05:37.470 INFO:teuthology.orchestra.run.smithi029.stdout: applications will generate AVC messages and not be allowed access to 2024-01-25T15:05:37.470 INFO:teuthology.orchestra.run.smithi029.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-25T15:05:37.472 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-25T15:05:37.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:37.472 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-25T15:05:37.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:37.502 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-25T15:05:37.561 INFO:teuthology.orchestra.run.smithi029.stdout:client4961 2024-01-25T15:05:37.561 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:05:37.561 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:05:37.616 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-25T15:05:37.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.758+0000 7f4d5317d640 1 Processor -- start 2024-01-25T15:05:37.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.758+0000 7f4d5317d640 1 -- start start 2024-01-25T15:05:37.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.759+0000 7f4d5317d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4d4c0c66b0 0x7f4d4c06b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.759+0000 7f4d5317d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d4c1551a0 0x7f4d4c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.759+0000 7f4d5317d640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4c1521d0 con 0x7f4d4c06b2b0 2024-01-25T15:05:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.759+0000 7f4d5317d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4c06be50 con 0x7f4d4c0c66b0 2024-01-25T15:05:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.759+0000 7f4d5317d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c0c5b10 con 0x7f4d4c1551a0 2024-01-25T15:05:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.759+0000 7f4d4bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4d4c0c66b0 0x7f4d4c06b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.759+0000 7f4d50f19640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4d4c06b2b0 0x7f4d4c0c5fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42606/0 (socket says 172.21.15.29:42606) 2024-01-25T15:05:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.759+0000 7f4d4bfff640 1 --2- 172.21.15.29:0/3006053753 >> v2:172.21.15.29:3300/0 conn(0x7f4d4c0c66b0 0x7f4d4c06b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34174/0 (socket says 172.21.15.29:34174) 2024-01-25T15:05:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.759+0000 7f4d50f19640 1 -- 172.21.15.29:0/3006053753 learned_addr learned my addr 172.21.15.29:0/3006053753 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.759+0000 7f4d5171a640 1 --2- 172.21.15.29:0/3006053753 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d4c1551a0 0x7f4d4c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.759+0000 7f4d4bfff640 1 -- 172.21.15.29:0/3006053753 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d4c1551a0 msgr2=0x7f4d4c15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.759+0000 7f4d4bfff640 1 --2- 172.21.15.29:0/3006053753 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d4c1551a0 0x7f4d4c15f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.759+0000 7f4d4bfff640 1 -- 172.21.15.29:0/3006053753 >> v1:172.21.15.29:6789/0 conn(0x7f4d4c06b2b0 legacy=0x7f4d4c0c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.759+0000 7f4d4bfff640 1 -- 172.21.15.29:0/3006053753 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c0c4f20 con 0x7f4d4c0c66b0 2024-01-25T15:05:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.760+0000 7f4d4bfff640 1 --2- 172.21.15.29:0/3006053753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d4c0c66b0 0x7f4d4c06b690 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4d380097a0 tx=0x7f4d3802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25facf27d281c22c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:37.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.760+0000 7f4d4b7fe640 1 -- 172.21.15.29:0/3006053753 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3802e070 con 0x7f4d4c0c66b0 2024-01-25T15:05:37.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.760+0000 7f4d4b7fe640 1 -- 172.21.15.29:0/3006053753 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d380315a0 con 0x7f4d4c0c66b0 2024-01-25T15:05:37.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.760+0000 7f4d4b7fe640 1 -- 172.21.15.29:0/3006053753 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38031930 con 0x7f4d4c0c66b0 2024-01-25T15:05:37.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.760+0000 7f4d5317d640 1 -- 172.21.15.29:0/3006053753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d4c0c66b0 msgr2=0x7f4d4c06b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.760+0000 7f4d5317d640 1 --2- 172.21.15.29:0/3006053753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d4c0c66b0 0x7f4d4c06b690 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4d380097a0 tx=0x7f4d3802b840 comp rx=0 tx=0).stop 2024-01-25T15:05:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.761+0000 7f4d5317d640 1 -- 172.21.15.29:0/3006053753 shutdown_connections 2024-01-25T15:05:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.761+0000 7f4d5317d640 1 --2- 172.21.15.29:0/3006053753 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d4c1551a0 0x7f4d4c15f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.761+0000 7f4d5317d640 1 --2- 172.21.15.29:0/3006053753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d4c0c66b0 0x7f4d4c06b690 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.761+0000 7f4d5317d640 1 -- 172.21.15.29:0/3006053753 >> 172.21.15.29:0/3006053753 conn(0x7f4d4c0ca1f0 msgr2=0x7f4d4c0ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.761+0000 7f4d5317d640 1 -- 172.21.15.29:0/3006053753 shutdown_connections 2024-01-25T15:05:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.761+0000 7f4d5317d640 1 -- 172.21.15.29:0/3006053753 wait complete. 2024-01-25T15:05:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.762+0000 7f4d5317d640 1 Processor -- start 2024-01-25T15:05:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.762+0000 7f4d5317d640 1 -- start start 2024-01-25T15:05:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.762+0000 7f4d5317d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d4c06b2b0 0x7f4d4c14c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.762+0000 7f4d5317d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d4c0c66b0 0x7f4d4c14deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.762+0000 7f4d5317d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d4c1551a0 0x7f4d4c1eada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.762+0000 7f4d5317d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c148f70 con 0x7f4d4c1551a0 2024-01-25T15:05:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.762+0000 7f4d5317d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c1e0110 con 0x7f4d4c0c66b0 2024-01-25T15:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.762+0000 7f4d5317d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c1dfb50 con 0x7f4d4c06b2b0 2024-01-25T15:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.763+0000 7f4d5171a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d4c1551a0 0x7f4d4c1eada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.763+0000 7f4d5171a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d4c1551a0 0x7f4d4c1eada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34184/0 (socket says 172.21.15.29:34184) 2024-01-25T15:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.763+0000 7f4d5171a640 1 -- 172.21.15.29:0/2131762617 learned_addr learned my addr 172.21.15.29:0/2131762617 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.763+0000 7f4d5171a640 1 -- 172.21.15.29:0/2131762617 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d4c06b2b0 msgr2=0x7f4d4c14c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.763+0000 7f4d5171a640 1 --2- 172.21.15.29:0/2131762617 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d4c06b2b0 0x7f4d4c14c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.763+0000 7f4d5171a640 1 -- 172.21.15.29:0/2131762617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d4c0c66b0 msgr2=0x7f4d4c14deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.763+0000 7f4d4bfff640 1 --2- 172.21.15.29:0/2131762617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d4c0c66b0 0x7f4d4c14deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.763+0000 7f4d5171a640 1 --2- 172.21.15.29:0/2131762617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d4c0c66b0 0x7f4d4c14deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.763+0000 7f4d5171a640 1 -- 172.21.15.29:0/2131762617 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d38009400 con 0x7f4d4c1551a0 2024-01-25T15:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.763+0000 7f4d5171a640 1 --2- 172.21.15.29:0/2131762617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d4c1551a0 0x7f4d4c1eada0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4d44007cf0 tx=0x7f4d4400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.763+0000 7f4d497fa640 1 -- 172.21.15.29:0/2131762617 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44014420 con 0x7f4d4c1551a0 2024-01-25T15:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.763+0000 7f4d497fa640 1 -- 172.21.15.29:0/2131762617 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d440145a0 con 0x7f4d4c1551a0 2024-01-25T15:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.763+0000 7f4d497fa640 1 -- 172.21.15.29:0/2131762617 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44014950 con 0x7f4d4c1551a0 2024-01-25T15:05:37.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.763+0000 7f4d5317d640 1 -- 172.21.15.29:0/2131762617 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4c1dfe30 con 0x7f4d4c1551a0 2024-01-25T15:05:37.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.763+0000 7f4d5317d640 1 -- 172.21.15.29:0/2131762617 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4c1ea880 con 0x7f4d4c1551a0 2024-01-25T15:05:37.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.764+0000 7f4d5317d640 1 -- 172.21.15.29:0/2131762617 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4c074080 con 0x7f4d4c1551a0 2024-01-25T15:05:37.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.765+0000 7f4d497fa640 1 -- 172.21.15.29:0/2131762617 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4d44014ab0 con 0x7f4d4c1551a0 2024-01-25T15:05:37.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.765+0000 7f4d497fa640 1 --2- 172.21.15.29:0/2131762617 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4d3006af00 0x7f4d3006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:37.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.765+0000 7f4d497fa640 1 -- 172.21.15.29:0/2131762617 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4d44089f60 con 0x7f4d4c1551a0 2024-01-25T15:05:37.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.765+0000 7f4d50f19640 1 --2- 172.21.15.29:0/2131762617 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4d3006af00 0x7f4d3006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:37.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.766+0000 7f4d50f19640 1 --2- 172.21.15.29:0/2131762617 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4d3006af00 0x7f4d3006d3c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4d40000f60 tx=0x7f4d40007a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:37.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.770+0000 7f4d497fa640 1 -- 172.21.15.29:0/2131762617 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4d44054d80 con 0x7f4d4c1551a0 2024-01-25T15:05:37.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.985+0000 7f4d5317d640 1 -- 172.21.15.29:0/2131762617 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4d4c0c9a70 con 0x7f4d4c1551a0 2024-01-25T15:05:37.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.986+0000 7f4d497fa640 1 -- 172.21.15.29:0/2131762617 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4d440583a0 con 0x7f4d4c1551a0 2024-01-25T15:05:37.986 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-25T15:05:37.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.987+0000 7f4d5317d640 1 -- 172.21.15.29:0/2131762617 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4d3006af00 msgr2=0x7f4d3006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:37.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.987+0000 7f4d5317d640 1 --2- 172.21.15.29:0/2131762617 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4d3006af00 0x7f4d3006d3c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4d40000f60 tx=0x7f4d40007a80 comp rx=0 tx=0).stop 2024-01-25T15:05:37.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.987+0000 7f4d5317d640 1 -- 172.21.15.29:0/2131762617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d4c1551a0 msgr2=0x7f4d4c1eada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:37.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.987+0000 7f4d5317d640 1 --2- 172.21.15.29:0/2131762617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d4c1551a0 0x7f4d4c1eada0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4d44007cf0 tx=0x7f4d4400e4b0 comp rx=0 tx=0).stop 2024-01-25T15:05:37.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.987+0000 7f4d5317d640 1 -- 172.21.15.29:0/2131762617 shutdown_connections 2024-01-25T15:05:37.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.987+0000 7f4d5317d640 1 --2- 172.21.15.29:0/2131762617 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4d3006af00 0x7f4d3006d3c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:37.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.987+0000 7f4d5317d640 1 --2- 172.21.15.29:0/2131762617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d4c1551a0 0x7f4d4c1eada0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:37.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.987+0000 7f4d5317d640 1 --2- 172.21.15.29:0/2131762617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d4c0c66b0 0x7f4d4c14deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:37.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.987+0000 7f4d5317d640 1 --2- 172.21.15.29:0/2131762617 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d4c06b2b0 0x7f4d4c14c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:37.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.987+0000 7f4d5317d640 1 -- 172.21.15.29:0/2131762617 >> 172.21.15.29:0/2131762617 conn(0x7f4d4c0ca1f0 msgr2=0x7f4d4c0a99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:37.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.988+0000 7f4d5317d640 1 -- 172.21.15.29:0/2131762617 shutdown_connections 2024-01-25T15:05:37.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:37.988+0000 7f4d5317d640 1 -- 172.21.15.29:0/2131762617 wait complete. 2024-01-25T15:05:37.999 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-25T15:05:37.999 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-25T15:05:37.999 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-01-25T15:05:37.999 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-25T15:05:37.999 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-25T15:05:37.999 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-25T15:05:37.999 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-25T15:05:37.999 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-25T15:05:37.999 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-25T15:05:37.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:38.000 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-01-25T15:05:38.018 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-25T15:05:38.018 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-25T15:05:38.018 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-01-25T15:05:38.019 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:38.019 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-01-25T15:05:38.019 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:38.019 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:05:38.019 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-01-25T15:05:38.019 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-01-25T15:05:38.019 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:05:38.019 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-01-25T15:05:38.019 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-01-25T15:05:38.019 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-25T15:05:38.019 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-01-25T15:05:38.019 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-01-25T15:05:38.019 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-01-25T15:05:38.019 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42640sec preferred_lft 42640sec 2024-01-25T15:05:38.019 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link noprefixroute 2024-01-25T15:05:38.019 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:38.019 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:05:38.020 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-01-25T15:05:38.020 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-01-25T15:05:38.020 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-25T15:05:38.020 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether de:0a:fe:fc:c7:d3 brd ff:ff:ff:ff:ff:ff 2024-01-25T15:05:38.020 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-25T15:05:38.020 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:38.020 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::9810:c4ff:fe64:1765/64 scope link 2024-01-25T15:05:38.020 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:38.020 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-25T15:05:38.020 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether de:0a:fe:fc:c7:d3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-25T15:05:38.020 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::dc0a:feff:fefc:c7d3/64 scope link 2024-01-25T15:05:38.020 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:38.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:38.021 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-25T15:05:38.088 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-01-25T15:05:38.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:38.090 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-01-25T15:05:38.149 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-01-25T15:05:38.149 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-25T15:05:38.149 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-01-25T15:05:38.149 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-01-25T15:05:38.149 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-25T15:05:38.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:38.150 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2024-01-25T15:05:38.150 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-01-25T15:05:38.150 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-25T15:05:38.150 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-25T15:05:38.150 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-25T15:05:38.150 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-01-25T15:05:38.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:38.250 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-01-25T15:05:38.265 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-25T15:05:38.266 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-25T15:05:38.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:38.266 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-01-25T15:05:38.334 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-25T15:05:38.334 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-25T15:05:38.389 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-25T15:05:38.389 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-25T15:05:38.389 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-25T15:05:38.444 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-01-25T15:05:38.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:38.445 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-25T15:05:38.529 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-25T15:05:38.530 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-25T15:05:38.542 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-25T15:05:38.542 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-25T15:05:38.543 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.52:3300,172.21.15.52:3301" 2024-01-25T15:05:38.543 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with new device syntax: 1@3f65c5fb-9e8c-471f-b2c4-a9841e901c7a.cephfs=/ 2024-01-25T15:05:38.543 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.29:3300/172.21.15.52:3300/172.21.15.52:3301" will pass to kernel 2024-01-25T15:05:38.543 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-01-25T15:05:38.544 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-01-25T15:05:38.544 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-25T15:05:38.544 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-01-25T15:05:38.544 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-25T15:05:38.545 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-25T15:05:38.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:38.545 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-25T15:05:38.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:38.572 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-25T15:05:38.628 INFO:teuthology.orchestra.run.smithi052.stdout:client4967 2024-01-25T15:05:38.629 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:05:38.629 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:05:38.683 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2024-01-25T15:05:38.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.798+0000 7efdc2c61640 1 Processor -- start 2024-01-25T15:05:38.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.798+0000 7efdc2c61640 1 -- start start 2024-01-25T15:05:38.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.799+0000 7efdc2c61640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efdbc153320 0x7efdbc0c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:38.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.799+0000 7efdc2c61640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdbc0ac290 con 0x7efdbc0707a0 2024-01-25T15:05:38.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.799+0000 7efdc2c61640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdbc0ac4c0 con 0x7efdbc0c4910 2024-01-25T15:05:38.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.799+0000 7efdc2c61640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdbc153890 con 0x7efdbc153320 2024-01-25T15:05:38.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.799+0000 7efdbbfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efdbc153320 0x7efdbc0c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:38.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.799+0000 7efdc11fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7efdbc0707a0 0x7efdbc0c5d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42620/0 (socket says 172.21.15.29:42620) 2024-01-25T15:05:38.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.799+0000 7efdc11fe640 1 -- 172.21.15.29:0/2130265126 learned_addr learned my addr 172.21.15.29:0/2130265126 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:38.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.799+0000 7efdbbfff640 1 -- 172.21.15.29:0/2130265126 >> v1:172.21.15.52:6789/0 conn(0x7efdbc0c4910 legacy=0x7efdbc14fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:38.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.799+0000 7efdbbfff640 1 -- 172.21.15.29:0/2130265126 >> v1:172.21.15.29:6789/0 conn(0x7efdbc0707a0 legacy=0x7efdbc0c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:38.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.799+0000 7efdbbfff640 1 -- 172.21.15.29:0/2130265126 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdbc0ac7a0 con 0x7efdbc153320 2024-01-25T15:05:38.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.799+0000 7efdbb7fe640 1 -- 172.21.15.29:0/2130265126 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304825077 0 0) 0x7efdbc0ac290 con 0x7efdbc0707a0 2024-01-25T15:05:38.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.800+0000 7efdbbfff640 1 --2- 172.21.15.29:0/2130265126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdbc153320 0x7efdbc0c4cf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efda80097a0 tx=0x7efda802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e83577f67c9227 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:38.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.800+0000 7efdbb7fe640 1 -- 172.21.15.29:0/2130265126 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda8031830 con 0x7efdbc153320 2024-01-25T15:05:38.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.800+0000 7efdbb7fe640 1 -- 172.21.15.29:0/2130265126 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda8031990 con 0x7efdbc153320 2024-01-25T15:05:38.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.800+0000 7efdbb7fe640 1 -- 172.21.15.29:0/2130265126 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda8031d20 con 0x7efdbc153320 2024-01-25T15:05:38.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.801+0000 7efdc2c61640 1 -- 172.21.15.29:0/2130265126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdbc153320 msgr2=0x7efdbc0c4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:38.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.801+0000 7efdc2c61640 1 --2- 172.21.15.29:0/2130265126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdbc153320 0x7efdbc0c4cf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efda80097a0 tx=0x7efda802b8d0 comp rx=0 tx=0).stop 2024-01-25T15:05:38.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.801+0000 7efdc2c61640 1 -- 172.21.15.29:0/2130265126 shutdown_connections 2024-01-25T15:05:38.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.801+0000 7efdc2c61640 1 --2- 172.21.15.29:0/2130265126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdbc153320 0x7efdbc0c4cf0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:38.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.801+0000 7efdc2c61640 1 -- 172.21.15.29:0/2130265126 >> 172.21.15.29:0/2130265126 conn(0x7efdbc0c7e80 msgr2=0x7efdbc0c8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:38.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.801+0000 7efdc2c61640 1 -- 172.21.15.29:0/2130265126 shutdown_connections 2024-01-25T15:05:38.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.801+0000 7efdc2c61640 1 -- 172.21.15.29:0/2130265126 wait complete. 2024-01-25T15:05:38.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.802+0000 7efdc2c61640 1 Processor -- start 2024-01-25T15:05:38.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.802+0000 7efdc2c61640 1 -- start start 2024-01-25T15:05:38.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.803+0000 7efdc2c61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdbc0707a0 0x7efdbc06d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:38.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.803+0000 7efdc2c61640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc0c4910 0x7efdbc0c1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:38.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.803+0000 7efdc2c61640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efdbc153320 0x7efdbc1deda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:38.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.803+0000 7efdc2c61640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc1db7b0 con 0x7efdbc0707a0 2024-01-25T15:05:38.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.803+0000 7efdc2c61640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc1db400 con 0x7efdbc0c4910 2024-01-25T15:05:38.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.803+0000 7efdc2c61640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc1ea650 con 0x7efdbc153320 2024-01-25T15:05:38.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.803+0000 7efdc09fd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdbc0707a0 0x7efdbc06d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:38.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.803+0000 7efdc09fd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdbc0707a0 0x7efdbc06d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34196/0 (socket says 172.21.15.29:34196) 2024-01-25T15:05:38.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.803+0000 7efdc09fd640 1 -- 172.21.15.29:0/2965379448 learned_addr learned my addr 172.21.15.29:0/2965379448 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:38.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.803+0000 7efdbbfff640 1 --2- 172.21.15.29:0/2965379448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc0c4910 0x7efdbc0c1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:38.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.803+0000 7efdc11fe640 1 --2- 172.21.15.29:0/2965379448 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efdbc153320 0x7efdbc1deda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:38.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.803+0000 7efdc09fd640 1 -- 172.21.15.29:0/2965379448 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efdbc153320 msgr2=0x7efdbc1deda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:38.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.803+0000 7efdc09fd640 1 --2- 172.21.15.29:0/2965379448 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efdbc153320 0x7efdbc1deda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:38.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.803+0000 7efdc09fd640 1 -- 172.21.15.29:0/2965379448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc0c4910 msgr2=0x7efdbc0c1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:38.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.803+0000 7efdc09fd640 1 --2- 172.21.15.29:0/2965379448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc0c4910 0x7efdbc0c1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:38.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.803+0000 7efdc09fd640 1 -- 172.21.15.29:0/2965379448 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda8009400 con 0x7efdbc0707a0 2024-01-25T15:05:38.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.803+0000 7efdc09fd640 1 --2- 172.21.15.29:0/2965379448 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdbc0707a0 0x7efdbc06d2e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7efdb000c430 tx=0x7efdb000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:38.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.804+0000 7efdb97fa640 1 -- 172.21.15.29:0/2965379448 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb0011790 con 0x7efdbc0707a0 2024-01-25T15:05:38.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.804+0000 7efdb97fa640 1 -- 172.21.15.29:0/2965379448 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb00118f0 con 0x7efdbc0707a0 2024-01-25T15:05:38.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.804+0000 7efdb97fa640 1 -- 172.21.15.29:0/2965379448 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb0011ce0 con 0x7efdbc0707a0 2024-01-25T15:05:38.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.804+0000 7efdc2c61640 1 -- 172.21.15.29:0/2965379448 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdbc1daf70 con 0x7efdbc0707a0 2024-01-25T15:05:38.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.804+0000 7efdc2c61640 1 -- 172.21.15.29:0/2965379448 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdbc150fe0 con 0x7efdbc0707a0 2024-01-25T15:05:38.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.805+0000 7efdc2c61640 1 -- 172.21.15.29:0/2965379448 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdbc066fc0 con 0x7efdbc0707a0 2024-01-25T15:05:38.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.805+0000 7efdb97fa640 1 -- 172.21.15.29:0/2965379448 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7efdb001c460 con 0x7efdbc0707a0 2024-01-25T15:05:38.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.806+0000 7efdb97fa640 1 --2- 172.21.15.29:0/2965379448 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efda006aed0 0x7efda006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:38.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.806+0000 7efdb97fa640 1 -- 172.21.15.29:0/2965379448 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7efdb0089530 con 0x7efdbc0707a0 2024-01-25T15:05:38.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.806+0000 7efdbbfff640 1 --2- 172.21.15.29:0/2965379448 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efda006aed0 0x7efda006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:38.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.806+0000 7efdbbfff640 1 --2- 172.21.15.29:0/2965379448 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efda006aed0 0x7efda006d390 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efda8036000 tx=0x7efda803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:38.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:38.810+0000 7efdb97fa640 1 -- 172.21.15.29:0/2965379448 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7efdb0054400 con 0x7efdbc0707a0 2024-01-25T15:05:39.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.058+0000 7efdc2c61640 1 -- 172.21.15.29:0/2965379448 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7efdbc074010 con 0x7efdbc0707a0 2024-01-25T15:05:39.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.059+0000 7efdb97fa640 1 -- 172.21.15.29:0/2965379448 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v11) v1 ==== 84+0+0 (secure 0 0 0) 0x7efdb0057a20 con 0x7efdbc0707a0 2024-01-25T15:05:39.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.060+0000 7efdc2c61640 1 -- 172.21.15.29:0/2965379448 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efda006aed0 msgr2=0x7efda006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:39.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.060+0000 7efdc2c61640 1 --2- 172.21.15.29:0/2965379448 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efda006aed0 0x7efda006d390 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efda8036000 tx=0x7efda803d040 comp rx=0 tx=0).stop 2024-01-25T15:05:39.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.060+0000 7efdc2c61640 1 -- 172.21.15.29:0/2965379448 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdbc0707a0 msgr2=0x7efdbc06d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:39.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.060+0000 7efdc2c61640 1 --2- 172.21.15.29:0/2965379448 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdbc0707a0 0x7efdbc06d2e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7efdb000c430 tx=0x7efdb000c8f0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.060+0000 7efdc2c61640 1 -- 172.21.15.29:0/2965379448 shutdown_connections 2024-01-25T15:05:39.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.060+0000 7efdc2c61640 1 --2- 172.21.15.29:0/2965379448 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efdbc153320 0x7efdbc1deda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.060+0000 7efdc2c61640 1 --2- 172.21.15.29:0/2965379448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc0c4910 0x7efdbc0c1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.060+0000 7efdc2c61640 1 --2- 172.21.15.29:0/2965379448 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efda006aed0 0x7efda006d390 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.060+0000 7efdc2c61640 1 --2- 172.21.15.29:0/2965379448 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdbc0707a0 0x7efdbc06d2e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.060+0000 7efdc2c61640 1 -- 172.21.15.29:0/2965379448 >> 172.21.15.29:0/2965379448 conn(0x7efdbc0c7e80 msgr2=0x7efdbc152ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:39.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.060+0000 7efdc2c61640 1 -- 172.21.15.29:0/2965379448 shutdown_connections 2024-01-25T15:05:39.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.060+0000 7efdc2c61640 1 -- 172.21.15.29:0/2965379448 wait complete. 2024-01-25T15:05:39.072 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:39.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.172+0000 7f7abe690640 1 Processor -- start 2024-01-25T15:05:39.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.172+0000 7f7abe690640 1 -- start start 2024-01-25T15:05:39.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.173+0000 7f7abe690640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7ab80c29f0 0x7f7ab8155140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:39.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.173+0000 7f7abe690640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ab80c4620 0x7f7ab80c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:39.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.173+0000 7f7abe690640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab80c2750 con 0x7f7ab806cc80 2024-01-25T15:05:39.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.173+0000 7f7abe690640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab80c1f40 con 0x7f7ab80c29f0 2024-01-25T15:05:39.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.173+0000 7f7abe690640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab80c6120 con 0x7f7ab80c4620 2024-01-25T15:05:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.173+0000 7f7abcc2d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ab80c4620 0x7f7ab80c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.173+0000 7f7ab77fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7ab80c29f0 0x7f7ab8155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.173+0000 7f7ab7fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7ab806cc80 0x7f7ab80c82d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:56570/0 (socket says 172.21.15.29:56570) 2024-01-25T15:05:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.173+0000 7f7ab7fff640 1 -- 172.21.15.29:0/2377935 learned_addr learned my addr 172.21.15.29:0/2377935 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.173+0000 7f7abcc2d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ab80c4620 0x7f7ab80c4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:51334/0 (socket says 172.21.15.29:51334) 2024-01-25T15:05:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.173+0000 7f7ab77fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7ab80c29f0 0x7f7ab8155140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:42532/0 (socket says 172.21.15.29:42532) 2024-01-25T15:05:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.174+0000 7f7ab6ffd640 1 -- 172.21.15.29:0/2377935 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309397681 0 0) 0x7f7aa8001110 con 0x7f7ab806cc80 2024-01-25T15:05:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.174+0000 7f7ab6ffd640 1 -- 172.21.15.29:0/2377935 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7aa4003520 con 0x7f7ab806cc80 2024-01-25T15:05:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.174+0000 7f7abcc2d640 1 -- 172.21.15.29:0/2377935 >> v2:172.21.15.52:3300/0 conn(0x7f7ab80c29f0 msgr2=0x7f7ab8155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.174+0000 7f7abcc2d640 1 --2- 172.21.15.29:0/2377935 >> v2:172.21.15.52:3300/0 conn(0x7f7ab80c29f0 0x7f7ab8155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.174+0000 7f7abcc2d640 1 -- 172.21.15.29:0/2377935 >> v1:172.21.15.52:6789/0 conn(0x7f7ab806cc80 legacy=0x7f7ab80c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.174+0000 7f7abcc2d640 1 -- 172.21.15.29:0/2377935 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab806d790 con 0x7f7ab80c4620 2024-01-25T15:05:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.174+0000 7f7ab77fe640 1 --2- 172.21.15.29:0/2377935 >> v2:172.21.15.52:3300/0 conn(0x7f7ab80c29f0 0x7f7ab8155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:05:39.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.175+0000 7f7abcc2d640 1 --2- 172.21.15.29:0/2377935 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ab80c4620 0x7f7ab80c4ab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0009dc0 tx=0x7f7ab002be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4d6fd1b09ad659d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:39.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.175+0000 7f7ab6ffd640 1 -- 172.21.15.29:0/2377935 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab002cbb0 con 0x7f7ab80c4620 2024-01-25T15:05:39.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.175+0000 7f7ab6ffd640 1 -- 172.21.15.29:0/2377935 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab002cd10 con 0x7f7ab80c4620 2024-01-25T15:05:39.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.175+0000 7f7ab6ffd640 1 -- 172.21.15.29:0/2377935 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0034660 con 0x7f7ab80c4620 2024-01-25T15:05:39.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.175+0000 7f7abe690640 1 -- 172.21.15.29:0/2377935 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ab80c4620 msgr2=0x7f7ab80c4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:39.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.175+0000 7f7abe690640 1 --2- 172.21.15.29:0/2377935 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ab80c4620 0x7f7ab80c4ab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0009dc0 tx=0x7f7ab002be00 comp rx=0 tx=0).stop 2024-01-25T15:05:39.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.175+0000 7f7abe690640 1 -- 172.21.15.29:0/2377935 shutdown_connections 2024-01-25T15:05:39.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.175+0000 7f7abe690640 1 --2- 172.21.15.29:0/2377935 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ab80c4620 0x7f7ab80c4ab0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.175+0000 7f7abe690640 1 --2- 172.21.15.29:0/2377935 >> v2:172.21.15.52:3300/0 conn(0x7f7ab80c29f0 0x7f7ab8155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.175+0000 7f7abe690640 1 -- 172.21.15.29:0/2377935 >> 172.21.15.29:0/2377935 conn(0x7f7ab806a8a0 msgr2=0x7f7ab806acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:39.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.175+0000 7f7abe690640 1 -- 172.21.15.29:0/2377935 shutdown_connections 2024-01-25T15:05:39.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.175+0000 7f7abe690640 1 -- 172.21.15.29:0/2377935 wait complete. 2024-01-25T15:05:39.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.176+0000 7f7abe690640 1 Processor -- start 2024-01-25T15:05:39.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.177+0000 7f7abe690640 1 -- start start 2024-01-25T15:05:39.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.177+0000 7f7abe690640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ab806cc80 0x7f7ab8150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:39.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.177+0000 7f7abe690640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ab80c29f0 0x7f7ab81513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:39.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.177+0000 7f7abe690640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ab80c4620 0x7f7ab8147540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:39.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.177+0000 7f7abe690640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab81468b0 con 0x7f7ab80c29f0 2024-01-25T15:05:39.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.177+0000 7f7abe690640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab8149270 con 0x7f7ab806cc80 2024-01-25T15:05:39.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.177+0000 7f7abe690640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab814f800 con 0x7f7ab80c4620 2024-01-25T15:05:39.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.177+0000 7f7ab77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ab80c29f0 0x7f7ab81513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:39.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.177+0000 7f7ab77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ab80c29f0 0x7f7ab81513c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34198/0 (socket says 172.21.15.29:34198) 2024-01-25T15:05:39.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.177+0000 7f7ab77fe640 1 -- 172.21.15.29:0/112950333 learned_addr learned my addr 172.21.15.29:0/112950333 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:39.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.177+0000 7f7abcc2d640 1 --2- 172.21.15.29:0/112950333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ab80c4620 0x7f7ab8147540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:39.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.177+0000 7f7ab7fff640 1 --2- 172.21.15.29:0/112950333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ab806cc80 0x7f7ab8150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:39.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.178+0000 7f7ab77fe640 1 -- 172.21.15.29:0/112950333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ab80c4620 msgr2=0x7f7ab8147540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:39.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.178+0000 7f7ab77fe640 1 --2- 172.21.15.29:0/112950333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ab80c4620 0x7f7ab8147540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.178+0000 7f7ab77fe640 1 -- 172.21.15.29:0/112950333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ab806cc80 msgr2=0x7f7ab8150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:39.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.178+0000 7f7ab77fe640 1 --2- 172.21.15.29:0/112950333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ab806cc80 0x7f7ab8150210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.178+0000 7f7ab77fe640 1 -- 172.21.15.29:0/112950333 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa0009400 con 0x7f7ab80c29f0 2024-01-25T15:05:39.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.178+0000 7f7ab77fe640 1 --2- 172.21.15.29:0/112950333 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ab80c29f0 0x7f7ab81513c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7aa000ebe0 tx=0x7f7aa000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:39.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.178+0000 7f7ab4ff9640 1 -- 172.21.15.29:0/112950333 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0009760 con 0x7f7ab80c29f0 2024-01-25T15:05:39.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.178+0000 7f7ab4ff9640 1 -- 172.21.15.29:0/112950333 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa000cc30 con 0x7f7ab80c29f0 2024-01-25T15:05:39.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.178+0000 7f7abe690640 1 -- 172.21.15.29:0/112950333 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab0009a70 con 0x7f7ab80c29f0 2024-01-25T15:05:39.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.178+0000 7f7ab4ff9640 1 -- 172.21.15.29:0/112950333 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa000eee0 con 0x7f7ab80c29f0 2024-01-25T15:05:39.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.178+0000 7f7abe690640 1 -- 172.21.15.29:0/112950333 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab814fd80 con 0x7f7ab80c29f0 2024-01-25T15:05:39.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.179+0000 7f7abe690640 1 -- 172.21.15.29:0/112950333 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab814ff10 con 0x7f7ab80c29f0 2024-01-25T15:05:39.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.179+0000 7f7ab4ff9640 1 -- 172.21.15.29:0/112950333 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7aa0013470 con 0x7f7ab80c29f0 2024-01-25T15:05:39.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.180+0000 7f7ab4ff9640 1 --2- 172.21.15.29:0/112950333 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7a9806af00 0x7f7a9806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:39.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.180+0000 7f7ab4ff9640 1 -- 172.21.15.29:0/112950333 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7aa0089cd0 con 0x7f7ab80c29f0 2024-01-25T15:05:39.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.180+0000 7f7ab7fff640 1 --2- 172.21.15.29:0/112950333 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7a9806af00 0x7f7a9806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:39.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.181+0000 7f7ab7fff640 1 --2- 172.21.15.29:0/112950333 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7a9806af00 0x7f7a9806d3c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8005880 tx=0x7f7aa8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:39.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.184+0000 7f7ab4ff9640 1 -- 172.21.15.29:0/112950333 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7aa0054ba0 con 0x7f7ab80c29f0 2024-01-25T15:05:39.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.368+0000 7f7abe690640 1 -- 172.21.15.29:0/112950333 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ab8074080 con 0x7f7ab80c29f0 2024-01-25T15:05:39.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.369+0000 7f7ab4ff9640 1 -- 172.21.15.29:0/112950333 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16739 (secure 0 0 0) 0x7f7aa0017090 con 0x7f7ab80c29f0 2024-01-25T15:05:39.370 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:39.371 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":38,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:05:28.223439+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:05:25.099043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-25T15:05:25.537967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:39.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.371+0000 7f7abe690640 1 -- 172.21.15.29:0/112950333 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7a9806af00 msgr2=0x7f7a9806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:39.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.371+0000 7f7abe690640 1 --2- 172.21.15.29:0/112950333 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7a9806af00 0x7f7a9806d3c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8005880 tx=0x7f7aa8009040 comp rx=0 tx=0).stop 2024-01-25T15:05:39.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.371+0000 7f7abe690640 1 -- 172.21.15.29:0/112950333 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ab80c29f0 msgr2=0x7f7ab81513c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:39.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.371+0000 7f7abe690640 1 --2- 172.21.15.29:0/112950333 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ab80c29f0 0x7f7ab81513c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7aa000ebe0 tx=0x7f7aa000c520 comp rx=0 tx=0).stop 2024-01-25T15:05:39.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.371+0000 7f7abe690640 1 -- 172.21.15.29:0/112950333 shutdown_connections 2024-01-25T15:05:39.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.371+0000 7f7abe690640 1 --2- 172.21.15.29:0/112950333 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ab80c4620 0x7f7ab8147540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.371+0000 7f7abe690640 1 --2- 172.21.15.29:0/112950333 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7a9806af00 0x7f7a9806d3c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.371+0000 7f7abe690640 1 --2- 172.21.15.29:0/112950333 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ab80c29f0 0x7f7ab81513c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.371+0000 7f7abe690640 1 --2- 172.21.15.29:0/112950333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ab806cc80 0x7f7ab8150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.371+0000 7f7abe690640 1 -- 172.21.15.29:0/112950333 >> 172.21.15.29:0/112950333 conn(0x7f7ab806a8a0 msgr2=0x7f7ab80ab340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:39.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.371+0000 7f7abe690640 1 -- 172.21.15.29:0/112950333 shutdown_connections 2024-01-25T15:05:39.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.371+0000 7f7abe690640 1 -- 172.21.15.29:0/112950333 wait complete. 2024-01-25T15:05:39.383 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T15:04:14.955791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T15:05:25.099043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T15:05:25.537967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-25T15:05:39.384 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:05:39.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.488+0000 7fbd2b823640 1 Processor -- start 2024-01-25T15:05:39.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.488+0000 7fbd2b823640 1 -- start start 2024-01-25T15:05:39.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.488+0000 7fbd2b823640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbd2406b710 0x7fbd240c6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:39.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd2b823640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd240c58c0 con 0x7fbd2406b2b0 2024-01-25T15:05:39.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd2b823640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd240c4990 con 0x7fbd24151d80 2024-01-25T15:05:39.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd2b823640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2406c0a0 con 0x7fbd2406b710 2024-01-25T15:05:39.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd28dbe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbd2406b2b0 0x7fbd240c5d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42624/0 (socket says 172.21.15.29:42624) 2024-01-25T15:05:39.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd28dbe640 1 -- 172.21.15.29:0/2187221958 learned_addr learned my addr 172.21.15.29:0/2187221958 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:39.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd29dc0640 1 --2- 172.21.15.29:0/2187221958 >> v2:172.21.15.52:3300/0 conn(0x7fbd2406b710 0x7fbd240c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:39.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd1bfff640 1 -- 172.21.15.29:0/2187221958 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897129135 0 0) 0x7fbd240c58c0 con 0x7fbd2406b2b0 2024-01-25T15:05:39.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd1bfff640 1 -- 172.21.15.29:0/2187221958 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd10003520 con 0x7fbd2406b2b0 2024-01-25T15:05:39.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd1bfff640 1 -- 172.21.15.29:0/2187221958 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3377369407 0 0) 0x7fbd10003520 con 0x7fbd2406b2b0 2024-01-25T15:05:39.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd1bfff640 1 -- 172.21.15.29:0/2187221958 >> v2:172.21.15.52:3300/0 conn(0x7fbd2406b710 msgr2=0x7fbd240c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:39.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd1bfff640 1 --2- 172.21.15.29:0/2187221958 >> v2:172.21.15.52:3300/0 conn(0x7fbd2406b710 0x7fbd240c6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd1bfff640 1 -- 172.21.15.29:0/2187221958 >> v1:172.21.15.52:6789/0 conn(0x7fbd24151d80 legacy=0x7fbd24155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:39.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd1bfff640 1 -- 172.21.15.29:0/2187221958 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd240c4c30 con 0x7fbd2406b2b0 2024-01-25T15:05:39.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd1bfff640 1 -- 172.21.15.29:0/2187221958 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7fbd14001670 con 0x7fbd2406b2b0 2024-01-25T15:05:39.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd1bfff640 1 -- 172.21.15.29:0/2187221958 >> v1:172.21.15.29:6789/0 conn(0x7fbd2406b2b0 legacy=0x7fbd240c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:39.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd1bfff640 1 --2- 172.21.15.29:0/2187221958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd10003a10 0x7fbd10003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:39.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd1bfff640 1 --2- 172.21.15.29:0/2187221958 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd100047c0 0x7fbd10004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:39.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd1bfff640 1 --2- 172.21.15.29:0/2187221958 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd100052a0 0x7fbd1000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:39.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd1bfff640 1 -- 172.21.15.29:0/2187221958 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1000c140 con 0x7fbd100047c0 2024-01-25T15:05:39.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd1bfff640 1 -- 172.21.15.29:0/2187221958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1000c2b0 con 0x7fbd10003a10 2024-01-25T15:05:39.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd1bfff640 1 -- 172.21.15.29:0/2187221958 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1000c470 con 0x7fbd100052a0 2024-01-25T15:05:39.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd28dbe640 1 --2- 172.21.15.29:0/2187221958 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd100047c0 0x7fbd10004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:39.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.489+0000 7fbd295bf640 1 --2- 172.21.15.29:0/2187221958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd10003a10 0x7fbd10003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:39.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.490+0000 7fbd29dc0640 1 --2- 172.21.15.29:0/2187221958 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd100052a0 0x7fbd1000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:39.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.490+0000 7fbd28dbe640 1 -- 172.21.15.29:0/2187221958 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd100052a0 msgr2=0x7fbd1000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:39.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.490+0000 7fbd28dbe640 1 --2- 172.21.15.29:0/2187221958 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd100052a0 0x7fbd1000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.490+0000 7fbd28dbe640 1 -- 172.21.15.29:0/2187221958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd10003a10 msgr2=0x7fbd10003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:39.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.490+0000 7fbd28dbe640 1 --2- 172.21.15.29:0/2187221958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd10003a10 0x7fbd10003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.490+0000 7fbd28dbe640 1 -- 172.21.15.29:0/2187221958 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd10003520 con 0x7fbd100047c0 2024-01-25T15:05:39.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.490+0000 7fbd29dc0640 1 -- 172.21.15.29:0/2187221958 reap_dead start 2024-01-25T15:05:39.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.490+0000 7fbd28dbe640 1 --2- 172.21.15.29:0/2187221958 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd100047c0 0x7fbd10004c40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbd24155830 tx=0x7fbd100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf7bca8b12a855c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:39.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.491+0000 7fbd1bfff640 1 -- 172.21.15.29:0/2187221958 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd14005ad0 con 0x7fbd100047c0 2024-01-25T15:05:39.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.491+0000 7fbd1bfff640 1 -- 172.21.15.29:0/2187221958 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd14005c30 con 0x7fbd100047c0 2024-01-25T15:05:39.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.491+0000 7fbd1bfff640 1 -- 172.21.15.29:0/2187221958 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1402ca00 con 0x7fbd100047c0 2024-01-25T15:05:39.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.491+0000 7fbd2b823640 1 -- 172.21.15.29:0/2187221958 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd100047c0 msgr2=0x7fbd10004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:39.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.491+0000 7fbd2b823640 1 --2- 172.21.15.29:0/2187221958 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd100047c0 0x7fbd10004c40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbd24155830 tx=0x7fbd100057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.491+0000 7fbd2b823640 1 -- 172.21.15.29:0/2187221958 shutdown_connections 2024-01-25T15:05:39.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.491+0000 7fbd2b823640 1 --2- 172.21.15.29:0/2187221958 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd100047c0 0x7fbd10004c40 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.491+0000 7fbd2b823640 1 -- 172.21.15.29:0/2187221958 >> 172.21.15.29:0/2187221958 conn(0x7fbd240ca1f0 msgr2=0x7fbd240ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:39.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.491+0000 7fbd2b823640 1 -- 172.21.15.29:0/2187221958 shutdown_connections 2024-01-25T15:05:39.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.491+0000 7fbd2b823640 1 -- 172.21.15.29:0/2187221958 wait complete. 2024-01-25T15:05:39.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.492+0000 7fbd2b823640 1 Processor -- start 2024-01-25T15:05:39.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.492+0000 7fbd2b823640 1 -- start start 2024-01-25T15:05:39.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.493+0000 7fbd2b823640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd100047c0 0x7fbd240bdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:39.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.493+0000 7fbd2b823640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd240be080 0x7fbd241ed570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:39.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.493+0000 7fbd2b823640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd240c0200 0x7fbd241edab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:39.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.493+0000 7fbd2b823640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd240be5f0 con 0x7fbd100047c0 2024-01-25T15:05:39.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.493+0000 7fbd2b823640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd240bf690 con 0x7fbd240be080 2024-01-25T15:05:39.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.493+0000 7fbd2b823640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd240bf340 con 0x7fbd240c0200 2024-01-25T15:05:39.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.493+0000 7fbd295bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd100047c0 0x7fbd240bdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:39.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.493+0000 7fbd295bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd100047c0 0x7fbd240bdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34212/0 (socket says 172.21.15.29:34212) 2024-01-25T15:05:39.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.493+0000 7fbd295bf640 1 -- 172.21.15.29:0/2093759825 learned_addr learned my addr 172.21.15.29:0/2093759825 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:39.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.493+0000 7fbd28dbe640 1 --2- 172.21.15.29:0/2093759825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd240be080 0x7fbd241ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:39.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.493+0000 7fbd29dc0640 1 --2- 172.21.15.29:0/2093759825 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd240c0200 0x7fbd241edab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:39.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.493+0000 7fbd295bf640 1 -- 172.21.15.29:0/2093759825 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd240c0200 msgr2=0x7fbd241edab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:39.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.493+0000 7fbd295bf640 1 --2- 172.21.15.29:0/2093759825 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd240c0200 0x7fbd241edab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.493+0000 7fbd295bf640 1 -- 172.21.15.29:0/2093759825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd240be080 msgr2=0x7fbd241ed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:39.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.493+0000 7fbd295bf640 1 --2- 172.21.15.29:0/2093759825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd240be080 0x7fbd241ed570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.493+0000 7fbd295bf640 1 -- 172.21.15.29:0/2093759825 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd240be860 con 0x7fbd100047c0 2024-01-25T15:05:39.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.493+0000 7fbd295bf640 1 --2- 172.21.15.29:0/2093759825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd100047c0 0x7fbd240bdb40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000f5f0 tx=0x7fbd2000fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:39.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.494+0000 7fbd19ffb640 1 -- 172.21.15.29:0/2093759825 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd200052e0 con 0x7fbd100047c0 2024-01-25T15:05:39.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.494+0000 7fbd19ffb640 1 -- 172.21.15.29:0/2093759825 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd20005440 con 0x7fbd100047c0 2024-01-25T15:05:39.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.494+0000 7fbd2b823640 1 -- 172.21.15.29:0/2093759825 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd240beb40 con 0x7fbd100047c0 2024-01-25T15:05:39.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.494+0000 7fbd19ffb640 1 -- 172.21.15.29:0/2093759825 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20003810 con 0x7fbd100047c0 2024-01-25T15:05:39.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.494+0000 7fbd2b823640 1 -- 172.21.15.29:0/2093759825 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd241ee1a0 con 0x7fbd100047c0 2024-01-25T15:05:39.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.495+0000 7fbd2b823640 1 -- 172.21.15.29:0/2093759825 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd24074010 con 0x7fbd100047c0 2024-01-25T15:05:39.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.495+0000 7fbd19ffb640 1 -- 172.21.15.29:0/2093759825 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fbd20003970 con 0x7fbd100047c0 2024-01-25T15:05:39.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.495+0000 7fbd19ffb640 1 --2- 172.21.15.29:0/2093759825 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbd0806af00 0x7fbd0806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:39.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.496+0000 7fbd19ffb640 1 -- 172.21.15.29:0/2093759825 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbd200895a0 con 0x7fbd100047c0 2024-01-25T15:05:39.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.496+0000 7fbd28dbe640 1 --2- 172.21.15.29:0/2093759825 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbd0806af00 0x7fbd0806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:39.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.496+0000 7fbd28dbe640 1 --2- 172.21.15.29:0/2093759825 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbd0806af00 0x7fbd0806d3c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbd14034000 tx=0x7fbd14009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:39.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.500+0000 7fbd19ffb640 1 -- 172.21.15.29:0/2093759825 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fbd200543c0 con 0x7fbd100047c0 2024-01-25T15:05:39.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.681+0000 7fbd2b823640 1 -- 172.21.15.29:0/2093759825 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd2406c420 con 0x7fbd100047c0 2024-01-25T15:05:39.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.682+0000 7fbd19ffb640 1 -- 172.21.15.29:0/2093759825 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd200579e0 con 0x7fbd100047c0 2024-01-25T15:05:39.683 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-25T15:05:39.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.684+0000 7fbd2b823640 1 -- 172.21.15.29:0/2093759825 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbd0806af00 msgr2=0x7fbd0806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:39.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.684+0000 7fbd2b823640 1 --2- 172.21.15.29:0/2093759825 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbd0806af00 0x7fbd0806d3c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbd14034000 tx=0x7fbd14009030 comp rx=0 tx=0).stop 2024-01-25T15:05:39.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.684+0000 7fbd2b823640 1 -- 172.21.15.29:0/2093759825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd100047c0 msgr2=0x7fbd240bdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:39.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.684+0000 7fbd2b823640 1 --2- 172.21.15.29:0/2093759825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd100047c0 0x7fbd240bdb40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000f5f0 tx=0x7fbd2000fab0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.684+0000 7fbd2b823640 1 -- 172.21.15.29:0/2093759825 shutdown_connections 2024-01-25T15:05:39.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.684+0000 7fbd2b823640 1 --2- 172.21.15.29:0/2093759825 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbd240c0200 0x7fbd241edab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.684+0000 7fbd2b823640 1 --2- 172.21.15.29:0/2093759825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd240be080 0x7fbd241ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.684+0000 7fbd2b823640 1 --2- 172.21.15.29:0/2093759825 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbd0806af00 0x7fbd0806d3c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.684+0000 7fbd2b823640 1 --2- 172.21.15.29:0/2093759825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd100047c0 0x7fbd240bdb40 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.684+0000 7fbd2b823640 1 -- 172.21.15.29:0/2093759825 >> 172.21.15.29:0/2093759825 conn(0x7fbd240ca1f0 msgr2=0x7fbd2414cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:39.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.684+0000 7fbd2b823640 1 -- 172.21.15.29:0/2093759825 shutdown_connections 2024-01-25T15:05:39.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.684+0000 7fbd2b823640 1 -- 172.21.15.29:0/2093759825 wait complete. 2024-01-25T15:05:39.695 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:05:39.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.800+0000 7f9b646e5640 1 Processor -- start 2024-01-25T15:05:39.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.800+0000 7f9b646e5640 1 -- start start 2024-01-25T15:05:39.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.800+0000 7f9b646e5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9b5c0c4a10 0x7f9b5c0c7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:39.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.801+0000 7f9b646e5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b5c158950 0x7f9b5c0c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:39.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.801+0000 7f9b646e5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9b5c1551c0 0x7f9b5c0c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:39.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.801+0000 7f9b646e5640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5c0c7e40 con 0x7f9b5c0c4a10 2024-01-25T15:05:39.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.801+0000 7f9b646e5640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5c070e20 con 0x7f9b5c1551c0 2024-01-25T15:05:39.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.801+0000 7f9b646e5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0c7b60 con 0x7f9b5c158950 2024-01-25T15:05:39.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.801+0000 7f9b62481640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9b5c0c4a10 0x7f9b5c0c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:39.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.801+0000 7f9b62481640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9b5c0c4a10 0x7f9b5c0c7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34224/0 (socket says 172.21.15.29:34224) 2024-01-25T15:05:39.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.801+0000 7f9b62481640 1 -- 172.21.15.29:0/1841757190 learned_addr learned my addr 172.21.15.29:0/1841757190 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:39.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.801+0000 7f9b61c80640 1 --2- 172.21.15.29:0/1841757190 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b5c158950 0x7f9b5c0c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:39.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.801+0000 7f9b62c82640 1 --2- 172.21.15.29:0/1841757190 >> v2:172.21.15.52:3300/0 conn(0x7f9b5c1551c0 0x7f9b5c0c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:39.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.801+0000 7f9b62481640 1 -- 172.21.15.29:0/1841757190 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b5c158950 msgr2=0x7f9b5c0c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:39.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.801+0000 7f9b62481640 1 --2- 172.21.15.29:0/1841757190 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b5c158950 0x7f9b5c0c4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.801+0000 7f9b62481640 1 -- 172.21.15.29:0/1841757190 >> v2:172.21.15.52:3300/0 conn(0x7f9b5c1551c0 msgr2=0x7f9b5c0c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:39.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.801+0000 7f9b62481640 1 --2- 172.21.15.29:0/1841757190 >> v2:172.21.15.52:3300/0 conn(0x7f9b5c1551c0 0x7f9b5c0c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.801+0000 7f9b62481640 1 -- 172.21.15.29:0/1841757190 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c157e70 con 0x7f9b5c0c4a10 2024-01-25T15:05:39.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.801+0000 7f9b61c80640 1 --2- 172.21.15.29:0/1841757190 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b5c158950 0x7f9b5c0c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:39.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.802+0000 7f9b62481640 1 --2- 172.21.15.29:0/1841757190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b5c0c4a10 0x7f9b5c0c7580 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0c2750 tx=0x7f9b5802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd2cfa45331f7d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:39.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.802+0000 7f9b6147f640 1 -- 172.21.15.29:0/1841757190 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b58031870 con 0x7f9b5c0c4a10 2024-01-25T15:05:39.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.802+0000 7f9b6147f640 1 -- 172.21.15.29:0/1841757190 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b580319d0 con 0x7f9b5c0c4a10 2024-01-25T15:05:39.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.802+0000 7f9b6147f640 1 -- 172.21.15.29:0/1841757190 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b58031d60 con 0x7f9b5c0c4a10 2024-01-25T15:05:39.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.802+0000 7f9b646e5640 1 -- 172.21.15.29:0/1841757190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b5c0c4a10 msgr2=0x7f9b5c0c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:39.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.802+0000 7f9b646e5640 1 --2- 172.21.15.29:0/1841757190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b5c0c4a10 0x7f9b5c0c7580 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0c2750 tx=0x7f9b5802b910 comp rx=0 tx=0).stop 2024-01-25T15:05:39.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.803+0000 7f9b646e5640 1 -- 172.21.15.29:0/1841757190 shutdown_connections 2024-01-25T15:05:39.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.803+0000 7f9b646e5640 1 --2- 172.21.15.29:0/1841757190 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b5c158950 0x7f9b5c0c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.803+0000 7f9b646e5640 1 --2- 172.21.15.29:0/1841757190 >> v2:172.21.15.52:3300/0 conn(0x7f9b5c1551c0 0x7f9b5c0c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.803+0000 7f9b646e5640 1 --2- 172.21.15.29:0/1841757190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b5c0c4a10 0x7f9b5c0c7580 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.803+0000 7f9b646e5640 1 -- 172.21.15.29:0/1841757190 >> 172.21.15.29:0/1841757190 conn(0x7f9b5c0c7f80 msgr2=0x7f9b5c0c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:39.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.803+0000 7f9b646e5640 1 -- 172.21.15.29:0/1841757190 shutdown_connections 2024-01-25T15:05:39.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.803+0000 7f9b646e5640 1 -- 172.21.15.29:0/1841757190 wait complete. 2024-01-25T15:05:39.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.804+0000 7f9b646e5640 1 Processor -- start 2024-01-25T15:05:39.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.804+0000 7f9b646e5640 1 -- start start 2024-01-25T15:05:39.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.804+0000 7f9b646e5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b5c0c4a10 0x7f9b5c06f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:39.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.804+0000 7f9b646e5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b5c1551c0 0x7f9b5c145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:39.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.804+0000 7f9b646e5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b5c158950 0x7f9b5c146200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:39.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.804+0000 7f9b646e5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c154a20 con 0x7f9b5c1551c0 2024-01-25T15:05:39.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.804+0000 7f9b646e5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c1edfe0 con 0x7f9b5c158950 2024-01-25T15:05:39.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.804+0000 7f9b646e5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c154460 con 0x7f9b5c0c4a10 2024-01-25T15:05:39.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.804+0000 7f9b61c80640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b5c1551c0 0x7f9b5c145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:39.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.804+0000 7f9b61c80640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b5c1551c0 0x7f9b5c145cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34238/0 (socket says 172.21.15.29:34238) 2024-01-25T15:05:39.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.804+0000 7f9b61c80640 1 -- 172.21.15.29:0/2662579176 learned_addr learned my addr 172.21.15.29:0/2662579176 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:39.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.805+0000 7f9b62481640 1 --2- 172.21.15.29:0/2662579176 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b5c0c4a10 0x7f9b5c06f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:39.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.805+0000 7f9b62c82640 1 --2- 172.21.15.29:0/2662579176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b5c158950 0x7f9b5c146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:39.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.805+0000 7f9b61c80640 1 -- 172.21.15.29:0/2662579176 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b5c0c4a10 msgr2=0x7f9b5c06f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:39.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.805+0000 7f9b61c80640 1 --2- 172.21.15.29:0/2662579176 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b5c0c4a10 0x7f9b5c06f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.805+0000 7f9b61c80640 1 -- 172.21.15.29:0/2662579176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b5c158950 msgr2=0x7f9b5c146200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:39.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.805+0000 7f9b61c80640 1 --2- 172.21.15.29:0/2662579176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b5c158950 0x7f9b5c146200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.805+0000 7f9b61c80640 1 -- 172.21.15.29:0/2662579176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b580094d0 con 0x7f9b5c1551c0 2024-01-25T15:05:39.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.805+0000 7f9b61c80640 1 --2- 172.21.15.29:0/2662579176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b5c1551c0 0x7f9b5c145cc0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00d7d0 tx=0x7f9b4c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:39.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.805+0000 7f9b52ffd640 1 -- 172.21.15.29:0/2662579176 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c004030 con 0x7f9b5c1551c0 2024-01-25T15:05:39.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.805+0000 7f9b52ffd640 1 -- 172.21.15.29:0/2662579176 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c004190 con 0x7f9b5c1551c0 2024-01-25T15:05:39.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.805+0000 7f9b646e5640 1 -- 172.21.15.29:0/2662579176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5c154740 con 0x7f9b5c1551c0 2024-01-25T15:05:39.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.805+0000 7f9b52ffd640 1 -- 172.21.15.29:0/2662579176 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c004520 con 0x7f9b5c1551c0 2024-01-25T15:05:39.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.805+0000 7f9b646e5640 1 -- 172.21.15.29:0/2662579176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5c1ee2c0 con 0x7f9b5c1551c0 2024-01-25T15:05:39.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.806+0000 7f9b646e5640 1 -- 172.21.15.29:0/2662579176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5c04eb10 con 0x7f9b5c1551c0 2024-01-25T15:05:39.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.807+0000 7f9b52ffd640 1 -- 172.21.15.29:0/2662579176 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9b4c00b6c0 con 0x7f9b5c1551c0 2024-01-25T15:05:39.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.807+0000 7f9b52ffd640 1 --2- 172.21.15.29:0/2662579176 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9b4006af00 0x7f9b4006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:39.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.807+0000 7f9b52ffd640 1 -- 172.21.15.29:0/2662579176 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9b4c089930 con 0x7f9b5c1551c0 2024-01-25T15:05:39.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.807+0000 7f9b62481640 1 --2- 172.21.15.29:0/2662579176 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9b4006af00 0x7f9b4006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:39.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.808+0000 7f9b62481640 1 --2- 172.21.15.29:0/2662579176 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9b4006af00 0x7f9b4006d3c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9b58036000 tx=0x7f9b5803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:39.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.811+0000 7f9b52ffd640 1 -- 172.21.15.29:0/2662579176 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f9b4c0546c0 con 0x7f9b5c1551c0 2024-01-25T15:05:39.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.989+0000 7f9b646e5640 1 -- 172.21.15.29:0/2662579176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9b5c06d710 con 0x7f9b5c1551c0 2024-01-25T15:05:39.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.989+0000 7f9b52ffd640 1 -- 172.21.15.29:0/2662579176 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9b4c057ce0 con 0x7f9b5c1551c0 2024-01-25T15:05:39.990 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:39.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.991+0000 7f9b646e5640 1 -- 172.21.15.29:0/2662579176 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9b4006af00 msgr2=0x7f9b4006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:39.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.991+0000 7f9b646e5640 1 --2- 172.21.15.29:0/2662579176 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9b4006af00 0x7f9b4006d3c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9b58036000 tx=0x7f9b5803c040 comp rx=0 tx=0).stop 2024-01-25T15:05:39.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.991+0000 7f9b646e5640 1 -- 172.21.15.29:0/2662579176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b5c1551c0 msgr2=0x7f9b5c145cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:39.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.991+0000 7f9b646e5640 1 --2- 172.21.15.29:0/2662579176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b5c1551c0 0x7f9b5c145cc0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00d7d0 tx=0x7f9b4c00dc90 comp rx=0 tx=0).stop 2024-01-25T15:05:39.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.991+0000 7f9b646e5640 1 -- 172.21.15.29:0/2662579176 shutdown_connections 2024-01-25T15:05:39.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.991+0000 7f9b646e5640 1 --2- 172.21.15.29:0/2662579176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b5c158950 0x7f9b5c146200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.991+0000 7f9b646e5640 1 --2- 172.21.15.29:0/2662579176 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9b4006af00 0x7f9b4006d3c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.991+0000 7f9b646e5640 1 --2- 172.21.15.29:0/2662579176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b5c1551c0 0x7f9b5c145cc0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.991+0000 7f9b646e5640 1 --2- 172.21.15.29:0/2662579176 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b5c0c4a10 0x7f9b5c06f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:39.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.991+0000 7f9b646e5640 1 -- 172.21.15.29:0/2662579176 >> 172.21.15.29:0/2662579176 conn(0x7f9b5c0c7f80 msgr2=0x7f9b5c0c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:39.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.991+0000 7f9b646e5640 1 -- 172.21.15.29:0/2662579176 shutdown_connections 2024-01-25T15:05:39.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:39.991+0000 7f9b646e5640 1 -- 172.21.15.29:0/2662579176 wait complete. 2024-01-25T15:05:40.002 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:05:40.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.107+0000 7f2aa4e75640 1 Processor -- start 2024-01-25T15:05:40.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.107+0000 7f2aa4e75640 1 -- start start 2024-01-25T15:05:40.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2aa4e75640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2aa006f290 0x7f2aa0158800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:40.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2aa4e75640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa0158d40 con 0x7f2aa006b380 2024-01-25T15:05:40.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2aa4e75640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa0072350 con 0x7f2aa013ddd0 2024-01-25T15:05:40.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2aa4e75640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa006dcd0 con 0x7f2aa006f290 2024-01-25T15:05:40.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2a9ed9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2aa006b380 0x7f2aa006a6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42626/0 (socket says 172.21.15.29:42626) 2024-01-25T15:05:40.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2a9ed9d640 1 -- 172.21.15.29:0/1361040019 learned_addr learned my addr 172.21.15.29:0/1361040019 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:40.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2a97fff640 1 --2- 172.21.15.29:0/1361040019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2aa006f290 0x7f2aa0158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:40.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2a9dd9b640 1 -- 172.21.15.29:0/1361040019 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1122787594 0 0) 0x7f2a98001490 con 0x7f2aa006b380 2024-01-25T15:05:40.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2a9dd9b640 1 -- 172.21.15.29:0/1361040019 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a8c003520 con 0x7f2aa006b380 2024-01-25T15:05:40.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2a9dd9b640 1 -- 172.21.15.29:0/1361040019 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4278791378 0 0) 0x7f2aa0072350 con 0x7f2aa013ddd0 2024-01-25T15:05:40.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2a9dd9b640 1 -- 172.21.15.29:0/1361040019 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a98001490 con 0x7f2aa013ddd0 2024-01-25T15:05:40.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2a9dd9b640 1 -- 172.21.15.29:0/1361040019 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2349575433 0 0) 0x7f2a8c003520 con 0x7f2aa006b380 2024-01-25T15:05:40.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2a9dd9b640 1 -- 172.21.15.29:0/1361040019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2aa006f290 msgr2=0x7f2aa0158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:40.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2a9dd9b640 1 --2- 172.21.15.29:0/1361040019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2aa006f290 0x7f2aa0158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2a9dd9b640 1 -- 172.21.15.29:0/1361040019 >> v1:172.21.15.52:6789/0 conn(0x7f2aa013ddd0 legacy=0x7f2aa00c0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:40.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2a9dd9b640 1 -- 172.21.15.29:0/1361040019 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa0157db0 con 0x7f2aa006b380 2024-01-25T15:05:40.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2a9dd9b640 1 -- 172.21.15.29:0/1361040019 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f2a98001b80 con 0x7f2aa006b380 2024-01-25T15:05:40.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2a97fff640 1 --2- 172.21.15.29:0/1361040019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2aa006f290 0x7f2aa0158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:05:40.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2a9dd9b640 1 -- 172.21.15.29:0/1361040019 >> v1:172.21.15.29:6789/0 conn(0x7f2aa006b380 legacy=0x7f2aa006a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:40.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2a9dd9b640 1 --2- 172.21.15.29:0/1361040019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2a8c003ba0 0x7f2a8c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:40.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2a9dd9b640 1 --2- 172.21.15.29:0/1361040019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a8c0047c0 0x7f2a8c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:40.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2a9dd9b640 1 --2- 172.21.15.29:0/1361040019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a8c005180 0x7f2a8c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:40.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2a9dd9b640 1 -- 172.21.15.29:0/1361040019 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa006dcd0 con 0x7f2a8c0047c0 2024-01-25T15:05:40.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2a9dd9b640 1 -- 172.21.15.29:0/1361040019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c00c050 con 0x7f2a8c005180 2024-01-25T15:05:40.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.108+0000 7f2a9dd9b640 1 -- 172.21.15.29:0/1361040019 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c00c1e0 con 0x7f2a8c003ba0 2024-01-25T15:05:40.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.109+0000 7f2a97fff640 1 --2- 172.21.15.29:0/1361040019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a8c0047c0 0x7f2a8c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:40.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.109+0000 7f2a9e59c640 1 --2- 172.21.15.29:0/1361040019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2a8c003ba0 0x7f2a8c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:40.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.109+0000 7f2a9ed9d640 1 --2- 172.21.15.29:0/1361040019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a8c005180 0x7f2a8c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:40.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.109+0000 7f2a97fff640 1 -- 172.21.15.29:0/1361040019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2a8c003ba0 msgr2=0x7f2a8c003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:40.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.109+0000 7f2a97fff640 1 --2- 172.21.15.29:0/1361040019 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2a8c003ba0 0x7f2a8c003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.109+0000 7f2a97fff640 1 -- 172.21.15.29:0/1361040019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a8c005180 msgr2=0x7f2a8c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:40.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.109+0000 7f2a97fff640 1 --2- 172.21.15.29:0/1361040019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a8c005180 0x7f2a8c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.109+0000 7f2a97fff640 1 -- 172.21.15.29:0/1361040019 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a88009400 con 0x7f2a8c0047c0 2024-01-25T15:05:40.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.109+0000 7f2a97fff640 1 --2- 172.21.15.29:0/1361040019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a8c0047c0 0x7f2a8c004c40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2a88009c70 tx=0x7f2a8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2882b8209a38205 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:40.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.110+0000 7f2a9dd9b640 1 -- 172.21.15.29:0/1361040019 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8802c910 con 0x7f2a8c0047c0 2024-01-25T15:05:40.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.110+0000 7f2a9dd9b640 1 -- 172.21.15.29:0/1361040019 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8802ca70 con 0x7f2a8c0047c0 2024-01-25T15:05:40.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.110+0000 7f2a9dd9b640 1 -- 172.21.15.29:0/1361040019 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8802ce20 con 0x7f2a8c0047c0 2024-01-25T15:05:40.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.110+0000 7f2aa4e75640 1 -- 172.21.15.29:0/1361040019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a8c0047c0 msgr2=0x7f2a8c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:40.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.110+0000 7f2aa4e75640 1 --2- 172.21.15.29:0/1361040019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a8c0047c0 0x7f2a8c004c40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2a88009c70 tx=0x7f2a8c0057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.110+0000 7f2a9ed9d640 1 -- 172.21.15.29:0/1361040019 reap_dead start 2024-01-25T15:05:40.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.110+0000 7f2aa4e75640 1 -- 172.21.15.29:0/1361040019 shutdown_connections 2024-01-25T15:05:40.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.110+0000 7f2aa4e75640 1 -- 172.21.15.29:0/1361040019 >> 172.21.15.29:0/1361040019 conn(0x7f2aa00c3b00 msgr2=0x7f2aa00c3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:40.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.110+0000 7f2aa4e75640 1 -- 172.21.15.29:0/1361040019 shutdown_connections 2024-01-25T15:05:40.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.110+0000 7f2aa4e75640 1 -- 172.21.15.29:0/1361040019 wait complete. 2024-01-25T15:05:40.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.112+0000 7f2aa4e75640 1 Processor -- start 2024-01-25T15:05:40.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.112+0000 7f2aa4e75640 1 -- start start 2024-01-25T15:05:40.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.112+0000 7f2aa4e75640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a8c0047c0 0x7f2aa0152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:40.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.112+0000 7f2aa4e75640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2aa0157000 0x7f2aa006eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:40.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.112+0000 7f2aa4e75640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2aa01369f0 0x7f2aa0136ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:40.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.112+0000 7f2aa4e75640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa01373e0 con 0x7f2aa01369f0 2024-01-25T15:05:40.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.112+0000 7f2aa4e75640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa01ed7d0 con 0x7f2a8c0047c0 2024-01-25T15:05:40.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.112+0000 7f2aa4e75640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa0154360 con 0x7f2aa0157000 2024-01-25T15:05:40.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.112+0000 7f2a9ed9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2aa01369f0 0x7f2aa0136ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:40.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.112+0000 7f2a9ed9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2aa01369f0 0x7f2aa0136ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34264/0 (socket says 172.21.15.29:34264) 2024-01-25T15:05:40.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.112+0000 7f2a9ed9d640 1 -- 172.21.15.29:0/3362140132 learned_addr learned my addr 172.21.15.29:0/3362140132 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:40.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.112+0000 7f2a9e59c640 1 --2- 172.21.15.29:0/3362140132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a8c0047c0 0x7f2aa0152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:40.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.112+0000 7f2a97fff640 1 --2- 172.21.15.29:0/3362140132 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2aa0157000 0x7f2aa006eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:40.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.113+0000 7f2a9ed9d640 1 -- 172.21.15.29:0/3362140132 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2aa0157000 msgr2=0x7f2aa006eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:40.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.113+0000 7f2a9ed9d640 1 --2- 172.21.15.29:0/3362140132 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2aa0157000 0x7f2aa006eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.113+0000 7f2a9ed9d640 1 -- 172.21.15.29:0/3362140132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a8c0047c0 msgr2=0x7f2aa0152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:40.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.113+0000 7f2a9ed9d640 1 --2- 172.21.15.29:0/3362140132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a8c0047c0 0x7f2aa0152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.113+0000 7f2a9ed9d640 1 -- 172.21.15.29:0/3362140132 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa00aa4e0 con 0x7f2aa01369f0 2024-01-25T15:05:40.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.113+0000 7f2a9ed9d640 1 --2- 172.21.15.29:0/3362140132 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2aa01369f0 0x7f2aa0136ea0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00ad330 tx=0x7f2a9800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:40.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.113+0000 7f2a96ffd640 1 -- 172.21.15.29:0/3362140132 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9800ec10 con 0x7f2aa01369f0 2024-01-25T15:05:40.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.113+0000 7f2a96ffd640 1 -- 172.21.15.29:0/3362140132 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9800ed70 con 0x7f2aa01369f0 2024-01-25T15:05:40.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.113+0000 7f2aa4e75640 1 -- 172.21.15.29:0/3362140132 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa00ac140 con 0x7f2aa01369f0 2024-01-25T15:05:40.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.113+0000 7f2a96ffd640 1 -- 172.21.15.29:0/3362140132 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9800eee0 con 0x7f2aa01369f0 2024-01-25T15:05:40.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.113+0000 7f2aa4e75640 1 -- 172.21.15.29:0/3362140132 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa006f030 con 0x7f2aa01369f0 2024-01-25T15:05:40.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.114+0000 7f2aa4e75640 1 -- 172.21.15.29:0/3362140132 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa00abfa0 con 0x7f2aa01369f0 2024-01-25T15:05:40.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.114+0000 7f2a96ffd640 1 -- 172.21.15.29:0/3362140132 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2a98013660 con 0x7f2aa01369f0 2024-01-25T15:05:40.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.115+0000 7f2a96ffd640 1 --2- 172.21.15.29:0/3362140132 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2a8006aed0 0x7f2a8006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:40.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.115+0000 7f2a96ffd640 1 -- 172.21.15.29:0/3362140132 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2a980897e0 con 0x7f2aa01369f0 2024-01-25T15:05:40.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.115+0000 7f2a9e59c640 1 --2- 172.21.15.29:0/3362140132 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2a8006aed0 0x7f2a8006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:40.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.115+0000 7f2a9e59c640 1 --2- 172.21.15.29:0/3362140132 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2a8006aed0 0x7f2a8006d390 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2a900018b0 tx=0x7f2a90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:40.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.119+0000 7f2a96ffd640 1 -- 172.21.15.29:0/3362140132 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2aa00abfa0 con 0x7f2aa01369f0 2024-01-25T15:05:40.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.300+0000 7f2aa4e75640 1 -- 172.21.15.29:0/3362140132 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2aa0157fe0 con 0x7f2aa01369f0 2024-01-25T15:05:40.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.300+0000 7f2a96ffd640 1 -- 172.21.15.29:0/3362140132 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2aa0157fe0 con 0x7f2aa01369f0 2024-01-25T15:05:40.301 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-25T15:05:40.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.302+0000 7f2aa4e75640 1 -- 172.21.15.29:0/3362140132 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2a8006aed0 msgr2=0x7f2a8006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:40.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.302+0000 7f2aa4e75640 1 --2- 172.21.15.29:0/3362140132 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2a8006aed0 0x7f2a8006d390 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2a900018b0 tx=0x7f2a90009040 comp rx=0 tx=0).stop 2024-01-25T15:05:40.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.302+0000 7f2aa4e75640 1 -- 172.21.15.29:0/3362140132 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2aa01369f0 msgr2=0x7f2aa0136ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:40.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.302+0000 7f2aa4e75640 1 --2- 172.21.15.29:0/3362140132 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2aa01369f0 0x7f2aa0136ea0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00ad330 tx=0x7f2a9800e530 comp rx=0 tx=0).stop 2024-01-25T15:05:40.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.302+0000 7f2aa4e75640 1 -- 172.21.15.29:0/3362140132 shutdown_connections 2024-01-25T15:05:40.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.302+0000 7f2aa4e75640 1 --2- 172.21.15.29:0/3362140132 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2a8006aed0 0x7f2a8006d390 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.302+0000 7f2aa4e75640 1 --2- 172.21.15.29:0/3362140132 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2aa01369f0 0x7f2aa0136ea0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.302+0000 7f2aa4e75640 1 --2- 172.21.15.29:0/3362140132 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2aa0157000 0x7f2aa006eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.302+0000 7f2aa4e75640 1 --2- 172.21.15.29:0/3362140132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a8c0047c0 0x7f2aa0152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.302+0000 7f2aa4e75640 1 -- 172.21.15.29:0/3362140132 >> 172.21.15.29:0/3362140132 conn(0x7f2aa00c3b00 msgr2=0x7f2aa00c32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:40.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.302+0000 7f2aa4e75640 1 -- 172.21.15.29:0/3362140132 shutdown_connections 2024-01-25T15:05:40.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.302+0000 7f2aa4e75640 1 -- 172.21.15.29:0/3362140132 wait complete. 2024-01-25T15:05:40.314 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-25T15:05:40.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.414+0000 7f780172d640 1 Processor -- start 2024-01-25T15:05:40.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.414+0000 7f780172d640 1 -- start start 2024-01-25T15:05:40.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.415+0000 7f780172d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f77fc0c0bd0 0x7f77fc06add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:40.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.415+0000 7f780172d640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77fc152310 con 0x7f77fc0a8490 2024-01-25T15:05:40.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.415+0000 7f780172d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77fc0c1a90 con 0x7f77fc151f30 2024-01-25T15:05:40.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.415+0000 7f780172d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77fc0c1d70 con 0x7f77fc0c0bd0 2024-01-25T15:05:40.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.415+0000 7f77fb7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f77fc0c0bd0 0x7f77fc06add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:40.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.415+0000 7f77fa7fc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f77fc0a8490 0x7f77fc06a6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42630/0 (socket says 172.21.15.29:42630) 2024-01-25T15:05:40.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.415+0000 7f77fa7fc640 1 -- 172.21.15.29:0/3008287043 learned_addr learned my addr 172.21.15.29:0/3008287043 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:40.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.416+0000 7f77fb7fe640 1 -- 172.21.15.29:0/3008287043 >> v1:172.21.15.52:6789/0 conn(0x7f77fc151f30 legacy=0x7f77fc0c04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:40.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.416+0000 7f77fb7fe640 1 -- 172.21.15.29:0/3008287043 >> v1:172.21.15.29:6789/0 conn(0x7f77fc0a8490 legacy=0x7f77fc06a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:40.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.416+0000 7f77fb7fe640 1 -- 172.21.15.29:0/3008287043 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc06b310 con 0x7f77fc0c0bd0 2024-01-25T15:05:40.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.416+0000 7f77fb7fe640 1 --2- 172.21.15.29:0/3008287043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77fc0c0bd0 0x7f77fc06add0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009d90 tx=0x7f77ec02bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce17d7b1c64791b2 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:40.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.417+0000 7f77f9ffb640 1 -- 172.21.15.29:0/3008287043 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec02cb40 con 0x7f77fc0c0bd0 2024-01-25T15:05:40.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.417+0000 7f77f9ffb640 1 -- 172.21.15.29:0/3008287043 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ec02cca0 con 0x7f77fc0c0bd0 2024-01-25T15:05:40.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.417+0000 7f77f9ffb640 1 -- 172.21.15.29:0/3008287043 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec034660 con 0x7f77fc0c0bd0 2024-01-25T15:05:40.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.417+0000 7f780172d640 1 -- 172.21.15.29:0/3008287043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77fc0c0bd0 msgr2=0x7f77fc06add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:40.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.417+0000 7f780172d640 1 --2- 172.21.15.29:0/3008287043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77fc0c0bd0 0x7f77fc06add0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009d90 tx=0x7f77ec02bd90 comp rx=0 tx=0).stop 2024-01-25T15:05:40.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.417+0000 7f780172d640 1 -- 172.21.15.29:0/3008287043 shutdown_connections 2024-01-25T15:05:40.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.417+0000 7f780172d640 1 --2- 172.21.15.29:0/3008287043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77fc0c0bd0 0x7f77fc06add0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.417+0000 7f780172d640 1 -- 172.21.15.29:0/3008287043 >> 172.21.15.29:0/3008287043 conn(0x7f77fc0c3b90 msgr2=0x7f77fc0c3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:40.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.417+0000 7f780172d640 1 -- 172.21.15.29:0/3008287043 shutdown_connections 2024-01-25T15:05:40.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.417+0000 7f780172d640 1 -- 172.21.15.29:0/3008287043 wait complete. 2024-01-25T15:05:40.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.418+0000 7f780172d640 1 Processor -- start 2024-01-25T15:05:40.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.418+0000 7f780172d640 1 -- start start 2024-01-25T15:05:40.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.419+0000 7f780172d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77fc0a8490 0x7f77fc0c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:40.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.419+0000 7f780172d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f77fc0c0bd0 0x7f77fc147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:40.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.419+0000 7f780172d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77fc151f30 0x7f77fc1479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:40.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.419+0000 7f780172d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc14dfa0 con 0x7f77fc0a8490 2024-01-25T15:05:40.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.419+0000 7f780172d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc0ad110 con 0x7f77fc151f30 2024-01-25T15:05:40.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.419+0000 7f780172d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc14dc00 con 0x7f77fc0c0bd0 2024-01-25T15:05:40.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.419+0000 7f77faffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77fc0a8490 0x7f77fc0c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:40.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.419+0000 7f77faffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77fc0a8490 0x7f77fc0c6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34276/0 (socket says 172.21.15.29:34276) 2024-01-25T15:05:40.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.419+0000 7f77faffd640 1 -- 172.21.15.29:0/4015683038 learned_addr learned my addr 172.21.15.29:0/4015683038 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:40.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.419+0000 7f77faffd640 1 -- 172.21.15.29:0/4015683038 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f77fc0c0bd0 msgr2=0x7f77fc147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:40.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.419+0000 7f77faffd640 1 --2- 172.21.15.29:0/4015683038 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f77fc0c0bd0 0x7f77fc147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.419+0000 7f77faffd640 1 -- 172.21.15.29:0/4015683038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77fc151f30 msgr2=0x7f77fc1479c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:40.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.419+0000 7f77faffd640 1 --2- 172.21.15.29:0/4015683038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77fc151f30 0x7f77fc1479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.419+0000 7f77faffd640 1 -- 172.21.15.29:0/4015683038 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ec009a70 con 0x7f77fc0a8490 2024-01-25T15:05:40.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.420+0000 7f77faffd640 1 --2- 172.21.15.29:0/4015683038 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77fc0a8490 0x7f77fc0c6160 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f77f400b3f0 tx=0x7f77f400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:40.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.420+0000 7f77e37fe640 1 -- 172.21.15.29:0/4015683038 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4011830 con 0x7f77fc0a8490 2024-01-25T15:05:40.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.420+0000 7f77e37fe640 1 -- 172.21.15.29:0/4015683038 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f4011990 con 0x7f77fc0a8490 2024-01-25T15:05:40.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.420+0000 7f780172d640 1 -- 172.21.15.29:0/4015683038 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77fc1ee030 con 0x7f77fc0a8490 2024-01-25T15:05:40.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.420+0000 7f77e37fe640 1 -- 172.21.15.29:0/4015683038 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4011d40 con 0x7f77fc0a8490 2024-01-25T15:05:40.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.420+0000 7f780172d640 1 -- 172.21.15.29:0/4015683038 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77fc14cf40 con 0x7f77fc0a8490 2024-01-25T15:05:40.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.421+0000 7f780172d640 1 -- 172.21.15.29:0/4015683038 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77fc0c21e0 con 0x7f77fc0a8490 2024-01-25T15:05:40.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.421+0000 7f77e37fe640 1 -- 172.21.15.29:0/4015683038 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f77f401a400 con 0x7f77fc0a8490 2024-01-25T15:05:40.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.421+0000 7f77e37fe640 1 --2- 172.21.15.29:0/4015683038 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f77e806aed0 0x7f77e806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:40.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.422+0000 7f77e37fe640 1 -- 172.21.15.29:0/4015683038 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f77f40895c0 con 0x7f77fc0a8490 2024-01-25T15:05:40.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.422+0000 7f77fa7fc640 1 --2- 172.21.15.29:0/4015683038 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f77e806aed0 0x7f77e806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:40.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.422+0000 7f77fa7fc640 1 --2- 172.21.15.29:0/4015683038 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f77e806aed0 0x7f77e806d390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f77f0000f60 tx=0x7f77f0007a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:40.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.426+0000 7f77e37fe640 1 -- 172.21.15.29:0/4015683038 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f77fc0c21e0 con 0x7f77fc0a8490 2024-01-25T15:05:40.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.607+0000 7f780172d640 1 -- 172.21.15.29:0/4015683038 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f77fc0c21e0 con 0x7f77fc0a8490 2024-01-25T15:05:40.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.607+0000 7f77e37fe640 1 -- 172.21.15.29:0/4015683038 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v38) v1 ==== 84+0+207 (secure 0 0 0) 0x7f77fc0c21e0 con 0x7f77fc0a8490 2024-01-25T15:05:40.608 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:40.608 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2024-01-25T15:05:40.608 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:40.608 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2024-01-25T15:05:40.608 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2024-01-25T15:05:40.608 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:40.609 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:40.609 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 5, 2024-01-25T15:05:40.609 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": "cephfs_metadata" 2024-01-25T15:05:40.609 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-01-25T15:05:40.609 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-01-25T15:05:40.609 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 6, 2024-01-25T15:05:40.609 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": "cephfs_data" 2024-01-25T15:05:40.609 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-01-25T15:05:40.609 INFO:teuthology.orchestra.run.smithi029.stdout:] 2024-01-25T15:05:40.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.609+0000 7f780172d640 1 -- 172.21.15.29:0/4015683038 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f77e806aed0 msgr2=0x7f77e806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:40.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.609+0000 7f780172d640 1 --2- 172.21.15.29:0/4015683038 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f77e806aed0 0x7f77e806d390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f77f0000f60 tx=0x7f77f0007a80 comp rx=0 tx=0).stop 2024-01-25T15:05:40.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.609+0000 7f780172d640 1 -- 172.21.15.29:0/4015683038 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77fc0a8490 msgr2=0x7f77fc0c6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:40.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.609+0000 7f780172d640 1 --2- 172.21.15.29:0/4015683038 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77fc0a8490 0x7f77fc0c6160 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f77f400b3f0 tx=0x7f77f400b8b0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.609+0000 7f780172d640 1 -- 172.21.15.29:0/4015683038 shutdown_connections 2024-01-25T15:05:40.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.609+0000 7f780172d640 1 --2- 172.21.15.29:0/4015683038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77fc151f30 0x7f77fc1479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.609+0000 7f780172d640 1 --2- 172.21.15.29:0/4015683038 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f77fc0c0bd0 0x7f77fc147480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.609+0000 7f780172d640 1 --2- 172.21.15.29:0/4015683038 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f77e806aed0 0x7f77e806d390 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.609+0000 7f780172d640 1 --2- 172.21.15.29:0/4015683038 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77fc0a8490 0x7f77fc0c6160 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.609+0000 7f780172d640 1 -- 172.21.15.29:0/4015683038 >> 172.21.15.29:0/4015683038 conn(0x7f77fc0c3b90 msgr2=0x7f77fc1e0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:40.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.609+0000 7f780172d640 1 -- 172.21.15.29:0/4015683038 shutdown_connections 2024-01-25T15:05:40.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.609+0000 7f780172d640 1 -- 172.21.15.29:0/4015683038 wait complete. 2024-01-25T15:05:40.621 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2024-01-25T15:05:40.621 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2024-01-25T15:05:40.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.725+0000 7f5d9cd1f640 1 Processor -- start 2024-01-25T15:05:40.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.725+0000 7f5d9cd1f640 1 -- start start 2024-01-25T15:05:40.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.726+0000 7f5d9cd1f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5d980c48d0 0x7f5d980c6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:40.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.726+0000 7f5d9cd1f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5d98155190 0x7f5d980c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:40.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.726+0000 7f5d9cd1f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d98158120 con 0x7f5d98151f80 2024-01-25T15:05:40.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.726+0000 7f5d9cd1f640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d980c4db0 con 0x7f5d98155190 2024-01-25T15:05:40.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.726+0000 7f5d9cd1f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d980c5090 con 0x7f5d980c48d0 2024-01-25T15:05:40.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.726+0000 7f5d96d9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5d98155190 0x7f5d980c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:40.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.726+0000 7f5d9659c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5d98151f80 0x7f5d981585b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42634/0 (socket says 172.21.15.29:42634) 2024-01-25T15:05:40.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.726+0000 7f5d9659c640 1 -- 172.21.15.29:0/4068296854 learned_addr learned my addr 172.21.15.29:0/4068296854 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:40.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.726+0000 7f5d96d9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5d98155190 0x7f5d980c74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34284/0 (socket says 172.21.15.29:34284) 2024-01-25T15:05:40.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.726+0000 7f5d95d9b640 1 --2- 172.21.15.29:0/4068296854 >> v2:172.21.15.52:3300/0 conn(0x7f5d980c48d0 0x7f5d980c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:40.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.726+0000 7f5d96d9d640 1 -- 172.21.15.29:0/4068296854 >> v2:172.21.15.52:3300/0 conn(0x7f5d980c48d0 msgr2=0x7f5d980c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:40.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.726+0000 7f5d96d9d640 1 --2- 172.21.15.29:0/4068296854 >> v2:172.21.15.52:3300/0 conn(0x7f5d980c48d0 0x7f5d980c6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.726+0000 7f5d96d9d640 1 -- 172.21.15.29:0/4068296854 >> v1:172.21.15.29:6789/0 conn(0x7f5d98151f80 legacy=0x7f5d981585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:40.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.726+0000 7f5d96d9d640 1 -- 172.21.15.29:0/4068296854 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d980c5370 con 0x7f5d98155190 2024-01-25T15:05:40.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.726+0000 7f5d9559a640 1 -- 172.21.15.29:0/4068296854 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246416117 0 0) 0x7f5d98158120 con 0x7f5d98151f80 2024-01-25T15:05:40.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.727+0000 7f5d96d9d640 1 --2- 172.21.15.29:0/4068296854 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d98155190 0x7f5d980c74f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5d980c2370 tx=0x7f5d8802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad38cc9fa323837a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:40.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.727+0000 7f5d9559a640 1 -- 172.21.15.29:0/4068296854 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8802cc80 con 0x7f5d98155190 2024-01-25T15:05:40.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.727+0000 7f5d9559a640 1 -- 172.21.15.29:0/4068296854 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8802cde0 con 0x7f5d98155190 2024-01-25T15:05:40.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.727+0000 7f5d9559a640 1 -- 172.21.15.29:0/4068296854 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d88034660 con 0x7f5d98155190 2024-01-25T15:05:40.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.728+0000 7f5d9cd1f640 1 -- 172.21.15.29:0/4068296854 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d98155190 msgr2=0x7f5d980c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:40.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.728+0000 7f5d9cd1f640 1 --2- 172.21.15.29:0/4068296854 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d98155190 0x7f5d980c74f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5d980c2370 tx=0x7f5d8802bed0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.728+0000 7f5d9cd1f640 1 -- 172.21.15.29:0/4068296854 shutdown_connections 2024-01-25T15:05:40.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.728+0000 7f5d9cd1f640 1 --2- 172.21.15.29:0/4068296854 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d98155190 0x7f5d980c74f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.728+0000 7f5d9cd1f640 1 --2- 172.21.15.29:0/4068296854 >> v2:172.21.15.52:3300/0 conn(0x7f5d980c48d0 0x7f5d980c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.728+0000 7f5d9cd1f640 1 -- 172.21.15.29:0/4068296854 >> 172.21.15.29:0/4068296854 conn(0x7f5d980c7f10 msgr2=0x7f5d980c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:40.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.728+0000 7f5d9cd1f640 1 -- 172.21.15.29:0/4068296854 shutdown_connections 2024-01-25T15:05:40.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.728+0000 7f5d9cd1f640 1 -- 172.21.15.29:0/4068296854 wait complete. 2024-01-25T15:05:40.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.729+0000 7f5d9cd1f640 1 Processor -- start 2024-01-25T15:05:40.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.729+0000 7f5d9cd1f640 1 -- start start 2024-01-25T15:05:40.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.730+0000 7f5d9cd1f640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d980c48d0 0x7f5d981ea760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:40.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.730+0000 7f5d9cd1f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d98151f80 0x7f5d981e7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:40.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.730+0000 7f5d9cd1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d98155190 0x7f5d9814ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:40.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.730+0000 7f5d9cd1f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d98154310 con 0x7f5d98151f80 2024-01-25T15:05:40.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.730+0000 7f5d9cd1f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d981eaca0 con 0x7f5d98155190 2024-01-25T15:05:40.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.730+0000 7f5d9cd1f640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d98153a70 con 0x7f5d980c48d0 2024-01-25T15:05:40.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.730+0000 7f5d95d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d98151f80 0x7f5d981e7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:40.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.730+0000 7f5d95d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d98151f80 0x7f5d981e7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34296/0 (socket says 172.21.15.29:34296) 2024-01-25T15:05:40.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.730+0000 7f5d95d9b640 1 -- 172.21.15.29:0/3903331180 learned_addr learned my addr 172.21.15.29:0/3903331180 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:40.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.730+0000 7f5d96d9d640 1 --2- 172.21.15.29:0/3903331180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d98155190 0x7f5d9814ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:40.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.730+0000 7f5d9659c640 1 --2- 172.21.15.29:0/3903331180 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d980c48d0 0x7f5d981ea760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:40.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.730+0000 7f5d95d9b640 1 -- 172.21.15.29:0/3903331180 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d980c48d0 msgr2=0x7f5d981ea760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:40.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.730+0000 7f5d95d9b640 1 --2- 172.21.15.29:0/3903331180 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d980c48d0 0x7f5d981ea760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.730+0000 7f5d95d9b640 1 -- 172.21.15.29:0/3903331180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d98155190 msgr2=0x7f5d9814ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:40.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.730+0000 7f5d95d9b640 1 --2- 172.21.15.29:0/3903331180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d98155190 0x7f5d9814ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:40.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.730+0000 7f5d95d9b640 1 -- 172.21.15.29:0/3903331180 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d88009a70 con 0x7f5d98151f80 2024-01-25T15:05:40.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.730+0000 7f5d96d9d640 1 --2- 172.21.15.29:0/3903331180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d98155190 0x7f5d9814ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:40.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.730+0000 7f5d95d9b640 1 --2- 172.21.15.29:0/3903331180 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d98151f80 0x7f5d981e7380 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5d8000c7f0 tx=0x7f5d8000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:40.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.731+0000 7f5d8effd640 1 -- 172.21.15.29:0/3903331180 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d80004220 con 0x7f5d98151f80 2024-01-25T15:05:40.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.731+0000 7f5d8effd640 1 -- 172.21.15.29:0/3903331180 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d80004380 con 0x7f5d98151f80 2024-01-25T15:05:40.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.731+0000 7f5d8effd640 1 -- 172.21.15.29:0/3903331180 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d80007840 con 0x7f5d98151f80 2024-01-25T15:05:40.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.731+0000 7f5d9cd1f640 1 -- 172.21.15.29:0/3903331180 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d98153d50 con 0x7f5d98151f80 2024-01-25T15:05:40.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.731+0000 7f5d9cd1f640 1 -- 172.21.15.29:0/3903331180 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d981ed3b0 con 0x7f5d98151f80 2024-01-25T15:05:40.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.732+0000 7f5d9cd1f640 1 -- 172.21.15.29:0/3903331180 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d9804eb10 con 0x7f5d98151f80 2024-01-25T15:05:40.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.732+0000 7f5d8effd640 1 -- 172.21.15.29:0/3903331180 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f5d80007bb0 con 0x7f5d98151f80 2024-01-25T15:05:40.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.733+0000 7f5d8effd640 1 --2- 172.21.15.29:0/3903331180 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5d7806aed0 0x7f5d7806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:40.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.733+0000 7f5d8effd640 1 -- 172.21.15.29:0/3903331180 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5d800896a0 con 0x7f5d98151f80 2024-01-25T15:05:40.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.733+0000 7f5d9659c640 1 --2- 172.21.15.29:0/3903331180 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5d7806aed0 0x7f5d7806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:40.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.733+0000 7f5d9659c640 1 --2- 172.21.15.29:0/3903331180 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5d7806aed0 0x7f5d7806d390 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5d90007fd0 tx=0x7f5d90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:40.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.737+0000 7f5d8effd640 1 -- 172.21.15.29:0/3903331180 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f5d80054420 con 0x7f5d98151f80 2024-01-25T15:05:40.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:40.915+0000 7f5d9cd1f640 1 -- 172.21.15.29:0/3903331180 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5d98074010 con 0x7f5d98151f80 2024-01-25T15:05:41.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.549+0000 7f5d8effd640 1 -- 172.21.15.29:0/3903331180 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v39) v1 ==== 140+0+0 (secure 0 0 0) 0x7f5d80007e60 con 0x7f5d98151f80 2024-01-25T15:05:41.550 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs2_metadata' created 2024-01-25T15:05:41.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.552+0000 7f5d9cd1f640 1 -- 172.21.15.29:0/3903331180 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5d7806aed0 msgr2=0x7f5d7806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:41.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.552+0000 7f5d9cd1f640 1 --2- 172.21.15.29:0/3903331180 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5d7806aed0 0x7f5d7806d390 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5d90007fd0 tx=0x7f5d90009040 comp rx=0 tx=0).stop 2024-01-25T15:05:41.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.552+0000 7f5d9cd1f640 1 -- 172.21.15.29:0/3903331180 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d98151f80 msgr2=0x7f5d981e7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:41.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.552+0000 7f5d9cd1f640 1 --2- 172.21.15.29:0/3903331180 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d98151f80 0x7f5d981e7380 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5d8000c7f0 tx=0x7f5d8000ccb0 comp rx=0 tx=0).stop 2024-01-25T15:05:41.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.552+0000 7f5d9cd1f640 1 -- 172.21.15.29:0/3903331180 shutdown_connections 2024-01-25T15:05:41.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.552+0000 7f5d9cd1f640 1 --2- 172.21.15.29:0/3903331180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d98155190 0x7f5d9814ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:41.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.552+0000 7f5d9cd1f640 1 --2- 172.21.15.29:0/3903331180 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5d7806aed0 0x7f5d7806d390 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:41.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.552+0000 7f5d9cd1f640 1 --2- 172.21.15.29:0/3903331180 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d98151f80 0x7f5d981e7380 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:41.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.552+0000 7f5d9cd1f640 1 --2- 172.21.15.29:0/3903331180 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d980c48d0 0x7f5d981ea760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:41.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.552+0000 7f5d9cd1f640 1 -- 172.21.15.29:0/3903331180 >> 172.21.15.29:0/3903331180 conn(0x7f5d980c7f10 msgr2=0x7f5d98155a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:41.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.553+0000 7f5d9cd1f640 1 -- 172.21.15.29:0/3903331180 shutdown_connections 2024-01-25T15:05:41.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.553+0000 7f5d9cd1f640 1 -- 172.21.15.29:0/3903331180 wait complete. 2024-01-25T15:05:41.571 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-25T15:05:41.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.685+0000 7f5a5793e640 1 Processor -- start 2024-01-25T15:05:41.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.685+0000 7f5a5793e640 1 -- start start 2024-01-25T15:05:41.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.686+0000 7f5a5793e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5a50151e90 0x7f5a50155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:41.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.686+0000 7f5a5793e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a500c7f00 0x7f5a500c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:41.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.686+0000 7f5a5793e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a50152270 con 0x7f5a500c6530 2024-01-25T15:05:41.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.686+0000 7f5a5793e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a5006c090 con 0x7f5a50151e90 2024-01-25T15:05:41.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.686+0000 7f5a5793e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a50155780 con 0x7f5a500c7f00 2024-01-25T15:05:41.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.686+0000 7f5a556da640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5a50151e90 0x7f5a50155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:41.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.686+0000 7f5a556da640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5a50151e90 0x7f5a50155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34308/0 (socket says 172.21.15.29:34308) 2024-01-25T15:05:41.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.686+0000 7f5a556da640 1 -- 172.21.15.29:0/365109246 learned_addr learned my addr 172.21.15.29:0/365109246 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:41.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.687+0000 7f5a54ed9640 1 --2- 172.21.15.29:0/365109246 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a500c7f00 0x7f5a500c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:41.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.687+0000 7f5a556da640 1 -- 172.21.15.29:0/365109246 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a500c7f00 msgr2=0x7f5a500c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:41.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.687+0000 7f5a556da640 1 --2- 172.21.15.29:0/365109246 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a500c7f00 0x7f5a500c5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:41.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.687+0000 7f5a556da640 1 -- 172.21.15.29:0/365109246 >> v1:172.21.15.52:6789/0 conn(0x7f5a500c6530 legacy=0x7f5a500c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:41.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.687+0000 7f5a556da640 1 -- 172.21.15.29:0/365109246 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5006b590 con 0x7f5a50151e90 2024-01-25T15:05:41.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.687+0000 7f5a556da640 1 --2- 172.21.15.29:0/365109246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a50151e90 0x7f5a50155240 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5a48009870 tx=0x7f5a4802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a087f5dbfdfc2c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:41.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.688+0000 7f5a47fff640 1 -- 172.21.15.29:0/365109246 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a48031640 con 0x7f5a50151e90 2024-01-25T15:05:41.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.688+0000 7f5a47fff640 1 -- 172.21.15.29:0/365109246 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a480317a0 con 0x7f5a50151e90 2024-01-25T15:05:41.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.688+0000 7f5a47fff640 1 -- 172.21.15.29:0/365109246 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a48031b30 con 0x7f5a50151e90 2024-01-25T15:05:41.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.688+0000 7f5a5793e640 1 -- 172.21.15.29:0/365109246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a50151e90 msgr2=0x7f5a50155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:41.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.688+0000 7f5a5793e640 1 --2- 172.21.15.29:0/365109246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a50151e90 0x7f5a50155240 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5a48009870 tx=0x7f5a4802b8f0 comp rx=0 tx=0).stop 2024-01-25T15:05:41.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.688+0000 7f5a5793e640 1 -- 172.21.15.29:0/365109246 shutdown_connections 2024-01-25T15:05:41.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.688+0000 7f5a5793e640 1 --2- 172.21.15.29:0/365109246 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a500c7f00 0x7f5a500c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:41.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.688+0000 7f5a5793e640 1 --2- 172.21.15.29:0/365109246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a50151e90 0x7f5a50155240 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:41.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.688+0000 7f5a5793e640 1 -- 172.21.15.29:0/365109246 >> 172.21.15.29:0/365109246 conn(0x7f5a500ca000 msgr2=0x7f5a500ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:41.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.688+0000 7f5a5793e640 1 -- 172.21.15.29:0/365109246 shutdown_connections 2024-01-25T15:05:41.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.688+0000 7f5a5793e640 1 -- 172.21.15.29:0/365109246 wait complete. 2024-01-25T15:05:41.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.689+0000 7f5a5793e640 1 Processor -- start 2024-01-25T15:05:41.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.689+0000 7f5a5793e640 1 -- start start 2024-01-25T15:05:41.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.690+0000 7f5a5793e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a500c6530 0x7f5a501ed140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:41.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.690+0000 7f5a5793e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a500c7f00 0x7f5a501eadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:41.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.690+0000 7f5a5793e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a50151e90 0x7f5a5014c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:41.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.690+0000 7f5a5793e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a501edc60 con 0x7f5a500c7f00 2024-01-25T15:05:41.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.690+0000 7f5a5793e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a501ed980 con 0x7f5a500c6530 2024-01-25T15:05:41.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.690+0000 7f5a5793e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5014cce0 con 0x7f5a50151e90 2024-01-25T15:05:41.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.690+0000 7f5a54ed9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a500c7f00 0x7f5a501eadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:41.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.690+0000 7f5a54ed9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a500c7f00 0x7f5a501eadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34312/0 (socket says 172.21.15.29:34312) 2024-01-25T15:05:41.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.690+0000 7f5a54ed9640 1 -- 172.21.15.29:0/1903355074 learned_addr learned my addr 172.21.15.29:0/1903355074 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:41.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.690+0000 7f5a556da640 1 --2- 172.21.15.29:0/1903355074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a500c6530 0x7f5a501ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:41.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.690+0000 7f5a55edb640 1 --2- 172.21.15.29:0/1903355074 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a50151e90 0x7f5a5014c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:41.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.691+0000 7f5a54ed9640 1 -- 172.21.15.29:0/1903355074 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a50151e90 msgr2=0x7f5a5014c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:41.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.691+0000 7f5a54ed9640 1 --2- 172.21.15.29:0/1903355074 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a50151e90 0x7f5a5014c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:41.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.691+0000 7f5a54ed9640 1 -- 172.21.15.29:0/1903355074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a500c6530 msgr2=0x7f5a501ed140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:41.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.691+0000 7f5a54ed9640 1 --2- 172.21.15.29:0/1903355074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a500c6530 0x7f5a501ed140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:41.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.691+0000 7f5a54ed9640 1 -- 172.21.15.29:0/1903355074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a480094d0 con 0x7f5a500c7f00 2024-01-25T15:05:41.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.691+0000 7f5a556da640 1 --2- 172.21.15.29:0/1903355074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a500c6530 0x7f5a501ed140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:41.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.691+0000 7f5a55edb640 1 --2- 172.21.15.29:0/1903355074 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a50151e90 0x7f5a5014c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:41.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.691+0000 7f5a54ed9640 1 --2- 172.21.15.29:0/1903355074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a500c7f00 0x7f5a501eadd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000d800 tx=0x7f5a4000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:41.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.691+0000 7f5a45ffb640 1 -- 172.21.15.29:0/1903355074 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4000b6c0 con 0x7f5a500c7f00 2024-01-25T15:05:41.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.691+0000 7f5a45ffb640 1 -- 172.21.15.29:0/1903355074 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4000b820 con 0x7f5a500c7f00 2024-01-25T15:05:41.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.691+0000 7f5a45ffb640 1 -- 172.21.15.29:0/1903355074 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4000bbb0 con 0x7f5a500c7f00 2024-01-25T15:05:41.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.691+0000 7f5a5793e640 1 -- 172.21.15.29:0/1903355074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a5014cfc0 con 0x7f5a500c7f00 2024-01-25T15:05:41.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.691+0000 7f5a5793e640 1 -- 172.21.15.29:0/1903355074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a501ed680 con 0x7f5a500c7f00 2024-01-25T15:05:41.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.692+0000 7f5a5793e640 1 -- 172.21.15.29:0/1903355074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a50068580 con 0x7f5a500c7f00 2024-01-25T15:05:41.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.692+0000 7f5a45ffb640 1 -- 172.21.15.29:0/1903355074 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f5a4000bd10 con 0x7f5a500c7f00 2024-01-25T15:05:41.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.693+0000 7f5a45ffb640 1 --2- 172.21.15.29:0/1903355074 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5a3406aed0 0x7f5a3406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:41.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.693+0000 7f5a45ffb640 1 -- 172.21.15.29:0/1903355074 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6400+0+0 (secure 0 0 0) 0x7f5a40089df0 con 0x7f5a500c7f00 2024-01-25T15:05:41.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.693+0000 7f5a556da640 1 --2- 172.21.15.29:0/1903355074 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5a3406aed0 0x7f5a3406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:41.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.694+0000 7f5a556da640 1 --2- 172.21.15.29:0/1903355074 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5a3406aed0 0x7f5a3406d390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5a48036000 tx=0x7f5a4803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:41.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.698+0000 7f5a45ffb640 1 -- 172.21.15.29:0/1903355074 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f5a40054aa0 con 0x7f5a500c7f00 2024-01-25T15:05:41.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:41.876+0000 7f5a5793e640 1 -- 172.21.15.29:0/1903355074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5a50074010 con 0x7f5a500c7f00 2024-01-25T15:05:42.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.553+0000 7f5a45ffb640 1 -- 172.21.15.29:0/1903355074 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v40) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5a400580c0 con 0x7f5a500c7f00 2024-01-25T15:05:42.554 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs2_data' created 2024-01-25T15:05:42.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.558+0000 7f5a5793e640 1 -- 172.21.15.29:0/1903355074 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5a3406aed0 msgr2=0x7f5a3406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:42.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.558+0000 7f5a5793e640 1 --2- 172.21.15.29:0/1903355074 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5a3406aed0 0x7f5a3406d390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5a48036000 tx=0x7f5a4803c040 comp rx=0 tx=0).stop 2024-01-25T15:05:42.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.559+0000 7f5a5793e640 1 -- 172.21.15.29:0/1903355074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a500c7f00 msgr2=0x7f5a501eadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:42.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.559+0000 7f5a5793e640 1 --2- 172.21.15.29:0/1903355074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a500c7f00 0x7f5a501eadd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000d800 tx=0x7f5a4000dcc0 comp rx=0 tx=0).stop 2024-01-25T15:05:42.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.571+0000 7f5a5793e640 1 -- 172.21.15.29:0/1903355074 shutdown_connections 2024-01-25T15:05:42.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.571+0000 7f5a5793e640 1 --2- 172.21.15.29:0/1903355074 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5a50151e90 0x7f5a5014c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:42.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.571+0000 7f5a5793e640 1 --2- 172.21.15.29:0/1903355074 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5a3406aed0 0x7f5a3406d390 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:42.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.571+0000 7f5a5793e640 1 --2- 172.21.15.29:0/1903355074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a500c7f00 0x7f5a501eadd0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:42.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.571+0000 7f5a5793e640 1 --2- 172.21.15.29:0/1903355074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a500c6530 0x7f5a501ed140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:42.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.571+0000 7f5a5793e640 1 -- 172.21.15.29:0/1903355074 >> 172.21.15.29:0/1903355074 conn(0x7f5a500ca000 msgr2=0x7f5a500ca3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:42.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.575+0000 7f5a5793e640 1 -- 172.21.15.29:0/1903355074 shutdown_connections 2024-01-25T15:05:42.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.575+0000 7f5a5793e640 1 -- 172.21.15.29:0/1903355074 wait complete. 2024-01-25T15:05:42.590 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2024-01-25T15:05:42.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.698+0000 7f99e5182640 1 Processor -- start 2024-01-25T15:05:42.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.698+0000 7f99e5182640 1 -- start start 2024-01-25T15:05:42.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.699+0000 7f99e5182640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f99e006d560 0x7f99e006b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:42.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.699+0000 7f99e5182640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e00afaa0 con 0x7f99e00af6c0 2024-01-25T15:05:42.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.699+0000 7f99e5182640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e00c6060 con 0x7f99e00c4fe0 2024-01-25T15:05:42.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.699+0000 7f99e5182640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e006c480 con 0x7f99e006d560 2024-01-25T15:05:42.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.699+0000 7f99ded9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f99e00af6c0 0x7f99e00c5530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42646/0 (socket says 172.21.15.29:42646) 2024-01-25T15:05:42.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.699+0000 7f99ded9d640 1 -- 172.21.15.29:0/4055007220 learned_addr learned my addr 172.21.15.29:0/4055007220 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:42.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.699+0000 7f99de59c640 1 --2- 172.21.15.29:0/4055007220 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f99e006d560 0x7f99e006b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:42.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.699+0000 7f99ddd9b640 1 -- 172.21.15.29:0/4055007220 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275205487 0 0) 0x7f99e00afaa0 con 0x7f99e00af6c0 2024-01-25T15:05:42.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.699+0000 7f99ddd9b640 1 -- 172.21.15.29:0/4055007220 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99cc003520 con 0x7f99e00af6c0 2024-01-25T15:05:42.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99ddd9b640 1 -- 172.21.15.29:0/4055007220 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2335442634 0 0) 0x7f99e00c6060 con 0x7f99e00c4fe0 2024-01-25T15:05:42.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99ddd9b640 1 -- 172.21.15.29:0/4055007220 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99e00afaa0 con 0x7f99e00c4fe0 2024-01-25T15:05:42.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99ddd9b640 1 -- 172.21.15.29:0/4055007220 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1930021249 0 0) 0x7f99cc003520 con 0x7f99e00af6c0 2024-01-25T15:05:42.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99ddd9b640 1 -- 172.21.15.29:0/4055007220 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f99e006d560 msgr2=0x7f99e006b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:42.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99ddd9b640 1 --2- 172.21.15.29:0/4055007220 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f99e006d560 0x7f99e006b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:42.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99ddd9b640 1 -- 172.21.15.29:0/4055007220 >> v1:172.21.15.52:6789/0 conn(0x7f99e00c4fe0 legacy=0x7f99e006b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:42.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99ddd9b640 1 -- 172.21.15.29:0/4055007220 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e0155480 con 0x7f99e00af6c0 2024-01-25T15:05:42.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99ddd9b640 1 -- 172.21.15.29:0/4055007220 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f99d8001670 con 0x7f99e00af6c0 2024-01-25T15:05:42.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99ddd9b640 1 -- 172.21.15.29:0/4055007220 >> v1:172.21.15.29:6789/0 conn(0x7f99e00af6c0 legacy=0x7f99e00c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:42.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99ddd9b640 1 --2- 172.21.15.29:0/4055007220 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc003ba0 0x7f99cc003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:42.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99ddd9b640 1 --2- 172.21.15.29:0/4055007220 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f99e006d560 0x7f99cc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:42.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99ddd9b640 1 --2- 172.21.15.29:0/4055007220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99cc004d00 0x7f99cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:42.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99ddd9b640 1 -- 172.21.15.29:0/4055007220 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e006c480 con 0x7f99cc003ba0 2024-01-25T15:05:42.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99ddd9b640 1 -- 172.21.15.29:0/4055007220 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc00bab0 con 0x7f99cc004d00 2024-01-25T15:05:42.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99ddd9b640 1 -- 172.21.15.29:0/4055007220 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc00bc70 con 0x7f99e006d560 2024-01-25T15:05:42.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99ded9d640 1 --2- 172.21.15.29:0/4055007220 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc003ba0 0x7f99cc003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:42.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99df59e640 1 --2- 172.21.15.29:0/4055007220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99cc004d00 0x7f99cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:42.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99de59c640 1 --2- 172.21.15.29:0/4055007220 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f99e006d560 0x7f99cc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:42.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99ded9d640 1 -- 172.21.15.29:0/4055007220 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f99e006d560 msgr2=0x7f99cc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:42.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99ded9d640 1 --2- 172.21.15.29:0/4055007220 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f99e006d560 0x7f99cc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:42.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99ded9d640 1 -- 172.21.15.29:0/4055007220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99cc004d00 msgr2=0x7f99cc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:42.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99ded9d640 1 --2- 172.21.15.29:0/4055007220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99cc004d00 0x7f99cc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:42.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99ded9d640 1 -- 172.21.15.29:0/4055007220 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc003520 con 0x7f99cc003ba0 2024-01-25T15:05:42.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.700+0000 7f99df59e640 1 --2- 172.21.15.29:0/4055007220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99cc004d00 0x7f99cc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:42.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.701+0000 7f99ded9d640 1 --2- 172.21.15.29:0/4055007220 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc003ba0 0x7f99cc003fa0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f99d8007fa0 tx=0x7f99cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134d0b6f011f7089 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:42.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.701+0000 7f99ddd9b640 1 -- 172.21.15.29:0/4055007220 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8005ad0 con 0x7f99cc003ba0 2024-01-25T15:05:42.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.701+0000 7f99ddd9b640 1 -- 172.21.15.29:0/4055007220 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d8005c50 con 0x7f99cc003ba0 2024-01-25T15:05:42.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.701+0000 7f99ddd9b640 1 -- 172.21.15.29:0/4055007220 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8007070 con 0x7f99cc003ba0 2024-01-25T15:05:42.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.701+0000 7f99e5182640 1 -- 172.21.15.29:0/4055007220 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc003ba0 msgr2=0x7f99cc003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:42.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.701+0000 7f99e5182640 1 --2- 172.21.15.29:0/4055007220 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc003ba0 0x7f99cc003fa0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f99d8007fa0 tx=0x7f99cc0057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:42.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.701+0000 7f99df59e640 1 -- 172.21.15.29:0/4055007220 reap_dead start 2024-01-25T15:05:42.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.701+0000 7f99e5182640 1 -- 172.21.15.29:0/4055007220 shutdown_connections 2024-01-25T15:05:42.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.701+0000 7f99e5182640 1 -- 172.21.15.29:0/4055007220 >> 172.21.15.29:0/4055007220 conn(0x7f99e00c6ca0 msgr2=0x7f99e00c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:42.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.702+0000 7f99e5182640 1 -- 172.21.15.29:0/4055007220 shutdown_connections 2024-01-25T15:05:42.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.702+0000 7f99e5182640 1 -- 172.21.15.29:0/4055007220 wait complete. 2024-01-25T15:05:42.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.703+0000 7f99e5182640 1 Processor -- start 2024-01-25T15:05:42.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.703+0000 7f99e5182640 1 -- start start 2024-01-25T15:05:42.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.704+0000 7f99e5182640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc003ba0 0x7f99e00c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:42.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.704+0000 7f99e5182640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f99e00bd450 0x7f99e01eb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:42.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.704+0000 7f99e5182640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99e01ed680 0x7f99e01edb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:42.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.704+0000 7f99e5182640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e00c2c90 con 0x7f99cc003ba0 2024-01-25T15:05:42.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.704+0000 7f99e5182640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e00c3bf0 con 0x7f99e01ed680 2024-01-25T15:05:42.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.704+0000 7f99e5182640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e00c3ed0 con 0x7f99e00bd450 2024-01-25T15:05:42.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.704+0000 7f99ded9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc003ba0 0x7f99e00c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:42.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.704+0000 7f99ded9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc003ba0 0x7f99e00c2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34324/0 (socket says 172.21.15.29:34324) 2024-01-25T15:05:42.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.704+0000 7f99ded9d640 1 -- 172.21.15.29:0/3612172146 learned_addr learned my addr 172.21.15.29:0/3612172146 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:42.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.704+0000 7f99df59e640 1 --2- 172.21.15.29:0/3612172146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99e01ed680 0x7f99e01edb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:42.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.704+0000 7f99de59c640 1 --2- 172.21.15.29:0/3612172146 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f99e00bd450 0x7f99e01eb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:42.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.704+0000 7f99ded9d640 1 -- 172.21.15.29:0/3612172146 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f99e00bd450 msgr2=0x7f99e01eb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:42.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.704+0000 7f99ded9d640 1 --2- 172.21.15.29:0/3612172146 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f99e00bd450 0x7f99e01eb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:42.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.704+0000 7f99ded9d640 1 -- 172.21.15.29:0/3612172146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99e01ed680 msgr2=0x7f99e01edb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:42.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.704+0000 7f99ded9d640 1 --2- 172.21.15.29:0/3612172146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99e01ed680 0x7f99e01edb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:42.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.704+0000 7f99ded9d640 1 -- 172.21.15.29:0/3612172146 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e00c1c70 con 0x7f99cc003ba0 2024-01-25T15:05:42.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.704+0000 7f99ded9d640 1 --2- 172.21.15.29:0/3612172146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc003ba0 0x7f99e00c2750 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f99d8007fa0 tx=0x7f99e00c61f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:42.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.704+0000 7f99d77fe640 1 -- 172.21.15.29:0/3612172146 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8039070 con 0x7f99cc003ba0 2024-01-25T15:05:42.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.704+0000 7f99d77fe640 1 -- 172.21.15.29:0/3612172146 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d8007480 con 0x7f99cc003ba0 2024-01-25T15:05:42.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.704+0000 7f99e5182640 1 -- 172.21.15.29:0/3612172146 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e00c1f50 con 0x7f99cc003ba0 2024-01-25T15:05:42.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.705+0000 7f99d77fe640 1 -- 172.21.15.29:0/3612172146 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d802c6b0 con 0x7f99cc003ba0 2024-01-25T15:05:42.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.705+0000 7f99e5182640 1 -- 172.21.15.29:0/3612172146 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e01eb850 con 0x7f99cc003ba0 2024-01-25T15:05:42.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.705+0000 7f99e5182640 1 -- 172.21.15.29:0/3612172146 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e0074010 con 0x7f99cc003ba0 2024-01-25T15:05:42.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.706+0000 7f99d77fe640 1 -- 172.21.15.29:0/3612172146 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f99d8032070 con 0x7f99cc003ba0 2024-01-25T15:05:42.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.706+0000 7f99d77fe640 1 --2- 172.21.15.29:0/3612172146 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f99c006aed0 0x7f99c006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:42.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.707+0000 7f99d77fe640 1 -- 172.21.15.29:0/3612172146 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6783+0+0 (secure 0 0 0) 0x7f99d803c040 con 0x7f99cc003ba0 2024-01-25T15:05:42.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.707+0000 7f99de59c640 1 --2- 172.21.15.29:0/3612172146 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f99c006aed0 0x7f99c006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:42.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.707+0000 7f99de59c640 1 --2- 172.21.15.29:0/3612172146 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f99c006aed0 0x7f99c006d390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f99e00abbb0 tx=0x7f99c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:42.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.711+0000 7f99d77fe640 1 -- 172.21.15.29:0/3612172146 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f99d8076130 con 0x7f99cc003ba0 2024-01-25T15:05:42.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:42.927+0000 7f99e5182640 1 -- 172.21.15.29:0/3612172146 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f99e00c9090 con 0x7f99cc003ba0 2024-01-25T15:05:43.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.564+0000 7f99d77fe640 1 -- 172.21.15.29:0/3612172146 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 7 and data pool 8 v18) v1 ==== 175+0+0 (secure 0 0 0) 0x7f99d8079750 con 0x7f99cc003ba0 2024-01-25T15:05:43.566 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 7 and data pool 8 2024-01-25T15:05:43.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.574+0000 7f99e5182640 1 -- 172.21.15.29:0/3612172146 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f99c006aed0 msgr2=0x7f99c006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:43.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.574+0000 7f99e5182640 1 --2- 172.21.15.29:0/3612172146 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f99c006aed0 0x7f99c006d390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f99e00abbb0 tx=0x7f99c8008040 comp rx=0 tx=0).stop 2024-01-25T15:05:43.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.574+0000 7f99e5182640 1 -- 172.21.15.29:0/3612172146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc003ba0 msgr2=0x7f99e00c2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:43.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.574+0000 7f99e5182640 1 --2- 172.21.15.29:0/3612172146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc003ba0 0x7f99e00c2750 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f99d8007fa0 tx=0x7f99e00c61f0 comp rx=0 tx=0).stop 2024-01-25T15:05:43.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.575+0000 7f99e5182640 1 -- 172.21.15.29:0/3612172146 shutdown_connections 2024-01-25T15:05:43.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.575+0000 7f99e5182640 1 --2- 172.21.15.29:0/3612172146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99e01ed680 0x7f99e01edb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:43.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.575+0000 7f99e5182640 1 --2- 172.21.15.29:0/3612172146 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f99e00bd450 0x7f99e01eb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:43.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.575+0000 7f99e5182640 1 --2- 172.21.15.29:0/3612172146 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f99c006aed0 0x7f99c006d390 secure :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f99e00abbb0 tx=0x7f99c8008040 comp rx=0 tx=0).stop 2024-01-25T15:05:43.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.575+0000 7f99e5182640 1 --2- 172.21.15.29:0/3612172146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99cc003ba0 0x7f99e00c2750 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:43.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.575+0000 7f99e5182640 1 -- 172.21.15.29:0/3612172146 >> 172.21.15.29:0/3612172146 conn(0x7f99e00c6ca0 msgr2=0x7f99e00c8430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:43.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.577+0000 7f99e5182640 1 -- 172.21.15.29:0/3612172146 shutdown_connections 2024-01-25T15:05:43.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.577+0000 7f99e5182640 1 -- 172.21.15.29:0/3612172146 wait complete. 2024-01-25T15:05:43.599 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:43.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.702+0000 7fe50e5bd640 1 Processor -- start 2024-01-25T15:05:43.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.702+0000 7fe50e5bd640 1 -- start start 2024-01-25T15:05:43.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.703+0000 7fe50e5bd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe5080c55e0 0x7fe508155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:43.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.703+0000 7fe50e5bd640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5080c66c0 con 0x7fe5080c4f00 2024-01-25T15:05:43.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.703+0000 7fe50e5bd640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe50806cfc0 con 0x7fe5081520b0 2024-01-25T15:05:43.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.703+0000 7fe50e5bd640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe508152490 con 0x7fe5080c55e0 2024-01-25T15:05:43.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.703+0000 7fe5077fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe5080c55e0 0x7fe508155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:43.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.703+0000 7fe50cb5a640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe5080c4f00 0x7fe5080c5b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42648/0 (socket says 172.21.15.29:42648) 2024-01-25T15:05:43.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.703+0000 7fe50cb5a640 1 -- 172.21.15.29:0/3901283784 learned_addr learned my addr 172.21.15.29:0/3901283784 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:43.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.704+0000 7fe5077fe640 1 -- 172.21.15.29:0/3901283784 >> v1:172.21.15.52:6789/0 conn(0x7fe5081520b0 legacy=0x7fe5080c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:43.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.704+0000 7fe5077fe640 1 -- 172.21.15.29:0/3901283784 >> v1:172.21.15.29:6789/0 conn(0x7fe5080c4f00 legacy=0x7fe5080c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:43.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.704+0000 7fe5077fe640 1 -- 172.21.15.29:0/3901283784 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5080c8830 con 0x7fe5080c55e0 2024-01-25T15:05:43.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.704+0000 7fe506ffd640 1 -- 172.21.15.29:0/3901283784 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1448166153 0 0) 0x7fe5080c66c0 con 0x7fe5080c4f00 2024-01-25T15:05:43.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.704+0000 7fe5077fe640 1 --2- 172.21.15.29:0/3901283784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5080c55e0 0x7fe508155570 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0097a0 tx=0x7fe4fc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5818776ffc8862 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:43.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.704+0000 7fe506ffd640 1 -- 172.21.15.29:0/3901283784 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc031830 con 0x7fe5080c55e0 2024-01-25T15:05:43.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.704+0000 7fe506ffd640 1 -- 172.21.15.29:0/3901283784 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4fc031990 con 0x7fe5080c55e0 2024-01-25T15:05:43.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.704+0000 7fe506ffd640 1 -- 172.21.15.29:0/3901283784 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc031d20 con 0x7fe5080c55e0 2024-01-25T15:05:43.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.705+0000 7fe50e5bd640 1 -- 172.21.15.29:0/3901283784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5080c55e0 msgr2=0x7fe508155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:43.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.705+0000 7fe50e5bd640 1 --2- 172.21.15.29:0/3901283784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5080c55e0 0x7fe508155570 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0097a0 tx=0x7fe4fc02b8d0 comp rx=0 tx=0).stop 2024-01-25T15:05:43.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.705+0000 7fe50e5bd640 1 -- 172.21.15.29:0/3901283784 shutdown_connections 2024-01-25T15:05:43.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.705+0000 7fe50e5bd640 1 --2- 172.21.15.29:0/3901283784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5080c55e0 0x7fe508155570 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:43.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.705+0000 7fe50e5bd640 1 -- 172.21.15.29:0/3901283784 >> 172.21.15.29:0/3901283784 conn(0x7fe5080ca220 msgr2=0x7fe5080ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:43.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.705+0000 7fe50e5bd640 1 -- 172.21.15.29:0/3901283784 shutdown_connections 2024-01-25T15:05:43.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.705+0000 7fe50e5bd640 1 -- 172.21.15.29:0/3901283784 wait complete. 2024-01-25T15:05:43.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.706+0000 7fe50e5bd640 1 Processor -- start 2024-01-25T15:05:43.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.706+0000 7fe50e5bd640 1 -- start start 2024-01-25T15:05:43.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.707+0000 7fe50e5bd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5080c4f00 0x7fe5081eb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:43.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.707+0000 7fe50e5bd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5081520b0 0x7fe5080aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:43.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.707+0000 7fe50e5bd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe50814dff0 0x7fe50814cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:43.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.707+0000 7fe50e5bd640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5080af6f0 con 0x7fe50814dff0 2024-01-25T15:05:43.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.707+0000 7fe50e5bd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50814c350 con 0x7fe5080c4f00 2024-01-25T15:05:43.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.707+0000 7fe50e5bd640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5081eab90 con 0x7fe5081520b0 2024-01-25T15:05:43.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.707+0000 7fe50cb5a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe50814dff0 0x7fe50814cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:43.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.707+0000 7fe50cb5a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe50814dff0 0x7fe50814cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34340/0 (socket says 172.21.15.29:34340) 2024-01-25T15:05:43.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.707+0000 7fe50cb5a640 1 -- 172.21.15.29:0/2683277785 learned_addr learned my addr 172.21.15.29:0/2683277785 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:43.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.707+0000 7fe5077fe640 1 --2- 172.21.15.29:0/2683277785 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5081520b0 0x7fe5080aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:43.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.707+0000 7fe507fff640 1 --2- 172.21.15.29:0/2683277785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5080c4f00 0x7fe5081eb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:43.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.707+0000 7fe50cb5a640 1 -- 172.21.15.29:0/2683277785 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5081520b0 msgr2=0x7fe5080aaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:43.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.707+0000 7fe50cb5a640 1 --2- 172.21.15.29:0/2683277785 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5081520b0 0x7fe5080aaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:43.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.707+0000 7fe50cb5a640 1 -- 172.21.15.29:0/2683277785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5080c4f00 msgr2=0x7fe5081eb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:43.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.707+0000 7fe50cb5a640 1 --2- 172.21.15.29:0/2683277785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5080c4f00 0x7fe5081eb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:43.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.707+0000 7fe50cb5a640 1 -- 172.21.15.29:0/2683277785 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4fc009400 con 0x7fe50814dff0 2024-01-25T15:05:43.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.708+0000 7fe50cb5a640 1 --2- 172.21.15.29:0/2683277785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe50814dff0 0x7fe50814cda0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe50000c7d0 tx=0x7fe50000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:43.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.708+0000 7fe504ff9640 1 -- 172.21.15.29:0/2683277785 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50000a640 con 0x7fe50814dff0 2024-01-25T15:05:43.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.708+0000 7fe504ff9640 1 -- 172.21.15.29:0/2683277785 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50000a7a0 con 0x7fe50814dff0 2024-01-25T15:05:43.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.708+0000 7fe50e5bd640 1 -- 172.21.15.29:0/2683277785 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5081eae70 con 0x7fe50814dff0 2024-01-25T15:05:43.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.708+0000 7fe504ff9640 1 -- 172.21.15.29:0/2683277785 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50000ab90 con 0x7fe50814dff0 2024-01-25T15:05:43.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.708+0000 7fe50e5bd640 1 -- 172.21.15.29:0/2683277785 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50814c880 con 0x7fe50814dff0 2024-01-25T15:05:43.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.709+0000 7fe50e5bd640 1 -- 172.21.15.29:0/2683277785 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe508062320 con 0x7fe50814dff0 2024-01-25T15:05:43.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.709+0000 7fe504ff9640 1 -- 172.21.15.29:0/2683277785 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fe50000acf0 con 0x7fe50814dff0 2024-01-25T15:05:43.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.710+0000 7fe504ff9640 1 --2- 172.21.15.29:0/2683277785 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe4f406aed0 0x7fe4f406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:43.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.710+0000 7fe504ff9640 1 -- 172.21.15.29:0/2683277785 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fe5000891c0 con 0x7fe50814dff0 2024-01-25T15:05:43.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.710+0000 7fe507fff640 1 --2- 172.21.15.29:0/2683277785 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe4f406aed0 0x7fe4f406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:43.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.710+0000 7fe507fff640 1 --2- 172.21.15.29:0/2683277785 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe4f406aed0 0x7fe4f406d390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe5080ab7b0 tx=0x7fe4f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:43.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.714+0000 7fe504ff9640 1 -- 172.21.15.29:0/2683277785 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fe500053d30 con 0x7fe50814dff0 2024-01-25T15:05:43.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.893+0000 7fe50e5bd640 1 -- 172.21.15.29:0/2683277785 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe50814ca70 con 0x7fe50814dff0 2024-01-25T15:05:43.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.895+0000 7fe504ff9640 1 -- 172.21.15.29:0/2683277785 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+20468 (secure 0 0 0) 0x7fe500057350 con 0x7fe50814dff0 2024-01-25T15:05:43.896 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:43.896 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":41,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:05:42.928621+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:05:25.099043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-25T15:05:25.537967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-25T15:05:40.935431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-25T15:05:41.895611+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:43.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.896+0000 7fe50e5bd640 1 -- 172.21.15.29:0/2683277785 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe4f406aed0 msgr2=0x7fe4f406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:43.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.896+0000 7fe50e5bd640 1 --2- 172.21.15.29:0/2683277785 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe4f406aed0 0x7fe4f406d390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe5080ab7b0 tx=0x7fe4f8009040 comp rx=0 tx=0).stop 2024-01-25T15:05:43.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.896+0000 7fe50e5bd640 1 -- 172.21.15.29:0/2683277785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe50814dff0 msgr2=0x7fe50814cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:43.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.897+0000 7fe50e5bd640 1 --2- 172.21.15.29:0/2683277785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe50814dff0 0x7fe50814cda0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe50000c7d0 tx=0x7fe50000cc90 comp rx=0 tx=0).stop 2024-01-25T15:05:43.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.897+0000 7fe50e5bd640 1 -- 172.21.15.29:0/2683277785 shutdown_connections 2024-01-25T15:05:43.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.897+0000 7fe50e5bd640 1 --2- 172.21.15.29:0/2683277785 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fe4f406aed0 0x7fe4f406d390 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:43.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.897+0000 7fe50e5bd640 1 --2- 172.21.15.29:0/2683277785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe50814dff0 0x7fe50814cda0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:43.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.897+0000 7fe50e5bd640 1 --2- 172.21.15.29:0/2683277785 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5081520b0 0x7fe5080aaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:43.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.897+0000 7fe50e5bd640 1 --2- 172.21.15.29:0/2683277785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5080c4f00 0x7fe5081eb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:43.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.897+0000 7fe50e5bd640 1 -- 172.21.15.29:0/2683277785 >> 172.21.15.29:0/2683277785 conn(0x7fe5080ca220 msgr2=0x7fe5080730a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:43.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.897+0000 7fe50e5bd640 1 -- 172.21.15.29:0/2683277785 shutdown_connections 2024-01-25T15:05:43.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:43.897+0000 7fe50e5bd640 1 -- 172.21.15.29:0/2683277785 wait complete. 2024-01-25T15:05:43.908 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:44.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.009+0000 7f25dbf1f640 1 Processor -- start 2024-01-25T15:05:44.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.009+0000 7f25dbf1f640 1 -- start start 2024-01-25T15:05:44.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.010+0000 7f25dbf1f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f25d4151d10 0x7f25d4155370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:44.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.010+0000 7f25dbf1f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f25d40c75a0 0x7f25d40c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:44.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.010+0000 7f25dbf1f640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d40c7d10 con 0x7f25d40c4e30 2024-01-25T15:05:44.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.010+0000 7f25dbf1f640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d40c5260 con 0x7f25d4151d10 2024-01-25T15:05:44.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.010+0000 7f25dbf1f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d4158cb0 con 0x7f25d40c75a0 2024-01-25T15:05:44.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.010+0000 7f25d9cbb640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f25d4151d10 0x7f25d4155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:44.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.010+0000 7f25d9cbb640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f25d4151d10 0x7f25d4155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34356/0 (socket says 172.21.15.29:34356) 2024-01-25T15:05:44.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.010+0000 7f25d9cbb640 1 -- 172.21.15.29:0/2908966998 learned_addr learned my addr 172.21.15.29:0/2908966998 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:44.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.011+0000 7f25d94ba640 1 --2- 172.21.15.29:0/2908966998 >> v2:172.21.15.52:3300/0 conn(0x7f25d40c75a0 0x7f25d40c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:44.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.011+0000 7f25d9cbb640 1 -- 172.21.15.29:0/2908966998 >> v2:172.21.15.52:3300/0 conn(0x7f25d40c75a0 msgr2=0x7f25d40c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:44.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.011+0000 7f25d9cbb640 1 --2- 172.21.15.29:0/2908966998 >> v2:172.21.15.52:3300/0 conn(0x7f25d40c75a0 0x7f25d40c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.011+0000 7f25d9cbb640 1 -- 172.21.15.29:0/2908966998 >> v1:172.21.15.52:6789/0 conn(0x7f25d40c4e30 legacy=0x7f25d40c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:44.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.011+0000 7f25d9cbb640 1 -- 172.21.15.29:0/2908966998 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d4157ef0 con 0x7f25d4151d10 2024-01-25T15:05:44.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.011+0000 7f25d9cbb640 1 --2- 172.21.15.29:0/2908966998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25d4151d10 0x7f25d4155370 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f25d40c5ad0 tx=0x7f25d002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0f48d8c4b2878c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:44.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.012+0000 7f25d8cb9640 1 -- 172.21.15.29:0/2908966998 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0031870 con 0x7f25d4151d10 2024-01-25T15:05:44.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.012+0000 7f25d8cb9640 1 -- 172.21.15.29:0/2908966998 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d00319d0 con 0x7f25d4151d10 2024-01-25T15:05:44.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.012+0000 7f25d8cb9640 1 -- 172.21.15.29:0/2908966998 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0031d60 con 0x7f25d4151d10 2024-01-25T15:05:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.012+0000 7f25dbf1f640 1 -- 172.21.15.29:0/2908966998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25d4151d10 msgr2=0x7f25d4155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.012+0000 7f25dbf1f640 1 --2- 172.21.15.29:0/2908966998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25d4151d10 0x7f25d4155370 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f25d40c5ad0 tx=0x7f25d002b910 comp rx=0 tx=0).stop 2024-01-25T15:05:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.012+0000 7f25dbf1f640 1 -- 172.21.15.29:0/2908966998 shutdown_connections 2024-01-25T15:05:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.012+0000 7f25dbf1f640 1 --2- 172.21.15.29:0/2908966998 >> v2:172.21.15.52:3300/0 conn(0x7f25d40c75a0 0x7f25d40c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.012+0000 7f25dbf1f640 1 --2- 172.21.15.29:0/2908966998 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25d4151d10 0x7f25d4155370 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.012+0000 7f25dbf1f640 1 -- 172.21.15.29:0/2908966998 >> 172.21.15.29:0/2908966998 conn(0x7f25d40c7f10 msgr2=0x7f25d40c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.012+0000 7f25dbf1f640 1 -- 172.21.15.29:0/2908966998 shutdown_connections 2024-01-25T15:05:44.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.012+0000 7f25dbf1f640 1 -- 172.21.15.29:0/2908966998 wait complete. 2024-01-25T15:05:44.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.013+0000 7f25dbf1f640 1 Processor -- start 2024-01-25T15:05:44.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.013+0000 7f25dbf1f640 1 -- start start 2024-01-25T15:05:44.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.014+0000 7f25dbf1f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25d40c4e30 0x7f25d40ad050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:44.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.014+0000 7f25dbf1f640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f25d40c75a0 0x7f25d41534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:44.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.014+0000 7f25dbf1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25d4151d10 0x7f25d414e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:44.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.014+0000 7f25dbf1f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d414f300 con 0x7f25d40c4e30 2024-01-25T15:05:44.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.014+0000 7f25dbf1f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d40ab500 con 0x7f25d4151d10 2024-01-25T15:05:44.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.014+0000 7f25dbf1f640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d4152b00 con 0x7f25d40c75a0 2024-01-25T15:05:44.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.014+0000 7f25d9cbb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25d40c4e30 0x7f25d40ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:44.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.014+0000 7f25d9cbb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25d40c4e30 0x7f25d40ad050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34360/0 (socket says 172.21.15.29:34360) 2024-01-25T15:05:44.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.014+0000 7f25d9cbb640 1 -- 172.21.15.29:0/1002552814 learned_addr learned my addr 172.21.15.29:0/1002552814 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:44.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.014+0000 7f25d9cbb640 1 -- 172.21.15.29:0/1002552814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f25d40c75a0 msgr2=0x7f25d41534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:44.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.014+0000 7f25d9cbb640 1 --2- 172.21.15.29:0/1002552814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f25d40c75a0 0x7f25d41534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.014+0000 7f25d9cbb640 1 -- 172.21.15.29:0/1002552814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25d4151d10 msgr2=0x7f25d414e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:44.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.014+0000 7f25da4bc640 1 --2- 172.21.15.29:0/1002552814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25d4151d10 0x7f25d414e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:44.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.014+0000 7f25d9cbb640 1 --2- 172.21.15.29:0/1002552814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25d4151d10 0x7f25d414e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.014+0000 7f25d9cbb640 1 -- 172.21.15.29:0/1002552814 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d00094d0 con 0x7f25d40c4e30 2024-01-25T15:05:44.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.015+0000 7f25d9cbb640 1 --2- 172.21.15.29:0/1002552814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25d40c4e30 0x7f25d40ad050 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f25d0000c00 tx=0x7f25d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:44.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.015+0000 7f25ca7fc640 1 -- 172.21.15.29:0/1002552814 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d003abe0 con 0x7f25d40c4e30 2024-01-25T15:05:44.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.015+0000 7f25ca7fc640 1 -- 172.21.15.29:0/1002552814 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d003ad40 con 0x7f25d40c4e30 2024-01-25T15:05:44.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.015+0000 7f25dbf1f640 1 -- 172.21.15.29:0/1002552814 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d40ab750 con 0x7f25d40c4e30 2024-01-25T15:05:44.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.015+0000 7f25ca7fc640 1 -- 172.21.15.29:0/1002552814 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0044630 con 0x7f25d40c4e30 2024-01-25T15:05:44.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.015+0000 7f25dbf1f640 1 -- 172.21.15.29:0/1002552814 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d4152fc0 con 0x7f25d40c4e30 2024-01-25T15:05:44.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.016+0000 7f25dbf1f640 1 -- 172.21.15.29:0/1002552814 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d404eb10 con 0x7f25d40c4e30 2024-01-25T15:05:44.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.016+0000 7f25ca7fc640 1 -- 172.21.15.29:0/1002552814 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f25d0044790 con 0x7f25d40c4e30 2024-01-25T15:05:44.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.016+0000 7f25ca7fc640 1 --2- 172.21.15.29:0/1002552814 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f25b806aed0 0x7f25b806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:44.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.016+0000 7f25ca7fc640 1 -- 172.21.15.29:0/1002552814 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f25d002d040 con 0x7f25d40c4e30 2024-01-25T15:05:44.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.017+0000 7f25d94ba640 1 --2- 172.21.15.29:0/1002552814 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f25b806aed0 0x7f25b806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:44.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.017+0000 7f25d94ba640 1 --2- 172.21.15.29:0/1002552814 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f25b806aed0 0x7f25b806d390 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f25d40ad590 tx=0x7f25c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:44.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.021+0000 7f25ca7fc640 1 -- 172.21.15.29:0/1002552814 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f25d00df190 con 0x7f25d40c4e30 2024-01-25T15:05:44.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.200+0000 7f25dbf1f640 1 -- 172.21.15.29:0/1002552814 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25d4074080 con 0x7f25d40c4e30 2024-01-25T15:05:44.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.202+0000 7f25ca7fc640 1 -- 172.21.15.29:0/1002552814 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+20468 (secure 0 0 0) 0x7f25d0035090 con 0x7f25d40c4e30 2024-01-25T15:05:44.203 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:44.203 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":41,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:05:42.928621+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:05:25.099043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-25T15:05:25.537967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-25T15:05:40.935431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-25T15:05:41.895611+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:44.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.203+0000 7f25dbf1f640 1 -- 172.21.15.29:0/1002552814 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f25b806aed0 msgr2=0x7f25b806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:44.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.203+0000 7f25dbf1f640 1 --2- 172.21.15.29:0/1002552814 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f25b806aed0 0x7f25b806d390 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f25d40ad590 tx=0x7f25c4008040 comp rx=0 tx=0).stop 2024-01-25T15:05:44.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.203+0000 7f25dbf1f640 1 -- 172.21.15.29:0/1002552814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25d40c4e30 msgr2=0x7f25d40ad050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:44.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.203+0000 7f25dbf1f640 1 --2- 172.21.15.29:0/1002552814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25d40c4e30 0x7f25d40ad050 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f25d0000c00 tx=0x7f25d00046c0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.204+0000 7f25dbf1f640 1 -- 172.21.15.29:0/1002552814 shutdown_connections 2024-01-25T15:05:44.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.204+0000 7f25dbf1f640 1 --2- 172.21.15.29:0/1002552814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25d4151d10 0x7f25d414e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.204+0000 7f25dbf1f640 1 --2- 172.21.15.29:0/1002552814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f25d40c75a0 0x7f25d41534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.204+0000 7f25dbf1f640 1 --2- 172.21.15.29:0/1002552814 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f25b806aed0 0x7f25b806d390 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.204+0000 7f25dbf1f640 1 --2- 172.21.15.29:0/1002552814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25d40c4e30 0x7f25d40ad050 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.204+0000 7f25dbf1f640 1 -- 172.21.15.29:0/1002552814 >> 172.21.15.29:0/1002552814 conn(0x7f25d40c7f10 msgr2=0x7f25d40c29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:44.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.204+0000 7f25dbf1f640 1 -- 172.21.15.29:0/1002552814 shutdown_connections 2024-01-25T15:05:44.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.204+0000 7f25dbf1f640 1 -- 172.21.15.29:0/1002552814 wait complete. 2024-01-25T15:05:44.216 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2024-01-25T15:05:44.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.319+0000 7f93db6ca640 1 Processor -- start 2024-01-25T15:05:44.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.319+0000 7f93db6ca640 1 -- start start 2024-01-25T15:05:44.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.320+0000 7f93db6ca640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f93d406b490 0x7f93d40c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:44.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.320+0000 7f93db6ca640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f93d4158b80 0x7f93d40c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:44.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.320+0000 7f93db6ca640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f93d40c8450 0x7f93d4151c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:44.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.320+0000 7f93db6ca640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d40c88e0 con 0x7f93d40c8450 2024-01-25T15:05:44.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.320+0000 7f93db6ca640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d40c6770 con 0x7f93d406b490 2024-01-25T15:05:44.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.320+0000 7f93db6ca640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d4154f10 con 0x7f93d4158b80 2024-01-25T15:05:44.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.320+0000 7f93d9c67640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f93d40c8450 0x7f93d4151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:44.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.320+0000 7f93d9c67640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f93d40c8450 0x7f93d4151c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34372/0 (socket says 172.21.15.29:34372) 2024-01-25T15:05:44.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.320+0000 7f93d9c67640 1 -- 172.21.15.29:0/600204457 learned_addr learned my addr 172.21.15.29:0/600204457 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:44.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.320+0000 7f93d8c65640 1 --2- 172.21.15.29:0/600204457 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f93d4158b80 0x7f93d40c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:44.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.320+0000 7f93d9466640 1 --2- 172.21.15.29:0/600204457 >> v2:172.21.15.52:3300/0 conn(0x7f93d406b490 0x7f93d40c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:44.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.320+0000 7f93d9c67640 1 -- 172.21.15.29:0/600204457 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f93d4158b80 msgr2=0x7f93d40c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:44.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.320+0000 7f93d9c67640 1 --2- 172.21.15.29:0/600204457 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f93d4158b80 0x7f93d40c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.321+0000 7f93d9c67640 1 -- 172.21.15.29:0/600204457 >> v2:172.21.15.52:3300/0 conn(0x7f93d406b490 msgr2=0x7f93d40c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:44.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.321+0000 7f93d9c67640 1 --2- 172.21.15.29:0/600204457 >> v2:172.21.15.52:3300/0 conn(0x7f93d406b490 0x7f93d40c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.321+0000 7f93d9c67640 1 -- 172.21.15.29:0/600204457 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d41551f0 con 0x7f93d40c8450 2024-01-25T15:05:44.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.321+0000 7f93d9466640 1 --2- 172.21.15.29:0/600204457 >> v2:172.21.15.52:3300/0 conn(0x7f93d406b490 0x7f93d40c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:44.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.321+0000 7f93d8c65640 1 --2- 172.21.15.29:0/600204457 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f93d4158b80 0x7f93d40c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:44.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.321+0000 7f93d9c67640 1 --2- 172.21.15.29:0/600204457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d40c8450 0x7f93d4151c30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f93d40c7b60 tx=0x7f93cc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895df6f1ca894ec1 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:44.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.321+0000 7f93d3fff640 1 -- 172.21.15.29:0/600204457 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc0317e0 con 0x7f93d40c8450 2024-01-25T15:05:44.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.321+0000 7f93d3fff640 1 -- 172.21.15.29:0/600204457 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc031940 con 0x7f93d40c8450 2024-01-25T15:05:44.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.321+0000 7f93d3fff640 1 -- 172.21.15.29:0/600204457 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc031cd0 con 0x7f93d40c8450 2024-01-25T15:05:44.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.322+0000 7f93db6ca640 1 -- 172.21.15.29:0/600204457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d40c8450 msgr2=0x7f93d4151c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:44.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.322+0000 7f93db6ca640 1 --2- 172.21.15.29:0/600204457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d40c8450 0x7f93d4151c30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f93d40c7b60 tx=0x7f93cc02b880 comp rx=0 tx=0).stop 2024-01-25T15:05:44.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.322+0000 7f93db6ca640 1 -- 172.21.15.29:0/600204457 shutdown_connections 2024-01-25T15:05:44.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.322+0000 7f93db6ca640 1 --2- 172.21.15.29:0/600204457 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f93d4158b80 0x7f93d40c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.322+0000 7f93db6ca640 1 --2- 172.21.15.29:0/600204457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d40c8450 0x7f93d4151c30 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.322+0000 7f93db6ca640 1 --2- 172.21.15.29:0/600204457 >> v2:172.21.15.52:3300/0 conn(0x7f93d406b490 0x7f93d40c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.322+0000 7f93db6ca640 1 -- 172.21.15.29:0/600204457 >> 172.21.15.29:0/600204457 conn(0x7f93d40ca010 msgr2=0x7f93d40ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:44.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.322+0000 7f93db6ca640 1 -- 172.21.15.29:0/600204457 shutdown_connections 2024-01-25T15:05:44.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.322+0000 7f93db6ca640 1 -- 172.21.15.29:0/600204457 wait complete. 2024-01-25T15:05:44.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.323+0000 7f93db6ca640 1 Processor -- start 2024-01-25T15:05:44.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.323+0000 7f93db6ca640 1 -- start start 2024-01-25T15:05:44.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.324+0000 7f93db6ca640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93d406b490 0x7f93d40be880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:44.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.324+0000 7f93db6ca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d40c8450 0x7f93d40bedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:44.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.324+0000 7f93db6ca640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f93d4158b80 0x7f93d41493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:44.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.324+0000 7f93db6ca640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40bd7e0 con 0x7f93d40c8450 2024-01-25T15:05:44.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.324+0000 7f93db6ca640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40bdac0 con 0x7f93d406b490 2024-01-25T15:05:44.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.324+0000 7f93db6ca640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40bdda0 con 0x7f93d4158b80 2024-01-25T15:05:44.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.324+0000 7f93d8c65640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d40c8450 0x7f93d40bedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:44.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.324+0000 7f93d8c65640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d40c8450 0x7f93d40bedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34388/0 (socket says 172.21.15.29:34388) 2024-01-25T15:05:44.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.324+0000 7f93d8c65640 1 -- 172.21.15.29:0/1381811192 learned_addr learned my addr 172.21.15.29:0/1381811192 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:44.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.324+0000 7f93d9466640 1 --2- 172.21.15.29:0/1381811192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93d406b490 0x7f93d40be880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:44.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.324+0000 7f93d9c67640 1 --2- 172.21.15.29:0/1381811192 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f93d4158b80 0x7f93d41493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:44.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.324+0000 7f93d8c65640 1 -- 172.21.15.29:0/1381811192 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f93d4158b80 msgr2=0x7f93d41493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:44.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.324+0000 7f93d8c65640 1 --2- 172.21.15.29:0/1381811192 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f93d4158b80 0x7f93d41493b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.324+0000 7f93d8c65640 1 -- 172.21.15.29:0/1381811192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93d406b490 msgr2=0x7f93d40be880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:44.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.324+0000 7f93d8c65640 1 --2- 172.21.15.29:0/1381811192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93d406b490 0x7f93d40be880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.324+0000 7f93d8c65640 1 -- 172.21.15.29:0/1381811192 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc0094d0 con 0x7f93d40c8450 2024-01-25T15:05:44.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.324+0000 7f93d8c65640 1 --2- 172.21.15.29:0/1381811192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d40c8450 0x7f93d40bedc0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f93c800c7f0 tx=0x7f93c800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:44.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.325+0000 7f93d1ffb640 1 -- 172.21.15.29:0/1381811192 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c8007820 con 0x7f93d40c8450 2024-01-25T15:05:44.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.325+0000 7f93d1ffb640 1 -- 172.21.15.29:0/1381811192 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c8007980 con 0x7f93d40c8450 2024-01-25T15:05:44.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.325+0000 7f93db6ca640 1 -- 172.21.15.29:0/1381811192 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d40be080 con 0x7f93d40c8450 2024-01-25T15:05:44.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.325+0000 7f93d1ffb640 1 -- 172.21.15.29:0/1381811192 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c8007cf0 con 0x7f93d40c8450 2024-01-25T15:05:44.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.325+0000 7f93db6ca640 1 -- 172.21.15.29:0/1381811192 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d40c18a0 con 0x7f93d40c8450 2024-01-25T15:05:44.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.326+0000 7f93db6ca640 1 -- 172.21.15.29:0/1381811192 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d4067be0 con 0x7f93d40c8450 2024-01-25T15:05:44.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.326+0000 7f93d1ffb640 1 -- 172.21.15.29:0/1381811192 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f93c80113f0 con 0x7f93d40c8450 2024-01-25T15:05:44.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.326+0000 7f93d1ffb640 1 --2- 172.21.15.29:0/1381811192 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f93c006aed0 0x7f93c006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:44.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.327+0000 7f93d1ffb640 1 -- 172.21.15.29:0/1381811192 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f93c8089ca0 con 0x7f93d40c8450 2024-01-25T15:05:44.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.327+0000 7f93d9466640 1 --2- 172.21.15.29:0/1381811192 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f93c006aed0 0x7f93c006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:44.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.327+0000 7f93d9466640 1 --2- 172.21.15.29:0/1381811192 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f93c006aed0 0x7f93c006d390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f93c400d620 tx=0x7f93c4007810 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:44.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.331+0000 7f93d1ffb640 1 -- 172.21.15.29:0/1381811192 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f93c8054790 con 0x7f93d40c8450 2024-01-25T15:05:44.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.547+0000 7f93db6ca640 1 -- 172.21.15.29:0/1381811192 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f93d408b1b0 con 0x7f93d40c8450 2024-01-25T15:05:44.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.568+0000 7f93d1ffb640 1 -- 172.21.15.29:0/1381811192 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v19) v1 ==== 119+0+0 (secure 0 0 0) 0x7f93c8057db0 con 0x7f93d40c8450 2024-01-25T15:05:44.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.572+0000 7f93db6ca640 1 -- 172.21.15.29:0/1381811192 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f93c006aed0 msgr2=0x7f93c006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:44.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.572+0000 7f93db6ca640 1 --2- 172.21.15.29:0/1381811192 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f93c006aed0 0x7f93c006d390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f93c400d620 tx=0x7f93c4007810 comp rx=0 tx=0).stop 2024-01-25T15:05:44.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.572+0000 7f93db6ca640 1 -- 172.21.15.29:0/1381811192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d40c8450 msgr2=0x7f93d40bedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:44.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.572+0000 7f93db6ca640 1 --2- 172.21.15.29:0/1381811192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d40c8450 0x7f93d40bedc0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f93c800c7f0 tx=0x7f93c800ccb0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.572+0000 7f93db6ca640 1 -- 172.21.15.29:0/1381811192 shutdown_connections 2024-01-25T15:05:44.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.572+0000 7f93db6ca640 1 --2- 172.21.15.29:0/1381811192 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f93d4158b80 0x7f93d41493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.572+0000 7f93db6ca640 1 --2- 172.21.15.29:0/1381811192 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f93c006aed0 0x7f93c006d390 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.572+0000 7f93db6ca640 1 --2- 172.21.15.29:0/1381811192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d40c8450 0x7f93d40bedc0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.572+0000 7f93db6ca640 1 --2- 172.21.15.29:0/1381811192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93d406b490 0x7f93d40be880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.572+0000 7f93db6ca640 1 -- 172.21.15.29:0/1381811192 >> 172.21.15.29:0/1381811192 conn(0x7f93d40ca010 msgr2=0x7f93d40c59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:44.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.572+0000 7f93db6ca640 1 -- 172.21.15.29:0/1381811192 shutdown_connections 2024-01-25T15:05:44.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.572+0000 7f93db6ca640 1 -- 172.21.15.29:0/1381811192 wait complete. 2024-01-25T15:05:44.583 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-25T15:05:44.583 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2024-01-25T15:05:44.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.687+0000 7f716759e640 1 Processor -- start 2024-01-25T15:05:44.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.687+0000 7f716759e640 1 -- start start 2024-01-25T15:05:44.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.688+0000 7f716759e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7168151e10 0x7f71680c8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:44.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.688+0000 7f716759e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7168157d40 0x7f71681581d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:44.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.688+0000 7f716759e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71680c88d0 con 0x7f71680c7e80 2024-01-25T15:05:44.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.688+0000 7f716759e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71681521f0 con 0x7f7168157d40 2024-01-25T15:05:44.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.688+0000 7f716759e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716806ced0 con 0x7f7168151e10 2024-01-25T15:05:44.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.688+0000 7f7166d9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7168157d40 0x7f71681581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:44.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.688+0000 7f7165d9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f71680c7e80 0x7f71680abfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42660/0 (socket says 172.21.15.29:42660) 2024-01-25T15:05:44.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.688+0000 7f7165d9b640 1 -- 172.21.15.29:0/3214394463 learned_addr learned my addr 172.21.15.29:0/3214394463 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:44.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.688+0000 7f716659c640 1 --2- 172.21.15.29:0/3214394463 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7168151e10 0x7f71680c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:44.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.688+0000 7f7166d9d640 1 -- 172.21.15.29:0/3214394463 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7168151e10 msgr2=0x7f71680c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:44.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.688+0000 7f7166d9d640 1 --2- 172.21.15.29:0/3214394463 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7168151e10 0x7f71680c8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.688+0000 7f7166d9d640 1 -- 172.21.15.29:0/3214394463 >> v1:172.21.15.29:6789/0 conn(0x7f71680c7e80 legacy=0x7f71680abfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:44.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.688+0000 7f7166d9d640 1 -- 172.21.15.29:0/3214394463 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7168154750 con 0x7f7168157d40 2024-01-25T15:05:44.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.688+0000 7f716559a640 1 -- 172.21.15.29:0/3214394463 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141120950 0 0) 0x7f71680c88d0 con 0x7f71680c7e80 2024-01-25T15:05:44.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.689+0000 7f7166d9d640 1 --2- 172.21.15.29:0/3214394463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7168157d40 0x7f71681581d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7158009d90 tx=0x7f715802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c6089d35a876a9 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:44.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.689+0000 7f716559a640 1 -- 172.21.15.29:0/3214394463 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715802cbc0 con 0x7f7168157d40 2024-01-25T15:05:44.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.689+0000 7f716559a640 1 -- 172.21.15.29:0/3214394463 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715802cd20 con 0x7f7168157d40 2024-01-25T15:05:44.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.689+0000 7f716559a640 1 -- 172.21.15.29:0/3214394463 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7158034660 con 0x7f7168157d40 2024-01-25T15:05:44.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.690+0000 7f716759e640 1 -- 172.21.15.29:0/3214394463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7168157d40 msgr2=0x7f71681581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:44.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.690+0000 7f716759e640 1 --2- 172.21.15.29:0/3214394463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7168157d40 0x7f71681581d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7158009d90 tx=0x7f715802be10 comp rx=0 tx=0).stop 2024-01-25T15:05:44.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.690+0000 7f716759e640 1 -- 172.21.15.29:0/3214394463 shutdown_connections 2024-01-25T15:05:44.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.690+0000 7f716759e640 1 --2- 172.21.15.29:0/3214394463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7168157d40 0x7f71681581d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.690+0000 7f716759e640 1 --2- 172.21.15.29:0/3214394463 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7168151e10 0x7f71680c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.690+0000 7f716759e640 1 -- 172.21.15.29:0/3214394463 >> 172.21.15.29:0/3214394463 conn(0x7f7168072210 msgr2=0x7f7168072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:44.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.690+0000 7f716759e640 1 -- 172.21.15.29:0/3214394463 shutdown_connections 2024-01-25T15:05:44.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.690+0000 7f716759e640 1 -- 172.21.15.29:0/3214394463 wait complete. 2024-01-25T15:05:44.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.691+0000 7f716759e640 1 Processor -- start 2024-01-25T15:05:44.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.691+0000 7f716759e640 1 -- start start 2024-01-25T15:05:44.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.692+0000 7f716759e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f71680c7e80 0x7f71681583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:44.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.692+0000 7f716759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7168151e10 0x7f716814a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:44.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.692+0000 7f716759e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7168157d40 0x7f716814a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:44.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.692+0000 7f716759e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71680c3b00 con 0x7f7168157d40 2024-01-25T15:05:44.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.692+0000 7f716759e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71680ab540 con 0x7f7168151e10 2024-01-25T15:05:44.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.692+0000 7f716759e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71680ab820 con 0x7f71680c7e80 2024-01-25T15:05:44.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.692+0000 7f7166d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7168157d40 0x7f716814a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:44.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.692+0000 7f7166d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7168157d40 0x7f716814a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34412/0 (socket says 172.21.15.29:34412) 2024-01-25T15:05:44.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.692+0000 7f7166d9d640 1 -- 172.21.15.29:0/1166010566 learned_addr learned my addr 172.21.15.29:0/1166010566 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:44.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.692+0000 7f7165d9b640 1 --2- 172.21.15.29:0/1166010566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7168151e10 0x7f716814a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:44.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.692+0000 7f716659c640 1 --2- 172.21.15.29:0/1166010566 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f71680c7e80 0x7f71681583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:44.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.692+0000 7f7166d9d640 1 -- 172.21.15.29:0/1166010566 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f71680c7e80 msgr2=0x7f71681583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:44.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.692+0000 7f7166d9d640 1 --2- 172.21.15.29:0/1166010566 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f71680c7e80 0x7f71681583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.692+0000 7f7166d9d640 1 -- 172.21.15.29:0/1166010566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7168151e10 msgr2=0x7f716814a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:44.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.692+0000 7f7166d9d640 1 --2- 172.21.15.29:0/1166010566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7168151e10 0x7f716814a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:44.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.692+0000 7f7166d9d640 1 -- 172.21.15.29:0/1166010566 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7158009a70 con 0x7f7168157d40 2024-01-25T15:05:44.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.692+0000 7f7165d9b640 1 --2- 172.21.15.29:0/1166010566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7168151e10 0x7f716814a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:44.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.692+0000 7f7166d9d640 1 --2- 172.21.15.29:0/1166010566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7168157d40 0x7f716814a900 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7158009d90 tx=0x7f7158004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:44.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.693+0000 7f715effd640 1 -- 172.21.15.29:0/1166010566 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7158040650 con 0x7f7168157d40 2024-01-25T15:05:44.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.693+0000 7f715effd640 1 -- 172.21.15.29:0/1166010566 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715802ce90 con 0x7f7168157d40 2024-01-25T15:05:44.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.693+0000 7f716759e640 1 -- 172.21.15.29:0/1166010566 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71680c10f0 con 0x7f7168157d40 2024-01-25T15:05:44.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.693+0000 7f715effd640 1 -- 172.21.15.29:0/1166010566 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7158040a10 con 0x7f7168157d40 2024-01-25T15:05:44.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.693+0000 7f716759e640 1 -- 172.21.15.29:0/1166010566 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7168158900 con 0x7f7168157d40 2024-01-25T15:05:44.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.694+0000 7f716759e640 1 -- 172.21.15.29:0/1166010566 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71680c1610 con 0x7f7168157d40 2024-01-25T15:05:44.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.694+0000 7f715effd640 1 -- 172.21.15.29:0/1166010566 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7158040b70 con 0x7f7168157d40 2024-01-25T15:05:44.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.694+0000 7f715effd640 1 --2- 172.21.15.29:0/1166010566 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f714806af00 0x7f714806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:44.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.695+0000 7f715effd640 1 -- 172.21.15.29:0/1166010566 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f71580ac780 con 0x7f7168157d40 2024-01-25T15:05:44.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.695+0000 7f716659c640 1 --2- 172.21.15.29:0/1166010566 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f714806af00 0x7f714806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:44.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.695+0000 7f716659c640 1 --2- 172.21.15.29:0/1166010566 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f714806af00 0x7f714806d3c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f716000a970 tx=0x7f7160008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:44.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.699+0000 7f715effd640 1 -- 172.21.15.29:0/1166010566 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f71680c1610 con 0x7f7168157d40 2024-01-25T15:05:44.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:44.916+0000 7f716759e640 1 -- 172.21.15.29:0/1166010566 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f71680c1610 con 0x7f7168157d40 2024-01-25T15:05:45.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.572+0000 7f715effd640 1 -- 172.21.15.29:0/1166010566 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v20) v1 ==== 123+0+0 (secure 0 0 0) 0x7f71680c1610 con 0x7f7168157d40 2024-01-25T15:05:45.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.574+0000 7f716759e640 1 -- 172.21.15.29:0/1166010566 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f714806af00 msgr2=0x7f714806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:45.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.574+0000 7f716759e640 1 --2- 172.21.15.29:0/1166010566 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f714806af00 0x7f714806d3c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f716000a970 tx=0x7f7160008040 comp rx=0 tx=0).stop 2024-01-25T15:05:45.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.574+0000 7f716759e640 1 -- 172.21.15.29:0/1166010566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7168157d40 msgr2=0x7f716814a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:45.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.574+0000 7f716759e640 1 --2- 172.21.15.29:0/1166010566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7168157d40 0x7f716814a900 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7158009d90 tx=0x7f7158004a40 comp rx=0 tx=0).stop 2024-01-25T15:05:45.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.574+0000 7f716759e640 1 -- 172.21.15.29:0/1166010566 shutdown_connections 2024-01-25T15:05:45.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.574+0000 7f716759e640 1 --2- 172.21.15.29:0/1166010566 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f714806af00 0x7f714806d3c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:45.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.574+0000 7f716759e640 1 --2- 172.21.15.29:0/1166010566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7168157d40 0x7f716814a900 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:45.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.574+0000 7f716759e640 1 --2- 172.21.15.29:0/1166010566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7168151e10 0x7f716814a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:45.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.574+0000 7f716759e640 1 --2- 172.21.15.29:0/1166010566 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f71680c7e80 0x7f71681583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:45.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.574+0000 7f716759e640 1 -- 172.21.15.29:0/1166010566 >> 172.21.15.29:0/1166010566 conn(0x7f7168072210 msgr2=0x7f71680c6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:45.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.575+0000 7f716759e640 1 -- 172.21.15.29:0/1166010566 shutdown_connections 2024-01-25T15:05:45.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.575+0000 7f716759e640 1 -- 172.21.15.29:0/1166010566 wait complete. 2024-01-25T15:05:45.587 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2024-01-25T15:05:45.588 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:05:45.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.692+0000 7fea5baee640 1 Processor -- start 2024-01-25T15:05:45.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.692+0000 7fea5baee640 1 -- start start 2024-01-25T15:05:45.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.693+0000 7fea5baee640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea54151d10 0x7fea54155370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:45.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.693+0000 7fea5baee640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fea540c75a0 0x7fea540c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:45.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.693+0000 7fea5baee640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fea540c4e30 0x7fea540c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:45.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.693+0000 7fea5baee640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea540c7d10 con 0x7fea540c4e30 2024-01-25T15:05:45.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.693+0000 7fea5baee640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea54158cb0 con 0x7fea540c75a0 2024-01-25T15:05:45.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.693+0000 7fea5baee640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea54157ef0 con 0x7fea54151d10 2024-01-25T15:05:45.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.693+0000 7fea5a08b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fea540c4e30 0x7fea540c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:45.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.693+0000 7fea5a08b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fea540c4e30 0x7fea540c5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55424/0 (socket says 172.21.15.29:55424) 2024-01-25T15:05:45.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.693+0000 7fea5a08b640 1 -- 172.21.15.29:0/1204185690 learned_addr learned my addr 172.21.15.29:0/1204185690 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:45.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.693+0000 7fea5988a640 1 --2- 172.21.15.29:0/1204185690 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea54151d10 0x7fea54155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:45.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.693+0000 7fea5a08b640 1 -- 172.21.15.29:0/1204185690 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea54151d10 msgr2=0x7fea54155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:45.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.693+0000 7fea59089640 1 --2- 172.21.15.29:0/1204185690 >> v2:172.21.15.52:3300/0 conn(0x7fea540c75a0 0x7fea540c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:45.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.693+0000 7fea5a08b640 1 --2- 172.21.15.29:0/1204185690 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea54151d10 0x7fea54155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:45.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.693+0000 7fea5a08b640 1 -- 172.21.15.29:0/1204185690 >> v2:172.21.15.52:3300/0 conn(0x7fea540c75a0 msgr2=0x7fea540c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:45.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.693+0000 7fea5a08b640 1 --2- 172.21.15.29:0/1204185690 >> v2:172.21.15.52:3300/0 conn(0x7fea540c75a0 0x7fea540c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:45.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.693+0000 7fea5a08b640 1 -- 172.21.15.29:0/1204185690 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea541581d0 con 0x7fea540c4e30 2024-01-25T15:05:45.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.694+0000 7fea5a08b640 1 --2- 172.21.15.29:0/1204185690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea540c4e30 0x7fea540c5e10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fea5404fb10 tx=0x7fea4402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb48eb4513b629d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:45.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.694+0000 7fea58888640 1 -- 172.21.15.29:0/1204185690 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea44031870 con 0x7fea540c4e30 2024-01-25T15:05:45.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.694+0000 7fea58888640 1 -- 172.21.15.29:0/1204185690 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea440319d0 con 0x7fea540c4e30 2024-01-25T15:05:45.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.694+0000 7fea58888640 1 -- 172.21.15.29:0/1204185690 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea44031d60 con 0x7fea540c4e30 2024-01-25T15:05:45.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.695+0000 7fea5baee640 1 -- 172.21.15.29:0/1204185690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea540c4e30 msgr2=0x7fea540c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:45.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.695+0000 7fea5baee640 1 --2- 172.21.15.29:0/1204185690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea540c4e30 0x7fea540c5e10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fea5404fb10 tx=0x7fea4402b910 comp rx=0 tx=0).stop 2024-01-25T15:05:45.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.695+0000 7fea5baee640 1 -- 172.21.15.29:0/1204185690 shutdown_connections 2024-01-25T15:05:45.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.695+0000 7fea5baee640 1 --2- 172.21.15.29:0/1204185690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea540c4e30 0x7fea540c5e10 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:45.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.695+0000 7fea5baee640 1 --2- 172.21.15.29:0/1204185690 >> v2:172.21.15.52:3300/0 conn(0x7fea540c75a0 0x7fea540c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:45.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.695+0000 7fea5baee640 1 --2- 172.21.15.29:0/1204185690 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea54151d10 0x7fea54155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:45.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.695+0000 7fea5baee640 1 -- 172.21.15.29:0/1204185690 >> 172.21.15.29:0/1204185690 conn(0x7fea540c7f10 msgr2=0x7fea540c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:45.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.695+0000 7fea5baee640 1 -- 172.21.15.29:0/1204185690 shutdown_connections 2024-01-25T15:05:45.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.695+0000 7fea5baee640 1 -- 172.21.15.29:0/1204185690 wait complete. 2024-01-25T15:05:45.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.696+0000 7fea5baee640 1 Processor -- start 2024-01-25T15:05:45.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.696+0000 7fea5baee640 1 -- start start 2024-01-25T15:05:45.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.697+0000 7fea5baee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea540c4e30 0x7fea540c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:45.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.697+0000 7fea5baee640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea540c75a0 0x7fea5414e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:45.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.697+0000 7fea5baee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea54151d10 0x7fea5414e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:45.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.697+0000 7fea5baee640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5414eba0 con 0x7fea540c4e30 2024-01-25T15:05:45.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.697+0000 7fea5baee640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea54099e40 con 0x7fea54151d10 2024-01-25T15:05:45.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.697+0000 7fea5baee640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea541eab00 con 0x7fea540c75a0 2024-01-25T15:05:45.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.697+0000 7fea5988a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea540c4e30 0x7fea540c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:45.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.697+0000 7fea5988a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea540c4e30 0x7fea540c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55430/0 (socket says 172.21.15.29:55430) 2024-01-25T15:05:45.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.697+0000 7fea5988a640 1 -- 172.21.15.29:0/2286843388 learned_addr learned my addr 172.21.15.29:0/2286843388 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:45.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.697+0000 7fea5a08b640 1 --2- 172.21.15.29:0/2286843388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea54151d10 0x7fea5414e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:45.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.697+0000 7fea59089640 1 --2- 172.21.15.29:0/2286843388 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea540c75a0 0x7fea5414e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:45.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.697+0000 7fea5988a640 1 -- 172.21.15.29:0/2286843388 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea540c75a0 msgr2=0x7fea5414e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:45.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.697+0000 7fea5988a640 1 --2- 172.21.15.29:0/2286843388 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea540c75a0 0x7fea5414e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:45.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.697+0000 7fea5988a640 1 -- 172.21.15.29:0/2286843388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea54151d10 msgr2=0x7fea5414e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:45.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.697+0000 7fea5988a640 1 --2- 172.21.15.29:0/2286843388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea54151d10 0x7fea5414e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:45.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.697+0000 7fea5988a640 1 -- 172.21.15.29:0/2286843388 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea440094d0 con 0x7fea540c4e30 2024-01-25T15:05:45.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.697+0000 7fea5988a640 1 --2- 172.21.15.29:0/2286843388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea540c4e30 0x7fea540c6530 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00ce40 tx=0x7fea4c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:45.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.697+0000 7fea527fc640 1 -- 172.21.15.29:0/2286843388 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c003b90 con 0x7fea540c4e30 2024-01-25T15:05:45.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.697+0000 7fea527fc640 1 -- 172.21.15.29:0/2286843388 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c003cf0 con 0x7fea540c4e30 2024-01-25T15:05:45.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.697+0000 7fea527fc640 1 -- 172.21.15.29:0/2286843388 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c004240 con 0x7fea540c4e30 2024-01-25T15:05:45.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.697+0000 7fea5baee640 1 -- 172.21.15.29:0/2286843388 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea54099ad0 con 0x7fea540c4e30 2024-01-25T15:05:45.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.697+0000 7fea5baee640 1 -- 172.21.15.29:0/2286843388 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea540c6a70 con 0x7fea540c4e30 2024-01-25T15:05:45.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.698+0000 7fea5baee640 1 -- 172.21.15.29:0/2286843388 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5404eb10 con 0x7fea540c4e30 2024-01-25T15:05:45.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.699+0000 7fea527fc640 1 -- 172.21.15.29:0/2286843388 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fea4c0043a0 con 0x7fea540c4e30 2024-01-25T15:05:45.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.699+0000 7fea527fc640 1 --2- 172.21.15.29:0/2286843388 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fea4006aed0 0x7fea4006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:45.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.699+0000 7fea527fc640 1 -- 172.21.15.29:0/2286843388 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fea4c012070 con 0x7fea540c4e30 2024-01-25T15:05:45.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.699+0000 7fea59089640 1 --2- 172.21.15.29:0/2286843388 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fea4006aed0 0x7fea4006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:45.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.700+0000 7fea59089640 1 --2- 172.21.15.29:0/2286843388 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fea4006aed0 0x7fea4006d390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fea540ad1a0 tx=0x7fea48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:45.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.703+0000 7fea527fc640 1 -- 172.21.15.29:0/2286843388 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fea4c054f50 con 0x7fea540c4e30 2024-01-25T15:05:45.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.918+0000 7fea5baee640 1 -- 172.21.15.29:0/2286843388 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea54099c60 con 0x7fea540c4e30 2024-01-25T15:05:45.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.919+0000 7fea527fc640 1 -- 172.21.15.29:0/2286843388 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6180 (secure 0 0 0) 0x7fea4c003e60 con 0x7fea540c4e30 2024-01-25T15:05:45.920 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:45.920 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/3901576943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6835","nonce":3901576943},{"type":"v1","addr":"172.21.15.52:6837","nonce":3901576943}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6836/1878395580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1878395580},{"type":"v1","addr":"172.21.15.52:6836","nonce":1878395580}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:05:26.577307+0000","modified":"2024-01-25T15:05:28.881837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3222226893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3222226893},{"type":"v1","addr":"172.21.15.29:6835","nonce":3222226893}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:05:42.928937+0000","modified":"2024-01-25T15:05:44.918053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.29:6834/1607449141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1607449141},{"type":"v1","addr":"172.21.15.29:6834","nonce":1607449141}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-25T15:05:45.920 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 20 2024-01-25T15:05:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.921+0000 7fea5baee640 1 -- 172.21.15.29:0/2286843388 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fea4006aed0 msgr2=0x7fea4006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.921+0000 7fea5baee640 1 --2- 172.21.15.29:0/2286843388 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fea4006aed0 0x7fea4006d390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fea540ad1a0 tx=0x7fea48008040 comp rx=0 tx=0).stop 2024-01-25T15:05:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.921+0000 7fea5baee640 1 -- 172.21.15.29:0/2286843388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea540c4e30 msgr2=0x7fea540c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.921+0000 7fea5baee640 1 --2- 172.21.15.29:0/2286843388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea540c4e30 0x7fea540c6530 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00ce40 tx=0x7fea4c00a660 comp rx=0 tx=0).stop 2024-01-25T15:05:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.921+0000 7fea5baee640 1 -- 172.21.15.29:0/2286843388 shutdown_connections 2024-01-25T15:05:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.921+0000 7fea5baee640 1 --2- 172.21.15.29:0/2286843388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea54151d10 0x7fea5414e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.921+0000 7fea5baee640 1 --2- 172.21.15.29:0/2286843388 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fea540c75a0 0x7fea5414e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.921+0000 7fea5baee640 1 --2- 172.21.15.29:0/2286843388 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fea4006aed0 0x7fea4006d390 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.921+0000 7fea5baee640 1 --2- 172.21.15.29:0/2286843388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea540c4e30 0x7fea540c6530 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.921+0000 7fea5baee640 1 -- 172.21.15.29:0/2286843388 >> 172.21.15.29:0/2286843388 conn(0x7fea540c7f10 msgr2=0x7fea5406c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.921+0000 7fea5baee640 1 -- 172.21.15.29:0/2286843388 shutdown_connections 2024-01-25T15:05:45.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:45.921+0000 7fea5baee640 1 -- 172.21.15.29:0/2286843388 wait complete. 2024-01-25T15:05:45.932 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:46.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.033+0000 7f6c680e7640 1 Processor -- start 2024-01-25T15:05:46.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.033+0000 7f6c680e7640 1 -- start start 2024-01-25T15:05:46.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.034+0000 7f6c680e7640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6c60152060 0x7f6c6006db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.034+0000 7f6c680e7640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6c601548b0 0x7f6c60154d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.034+0000 7f6c680e7640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c600c2030 con 0x7f6c6006e090 2024-01-25T15:05:46.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.034+0000 7f6c680e7640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c60152440 con 0x7f6c60152060 2024-01-25T15:05:46.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.034+0000 7f6c680e7640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c600c2eb0 con 0x7f6c601548b0 2024-01-25T15:05:46.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.034+0000 7f6c65682640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6c6006e090 0x7f6c6006b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54474/0 (socket says 172.21.15.29:54474) 2024-01-25T15:05:46.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.034+0000 7f6c65682640 1 -- 172.21.15.29:0/1745443953 learned_addr learned my addr 172.21.15.29:0/1745443953 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:46.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.034+0000 7f6c66684640 1 --2- 172.21.15.29:0/1745443953 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6c601548b0 0x7f6c60154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:46.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.034+0000 7f6c65e83640 1 --2- 172.21.15.29:0/1745443953 >> v2:172.21.15.52:3300/0 conn(0x7f6c60152060 0x7f6c6006db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:46.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.034+0000 7f6c64e81640 1 -- 172.21.15.29:0/1745443953 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653868136 0 0) 0x7f6c600c2030 con 0x7f6c6006e090 2024-01-25T15:05:46.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.034+0000 7f6c64e81640 1 -- 172.21.15.29:0/1745443953 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c4c003520 con 0x7f6c6006e090 2024-01-25T15:05:46.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.034+0000 7f6c64e81640 1 -- 172.21.15.29:0/1745443953 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 859593783 0 0) 0x7f6c4c003520 con 0x7f6c6006e090 2024-01-25T15:05:46.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.034+0000 7f6c64e81640 1 -- 172.21.15.29:0/1745443953 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6c601548b0 msgr2=0x7f6c60154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:46.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.034+0000 7f6c64e81640 1 --2- 172.21.15.29:0/1745443953 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6c601548b0 0x7f6c60154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.034+0000 7f6c64e81640 1 -- 172.21.15.29:0/1745443953 >> v2:172.21.15.52:3300/0 conn(0x7f6c60152060 msgr2=0x7f6c6006db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:46.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.034+0000 7f6c64e81640 1 --2- 172.21.15.29:0/1745443953 >> v2:172.21.15.52:3300/0 conn(0x7f6c60152060 0x7f6c6006db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.034+0000 7f6c64e81640 1 -- 172.21.15.29:0/1745443953 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c600c1ba0 con 0x7f6c6006e090 2024-01-25T15:05:46.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.034+0000 7f6c64e81640 1 -- 172.21.15.29:0/1745443953 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f6c50001670 con 0x7f6c6006e090 2024-01-25T15:05:46.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.034+0000 7f6c64e81640 1 -- 172.21.15.29:0/1745443953 >> v1:172.21.15.29:6789/0 conn(0x7f6c6006e090 legacy=0x7f6c6006b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:46.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.034+0000 7f6c64e81640 1 --2- 172.21.15.29:0/1745443953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c4c003970 0x7f6c4c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.035+0000 7f6c64e81640 1 --2- 172.21.15.29:0/1745443953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c4c0047c0 0x7f6c4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.035+0000 7f6c64e81640 1 --2- 172.21.15.29:0/1745443953 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6c601548b0 0x7f6c4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.035+0000 7f6c64e81640 1 -- 172.21.15.29:0/1745443953 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c60152440 con 0x7f6c4c003970 2024-01-25T15:05:46.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.035+0000 7f6c64e81640 1 -- 172.21.15.29:0/1745443953 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c00b980 con 0x7f6c4c0047c0 2024-01-25T15:05:46.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.035+0000 7f6c64e81640 1 -- 172.21.15.29:0/1745443953 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c00bac0 con 0x7f6c601548b0 2024-01-25T15:05:46.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.035+0000 7f6c65e83640 1 --2- 172.21.15.29:0/1745443953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c4c003970 0x7f6c4c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:46.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.035+0000 7f6c65682640 1 --2- 172.21.15.29:0/1745443953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c4c0047c0 0x7f6c4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:46.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.035+0000 7f6c66684640 1 --2- 172.21.15.29:0/1745443953 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6c601548b0 0x7f6c4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:46.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.035+0000 7f6c65e83640 1 -- 172.21.15.29:0/1745443953 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6c601548b0 msgr2=0x7f6c4c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:46.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.035+0000 7f6c65e83640 1 --2- 172.21.15.29:0/1745443953 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6c601548b0 0x7f6c4c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.035+0000 7f6c65e83640 1 -- 172.21.15.29:0/1745443953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c4c0047c0 msgr2=0x7f6c4c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:46.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.035+0000 7f6c65e83640 1 --2- 172.21.15.29:0/1745443953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c4c0047c0 0x7f6c4c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.035+0000 7f6c65e83640 1 -- 172.21.15.29:0/1745443953 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c003520 con 0x7f6c4c003970 2024-01-25T15:05:46.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.036+0000 7f6c65e83640 1 --2- 172.21.15.29:0/1745443953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c4c003970 0x7f6c4c003d90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009af0 tx=0x7f6c4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f0425253641f00 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:46.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.036+0000 7f6c64e81640 1 -- 172.21.15.29:0/1745443953 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c02c710 con 0x7f6c4c003970 2024-01-25T15:05:46.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.036+0000 7f6c64e81640 1 -- 172.21.15.29:0/1745443953 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c02c870 con 0x7f6c4c003970 2024-01-25T15:05:46.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.036+0000 7f6c64e81640 1 -- 172.21.15.29:0/1745443953 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c02cc00 con 0x7f6c4c003970 2024-01-25T15:05:46.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.036+0000 7f6c680e7640 1 -- 172.21.15.29:0/1745443953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c4c003970 msgr2=0x7f6c4c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:46.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.036+0000 7f6c680e7640 1 --2- 172.21.15.29:0/1745443953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c4c003970 0x7f6c4c003d90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009af0 tx=0x7f6c4c0057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.036+0000 7f6c66684640 1 -- 172.21.15.29:0/1745443953 reap_dead start 2024-01-25T15:05:46.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.036+0000 7f6c680e7640 1 -- 172.21.15.29:0/1745443953 shutdown_connections 2024-01-25T15:05:46.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.036+0000 7f6c680e7640 1 -- 172.21.15.29:0/1745443953 >> 172.21.15.29:0/1745443953 conn(0x7f6c600c3260 msgr2=0x7f6c600c3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:46.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.036+0000 7f6c680e7640 1 -- 172.21.15.29:0/1745443953 shutdown_connections 2024-01-25T15:05:46.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.036+0000 7f6c680e7640 1 -- 172.21.15.29:0/1745443953 wait complete. 2024-01-25T15:05:46.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.037+0000 7f6c680e7640 1 Processor -- start 2024-01-25T15:05:46.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.038+0000 7f6c680e7640 1 -- start start 2024-01-25T15:05:46.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.038+0000 7f6c680e7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c4c003970 0x7f6c600a8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.038+0000 7f6c680e7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c600a6230 0x7f6c600a8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.038+0000 7f6c680e7640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6c6014a500 0x7f6c6014a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.038+0000 7f6c680e7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c600a8a90 con 0x7f6c600a6230 2024-01-25T15:05:46.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.038+0000 7f6c680e7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c60072810 con 0x7f6c4c003970 2024-01-25T15:05:46.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.038+0000 7f6c680e7640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c601eb0e0 con 0x7f6c6014a500 2024-01-25T15:05:46.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.038+0000 7f6c65682640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c600a6230 0x7f6c600a8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:46.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.038+0000 7f6c65682640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c600a6230 0x7f6c600a8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55456/0 (socket says 172.21.15.29:55456) 2024-01-25T15:05:46.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.038+0000 7f6c65682640 1 -- 172.21.15.29:0/1311066403 learned_addr learned my addr 172.21.15.29:0/1311066403 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:46.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.039+0000 7f6c66684640 1 --2- 172.21.15.29:0/1311066403 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6c6014a500 0x7f6c6014a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:46.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.039+0000 7f6c65e83640 1 --2- 172.21.15.29:0/1311066403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c4c003970 0x7f6c600a8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:46.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.039+0000 7f6c65682640 1 -- 172.21.15.29:0/1311066403 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6c6014a500 msgr2=0x7f6c6014a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:46.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.039+0000 7f6c65682640 1 --2- 172.21.15.29:0/1311066403 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6c6014a500 0x7f6c6014a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.039+0000 7f6c65682640 1 -- 172.21.15.29:0/1311066403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c4c003970 msgr2=0x7f6c600a8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:46.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.039+0000 7f6c65682640 1 --2- 172.21.15.29:0/1311066403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c4c003970 0x7f6c600a8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.039+0000 7f6c65682640 1 -- 172.21.15.29:0/1311066403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c600c6080 con 0x7f6c600a6230 2024-01-25T15:05:46.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.039+0000 7f6c66684640 1 --2- 172.21.15.29:0/1311066403 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6c6014a500 0x7f6c6014a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:46.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.039+0000 7f6c65682640 1 --2- 172.21.15.29:0/1311066403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c600a6230 0x7f6c600a8550 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6c5000e700 tx=0x7f6c5000ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:46.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.039+0000 7f6c567fc640 1 -- 172.21.15.29:0/1311066403 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5000ee10 con 0x7f6c600a6230 2024-01-25T15:05:46.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.039+0000 7f6c567fc640 1 -- 172.21.15.29:0/1311066403 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5000c8d0 con 0x7f6c600a6230 2024-01-25T15:05:46.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.039+0000 7f6c567fc640 1 -- 172.21.15.29:0/1311066403 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5000cc80 con 0x7f6c600a6230 2024-01-25T15:05:46.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.039+0000 7f6c680e7640 1 -- 172.21.15.29:0/1311066403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c600c6360 con 0x7f6c600a6230 2024-01-25T15:05:46.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.039+0000 7f6c680e7640 1 -- 172.21.15.29:0/1311066403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c601eb3c0 con 0x7f6c600a6230 2024-01-25T15:05:46.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.040+0000 7f6c680e7640 1 -- 172.21.15.29:0/1311066403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c6006d830 con 0x7f6c600a6230 2024-01-25T15:05:46.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.040+0000 7f6c567fc640 1 -- 172.21.15.29:0/1311066403 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6c5001d460 con 0x7f6c600a6230 2024-01-25T15:05:46.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.041+0000 7f6c567fc640 1 --2- 172.21.15.29:0/1311066403 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6c4406aed0 0x7f6c4406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.041+0000 7f6c567fc640 1 -- 172.21.15.29:0/1311066403 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f6c500899e0 con 0x7f6c600a6230 2024-01-25T15:05:46.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.041+0000 7f6c65e83640 1 --2- 172.21.15.29:0/1311066403 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6c4406aed0 0x7f6c4406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:46.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.041+0000 7f6c65e83640 1 --2- 172.21.15.29:0/1311066403 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6c4406aed0 0x7f6c4406d390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c036000 tx=0x7f6c5c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:46.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.045+0000 7f6c567fc640 1 -- 172.21.15.29:0/1311066403 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6c500544a0 con 0x7f6c600a6230 2024-01-25T15:05:46.199 INFO:tasks.ceph.mds.a.smithi029.stderr:2024-01-25T15:05:46.198+0000 7f941c58b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-25T15:05:46.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.228+0000 7f6c680e7640 1 -- 172.21.15.29:0/1311066403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c60074080 con 0x7f6c600a6230 2024-01-25T15:05:46.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.230+0000 7f6c567fc640 1 -- 172.21.15.29:0/1311066403 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+20455 (secure 0 0 0) 0x7f6c50057ac0 con 0x7f6c600a6230 2024-01-25T15:05:46.230 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:46.231 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":42,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:05:44.564655+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:05:25.099043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-25T15:05:25.537967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-25T15:05:40.935431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-25T15:05:41.895611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:46.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.231+0000 7f6c680e7640 1 -- 172.21.15.29:0/1311066403 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6c4406aed0 msgr2=0x7f6c4406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:46.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.231+0000 7f6c680e7640 1 --2- 172.21.15.29:0/1311066403 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6c4406aed0 0x7f6c4406d390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c036000 tx=0x7f6c5c030000 comp rx=0 tx=0).stop 2024-01-25T15:05:46.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.231+0000 7f6c680e7640 1 -- 172.21.15.29:0/1311066403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c600a6230 msgr2=0x7f6c600a8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:46.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.231+0000 7f6c680e7640 1 --2- 172.21.15.29:0/1311066403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c600a6230 0x7f6c600a8550 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6c5000e700 tx=0x7f6c5000ebc0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.232+0000 7f6c680e7640 1 -- 172.21.15.29:0/1311066403 shutdown_connections 2024-01-25T15:05:46.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.232+0000 7f6c680e7640 1 --2- 172.21.15.29:0/1311066403 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6c6014a500 0x7f6c6014a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.232+0000 7f6c680e7640 1 --2- 172.21.15.29:0/1311066403 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6c4406aed0 0x7f6c4406d390 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.232+0000 7f6c680e7640 1 --2- 172.21.15.29:0/1311066403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c600a6230 0x7f6c600a8550 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.232+0000 7f6c680e7640 1 --2- 172.21.15.29:0/1311066403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c4c003970 0x7f6c600a8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.232+0000 7f6c680e7640 1 -- 172.21.15.29:0/1311066403 >> 172.21.15.29:0/1311066403 conn(0x7f6c600c3260 msgr2=0x7f6c60152c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:46.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.232+0000 7f6c680e7640 1 -- 172.21.15.29:0/1311066403 shutdown_connections 2024-01-25T15:05:46.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.232+0000 7f6c680e7640 1 -- 172.21.15.29:0/1311066403 wait complete. 2024-01-25T15:05:46.244 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-25T15:05:46.244 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-25T15:05:46.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.344+0000 7fb25c4a6640 1 Processor -- start 2024-01-25T15:05:46.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.344+0000 7fb25c4a6640 1 -- start start 2024-01-25T15:05:46.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.345+0000 7fb25c4a6640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2540c29f0 0x7fb254155140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.345+0000 7fb25c4a6640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2540c2750 con 0x7fb2540c4620 2024-01-25T15:05:46.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.345+0000 7fb25c4a6640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2540c1f40 con 0x7fb25406cc80 2024-01-25T15:05:46.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.345+0000 7fb25c4a6640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2540c6120 con 0x7fb2540c29f0 2024-01-25T15:05:46.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.345+0000 7fb25aa43640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb2540c4620 0x7fb2540c4ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54488/0 (socket says 172.21.15.29:54488) 2024-01-25T15:05:46.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.346+0000 7fb25aa43640 1 -- 172.21.15.29:0/2463906270 learned_addr learned my addr 172.21.15.29:0/2463906270 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:46.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.346+0000 7fb259a41640 1 --2- 172.21.15.29:0/2463906270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2540c29f0 0x7fb254155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:46.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.346+0000 7fb259240640 1 -- 172.21.15.29:0/2463906270 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11704297 0 0) 0x7fb24c001490 con 0x7fb2540c4620 2024-01-25T15:05:46.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.346+0000 7fb259240640 1 -- 172.21.15.29:0/2463906270 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb240003520 con 0x7fb2540c4620 2024-01-25T15:05:46.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.346+0000 7fb259240640 1 -- 172.21.15.29:0/2463906270 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2831867216 0 0) 0x7fb240003520 con 0x7fb2540c4620 2024-01-25T15:05:46.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.346+0000 7fb259240640 1 -- 172.21.15.29:0/2463906270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2540c29f0 msgr2=0x7fb254155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:46.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.346+0000 7fb259240640 1 --2- 172.21.15.29:0/2463906270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2540c29f0 0x7fb254155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.346+0000 7fb259240640 1 -- 172.21.15.29:0/2463906270 >> v1:172.21.15.52:6789/0 conn(0x7fb25406cc80 legacy=0x7fb2540c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:46.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.346+0000 7fb259240640 1 -- 172.21.15.29:0/2463906270 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25406d790 con 0x7fb2540c4620 2024-01-25T15:05:46.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.346+0000 7fb259240640 1 -- 172.21.15.29:0/2463906270 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7fb24c001b80 con 0x7fb2540c4620 2024-01-25T15:05:46.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.346+0000 7fb259240640 1 -- 172.21.15.29:0/2463906270 >> v1:172.21.15.29:6789/0 conn(0x7fb2540c4620 legacy=0x7fb2540c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:46.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.346+0000 7fb259240640 1 --2- 172.21.15.29:0/2463906270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2400039a0 0x7fb240003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.346+0000 7fb259240640 1 --2- 172.21.15.29:0/2463906270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2400047c0 0x7fb240004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.346+0000 7fb259240640 1 --2- 172.21.15.29:0/2463906270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2540c29f0 0x7fb240005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.346+0000 7fb259240640 1 -- 172.21.15.29:0/2463906270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2540c6120 con 0x7fb2400047c0 2024-01-25T15:05:46.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.346+0000 7fb259240640 1 -- 172.21.15.29:0/2463906270 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24000bab0 con 0x7fb2400039a0 2024-01-25T15:05:46.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.346+0000 7fb259240640 1 -- 172.21.15.29:0/2463906270 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24000bc70 con 0x7fb2540c29f0 2024-01-25T15:05:46.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.347+0000 7fb259a41640 1 --2- 172.21.15.29:0/2463906270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2400047c0 0x7fb240004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:46.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.347+0000 7fb25a242640 1 --2- 172.21.15.29:0/2463906270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2400039a0 0x7fb240003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:46.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.347+0000 7fb25aa43640 1 --2- 172.21.15.29:0/2463906270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2540c29f0 0x7fb240005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:46.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.347+0000 7fb259a41640 1 -- 172.21.15.29:0/2463906270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2540c29f0 msgr2=0x7fb240005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:46.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.347+0000 7fb259a41640 1 --2- 172.21.15.29:0/2463906270 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2540c29f0 0x7fb240005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.347+0000 7fb259a41640 1 -- 172.21.15.29:0/2463906270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2400039a0 msgr2=0x7fb240003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:46.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.347+0000 7fb259a41640 1 --2- 172.21.15.29:0/2463906270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2400039a0 0x7fb240003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.347+0000 7fb259a41640 1 -- 172.21.15.29:0/2463906270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb240003520 con 0x7fb2400047c0 2024-01-25T15:05:46.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.348+0000 7fb259a41640 1 --2- 172.21.15.29:0/2463906270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2400047c0 0x7fb240004c40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb244009ac0 tx=0x7fb2400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33eee9d644b91413 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:46.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.348+0000 7fb259240640 1 -- 172.21.15.29:0/2463906270 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24402c6b0 con 0x7fb2400047c0 2024-01-25T15:05:46.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.348+0000 7fb259240640 1 -- 172.21.15.29:0/2463906270 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24402c810 con 0x7fb2400047c0 2024-01-25T15:05:46.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.348+0000 7fb259240640 1 -- 172.21.15.29:0/2463906270 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24402cba0 con 0x7fb2400047c0 2024-01-25T15:05:46.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.348+0000 7fb25c4a6640 1 -- 172.21.15.29:0/2463906270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2400047c0 msgr2=0x7fb240004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:46.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.348+0000 7fb25c4a6640 1 --2- 172.21.15.29:0/2463906270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2400047c0 0x7fb240004c40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb244009ac0 tx=0x7fb2400057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.348+0000 7fb25aa43640 1 -- 172.21.15.29:0/2463906270 reap_dead start 2024-01-25T15:05:46.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.348+0000 7fb25c4a6640 1 -- 172.21.15.29:0/2463906270 shutdown_connections 2024-01-25T15:05:46.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.348+0000 7fb25c4a6640 1 -- 172.21.15.29:0/2463906270 >> 172.21.15.29:0/2463906270 conn(0x7fb25406a8a0 msgr2=0x7fb25406acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:46.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.348+0000 7fb25c4a6640 1 -- 172.21.15.29:0/2463906270 shutdown_connections 2024-01-25T15:05:46.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.348+0000 7fb25c4a6640 1 -- 172.21.15.29:0/2463906270 wait complete. 2024-01-25T15:05:46.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.349+0000 7fb25c4a6640 1 Processor -- start 2024-01-25T15:05:46.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.350+0000 7fb25c4a6640 1 -- start start 2024-01-25T15:05:46.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.350+0000 7fb25c4a6640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2400047c0 0x7fb25414d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.350+0000 7fb25c4a6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2541506e0 0x7fb25414f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.350+0000 7fb25c4a6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb25414fd40 0x7fb25414a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.350+0000 7fb25c4a6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25414b270 con 0x7fb2541506e0 2024-01-25T15:05:46.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.350+0000 7fb25c4a6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2541e9910 con 0x7fb25414fd40 2024-01-25T15:05:46.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.350+0000 7fb25c4a6640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2541e9bf0 con 0x7fb2400047c0 2024-01-25T15:05:46.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.350+0000 7fb259a41640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2541506e0 0x7fb25414f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:46.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.350+0000 7fb259a41640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2541506e0 0x7fb25414f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55482/0 (socket says 172.21.15.29:55482) 2024-01-25T15:05:46.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.350+0000 7fb259a41640 1 -- 172.21.15.29:0/1958563887 learned_addr learned my addr 172.21.15.29:0/1958563887 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:46.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.350+0000 7fb25aa43640 1 --2- 172.21.15.29:0/1958563887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb25414fd40 0x7fb25414a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:46.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.350+0000 7fb25a242640 1 --2- 172.21.15.29:0/1958563887 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2400047c0 0x7fb25414d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:46.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.351+0000 7fb259a41640 1 -- 172.21.15.29:0/1958563887 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2400047c0 msgr2=0x7fb25414d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:46.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.351+0000 7fb259a41640 1 --2- 172.21.15.29:0/1958563887 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2400047c0 0x7fb25414d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.351+0000 7fb259a41640 1 -- 172.21.15.29:0/1958563887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb25414fd40 msgr2=0x7fb25414a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:46.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.351+0000 7fb259a41640 1 --2- 172.21.15.29:0/1958563887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb25414fd40 0x7fb25414a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.351+0000 7fb259a41640 1 -- 172.21.15.29:0/1958563887 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2541e9ed0 con 0x7fb2541506e0 2024-01-25T15:05:46.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.351+0000 7fb25aa43640 1 --2- 172.21.15.29:0/1958563887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb25414fd40 0x7fb25414a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:46.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.351+0000 7fb259a41640 1 --2- 172.21.15.29:0/1958563887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2541506e0 0x7fb25414f800 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb244000c00 tx=0x7fb244004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:46.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.351+0000 7fb24affd640 1 -- 172.21.15.29:0/1958563887 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb244003810 con 0x7fb2541506e0 2024-01-25T15:05:46.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.351+0000 7fb24affd640 1 -- 172.21.15.29:0/1958563887 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb244003970 con 0x7fb2541506e0 2024-01-25T15:05:46.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.351+0000 7fb25c4a6640 1 -- 172.21.15.29:0/1958563887 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2541ea1b0 con 0x7fb2541506e0 2024-01-25T15:05:46.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.351+0000 7fb24affd640 1 -- 172.21.15.29:0/1958563887 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb244003d00 con 0x7fb2541506e0 2024-01-25T15:05:46.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.351+0000 7fb25c4a6640 1 -- 172.21.15.29:0/1958563887 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb25414cd60 con 0x7fb2541506e0 2024-01-25T15:05:46.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.352+0000 7fb25c4a6640 1 -- 172.21.15.29:0/1958563887 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb254074080 con 0x7fb2541506e0 2024-01-25T15:05:46.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.352+0000 7fb24affd640 1 -- 172.21.15.29:0/1958563887 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fb244047450 con 0x7fb2541506e0 2024-01-25T15:05:46.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.353+0000 7fb24affd640 1 --2- 172.21.15.29:0/1958563887 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb23806aed0 0x7fb23806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.353+0000 7fb24affd640 1 -- 172.21.15.29:0/1958563887 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fb2440abe00 con 0x7fb2541506e0 2024-01-25T15:05:46.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.353+0000 7fb25a242640 1 --2- 172.21.15.29:0/1958563887 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb23806aed0 0x7fb23806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:46.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.353+0000 7fb25a242640 1 --2- 172.21.15.29:0/1958563887 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb23806aed0 0x7fb23806d390 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb2541edeb0 tx=0x7fb250009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:46.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.357+0000 7fb24affd640 1 -- 172.21.15.29:0/1958563887 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fb2440768e0 con 0x7fb2541506e0 2024-01-25T15:05:46.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.536+0000 7fb25c4a6640 1 -- 172.21.15.29:0/1958563887 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2541e9d60 con 0x7fb23806aed0 2024-01-25T15:05:46.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.550+0000 7fb24affd640 1 -- 172.21.15.29:0/1958563887 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527237 (secure 0 0 0) 0x7fb2541e9d60 con 0x7fb23806aed0 2024-01-25T15:05:46.557 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:46.560 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-25T15:05:46.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.554+0000 7fb25c4a6640 1 -- 172.21.15.29:0/1958563887 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb23806aed0 msgr2=0x7fb23806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:46.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.554+0000 7fb25c4a6640 1 --2- 172.21.15.29:0/1958563887 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb23806aed0 0x7fb23806d390 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb2541edeb0 tx=0x7fb250009040 comp rx=0 tx=0).stop 2024-01-25T15:05:46.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.554+0000 7fb25c4a6640 1 -- 172.21.15.29:0/1958563887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2541506e0 msgr2=0x7fb25414f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:46.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.554+0000 7fb25c4a6640 1 --2- 172.21.15.29:0/1958563887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2541506e0 0x7fb25414f800 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb244000c00 tx=0x7fb244004730 comp rx=0 tx=0).stop 2024-01-25T15:05:46.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.554+0000 7fb25c4a6640 1 -- 172.21.15.29:0/1958563887 shutdown_connections 2024-01-25T15:05:46.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.554+0000 7fb25c4a6640 1 --2- 172.21.15.29:0/1958563887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb25414fd40 0x7fb25414a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.554+0000 7fb25c4a6640 1 --2- 172.21.15.29:0/1958563887 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb23806aed0 0x7fb23806d390 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.554+0000 7fb25c4a6640 1 --2- 172.21.15.29:0/1958563887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2541506e0 0x7fb25414f800 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.554+0000 7fb25c4a6640 1 --2- 172.21.15.29:0/1958563887 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb2400047c0 0x7fb25414d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.554+0000 7fb25c4a6640 1 -- 172.21.15.29:0/1958563887 >> 172.21.15.29:0/1958563887 conn(0x7fb25406a8a0 msgr2=0x7fb2541525a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:46.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.554+0000 7fb25c4a6640 1 -- 172.21.15.29:0/1958563887 shutdown_connections 2024-01-25T15:05:46.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.554+0000 7fb25c4a6640 1 -- 172.21.15.29:0/1958563887 wait complete. 2024-01-25T15:05:46.565 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-01-25T15:05:44.935222+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596687,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":260,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254328,"kb_used_data":4876,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720392,"statfs":{"total":773094113280,"available":772833681408,"internally_reserved":0,"allocated":4993024,"data_stored":2830326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001015"},"pg_stats":[{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.577035+0000","last_change":"2024-01-25T15:05:43.565058+0000","last_active":"2024-01-25T15:05:43.577035+0000","last_peered":"2024-01-25T15:05:43.577035+0000","last_clean":"2024-01-25T15:05:43.577035+0000","last_became_active":"2024-01-25T15:05:43.564786+0000","last_became_peered":"2024-01-25T15:05:43.564786+0000","last_unstale":"2024-01-25T15:05:43.577035+0000","last_undegraded":"2024-01-25T15:05:43.577035+0000","last_fullsized":"2024-01-25T15:05:43.577035+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:21:44.556343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559638+0000","last_change":"2024-01-25T15:05:27.231656+0000","last_active":"2024-01-25T15:05:43.559638+0000","last_peered":"2024-01-25T15:05:43.559638+0000","last_clean":"2024-01-25T15:05:43.559638+0000","last_became_active":"2024-01-25T15:05:27.228184+0000","last_became_peered":"2024-01-25T15:05:27.228184+0000","last_unstale":"2024-01-25T15:05:43.559638+0000","last_undegraded":"2024-01-25T15:05:43.559638+0000","last_fullsized":"2024-01-25T15:05:43.559638+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:44:26.334164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.577973+0000","last_change":"2024-01-25T15:05:43.573666+0000","last_active":"2024-01-25T15:05:43.577973+0000","last_peered":"2024-01-25T15:05:43.577973+0000","last_clean":"2024-01-25T15:05:43.577973+0000","last_became_active":"2024-01-25T15:05:43.573347+0000","last_became_peered":"2024-01-25T15:05:43.573347+0000","last_unstale":"2024-01-25T15:05:43.577973+0000","last_undegraded":"2024-01-25T15:05:43.577973+0000","last_fullsized":"2024-01-25T15:05:43.577973+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:43:49.484854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560466+0000","last_change":"2024-01-25T15:05:27.235003+0000","last_active":"2024-01-25T15:05:43.560466+0000","last_peered":"2024-01-25T15:05:43.560466+0000","last_clean":"2024-01-25T15:05:43.560466+0000","last_became_active":"2024-01-25T15:05:27.234734+0000","last_became_peered":"2024-01-25T15:05:27.234734+0000","last_unstale":"2024-01-25T15:05:43.560466+0000","last_undegraded":"2024-01-25T15:05:43.560466+0000","last_fullsized":"2024-01-25T15:05:43.560466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:55:46.833186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.577996+0000","last_change":"2024-01-25T15:05:43.574434+0000","last_active":"2024-01-25T15:05:43.577996+0000","last_peered":"2024-01-25T15:05:43.577996+0000","last_clean":"2024-01-25T15:05:43.577996+0000","last_became_active":"2024-01-25T15:05:43.574150+0000","last_became_peered":"2024-01-25T15:05:43.574150+0000","last_unstale":"2024-01-25T15:05:43.577996+0000","last_undegraded":"2024-01-25T15:05:43.577996+0000","last_fullsized":"2024-01-25T15:05:43.577996+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:47:17.536420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.576602+0000","last_change":"2024-01-25T15:05:27.239434+0000","last_active":"2024-01-25T15:05:43.576602+0000","last_peered":"2024-01-25T15:05:43.576602+0000","last_clean":"2024-01-25T15:05:43.576602+0000","last_became_active":"2024-01-25T15:05:27.239182+0000","last_became_peered":"2024-01-25T15:05:27.239182+0000","last_unstale":"2024-01-25T15:05:43.576602+0000","last_undegraded":"2024-01-25T15:05:43.576602+0000","last_fullsized":"2024-01-25T15:05:43.576602+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:02:27.702949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.591335+0000","last_change":"2024-01-25T15:05:43.580805+0000","last_active":"2024-01-25T15:05:43.591335+0000","last_peered":"2024-01-25T15:05:43.591335+0000","last_clean":"2024-01-25T15:05:43.591335+0000","last_became_active":"2024-01-25T15:05:43.580537+0000","last_became_peered":"2024-01-25T15:05:43.580537+0000","last_unstale":"2024-01-25T15:05:43.591335+0000","last_undegraded":"2024-01-25T15:05:43.591335+0000","last_fullsized":"2024-01-25T15:05:43.591335+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:27:43.538770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.566964+0000","last_change":"2024-01-25T15:05:27.243839+0000","last_active":"2024-01-25T15:05:43.566964+0000","last_peered":"2024-01-25T15:05:43.566964+0000","last_clean":"2024-01-25T15:05:43.566964+0000","last_became_active":"2024-01-25T15:05:27.243563+0000","last_became_peered":"2024-01-25T15:05:27.243563+0000","last_unstale":"2024-01-25T15:05:43.566964+0000","last_undegraded":"2024-01-25T15:05:43.566964+0000","last_fullsized":"2024-01-25T15:05:43.566964+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:18:52.758791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.588650+0000","last_change":"2024-01-25T15:05:43.579902+0000","last_active":"2024-01-25T15:05:43.588650+0000","last_peered":"2024-01-25T15:05:43.588650+0000","last_clean":"2024-01-25T15:05:43.588650+0000","last_became_active":"2024-01-25T15:05:43.579629+0000","last_became_peered":"2024-01-25T15:05:43.579629+0000","last_unstale":"2024-01-25T15:05:43.588650+0000","last_undegraded":"2024-01-25T15:05:43.588650+0000","last_fullsized":"2024-01-25T15:05:43.588650+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:26:35.761498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.569392+0000","last_change":"2024-01-25T15:05:27.230988+0000","last_active":"2024-01-25T15:05:43.569392+0000","last_peered":"2024-01-25T15:05:43.569392+0000","last_clean":"2024-01-25T15:05:43.569392+0000","last_became_active":"2024-01-25T15:05:27.230740+0000","last_became_peered":"2024-01-25T15:05:27.230740+0000","last_unstale":"2024-01-25T15:05:43.569392+0000","last_undegraded":"2024-01-25T15:05:43.569392+0000","last_fullsized":"2024-01-25T15:05:43.569392+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:22:36.224608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.573206+0000","last_change":"2024-01-25T15:05:43.565145+0000","last_active":"2024-01-25T15:05:43.573206+0000","last_peered":"2024-01-25T15:05:43.573206+0000","last_clean":"2024-01-25T15:05:43.573206+0000","last_became_active":"2024-01-25T15:05:43.564897+0000","last_became_peered":"2024-01-25T15:05:43.564897+0000","last_unstale":"2024-01-25T15:05:43.573206+0000","last_undegraded":"2024-01-25T15:05:43.573206+0000","last_fullsized":"2024-01-25T15:05:43.573206+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:27:43.538770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.561969+0000","last_change":"2024-01-25T15:05:27.239531+0000","last_active":"2024-01-25T15:05:43.561969+0000","last_peered":"2024-01-25T15:05:43.561969+0000","last_clean":"2024-01-25T15:05:43.561969+0000","last_became_active":"2024-01-25T15:05:27.238884+0000","last_became_peered":"2024-01-25T15:05:27.238884+0000","last_unstale":"2024-01-25T15:05:43.561969+0000","last_undegraded":"2024-01-25T15:05:43.561969+0000","last_fullsized":"2024-01-25T15:05:43.561969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:26:19.413150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.574121+0000","last_change":"2024-01-25T15:05:43.573222+0000","last_active":"2024-01-25T15:05:43.574121+0000","last_peered":"2024-01-25T15:05:43.574121+0000","last_clean":"2024-01-25T15:05:43.574121+0000","last_became_active":"2024-01-25T15:05:43.572898+0000","last_became_peered":"2024-01-25T15:05:43.572898+0000","last_unstale":"2024-01-25T15:05:43.574121+0000","last_undegraded":"2024-01-25T15:05:43.574121+0000","last_fullsized":"2024-01-25T15:05:43.574121+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:26:18.604996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.570719+0000","last_change":"2024-01-25T15:05:27.236157+0000","last_active":"2024-01-25T15:05:43.570719+0000","last_peered":"2024-01-25T15:05:43.570719+0000","last_clean":"2024-01-25T15:05:43.570719+0000","last_became_active":"2024-01-25T15:05:27.235882+0000","last_became_peered":"2024-01-25T15:05:27.235882+0000","last_unstale":"2024-01-25T15:05:43.570719+0000","last_undegraded":"2024-01-25T15:05:43.570719+0000","last_fullsized":"2024-01-25T15:05:43.570719+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:53:45.905579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.580368+0000","last_change":"2024-01-25T15:05:43.575607+0000","last_active":"2024-01-25T15:05:43.580368+0000","last_peered":"2024-01-25T15:05:43.580368+0000","last_clean":"2024-01-25T15:05:43.580368+0000","last_became_active":"2024-01-25T15:05:43.575358+0000","last_became_peered":"2024-01-25T15:05:43.575358+0000","last_unstale":"2024-01-25T15:05:43.580368+0000","last_undegraded":"2024-01-25T15:05:43.580368+0000","last_fullsized":"2024-01-25T15:05:43.580368+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:01:49.379607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.558510+0000","last_change":"2024-01-25T15:05:27.242301+0000","last_active":"2024-01-25T15:05:43.558510+0000","last_peered":"2024-01-25T15:05:43.558510+0000","last_clean":"2024-01-25T15:05:43.558510+0000","last_became_active":"2024-01-25T15:05:27.242077+0000","last_became_peered":"2024-01-25T15:05:27.242077+0000","last_unstale":"2024-01-25T15:05:43.558510+0000","last_undegraded":"2024-01-25T15:05:43.558510+0000","last_fullsized":"2024-01-25T15:05:43.558510+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:17:07.138969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.592312+0000","last_change":"2024-01-25T15:05:43.580667+0000","last_active":"2024-01-25T15:05:43.592312+0000","last_peered":"2024-01-25T15:05:43.592312+0000","last_clean":"2024-01-25T15:05:43.592312+0000","last_became_active":"2024-01-25T15:05:43.580403+0000","last_became_peered":"2024-01-25T15:05:43.580403+0000","last_unstale":"2024-01-25T15:05:43.592312+0000","last_undegraded":"2024-01-25T15:05:43.592312+0000","last_fullsized":"2024-01-25T15:05:43.592312+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:37:58.901484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.576579+0000","last_change":"2024-01-25T15:05:27.236734+0000","last_active":"2024-01-25T15:05:43.576579+0000","last_peered":"2024-01-25T15:05:43.576579+0000","last_clean":"2024-01-25T15:05:43.576579+0000","last_became_active":"2024-01-25T15:05:27.236377+0000","last_became_peered":"2024-01-25T15:05:27.236377+0000","last_unstale":"2024-01-25T15:05:43.576579+0000","last_undegraded":"2024-01-25T15:05:43.576579+0000","last_fullsized":"2024-01-25T15:05:43.576579+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:02:27.622813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.573059+0000","last_change":"2024-01-25T15:05:43.571115+0000","last_active":"2024-01-25T15:05:43.573059+0000","last_peered":"2024-01-25T15:05:43.573059+0000","last_clean":"2024-01-25T15:05:43.573059+0000","last_became_active":"2024-01-25T15:05:43.570862+0000","last_became_peered":"2024-01-25T15:05:43.570862+0000","last_unstale":"2024-01-25T15:05:43.573059+0000","last_undegraded":"2024-01-25T15:05:43.573059+0000","last_fullsized":"2024-01-25T15:05:43.573059+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:29:25.351790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.571720+0000","last_change":"2024-01-25T15:05:27.244798+0000","last_active":"2024-01-25T15:05:43.571720+0000","last_peered":"2024-01-25T15:05:43.571720+0000","last_clean":"2024-01-25T15:05:43.571720+0000","last_became_active":"2024-01-25T15:05:27.244547+0000","last_became_peered":"2024-01-25T15:05:27.244547+0000","last_unstale":"2024-01-25T15:05:43.571720+0000","last_undegraded":"2024-01-25T15:05:43.571720+0000","last_fullsized":"2024-01-25T15:05:43.571720+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:47:01.188072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.580714+0000","last_change":"2024-01-25T15:05:43.580255+0000","last_active":"2024-01-25T15:05:43.580714+0000","last_peered":"2024-01-25T15:05:43.580714+0000","last_clean":"2024-01-25T15:05:43.580714+0000","last_became_active":"2024-01-25T15:05:43.579855+0000","last_became_peered":"2024-01-25T15:05:43.579855+0000","last_unstale":"2024-01-25T15:05:43.580714+0000","last_undegraded":"2024-01-25T15:05:43.580714+0000","last_fullsized":"2024-01-25T15:05:43.580714+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:00:44.093143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.571636+0000","last_change":"2024-01-25T15:05:27.238399+0000","last_active":"2024-01-25T15:05:43.571636+0000","last_peered":"2024-01-25T15:05:43.571636+0000","last_clean":"2024-01-25T15:05:43.571636+0000","last_became_active":"2024-01-25T15:05:27.237999+0000","last_became_peered":"2024-01-25T15:05:27.237999+0000","last_unstale":"2024-01-25T15:05:43.571636+0000","last_undegraded":"2024-01-25T15:05:43.571636+0000","last_fullsized":"2024-01-25T15:05:43.571636+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:43:33.136506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.590029+0000","last_change":"2024-01-25T15:05:43.581011+0000","last_active":"2024-01-25T15:05:43.590029+0000","last_peered":"2024-01-25T15:05:43.590029+0000","last_clean":"2024-01-25T15:05:43.590029+0000","last_became_active":"2024-01-25T15:05:43.580720+0000","last_became_peered":"2024-01-25T15:05:43.580720+0000","last_unstale":"2024-01-25T15:05:43.590029+0000","last_undegraded":"2024-01-25T15:05:43.590029+0000","last_fullsized":"2024-01-25T15:05:43.590029+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:22:30.262070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.570397+0000","last_change":"2024-01-25T15:05:27.230234+0000","last_active":"2024-01-25T15:05:43.570397+0000","last_peered":"2024-01-25T15:05:43.570397+0000","last_clean":"2024-01-25T15:05:43.570397+0000","last_became_active":"2024-01-25T15:05:27.229945+0000","last_became_peered":"2024-01-25T15:05:27.229945+0000","last_unstale":"2024-01-25T15:05:43.570397+0000","last_undegraded":"2024-01-25T15:05:43.570397+0000","last_fullsized":"2024-01-25T15:05:43.570397+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:10.931099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.592328+0000","last_change":"2024-01-25T15:05:43.581085+0000","last_active":"2024-01-25T15:05:43.592328+0000","last_peered":"2024-01-25T15:05:43.592328+0000","last_clean":"2024-01-25T15:05:43.592328+0000","last_became_active":"2024-01-25T15:05:43.580816+0000","last_became_peered":"2024-01-25T15:05:43.580816+0000","last_unstale":"2024-01-25T15:05:43.592328+0000","last_undegraded":"2024-01-25T15:05:43.592328+0000","last_fullsized":"2024-01-25T15:05:43.592328+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:29:25.351790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.571302+0000","last_change":"2024-01-25T15:05:27.244146+0000","last_active":"2024-01-25T15:05:43.571302+0000","last_peered":"2024-01-25T15:05:43.571302+0000","last_clean":"2024-01-25T15:05:43.571302+0000","last_became_active":"2024-01-25T15:05:27.243861+0000","last_became_peered":"2024-01-25T15:05:27.243861+0000","last_unstale":"2024-01-25T15:05:43.571302+0000","last_undegraded":"2024-01-25T15:05:43.571302+0000","last_fullsized":"2024-01-25T15:05:43.571302+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:06:14.777919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.578900+0000","last_change":"2024-01-25T15:05:43.572731+0000","last_active":"2024-01-25T15:05:43.578900+0000","last_peered":"2024-01-25T15:05:43.578900+0000","last_clean":"2024-01-25T15:05:43.578900+0000","last_became_active":"2024-01-25T15:05:43.572476+0000","last_became_peered":"2024-01-25T15:05:43.572476+0000","last_unstale":"2024-01-25T15:05:43.578900+0000","last_undegraded":"2024-01-25T15:05:43.578900+0000","last_fullsized":"2024-01-25T15:05:43.578900+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:49:14.172453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.566670+0000","last_change":"2024-01-25T15:05:27.236676+0000","last_active":"2024-01-25T15:05:43.566670+0000","last_peered":"2024-01-25T15:05:43.566670+0000","last_clean":"2024-01-25T15:05:43.566670+0000","last_became_active":"2024-01-25T15:05:27.236411+0000","last_became_peered":"2024-01-25T15:05:27.236411+0000","last_unstale":"2024-01-25T15:05:43.566670+0000","last_undegraded":"2024-01-25T15:05:43.566670+0000","last_fullsized":"2024-01-25T15:05:43.566670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:43:59.664529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.584535+0000","last_change":"2024-01-25T15:05:43.583944+0000","last_active":"2024-01-25T15:05:43.584535+0000","last_peered":"2024-01-25T15:05:43.584535+0000","last_clean":"2024-01-25T15:05:43.584535+0000","last_became_active":"2024-01-25T15:05:43.583664+0000","last_became_peered":"2024-01-25T15:05:43.583664+0000","last_unstale":"2024-01-25T15:05:43.584535+0000","last_undegraded":"2024-01-25T15:05:43.584535+0000","last_fullsized":"2024-01-25T15:05:43.584535+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:44:42.682512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.570819+0000","last_change":"2024-01-25T15:05:27.234767+0000","last_active":"2024-01-25T15:05:43.570819+0000","last_peered":"2024-01-25T15:05:43.570819+0000","last_clean":"2024-01-25T15:05:43.570819+0000","last_became_active":"2024-01-25T15:05:27.234370+0000","last_became_peered":"2024-01-25T15:05:27.234370+0000","last_unstale":"2024-01-25T15:05:43.570819+0000","last_undegraded":"2024-01-25T15:05:43.570819+0000","last_fullsized":"2024-01-25T15:05:43.570819+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:24:11.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.580662+0000","last_change":"2024-01-25T15:05:43.576484+0000","last_active":"2024-01-25T15:05:43.580662+0000","last_peered":"2024-01-25T15:05:43.580662+0000","last_clean":"2024-01-25T15:05:43.580662+0000","last_became_active":"2024-01-25T15:05:43.576086+0000","last_became_peered":"2024-01-25T15:05:43.576086+0000","last_unstale":"2024-01-25T15:05:43.580662+0000","last_undegraded":"2024-01-25T15:05:43.580662+0000","last_fullsized":"2024-01-25T15:05:43.580662+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:37:58.901484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560382+0000","last_change":"2024-01-25T15:05:27.246760+0000","last_active":"2024-01-25T15:05:43.560382+0000","last_peered":"2024-01-25T15:05:43.560382+0000","last_clean":"2024-01-25T15:05:43.560382+0000","last_became_active":"2024-01-25T15:05:27.246482+0000","last_became_peered":"2024-01-25T15:05:27.246482+0000","last_unstale":"2024-01-25T15:05:43.560382+0000","last_undegraded":"2024-01-25T15:05:43.560382+0000","last_fullsized":"2024-01-25T15:05:43.560382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:10.931099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.590742+0000","last_change":"2024-01-25T15:05:43.577811+0000","last_active":"2024-01-25T15:05:43.590742+0000","last_peered":"2024-01-25T15:05:43.590742+0000","last_clean":"2024-01-25T15:05:43.590742+0000","last_became_active":"2024-01-25T15:05:43.576939+0000","last_became_peered":"2024-01-25T15:05:43.576939+0000","last_unstale":"2024-01-25T15:05:43.590742+0000","last_undegraded":"2024-01-25T15:05:43.590742+0000","last_fullsized":"2024-01-25T15:05:43.590742+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:30:42.037889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.562569+0000","last_change":"2024-01-25T15:05:27.246282+0000","last_active":"2024-01-25T15:05:43.562569+0000","last_peered":"2024-01-25T15:05:43.562569+0000","last_clean":"2024-01-25T15:05:43.562569+0000","last_became_active":"2024-01-25T15:05:27.245958+0000","last_became_peered":"2024-01-25T15:05:27.245958+0000","last_unstale":"2024-01-25T15:05:43.562569+0000","last_undegraded":"2024-01-25T15:05:43.562569+0000","last_fullsized":"2024-01-25T15:05:43.562569+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:06:14.777919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.579020+0000","last_change":"2024-01-25T15:05:43.576149+0000","last_active":"2024-01-25T15:05:43.579020+0000","last_peered":"2024-01-25T15:05:43.579020+0000","last_clean":"2024-01-25T15:05:43.579020+0000","last_became_active":"2024-01-25T15:05:43.575855+0000","last_became_peered":"2024-01-25T15:05:43.575855+0000","last_unstale":"2024-01-25T15:05:43.579020+0000","last_undegraded":"2024-01-25T15:05:43.579020+0000","last_fullsized":"2024-01-25T15:05:43.579020+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:21:44.556343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559247+0000","last_change":"2024-01-25T15:05:27.229020+0000","last_active":"2024-01-25T15:05:43.559247+0000","last_peered":"2024-01-25T15:05:43.559247+0000","last_clean":"2024-01-25T15:05:43.559247+0000","last_became_active":"2024-01-25T15:05:27.228749+0000","last_became_peered":"2024-01-25T15:05:27.228749+0000","last_unstale":"2024-01-25T15:05:43.559247+0000","last_undegraded":"2024-01-25T15:05:43.559247+0000","last_fullsized":"2024-01-25T15:05:43.559247+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:49:29.672511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.592996+0000","last_change":"2024-01-25T15:05:43.588467+0000","last_active":"2024-01-25T15:05:43.592996+0000","last_peered":"2024-01-25T15:05:43.592996+0000","last_clean":"2024-01-25T15:05:43.592996+0000","last_became_active":"2024-01-25T15:05:43.584179+0000","last_became_peered":"2024-01-25T15:05:43.584179+0000","last_unstale":"2024-01-25T15:05:43.592996+0000","last_undegraded":"2024-01-25T15:05:43.592996+0000","last_fullsized":"2024-01-25T15:05:43.592996+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:38:33.531978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.569427+0000","last_change":"2024-01-25T15:05:27.244605+0000","last_active":"2024-01-25T15:05:43.569427+0000","last_peered":"2024-01-25T15:05:43.569427+0000","last_clean":"2024-01-25T15:05:43.569427+0000","last_became_active":"2024-01-25T15:05:27.244345+0000","last_became_peered":"2024-01-25T15:05:27.244345+0000","last_unstale":"2024-01-25T15:05:43.569427+0000","last_undegraded":"2024-01-25T15:05:43.569427+0000","last_fullsized":"2024-01-25T15:05:43.569427+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:23:26.096821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.578690+0000","last_change":"2024-01-25T15:05:43.570240+0000","last_active":"2024-01-25T15:05:43.578690+0000","last_peered":"2024-01-25T15:05:43.578690+0000","last_clean":"2024-01-25T15:05:43.578690+0000","last_became_active":"2024-01-25T15:05:43.569958+0000","last_became_peered":"2024-01-25T15:05:43.569958+0000","last_unstale":"2024-01-25T15:05:43.578690+0000","last_undegraded":"2024-01-25T15:05:43.578690+0000","last_fullsized":"2024-01-25T15:05:43.578690+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:07:48.338513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560952+0000","last_change":"2024-01-25T15:05:27.229918+0000","last_active":"2024-01-25T15:05:43.560952+0000","last_peered":"2024-01-25T15:05:43.560952+0000","last_clean":"2024-01-25T15:05:43.560952+0000","last_became_active":"2024-01-25T15:05:27.229636+0000","last_became_peered":"2024-01-25T15:05:27.229636+0000","last_unstale":"2024-01-25T15:05:43.560952+0000","last_undegraded":"2024-01-25T15:05:43.560952+0000","last_fullsized":"2024-01-25T15:05:43.560952+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:31.002968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.584945+0000","last_change":"2024-01-25T15:05:43.584130+0000","last_active":"2024-01-25T15:05:43.584945+0000","last_peered":"2024-01-25T15:05:43.584945+0000","last_clean":"2024-01-25T15:05:43.584945+0000","last_became_active":"2024-01-25T15:05:43.583876+0000","last_became_peered":"2024-01-25T15:05:43.583876+0000","last_unstale":"2024-01-25T15:05:43.584945+0000","last_undegraded":"2024-01-25T15:05:43.584945+0000","last_fullsized":"2024-01-25T15:05:43.584945+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:17:02.746946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.571361+0000","last_change":"2024-01-25T15:05:27.240952+0000","last_active":"2024-01-25T15:05:43.571361+0000","last_peered":"2024-01-25T15:05:43.571361+0000","last_clean":"2024-01-25T15:05:43.571361+0000","last_became_active":"2024-01-25T15:05:27.240683+0000","last_became_peered":"2024-01-25T15:05:27.240683+0000","last_unstale":"2024-01-25T15:05:43.571361+0000","last_undegraded":"2024-01-25T15:05:43.571361+0000","last_fullsized":"2024-01-25T15:05:43.571361+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:44:30.520452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.579616+0000","last_change":"2024-01-25T15:05:43.574951+0000","last_active":"2024-01-25T15:05:43.579616+0000","last_peered":"2024-01-25T15:05:43.579616+0000","last_clean":"2024-01-25T15:05:43.579616+0000","last_became_active":"2024-01-25T15:05:43.574693+0000","last_became_peered":"2024-01-25T15:05:43.574693+0000","last_unstale":"2024-01-25T15:05:43.579616+0000","last_undegraded":"2024-01-25T15:05:43.579616+0000","last_fullsized":"2024-01-25T15:05:43.579616+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:22:30.262070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.567065+0000","last_change":"2024-01-25T15:05:27.235172+0000","last_active":"2024-01-25T15:05:43.567065+0000","last_peered":"2024-01-25T15:05:43.567065+0000","last_clean":"2024-01-25T15:05:43.567065+0000","last_became_active":"2024-01-25T15:05:27.234884+0000","last_became_peered":"2024-01-25T15:05:27.234884+0000","last_unstale":"2024-01-25T15:05:43.567065+0000","last_undegraded":"2024-01-25T15:05:43.567065+0000","last_fullsized":"2024-01-25T15:05:43.567065+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:14:28.578562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.592086+0000","last_change":"2024-01-25T15:05:43.578485+0000","last_active":"2024-01-25T15:05:43.592086+0000","last_peered":"2024-01-25T15:05:43.592086+0000","last_clean":"2024-01-25T15:05:43.592086+0000","last_became_active":"2024-01-25T15:05:43.578202+0000","last_became_peered":"2024-01-25T15:05:43.578202+0000","last_unstale":"2024-01-25T15:05:43.592086+0000","last_undegraded":"2024-01-25T15:05:43.592086+0000","last_fullsized":"2024-01-25T15:05:43.592086+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:21:12.963843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559737+0000","last_change":"2024-01-25T15:05:27.233225+0000","last_active":"2024-01-25T15:05:43.559737+0000","last_peered":"2024-01-25T15:05:43.559737+0000","last_clean":"2024-01-25T15:05:43.559737+0000","last_became_active":"2024-01-25T15:05:27.232731+0000","last_became_peered":"2024-01-25T15:05:27.232731+0000","last_unstale":"2024-01-25T15:05:43.559737+0000","last_undegraded":"2024-01-25T15:05:43.559737+0000","last_fullsized":"2024-01-25T15:05:43.559737+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:53:45.905579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.591081+0000","last_change":"2024-01-25T15:05:43.585880+0000","last_active":"2024-01-25T15:05:43.591081+0000","last_peered":"2024-01-25T15:05:43.591081+0000","last_clean":"2024-01-25T15:05:43.591081+0000","last_became_active":"2024-01-25T15:05:43.584940+0000","last_became_peered":"2024-01-25T15:05:43.584940+0000","last_unstale":"2024-01-25T15:05:43.591081+0000","last_undegraded":"2024-01-25T15:05:43.591081+0000","last_fullsized":"2024-01-25T15:05:43.591081+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:38:33.531978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.565840+0000","last_change":"2024-01-25T15:05:27.226292+0000","last_active":"2024-01-25T15:05:43.565840+0000","last_peered":"2024-01-25T15:05:43.565840+0000","last_clean":"2024-01-25T15:05:43.565840+0000","last_became_active":"2024-01-25T15:05:27.226037+0000","last_became_peered":"2024-01-25T15:05:27.226037+0000","last_unstale":"2024-01-25T15:05:43.565840+0000","last_undegraded":"2024-01-25T15:05:43.565840+0000","last_fullsized":"2024-01-25T15:05:43.565840+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:35:20.251170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.587385+0000","last_change":"2024-01-25T15:05:43.578521+0000","last_active":"2024-01-25T15:05:43.587385+0000","last_peered":"2024-01-25T15:05:43.587385+0000","last_clean":"2024-01-25T15:05:43.587385+0000","last_became_active":"2024-01-25T15:05:43.578269+0000","last_became_peered":"2024-01-25T15:05:43.578269+0000","last_unstale":"2024-01-25T15:05:43.587385+0000","last_undegraded":"2024-01-25T15:05:43.587385+0000","last_fullsized":"2024-01-25T15:05:43.587385+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:44:16.012877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559636+0000","last_change":"2024-01-25T15:05:27.229896+0000","last_active":"2024-01-25T15:05:43.559636+0000","last_peered":"2024-01-25T15:05:43.559636+0000","last_clean":"2024-01-25T15:05:43.559636+0000","last_became_active":"2024-01-25T15:05:27.229558+0000","last_became_peered":"2024-01-25T15:05:27.229558+0000","last_unstale":"2024-01-25T15:05:43.559636+0000","last_undegraded":"2024-01-25T15:05:43.559636+0000","last_fullsized":"2024-01-25T15:05:43.559636+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:43:59.664529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.590782+0000","last_change":"2024-01-25T15:05:43.577672+0000","last_active":"2024-01-25T15:05:43.590782+0000","last_peered":"2024-01-25T15:05:43.590782+0000","last_clean":"2024-01-25T15:05:43.590782+0000","last_became_active":"2024-01-25T15:05:43.575906+0000","last_became_peered":"2024-01-25T15:05:43.575906+0000","last_unstale":"2024-01-25T15:05:43.590782+0000","last_undegraded":"2024-01-25T15:05:43.590782+0000","last_fullsized":"2024-01-25T15:05:43.590782+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:49:14.172453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.562278+0000","last_change":"2024-01-25T15:05:27.242603+0000","last_active":"2024-01-25T15:05:43.562278+0000","last_peered":"2024-01-25T15:05:43.562278+0000","last_clean":"2024-01-25T15:05:43.562278+0000","last_became_active":"2024-01-25T15:05:27.241732+0000","last_became_peered":"2024-01-25T15:05:27.241732+0000","last_unstale":"2024-01-25T15:05:43.562278+0000","last_undegraded":"2024-01-25T15:05:43.562278+0000","last_fullsized":"2024-01-25T15:05:43.562278+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:14:28.578562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.574830+0000","last_change":"2024-01-25T15:05:43.567926+0000","last_active":"2024-01-25T15:05:43.574830+0000","last_peered":"2024-01-25T15:05:43.574830+0000","last_clean":"2024-01-25T15:05:43.574830+0000","last_became_active":"2024-01-25T15:05:43.567637+0000","last_became_peered":"2024-01-25T15:05:43.567637+0000","last_unstale":"2024-01-25T15:05:43.574830+0000","last_undegraded":"2024-01-25T15:05:43.574830+0000","last_fullsized":"2024-01-25T15:05:43.574830+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:01:49.379607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.561131+0000","last_change":"2024-01-25T15:05:27.229445+0000","last_active":"2024-01-25T15:05:43.561131+0000","last_peered":"2024-01-25T15:05:43.561131+0000","last_clean":"2024-01-25T15:05:43.561131+0000","last_became_active":"2024-01-25T15:05:27.229198+0000","last_became_peered":"2024-01-25T15:05:27.229198+0000","last_unstale":"2024-01-25T15:05:43.561131+0000","last_undegraded":"2024-01-25T15:05:43.561131+0000","last_fullsized":"2024-01-25T15:05:43.561131+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:26:19.413150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.575560+0000","last_change":"2024-01-25T15:05:43.574437+0000","last_active":"2024-01-25T15:05:43.575560+0000","last_peered":"2024-01-25T15:05:43.575560+0000","last_clean":"2024-01-25T15:05:43.575560+0000","last_became_active":"2024-01-25T15:05:43.574181+0000","last_became_peered":"2024-01-25T15:05:43.574181+0000","last_unstale":"2024-01-25T15:05:43.575560+0000","last_undegraded":"2024-01-25T15:05:43.575560+0000","last_fullsized":"2024-01-25T15:05:43.575560+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:26:26.772555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.571091+0000","last_change":"2024-01-25T15:05:27.238720+0000","last_active":"2024-01-25T15:05:43.571091+0000","last_peered":"2024-01-25T15:05:43.571091+0000","last_clean":"2024-01-25T15:05:43.571091+0000","last_became_active":"2024-01-25T15:05:27.238362+0000","last_became_peered":"2024-01-25T15:05:27.238362+0000","last_unstale":"2024-01-25T15:05:43.571091+0000","last_undegraded":"2024-01-25T15:05:43.571091+0000","last_fullsized":"2024-01-25T15:05:43.571091+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:36.810625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.590713+0000","last_change":"2024-01-25T15:05:43.576898+0000","last_active":"2024-01-25T15:05:43.590713+0000","last_peered":"2024-01-25T15:05:43.590713+0000","last_clean":"2024-01-25T15:05:43.590713+0000","last_became_active":"2024-01-25T15:05:43.576317+0000","last_became_peered":"2024-01-25T15:05:43.576317+0000","last_unstale":"2024-01-25T15:05:43.590713+0000","last_undegraded":"2024-01-25T15:05:43.590713+0000","last_fullsized":"2024-01-25T15:05:43.590713+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:21:39.661375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560531+0000","last_change":"2024-01-25T15:05:27.229034+0000","last_active":"2024-01-25T15:05:43.560531+0000","last_peered":"2024-01-25T15:05:43.560531+0000","last_clean":"2024-01-25T15:05:43.560531+0000","last_became_active":"2024-01-25T15:05:27.227681+0000","last_became_peered":"2024-01-25T15:05:27.227681+0000","last_unstale":"2024-01-25T15:05:43.560531+0000","last_undegraded":"2024-01-25T15:05:43.560531+0000","last_fullsized":"2024-01-25T15:05:43.560531+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:33:05.014284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.579397+0000","last_change":"2024-01-25T15:05:43.574228+0000","last_active":"2024-01-25T15:05:43.579397+0000","last_peered":"2024-01-25T15:05:43.579397+0000","last_clean":"2024-01-25T15:05:43.579397+0000","last_became_active":"2024-01-25T15:05:43.573856+0000","last_became_peered":"2024-01-25T15:05:43.573856+0000","last_unstale":"2024-01-25T15:05:43.579397+0000","last_undegraded":"2024-01-25T15:05:43.579397+0000","last_fullsized":"2024-01-25T15:05:43.579397+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:00:44.093143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.561373+0000","last_change":"2024-01-25T15:05:27.227464+0000","last_active":"2024-01-25T15:05:43.561373+0000","last_peered":"2024-01-25T15:05:43.561373+0000","last_clean":"2024-01-25T15:05:43.561373+0000","last_became_active":"2024-01-25T15:05:27.227162+0000","last_became_peered":"2024-01-25T15:05:27.227162+0000","last_unstale":"2024-01-25T15:05:43.561373+0000","last_undegraded":"2024-01-25T15:05:43.561373+0000","last_fullsized":"2024-01-25T15:05:43.561373+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:16:31.883434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.592105+0000","last_change":"2024-01-25T15:05:43.582235+0000","last_active":"2024-01-25T15:05:43.592105+0000","last_peered":"2024-01-25T15:05:43.592105+0000","last_clean":"2024-01-25T15:05:43.592105+0000","last_became_active":"2024-01-25T15:05:43.581973+0000","last_became_peered":"2024-01-25T15:05:43.581973+0000","last_unstale":"2024-01-25T15:05:43.592105+0000","last_undegraded":"2024-01-25T15:05:43.592105+0000","last_fullsized":"2024-01-25T15:05:43.592105+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:26:18.604996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560884+0000","last_change":"2024-01-25T15:05:27.233301+0000","last_active":"2024-01-25T15:05:43.560884+0000","last_peered":"2024-01-25T15:05:43.560884+0000","last_clean":"2024-01-25T15:05:43.560884+0000","last_became_active":"2024-01-25T15:05:27.233035+0000","last_became_peered":"2024-01-25T15:05:27.233035+0000","last_unstale":"2024-01-25T15:05:43.560884+0000","last_undegraded":"2024-01-25T15:05:43.560884+0000","last_fullsized":"2024-01-25T15:05:43.560884+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:02:27.622813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.580642+0000","last_change":"2024-01-25T15:05:43.575707+0000","last_active":"2024-01-25T15:05:43.580642+0000","last_peered":"2024-01-25T15:05:43.580642+0000","last_clean":"2024-01-25T15:05:43.580642+0000","last_became_active":"2024-01-25T15:05:43.575402+0000","last_became_peered":"2024-01-25T15:05:43.575402+0000","last_unstale":"2024-01-25T15:05:43.580642+0000","last_undegraded":"2024-01-25T15:05:43.580642+0000","last_fullsized":"2024-01-25T15:05:43.580642+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:21:12.963843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.561675+0000","last_change":"2024-01-25T15:05:27.237586+0000","last_active":"2024-01-25T15:05:43.561675+0000","last_peered":"2024-01-25T15:05:43.561675+0000","last_clean":"2024-01-25T15:05:43.561675+0000","last_became_active":"2024-01-25T15:05:27.237334+0000","last_became_peered":"2024-01-25T15:05:27.237334+0000","last_unstale":"2024-01-25T15:05:43.561675+0000","last_undegraded":"2024-01-25T15:05:43.561675+0000","last_fullsized":"2024-01-25T15:05:43.561675+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:33:05.014284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.567157+0000","last_change":"2024-01-25T15:05:43.565792+0000","last_active":"2024-01-25T15:05:43.567157+0000","last_peered":"2024-01-25T15:05:43.567157+0000","last_clean":"2024-01-25T15:05:43.567157+0000","last_became_active":"2024-01-25T15:05:43.565531+0000","last_became_peered":"2024-01-25T15:05:43.565531+0000","last_unstale":"2024-01-25T15:05:43.567157+0000","last_undegraded":"2024-01-25T15:05:43.567157+0000","last_fullsized":"2024-01-25T15:05:43.567157+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:56:03.181534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"41'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.595518+0000","last_change":"2024-01-25T15:05:42.573987+0000","last_active":"2024-01-25T15:05:43.595518+0000","last_peered":"2024-01-25T15:05:43.595518+0000","last_clean":"2024-01-25T15:05:43.595518+0000","last_became_active":"2024-01-25T15:05:42.573714+0000","last_became_peered":"2024-01-25T15:05:42.573714+0000","last_unstale":"2024-01-25T15:05:43.595518+0000","last_undegraded":"2024-01-25T15:05:43.595518+0000","last_fullsized":"2024-01-25T15:05:43.595518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:17:22.482965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560804+0000","last_change":"2024-01-25T15:05:27.247070+0000","last_active":"2024-01-25T15:05:43.560804+0000","last_peered":"2024-01-25T15:05:43.560804+0000","last_clean":"2024-01-25T15:05:43.560804+0000","last_became_active":"2024-01-25T15:05:27.246793+0000","last_became_peered":"2024-01-25T15:05:27.246793+0000","last_unstale":"2024-01-25T15:05:43.560804+0000","last_undegraded":"2024-01-25T15:05:43.560804+0000","last_fullsized":"2024-01-25T15:05:43.560804+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:13:38.590014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559879+0000","last_change":"2024-01-25T15:05:26.223571+0000","last_active":"2024-01-25T15:05:43.559879+0000","last_peered":"2024-01-25T15:05:43.559879+0000","last_clean":"2024-01-25T15:05:43.559879+0000","last_became_active":"2024-01-25T15:05:26.223239+0000","last_became_peered":"2024-01-25T15:05:26.223239+0000","last_unstale":"2024-01-25T15:05:43.559879+0000","last_undegraded":"2024-01-25T15:05:43.559879+0000","last_fullsized":"2024-01-25T15:05:43.559879+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:23:25.092941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.585455+0000","last_change":"2024-01-25T15:05:43.581236+0000","last_active":"2024-01-25T15:05:43.585455+0000","last_peered":"2024-01-25T15:05:43.585455+0000","last_clean":"2024-01-25T15:05:43.585455+0000","last_became_active":"2024-01-25T15:05:43.580988+0000","last_became_peered":"2024-01-25T15:05:43.580988+0000","last_unstale":"2024-01-25T15:05:43.585455+0000","last_undegraded":"2024-01-25T15:05:43.585455+0000","last_fullsized":"2024-01-25T15:05:43.585455+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:38:07.709476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"41'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.588511+0000","last_change":"2024-01-25T15:05:42.572919+0000","last_active":"2024-01-25T15:05:43.588511+0000","last_peered":"2024-01-25T15:05:43.588511+0000","last_clean":"2024-01-25T15:05:43.588511+0000","last_became_active":"2024-01-25T15:05:42.571944+0000","last_became_peered":"2024-01-25T15:05:42.571944+0000","last_unstale":"2024-01-25T15:05:43.588511+0000","last_undegraded":"2024-01-25T15:05:43.588511+0000","last_fullsized":"2024-01-25T15:05:43.588511+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:16:41.975458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.565487+0000","last_change":"2024-01-25T15:05:27.243468+0000","last_active":"2024-01-25T15:05:43.565487+0000","last_peered":"2024-01-25T15:05:43.565487+0000","last_clean":"2024-01-25T15:05:43.565487+0000","last_became_active":"2024-01-25T15:05:27.241288+0000","last_became_peered":"2024-01-25T15:05:27.241288+0000","last_unstale":"2024-01-25T15:05:43.565487+0000","last_undegraded":"2024-01-25T15:05:43.565487+0000","last_fullsized":"2024-01-25T15:05:43.565487+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:46:52.035987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.576642+0000","last_change":"2024-01-25T15:05:26.222363+0000","last_active":"2024-01-25T15:05:43.576642+0000","last_peered":"2024-01-25T15:05:43.576642+0000","last_clean":"2024-01-25T15:05:43.576642+0000","last_became_active":"2024-01-25T15:05:26.222076+0000","last_became_peered":"2024-01-25T15:05:26.222076+0000","last_unstale":"2024-01-25T15:05:43.576642+0000","last_undegraded":"2024-01-25T15:05:43.576642+0000","last_fullsized":"2024-01-25T15:05:43.576642+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:25:54.998838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.580684+0000","last_change":"2024-01-25T15:05:43.575601+0000","last_active":"2024-01-25T15:05:43.580684+0000","last_peered":"2024-01-25T15:05:43.580684+0000","last_clean":"2024-01-25T15:05:43.580684+0000","last_became_active":"2024-01-25T15:05:43.575327+0000","last_became_peered":"2024-01-25T15:05:43.575327+0000","last_unstale":"2024-01-25T15:05:43.580684+0000","last_undegraded":"2024-01-25T15:05:43.580684+0000","last_fullsized":"2024-01-25T15:05:43.580684+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:30:42.037889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"41'4","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.586159+0000","last_change":"2024-01-25T15:05:42.571914+0000","last_active":"2024-01-25T15:05:43.586159+0000","last_peered":"2024-01-25T15:05:43.586159+0000","last_clean":"2024-01-25T15:05:43.586159+0000","last_became_active":"2024-01-25T15:05:42.571659+0000","last_became_peered":"2024-01-25T15:05:42.571659+0000","last_unstale":"2024-01-25T15:05:43.586159+0000","last_undegraded":"2024-01-25T15:05:43.586159+0000","last_fullsized":"2024-01-25T15:05:43.586159+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:44:45.864448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.565772+0000","last_change":"2024-01-25T15:05:27.236309+0000","last_active":"2024-01-25T15:05:43.565772+0000","last_peered":"2024-01-25T15:05:43.565772+0000","last_clean":"2024-01-25T15:05:43.565772+0000","last_became_active":"2024-01-25T15:05:27.236051+0000","last_became_peered":"2024-01-25T15:05:27.236051+0000","last_unstale":"2024-01-25T15:05:43.565772+0000","last_undegraded":"2024-01-25T15:05:43.565772+0000","last_fullsized":"2024-01-25T15:05:43.565772+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:16:02.607369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.565644+0000","last_change":"2024-01-25T15:05:26.222345+0000","last_active":"2024-01-25T15:05:43.565644+0000","last_peered":"2024-01-25T15:05:43.565644+0000","last_clean":"2024-01-25T15:05:43.565644+0000","last_became_active":"2024-01-25T15:05:26.221552+0000","last_became_peered":"2024-01-25T15:05:26.221552+0000","last_unstale":"2024-01-25T15:05:43.565644+0000","last_undegraded":"2024-01-25T15:05:43.565644+0000","last_fullsized":"2024-01-25T15:05:43.565644+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:31:52.278724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.581980+0000","last_change":"2024-01-25T15:05:43.580058+0000","last_active":"2024-01-25T15:05:43.581980+0000","last_peered":"2024-01-25T15:05:43.581980+0000","last_clean":"2024-01-25T15:05:43.581980+0000","last_became_active":"2024-01-25T15:05:43.579774+0000","last_became_peered":"2024-01-25T15:05:43.579774+0000","last_unstale":"2024-01-25T15:05:43.581980+0000","last_undegraded":"2024-01-25T15:05:43.581980+0000","last_fullsized":"2024-01-25T15:05:43.581980+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:07:48.338513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"41'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.595485+0000","last_change":"2024-01-25T15:05:42.576483+0000","last_active":"2024-01-25T15:05:43.595485+0000","last_peered":"2024-01-25T15:05:43.595485+0000","last_clean":"2024-01-25T15:05:43.595485+0000","last_became_active":"2024-01-25T15:05:42.576222+0000","last_became_peered":"2024-01-25T15:05:42.576222+0000","last_unstale":"2024-01-25T15:05:43.595485+0000","last_undegraded":"2024-01-25T15:05:43.595485+0000","last_fullsized":"2024-01-25T15:05:43.595485+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:06:30.121915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559536+0000","last_change":"2024-01-25T15:05:27.224791+0000","last_active":"2024-01-25T15:05:43.559536+0000","last_peered":"2024-01-25T15:05:43.559536+0000","last_clean":"2024-01-25T15:05:43.559536+0000","last_became_active":"2024-01-25T15:05:27.224542+0000","last_became_peered":"2024-01-25T15:05:27.224542+0000","last_unstale":"2024-01-25T15:05:43.559536+0000","last_undegraded":"2024-01-25T15:05:43.559536+0000","last_fullsized":"2024-01-25T15:05:43.559536+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:22:13.913722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.565632+0000","last_change":"2024-01-25T15:05:26.217509+0000","last_active":"2024-01-25T15:05:43.565632+0000","last_peered":"2024-01-25T15:05:43.565632+0000","last_clean":"2024-01-25T15:05:43.565632+0000","last_became_active":"2024-01-25T15:05:26.217198+0000","last_became_peered":"2024-01-25T15:05:26.217198+0000","last_unstale":"2024-01-25T15:05:43.565632+0000","last_undegraded":"2024-01-25T15:05:43.565632+0000","last_fullsized":"2024-01-25T15:05:43.565632+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:23:25.092941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.591884+0000","last_change":"2024-01-25T15:05:43.588206+0000","last_active":"2024-01-25T15:05:43.591884+0000","last_peered":"2024-01-25T15:05:43.591884+0000","last_clean":"2024-01-25T15:05:43.591884+0000","last_became_active":"2024-01-25T15:05:43.586250+0000","last_became_peered":"2024-01-25T15:05:43.586250+0000","last_unstale":"2024-01-25T15:05:43.591884+0000","last_undegraded":"2024-01-25T15:05:43.591884+0000","last_fullsized":"2024-01-25T15:05:43.591884+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:25:24.134995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559533+0000","last_change":"2024-01-25T15:05:42.569299+0000","last_active":"2024-01-25T15:05:43.559533+0000","last_peered":"2024-01-25T15:05:43.559533+0000","last_clean":"2024-01-25T15:05:43.559533+0000","last_became_active":"2024-01-25T15:05:42.569003+0000","last_became_peered":"2024-01-25T15:05:42.569003+0000","last_unstale":"2024-01-25T15:05:43.559533+0000","last_undegraded":"2024-01-25T15:05:43.559533+0000","last_fullsized":"2024-01-25T15:05:43.559533+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:06:30.121915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.563290+0000","last_change":"2024-01-25T15:05:27.241011+0000","last_active":"2024-01-25T15:05:43.563290+0000","last_peered":"2024-01-25T15:05:43.563290+0000","last_clean":"2024-01-25T15:05:43.563290+0000","last_became_active":"2024-01-25T15:05:27.240732+0000","last_became_peered":"2024-01-25T15:05:27.240732+0000","last_unstale":"2024-01-25T15:05:43.563290+0000","last_undegraded":"2024-01-25T15:05:43.563290+0000","last_fullsized":"2024-01-25T15:05:43.563290+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:53:45.905579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.571398+0000","last_change":"2024-01-25T15:05:26.224826+0000","last_active":"2024-01-25T15:05:43.571398+0000","last_peered":"2024-01-25T15:05:43.571398+0000","last_clean":"2024-01-25T15:05:43.571398+0000","last_became_active":"2024-01-25T15:05:26.224517+0000","last_became_peered":"2024-01-25T15:05:26.224517+0000","last_unstale":"2024-01-25T15:05:43.571398+0000","last_undegraded":"2024-01-25T15:05:43.571398+0000","last_fullsized":"2024-01-25T15:05:43.571398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:00:52.590768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.578817+0000","last_change":"2024-01-25T15:05:43.572442+0000","last_active":"2024-01-25T15:05:43.578817+0000","last_peered":"2024-01-25T15:05:43.578817+0000","last_clean":"2024-01-25T15:05:43.578817+0000","last_became_active":"2024-01-25T15:05:43.572150+0000","last_became_peered":"2024-01-25T15:05:43.572150+0000","last_unstale":"2024-01-25T15:05:43.578817+0000","last_undegraded":"2024-01-25T15:05:43.578817+0000","last_fullsized":"2024-01-25T15:05:43.578817+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:10:36.558502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.563218+0000","last_change":"2024-01-25T15:05:42.579428+0000","last_active":"2024-01-25T15:05:43.563218+0000","last_peered":"2024-01-25T15:05:43.563218+0000","last_clean":"2024-01-25T15:05:43.563218+0000","last_became_active":"2024-01-25T15:05:42.579097+0000","last_became_peered":"2024-01-25T15:05:42.579097+0000","last_unstale":"2024-01-25T15:05:43.563218+0000","last_undegraded":"2024-01-25T15:05:43.563218+0000","last_fullsized":"2024-01-25T15:05:43.563218+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:40:09.070760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.570907+0000","last_change":"2024-01-25T15:05:27.243054+0000","last_active":"2024-01-25T15:05:43.570907+0000","last_peered":"2024-01-25T15:05:43.570907+0000","last_clean":"2024-01-25T15:05:43.570907+0000","last_became_active":"2024-01-25T15:05:27.240995+0000","last_became_peered":"2024-01-25T15:05:27.240995+0000","last_unstale":"2024-01-25T15:05:43.570907+0000","last_undegraded":"2024-01-25T15:05:43.570907+0000","last_fullsized":"2024-01-25T15:05:43.570907+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:17:07.138969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560423+0000","last_change":"2024-01-25T15:05:26.220260+0000","last_active":"2024-01-25T15:05:43.560423+0000","last_peered":"2024-01-25T15:05:43.560423+0000","last_clean":"2024-01-25T15:05:43.560423+0000","last_became_active":"2024-01-25T15:05:26.219815+0000","last_became_peered":"2024-01-25T15:05:26.219815+0000","last_unstale":"2024-01-25T15:05:43.560423+0000","last_undegraded":"2024-01-25T15:05:43.560423+0000","last_fullsized":"2024-01-25T15:05:43.560423+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:25:54.998838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.578718+0000","last_change":"2024-01-25T15:05:43.577316+0000","last_active":"2024-01-25T15:05:43.578718+0000","last_peered":"2024-01-25T15:05:43.578718+0000","last_clean":"2024-01-25T15:05:43.578718+0000","last_became_active":"2024-01-25T15:05:43.577035+0000","last_became_peered":"2024-01-25T15:05:43.577035+0000","last_unstale":"2024-01-25T15:05:43.578718+0000","last_undegraded":"2024-01-25T15:05:43.578718+0000","last_fullsized":"2024-01-25T15:05:43.578718+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:56:03.181534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"41'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.594394+0000","last_change":"2024-01-25T15:05:42.579557+0000","last_active":"2024-01-25T15:05:43.594394+0000","last_peered":"2024-01-25T15:05:43.594394+0000","last_clean":"2024-01-25T15:05:43.594394+0000","last_became_active":"2024-01-25T15:05:42.577295+0000","last_became_peered":"2024-01-25T15:05:42.577295+0000","last_unstale":"2024-01-25T15:05:43.594394+0000","last_undegraded":"2024-01-25T15:05:43.594394+0000","last_fullsized":"2024-01-25T15:05:43.594394+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:16:41.975458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.566902+0000","last_change":"2024-01-25T15:05:27.241873+0000","last_active":"2024-01-25T15:05:43.566902+0000","last_peered":"2024-01-25T15:05:43.566902+0000","last_clean":"2024-01-25T15:05:43.566902+0000","last_became_active":"2024-01-25T15:05:27.241586+0000","last_became_peered":"2024-01-25T15:05:27.241586+0000","last_unstale":"2024-01-25T15:05:43.566902+0000","last_undegraded":"2024-01-25T15:05:43.566902+0000","last_fullsized":"2024-01-25T15:05:43.566902+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:54:18.204207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.564459+0000","last_change":"2024-01-25T15:05:26.223828+0000","last_active":"2024-01-25T15:05:43.564459+0000","last_peered":"2024-01-25T15:05:43.564459+0000","last_clean":"2024-01-25T15:05:43.564459+0000","last_became_active":"2024-01-25T15:05:26.223568+0000","last_became_peered":"2024-01-25T15:05:26.223568+0000","last_unstale":"2024-01-25T15:05:43.564459+0000","last_undegraded":"2024-01-25T15:05:43.564459+0000","last_fullsized":"2024-01-25T15:05:43.564459+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:22:35.220728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.578885+0000","last_change":"2024-01-25T15:05:43.570972+0000","last_active":"2024-01-25T15:05:43.578885+0000","last_peered":"2024-01-25T15:05:43.578885+0000","last_clean":"2024-01-25T15:05:43.578885+0000","last_became_active":"2024-01-25T15:05:43.570699+0000","last_became_peered":"2024-01-25T15:05:43.570699+0000","last_unstale":"2024-01-25T15:05:43.578885+0000","last_undegraded":"2024-01-25T15:05:43.578885+0000","last_fullsized":"2024-01-25T15:05:43.578885+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:21:39.661375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"41'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.585272+0000","last_change":"2024-01-25T15:05:42.568160+0000","last_active":"2024-01-25T15:05:43.585272+0000","last_peered":"2024-01-25T15:05:43.585272+0000","last_clean":"2024-01-25T15:05:43.585272+0000","last_became_active":"2024-01-25T15:05:42.567865+0000","last_became_peered":"2024-01-25T15:05:42.567865+0000","last_unstale":"2024-01-25T15:05:43.585272+0000","last_undegraded":"2024-01-25T15:05:43.585272+0000","last_fullsized":"2024-01-25T15:05:43.585272+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:52.154622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559486+0000","last_change":"2024-01-25T15:05:27.230178+0000","last_active":"2024-01-25T15:05:43.559486+0000","last_peered":"2024-01-25T15:05:43.559486+0000","last_clean":"2024-01-25T15:05:43.559486+0000","last_became_active":"2024-01-25T15:05:27.229928+0000","last_became_peered":"2024-01-25T15:05:27.229928+0000","last_unstale":"2024-01-25T15:05:43.559486+0000","last_undegraded":"2024-01-25T15:05:43.559486+0000","last_fullsized":"2024-01-25T15:05:43.559486+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:43:33.136506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.564691+0000","last_change":"2024-01-25T15:05:26.221805+0000","last_active":"2024-01-25T15:05:43.564691+0000","last_peered":"2024-01-25T15:05:43.564691+0000","last_clean":"2024-01-25T15:05:43.564691+0000","last_became_active":"2024-01-25T15:05:26.221380+0000","last_became_peered":"2024-01-25T15:05:26.221380+0000","last_unstale":"2024-01-25T15:05:43.564691+0000","last_undegraded":"2024-01-25T15:05:43.564691+0000","last_fullsized":"2024-01-25T15:05:43.564691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:22:35.220728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.592218+0000","last_change":"2024-01-25T15:05:43.583155+0000","last_active":"2024-01-25T15:05:43.592218+0000","last_peered":"2024-01-25T15:05:43.592218+0000","last_clean":"2024-01-25T15:05:43.592218+0000","last_became_active":"2024-01-25T15:05:43.582879+0000","last_became_peered":"2024-01-25T15:05:43.582879+0000","last_unstale":"2024-01-25T15:05:43.592218+0000","last_undegraded":"2024-01-25T15:05:43.592218+0000","last_fullsized":"2024-01-25T15:05:43.592218+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:05:22.923400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"41'3","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.591689+0000","last_change":"2024-01-25T15:05:42.575256+0000","last_active":"2024-01-25T15:05:43.591689+0000","last_peered":"2024-01-25T15:05:43.591689+0000","last_clean":"2024-01-25T15:05:43.591689+0000","last_became_active":"2024-01-25T15:05:42.574972+0000","last_became_peered":"2024-01-25T15:05:42.574972+0000","last_unstale":"2024-01-25T15:05:43.591689+0000","last_undegraded":"2024-01-25T15:05:43.591689+0000","last_fullsized":"2024-01-25T15:05:43.591689+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:54:04.739775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.567057+0000","last_change":"2024-01-25T15:05:27.243866+0000","last_active":"2024-01-25T15:05:43.567057+0000","last_peered":"2024-01-25T15:05:43.567057+0000","last_clean":"2024-01-25T15:05:43.567057+0000","last_became_active":"2024-01-25T15:05:27.243596+0000","last_became_peered":"2024-01-25T15:05:27.243596+0000","last_unstale":"2024-01-25T15:05:43.567057+0000","last_undegraded":"2024-01-25T15:05:43.567057+0000","last_fullsized":"2024-01-25T15:05:43.567057+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:31:53.282604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559734+0000","last_change":"2024-01-25T15:05:26.219579+0000","last_active":"2024-01-25T15:05:43.559734+0000","last_peered":"2024-01-25T15:05:43.559734+0000","last_clean":"2024-01-25T15:05:43.559734+0000","last_became_active":"2024-01-25T15:05:26.219276+0000","last_became_peered":"2024-01-25T15:05:26.219276+0000","last_unstale":"2024-01-25T15:05:43.559734+0000","last_undegraded":"2024-01-25T15:05:43.559734+0000","last_fullsized":"2024-01-25T15:05:43.559734+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:26:18.409269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.580045+0000","last_change":"2024-01-25T15:05:43.578157+0000","last_active":"2024-01-25T15:05:43.580045+0000","last_peered":"2024-01-25T15:05:43.580045+0000","last_clean":"2024-01-25T15:05:43.580045+0000","last_became_active":"2024-01-25T15:05:43.577697+0000","last_became_peered":"2024-01-25T15:05:43.577697+0000","last_unstale":"2024-01-25T15:05:43.580045+0000","last_undegraded":"2024-01-25T15:05:43.580045+0000","last_fullsized":"2024-01-25T15:05:43.580045+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:01:49.379607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"41'6","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.596118+0000","last_change":"2024-01-25T15:05:42.570508+0000","last_active":"2024-01-25T15:05:43.596118+0000","last_peered":"2024-01-25T15:05:43.596118+0000","last_clean":"2024-01-25T15:05:43.596118+0000","last_became_active":"2024-01-25T15:05:42.570228+0000","last_became_peered":"2024-01-25T15:05:42.570228+0000","last_unstale":"2024-01-25T15:05:43.596118+0000","last_undegraded":"2024-01-25T15:05:43.596118+0000","last_fullsized":"2024-01-25T15:05:43.596118+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:21:11.959492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.562474+0000","last_change":"2024-01-25T15:05:27.241962+0000","last_active":"2024-01-25T15:05:43.562474+0000","last_peered":"2024-01-25T15:05:43.562474+0000","last_clean":"2024-01-25T15:05:43.562474+0000","last_became_active":"2024-01-25T15:05:27.241674+0000","last_became_peered":"2024-01-25T15:05:27.241674+0000","last_unstale":"2024-01-25T15:05:43.562474+0000","last_undegraded":"2024-01-25T15:05:43.562474+0000","last_fullsized":"2024-01-25T15:05:43.562474+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:36.810625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.572025+0000","last_change":"2024-01-25T15:05:26.223146+0000","last_active":"2024-01-25T15:05:43.572025+0000","last_peered":"2024-01-25T15:05:43.572025+0000","last_clean":"2024-01-25T15:05:43.572025+0000","last_became_active":"2024-01-25T15:05:26.222888+0000","last_became_peered":"2024-01-25T15:05:26.222888+0000","last_unstale":"2024-01-25T15:05:43.572025+0000","last_undegraded":"2024-01-25T15:05:43.572025+0000","last_fullsized":"2024-01-25T15:05:43.572025+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:05:05.431051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.576275+0000","last_change":"2024-01-25T15:05:43.574086+0000","last_active":"2024-01-25T15:05:43.576275+0000","last_peered":"2024-01-25T15:05:43.576275+0000","last_clean":"2024-01-25T15:05:43.576275+0000","last_became_active":"2024-01-25T15:05:43.573797+0000","last_became_peered":"2024-01-25T15:05:43.573797+0000","last_unstale":"2024-01-25T15:05:43.576275+0000","last_undegraded":"2024-01-25T15:05:43.576275+0000","last_fullsized":"2024-01-25T15:05:43.576275+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:47:17.536420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.562492+0000","last_change":"2024-01-25T15:05:42.568353+0000","last_active":"2024-01-25T15:05:43.562492+0000","last_peered":"2024-01-25T15:05:43.562492+0000","last_clean":"2024-01-25T15:05:43.562492+0000","last_became_active":"2024-01-25T15:05:42.568028+0000","last_became_peered":"2024-01-25T15:05:42.568028+0000","last_unstale":"2024-01-25T15:05:43.562492+0000","last_undegraded":"2024-01-25T15:05:43.562492+0000","last_fullsized":"2024-01-25T15:05:43.562492+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:00:45.445942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.576365+0000","last_change":"2024-01-25T15:05:27.235466+0000","last_active":"2024-01-25T15:05:43.576365+0000","last_peered":"2024-01-25T15:05:43.576365+0000","last_clean":"2024-01-25T15:05:43.576365+0000","last_became_active":"2024-01-25T15:05:27.235043+0000","last_became_peered":"2024-01-25T15:05:27.235043+0000","last_unstale":"2024-01-25T15:05:43.576365+0000","last_undegraded":"2024-01-25T15:05:43.576365+0000","last_fullsized":"2024-01-25T15:05:43.576365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:24:11.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.572117+0000","last_change":"2024-01-25T15:05:26.227418+0000","last_active":"2024-01-25T15:05:43.572117+0000","last_peered":"2024-01-25T15:05:43.572117+0000","last_clean":"2024-01-25T15:05:43.572117+0000","last_became_active":"2024-01-25T15:05:26.227133+0000","last_became_peered":"2024-01-25T15:05:26.227133+0000","last_unstale":"2024-01-25T15:05:43.572117+0000","last_undegraded":"2024-01-25T15:05:43.572117+0000","last_fullsized":"2024-01-25T15:05:43.572117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:25:54.998838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.575482+0000","last_change":"2024-01-25T15:05:43.573777+0000","last_active":"2024-01-25T15:05:43.575482+0000","last_peered":"2024-01-25T15:05:43.575482+0000","last_clean":"2024-01-25T15:05:43.575482+0000","last_became_active":"2024-01-25T15:05:43.573511+0000","last_became_peered":"2024-01-25T15:05:43.573511+0000","last_unstale":"2024-01-25T15:05:43.575482+0000","last_undegraded":"2024-01-25T15:05:43.575482+0000","last_fullsized":"2024-01-25T15:05:43.575482+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:54:05.744126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.565494+0000","last_change":"2024-01-25T15:05:42.577148+0000","last_active":"2024-01-25T15:05:43.565494+0000","last_peered":"2024-01-25T15:05:43.565494+0000","last_clean":"2024-01-25T15:05:43.565494+0000","last_became_active":"2024-01-25T15:05:42.576868+0000","last_became_peered":"2024-01-25T15:05:42.576868+0000","last_unstale":"2024-01-25T15:05:43.565494+0000","last_undegraded":"2024-01-25T15:05:43.565494+0000","last_fullsized":"2024-01-25T15:05:43.565494+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:17:22.482965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.566416+0000","last_change":"2024-01-25T15:05:27.235111+0000","last_active":"2024-01-25T15:05:43.566416+0000","last_peered":"2024-01-25T15:05:43.566416+0000","last_clean":"2024-01-25T15:05:43.566416+0000","last_became_active":"2024-01-25T15:05:27.234825+0000","last_became_peered":"2024-01-25T15:05:27.234825+0000","last_unstale":"2024-01-25T15:05:43.566416+0000","last_undegraded":"2024-01-25T15:05:43.566416+0000","last_fullsized":"2024-01-25T15:05:43.566416+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:10.931099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'8","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560153+0000","last_change":"2024-01-25T15:05:26.213663+0000","last_active":"2024-01-25T15:05:43.560153+0000","last_peered":"2024-01-25T15:05:43.560153+0000","last_clean":"2024-01-25T15:05:43.560153+0000","last_became_active":"2024-01-25T15:05:26.213360+0000","last_became_peered":"2024-01-25T15:05:26.213360+0000","last_unstale":"2024-01-25T15:05:43.560153+0000","last_undegraded":"2024-01-25T15:05:43.560153+0000","last_fullsized":"2024-01-25T15:05:43.560153+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:43:58.660649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3111,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.572569+0000","last_change":"2024-01-25T15:05:43.564471+0000","last_active":"2024-01-25T15:05:43.572569+0000","last_peered":"2024-01-25T15:05:43.572569+0000","last_clean":"2024-01-25T15:05:43.572569+0000","last_became_active":"2024-01-25T15:05:43.564182+0000","last_became_peered":"2024-01-25T15:05:43.564182+0000","last_unstale":"2024-01-25T15:05:43.572569+0000","last_undegraded":"2024-01-25T15:05:43.572569+0000","last_fullsized":"2024-01-25T15:05:43.572569+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:37:58.901484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559627+0000","last_change":"2024-01-25T15:05:42.571418+0000","last_active":"2024-01-25T15:05:43.559627+0000","last_peered":"2024-01-25T15:05:43.559627+0000","last_clean":"2024-01-25T15:05:43.559627+0000","last_became_active":"2024-01-25T15:05:42.571136+0000","last_became_peered":"2024-01-25T15:05:42.571136+0000","last_unstale":"2024-01-25T15:05:43.559627+0000","last_undegraded":"2024-01-25T15:05:43.559627+0000","last_fullsized":"2024-01-25T15:05:43.559627+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:16:41.975458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.563405+0000","last_change":"2024-01-25T15:05:27.244333+0000","last_active":"2024-01-25T15:05:43.563405+0000","last_peered":"2024-01-25T15:05:43.563405+0000","last_clean":"2024-01-25T15:05:43.563405+0000","last_became_active":"2024-01-25T15:05:27.244050+0000","last_became_peered":"2024-01-25T15:05:27.244050+0000","last_unstale":"2024-01-25T15:05:43.563405+0000","last_undegraded":"2024-01-25T15:05:43.563405+0000","last_fullsized":"2024-01-25T15:05:43.563405+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:14:28.578562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559619+0000","last_change":"2024-01-25T15:05:26.224736+0000","last_active":"2024-01-25T15:05:43.559619+0000","last_peered":"2024-01-25T15:05:43.559619+0000","last_clean":"2024-01-25T15:05:43.559619+0000","last_became_active":"2024-01-25T15:05:26.224440+0000","last_became_peered":"2024-01-25T15:05:26.224440+0000","last_unstale":"2024-01-25T15:05:43.559619+0000","last_undegraded":"2024-01-25T15:05:43.559619+0000","last_fullsized":"2024-01-25T15:05:43.559619+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:54:17.200327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.592122+0000","last_change":"2024-01-25T15:05:43.582817+0000","last_active":"2024-01-25T15:05:43.592122+0000","last_peered":"2024-01-25T15:05:43.592122+0000","last_clean":"2024-01-25T15:05:43.592122+0000","last_became_active":"2024-01-25T15:05:43.582548+0000","last_became_peered":"2024-01-25T15:05:43.582548+0000","last_unstale":"2024-01-25T15:05:43.592122+0000","last_undegraded":"2024-01-25T15:05:43.592122+0000","last_fullsized":"2024-01-25T15:05:43.592122+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:46:28.624685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"41'8","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.594607+0000","last_change":"2024-01-25T15:05:42.570582+0000","last_active":"2024-01-25T15:05:43.594607+0000","last_peered":"2024-01-25T15:05:43.594607+0000","last_clean":"2024-01-25T15:05:43.594607+0000","last_became_active":"2024-01-25T15:05:42.570297+0000","last_became_peered":"2024-01-25T15:05:42.570297+0000","last_unstale":"2024-01-25T15:05:43.594607+0000","last_undegraded":"2024-01-25T15:05:43.594607+0000","last_fullsized":"2024-01-25T15:05:43.594607+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:49:13.168101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.558051+0000","last_change":"2024-01-25T15:05:27.225582+0000","last_active":"2024-01-25T15:05:43.558051+0000","last_peered":"2024-01-25T15:05:43.558051+0000","last_clean":"2024-01-25T15:05:43.558051+0000","last_became_active":"2024-01-25T15:05:27.225337+0000","last_became_peered":"2024-01-25T15:05:27.225337+0000","last_unstale":"2024-01-25T15:05:43.558051+0000","last_undegraded":"2024-01-25T15:05:43.558051+0000","last_fullsized":"2024-01-25T15:05:43.558051+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:06:14.777919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.562321+0000","last_change":"2024-01-25T15:05:26.224964+0000","last_active":"2024-01-25T15:05:43.562321+0000","last_peered":"2024-01-25T15:05:43.562321+0000","last_clean":"2024-01-25T15:05:43.562321+0000","last_became_active":"2024-01-25T15:05:26.224350+0000","last_became_peered":"2024-01-25T15:05:26.224350+0000","last_unstale":"2024-01-25T15:05:43.562321+0000","last_undegraded":"2024-01-25T15:05:43.562321+0000","last_fullsized":"2024-01-25T15:05:43.562321+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:23:25.092941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.582551+0000","last_change":"2024-01-25T15:05:43.580930+0000","last_active":"2024-01-25T15:05:43.582551+0000","last_peered":"2024-01-25T15:05:43.582551+0000","last_clean":"2024-01-25T15:05:43.582551+0000","last_became_active":"2024-01-25T15:05:43.580563+0000","last_became_peered":"2024-01-25T15:05:43.580563+0000","last_unstale":"2024-01-25T15:05:43.582551+0000","last_undegraded":"2024-01-25T15:05:43.582551+0000","last_fullsized":"2024-01-25T15:05:43.582551+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:21:39.661375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"41'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.593260+0000","last_change":"2024-01-25T15:05:42.576849+0000","last_active":"2024-01-25T15:05:43.593260+0000","last_peered":"2024-01-25T15:05:43.593260+0000","last_clean":"2024-01-25T15:05:43.593260+0000","last_became_active":"2024-01-25T15:05:42.575264+0000","last_became_peered":"2024-01-25T15:05:42.575264+0000","last_unstale":"2024-01-25T15:05:43.593260+0000","last_undegraded":"2024-01-25T15:05:43.593260+0000","last_fullsized":"2024-01-25T15:05:43.593260+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:54:04.739775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560326+0000","last_change":"2024-01-25T15:05:27.230302+0000","last_active":"2024-01-25T15:05:43.560326+0000","last_peered":"2024-01-25T15:05:43.560326+0000","last_clean":"2024-01-25T15:05:43.560326+0000","last_became_active":"2024-01-25T15:05:27.230047+0000","last_became_peered":"2024-01-25T15:05:27.230047+0000","last_unstale":"2024-01-25T15:05:43.560326+0000","last_undegraded":"2024-01-25T15:05:43.560326+0000","last_fullsized":"2024-01-25T15:05:43.560326+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:02:27.702949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559703+0000","last_change":"2024-01-25T15:05:26.223718+0000","last_active":"2024-01-25T15:05:43.559703+0000","last_peered":"2024-01-25T15:05:43.559703+0000","last_clean":"2024-01-25T15:05:43.559703+0000","last_became_active":"2024-01-25T15:05:26.222346+0000","last_became_peered":"2024-01-25T15:05:26.222346+0000","last_unstale":"2024-01-25T15:05:43.559703+0000","last_undegraded":"2024-01-25T15:05:43.559703+0000","last_fullsized":"2024-01-25T15:05:43.559703+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:35:19.247290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.592345+0000","last_change":"2024-01-25T15:05:43.583456+0000","last_active":"2024-01-25T15:05:43.592345+0000","last_peered":"2024-01-25T15:05:43.592345+0000","last_clean":"2024-01-25T15:05:43.592345+0000","last_became_active":"2024-01-25T15:05:43.583183+0000","last_became_peered":"2024-01-25T15:05:43.583183+0000","last_unstale":"2024-01-25T15:05:43.592345+0000","last_undegraded":"2024-01-25T15:05:43.592345+0000","last_fullsized":"2024-01-25T15:05:43.592345+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:47:17.200557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559751+0000","last_change":"2024-01-25T15:05:42.576874+0000","last_active":"2024-01-25T15:05:43.559751+0000","last_peered":"2024-01-25T15:05:43.559751+0000","last_clean":"2024-01-25T15:05:43.559751+0000","last_became_active":"2024-01-25T15:05:42.576568+0000","last_became_peered":"2024-01-25T15:05:42.576568+0000","last_unstale":"2024-01-25T15:05:43.559751+0000","last_undegraded":"2024-01-25T15:05:43.559751+0000","last_fullsized":"2024-01-25T15:05:43.559751+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:17:22.482965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559436+0000","last_change":"2024-01-25T15:05:27.226239+0000","last_active":"2024-01-25T15:05:43.559436+0000","last_peered":"2024-01-25T15:05:43.559436+0000","last_clean":"2024-01-25T15:05:43.559436+0000","last_became_active":"2024-01-25T15:05:27.225978+0000","last_became_peered":"2024-01-25T15:05:27.225978+0000","last_unstale":"2024-01-25T15:05:43.559436+0000","last_undegraded":"2024-01-25T15:05:43.559436+0000","last_fullsized":"2024-01-25T15:05:43.559436+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:36.810625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560482+0000","last_change":"2024-01-25T15:05:26.222694+0000","last_active":"2024-01-25T15:05:43.560482+0000","last_peered":"2024-01-25T15:05:43.560482+0000","last_clean":"2024-01-25T15:05:43.560482+0000","last_became_active":"2024-01-25T15:05:26.222439+0000","last_became_peered":"2024-01-25T15:05:26.222439+0000","last_unstale":"2024-01-25T15:05:43.560482+0000","last_undegraded":"2024-01-25T15:05:43.560482+0000","last_fullsized":"2024-01-25T15:05:43.560482+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:48:18.501092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.576174+0000","last_change":"2024-01-25T15:05:43.573732+0000","last_active":"2024-01-25T15:05:43.576174+0000","last_peered":"2024-01-25T15:05:43.576174+0000","last_clean":"2024-01-25T15:05:43.576174+0000","last_became_active":"2024-01-25T15:05:43.573449+0000","last_became_peered":"2024-01-25T15:05:43.573449+0000","last_unstale":"2024-01-25T15:05:43.576174+0000","last_undegraded":"2024-01-25T15:05:43.576174+0000","last_fullsized":"2024-01-25T15:05:43.576174+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:43:49.484854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"41'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.590533+0000","last_change":"2024-01-25T15:05:42.575342+0000","last_active":"2024-01-25T15:05:43.590533+0000","last_peered":"2024-01-25T15:05:43.590533+0000","last_clean":"2024-01-25T15:05:43.590533+0000","last_became_active":"2024-01-25T15:05:42.575050+0000","last_became_peered":"2024-01-25T15:05:42.575050+0000","last_unstale":"2024-01-25T15:05:43.590533+0000","last_undegraded":"2024-01-25T15:05:43.590533+0000","last_fullsized":"2024-01-25T15:05:43.590533+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:47:16.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559996+0000","last_change":"2024-01-25T15:05:27.233916+0000","last_active":"2024-01-25T15:05:43.559996+0000","last_peered":"2024-01-25T15:05:43.559996+0000","last_clean":"2024-01-25T15:05:43.559996+0000","last_became_active":"2024-01-25T15:05:27.233305+0000","last_became_peered":"2024-01-25T15:05:27.233305+0000","last_unstale":"2024-01-25T15:05:43.559996+0000","last_undegraded":"2024-01-25T15:05:43.559996+0000","last_fullsized":"2024-01-25T15:05:43.559996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:00:27.744795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.572350+0000","last_change":"2024-01-25T15:05:26.225673+0000","last_active":"2024-01-25T15:05:43.572350+0000","last_peered":"2024-01-25T15:05:43.572350+0000","last_clean":"2024-01-25T15:05:43.572350+0000","last_became_active":"2024-01-25T15:05:26.225411+0000","last_became_peered":"2024-01-25T15:05:26.225411+0000","last_unstale":"2024-01-25T15:05:43.572350+0000","last_undegraded":"2024-01-25T15:05:43.572350+0000","last_fullsized":"2024-01-25T15:05:43.572350+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:16:30.879553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.590249+0000","last_change":"2024-01-25T15:05:43.584758+0000","last_active":"2024-01-25T15:05:43.590249+0000","last_peered":"2024-01-25T15:05:43.590249+0000","last_clean":"2024-01-25T15:05:43.590249+0000","last_became_active":"2024-01-25T15:05:43.584490+0000","last_became_peered":"2024-01-25T15:05:43.584490+0000","last_unstale":"2024-01-25T15:05:43.590249+0000","last_undegraded":"2024-01-25T15:05:43.590249+0000","last_fullsized":"2024-01-25T15:05:43.590249+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:40:10.075112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560434+0000","last_change":"2024-01-25T15:05:42.572792+0000","last_active":"2024-01-25T15:05:43.560434+0000","last_peered":"2024-01-25T15:05:43.560434+0000","last_clean":"2024-01-25T15:05:43.560434+0000","last_became_active":"2024-01-25T15:05:42.572497+0000","last_became_peered":"2024-01-25T15:05:42.572497+0000","last_unstale":"2024-01-25T15:05:43.560434+0000","last_undegraded":"2024-01-25T15:05:43.560434+0000","last_fullsized":"2024-01-25T15:05:43.560434+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:43:48.480502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.571996+0000","last_change":"2024-01-25T15:05:27.247875+0000","last_active":"2024-01-25T15:05:43.571996+0000","last_peered":"2024-01-25T15:05:43.571996+0000","last_clean":"2024-01-25T15:05:43.571996+0000","last_became_active":"2024-01-25T15:05:27.247493+0000","last_became_peered":"2024-01-25T15:05:27.247493+0000","last_unstale":"2024-01-25T15:05:43.571996+0000","last_undegraded":"2024-01-25T15:05:43.571996+0000","last_fullsized":"2024-01-25T15:05:43.571996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:01:33.031259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.565873+0000","last_change":"2024-01-25T15:05:26.220907+0000","last_active":"2024-01-25T15:05:43.565873+0000","last_peered":"2024-01-25T15:05:43.565873+0000","last_clean":"2024-01-25T15:05:43.565873+0000","last_became_active":"2024-01-25T15:05:26.220539+0000","last_became_peered":"2024-01-25T15:05:26.220539+0000","last_unstale":"2024-01-25T15:05:43.565873+0000","last_undegraded":"2024-01-25T15:05:43.565873+0000","last_fullsized":"2024-01-25T15:05:43.565873+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:18:51.754911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.575586+0000","last_change":"2024-01-25T15:05:43.574330+0000","last_active":"2024-01-25T15:05:43.575586+0000","last_peered":"2024-01-25T15:05:43.575586+0000","last_clean":"2024-01-25T15:05:43.575586+0000","last_became_active":"2024-01-25T15:05:43.574064+0000","last_became_peered":"2024-01-25T15:05:43.574064+0000","last_unstale":"2024-01-25T15:05:43.575586+0000","last_undegraded":"2024-01-25T15:05:43.575586+0000","last_fullsized":"2024-01-25T15:05:43.575586+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:46:28.624685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"41'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.594357+0000","last_change":"2024-01-25T15:05:42.579365+0000","last_active":"2024-01-25T15:05:43.594357+0000","last_peered":"2024-01-25T15:05:43.594357+0000","last_clean":"2024-01-25T15:05:43.594357+0000","last_became_active":"2024-01-25T15:05:42.578110+0000","last_became_peered":"2024-01-25T15:05:42.578110+0000","last_unstale":"2024-01-25T15:05:43.594357+0000","last_undegraded":"2024-01-25T15:05:43.594357+0000","last_fullsized":"2024-01-25T15:05:43.594357+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:21:43.551991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.565671+0000","last_change":"2024-01-25T15:05:27.242875+0000","last_active":"2024-01-25T15:05:43.565671+0000","last_peered":"2024-01-25T15:05:43.565671+0000","last_clean":"2024-01-25T15:05:43.565671+0000","last_became_active":"2024-01-25T15:05:27.241953+0000","last_became_peered":"2024-01-25T15:05:27.241953+0000","last_unstale":"2024-01-25T15:05:43.565671+0000","last_undegraded":"2024-01-25T15:05:43.565671+0000","last_fullsized":"2024-01-25T15:05:43.565671+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:46:52.035987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.569521+0000","last_change":"2024-01-25T15:05:26.218250+0000","last_active":"2024-01-25T15:05:43.569521+0000","last_peered":"2024-01-25T15:05:43.569521+0000","last_clean":"2024-01-25T15:05:43.569521+0000","last_became_active":"2024-01-25T15:05:26.217965+0000","last_became_peered":"2024-01-25T15:05:26.217965+0000","last_unstale":"2024-01-25T15:05:43.569521+0000","last_undegraded":"2024-01-25T15:05:43.569521+0000","last_fullsized":"2024-01-25T15:05:43.569521+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:03:01.180813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.584964+0000","last_change":"2024-01-25T15:05:43.584177+0000","last_active":"2024-01-25T15:05:43.584964+0000","last_peered":"2024-01-25T15:05:43.584964+0000","last_clean":"2024-01-25T15:05:43.584964+0000","last_became_active":"2024-01-25T15:05:43.583858+0000","last_became_peered":"2024-01-25T15:05:43.583858+0000","last_unstale":"2024-01-25T15:05:43.584964+0000","last_undegraded":"2024-01-25T15:05:43.584964+0000","last_fullsized":"2024-01-25T15:05:43.584964+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:43:00.062741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"41'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.589473+0000","last_change":"2024-01-25T15:05:42.572403+0000","last_active":"2024-01-25T15:05:43.589473+0000","last_peered":"2024-01-25T15:05:43.589473+0000","last_clean":"2024-01-25T15:05:43.589473+0000","last_became_active":"2024-01-25T15:05:42.572015+0000","last_became_peered":"2024-01-25T15:05:42.572015+0000","last_unstale":"2024-01-25T15:05:43.589473+0000","last_undegraded":"2024-01-25T15:05:43.589473+0000","last_fullsized":"2024-01-25T15:05:43.589473+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:33:20.358280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.567788+0000","last_change":"2024-01-25T15:05:27.236656+0000","last_active":"2024-01-25T15:05:43.567788+0000","last_peered":"2024-01-25T15:05:43.567788+0000","last_clean":"2024-01-25T15:05:43.567788+0000","last_became_active":"2024-01-25T15:05:27.236391+0000","last_became_peered":"2024-01-25T15:05:27.236391+0000","last_unstale":"2024-01-25T15:05:43.567788+0000","last_undegraded":"2024-01-25T15:05:43.567788+0000","last_fullsized":"2024-01-25T15:05:43.567788+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:48:19.504972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.561562+0000","last_change":"2024-01-25T15:05:26.218267+0000","last_active":"2024-01-25T15:05:43.561562+0000","last_peered":"2024-01-25T15:05:43.561562+0000","last_clean":"2024-01-25T15:05:43.561562+0000","last_became_active":"2024-01-25T15:05:26.217935+0000","last_became_peered":"2024-01-25T15:05:26.217935+0000","last_unstale":"2024-01-25T15:05:43.561562+0000","last_undegraded":"2024-01-25T15:05:43.561562+0000","last_fullsized":"2024-01-25T15:05:43.561562+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:18:51.754911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.592341+0000","last_change":"2024-01-25T15:05:43.583952+0000","last_active":"2024-01-25T15:05:43.592341+0000","last_peered":"2024-01-25T15:05:43.592341+0000","last_clean":"2024-01-25T15:05:43.592341+0000","last_became_active":"2024-01-25T15:05:43.583701+0000","last_became_peered":"2024-01-25T15:05:43.583701+0000","last_unstale":"2024-01-25T15:05:43.592341+0000","last_undegraded":"2024-01-25T15:05:43.592341+0000","last_fullsized":"2024-01-25T15:05:43.592341+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:38:07.709476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.570974+0000","last_change":"2024-01-25T15:05:42.579740+0000","last_active":"2024-01-25T15:05:43.570974+0000","last_peered":"2024-01-25T15:05:43.570974+0000","last_clean":"2024-01-25T15:05:43.570974+0000","last_became_active":"2024-01-25T15:05:42.579450+0000","last_became_peered":"2024-01-25T15:05:42.579450+0000","last_unstale":"2024-01-25T15:05:43.570974+0000","last_undegraded":"2024-01-25T15:05:43.570974+0000","last_fullsized":"2024-01-25T15:05:43.570974+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:00:45.445942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560586+0000","last_change":"2024-01-25T15:05:27.229184+0000","last_active":"2024-01-25T15:05:43.560586+0000","last_peered":"2024-01-25T15:05:43.560586+0000","last_clean":"2024-01-25T15:05:43.560586+0000","last_became_active":"2024-01-25T15:05:27.228691+0000","last_became_peered":"2024-01-25T15:05:27.228691+0000","last_unstale":"2024-01-25T15:05:43.560586+0000","last_undegraded":"2024-01-25T15:05:43.560586+0000","last_fullsized":"2024-01-25T15:05:43.560586+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:44:30.520452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.569479+0000","last_change":"2024-01-25T15:05:26.224643+0000","last_active":"2024-01-25T15:05:43.569479+0000","last_peered":"2024-01-25T15:05:43.569479+0000","last_clean":"2024-01-25T15:05:43.569479+0000","last_became_active":"2024-01-25T15:05:26.224395+0000","last_became_peered":"2024-01-25T15:05:26.224395+0000","last_unstale":"2024-01-25T15:05:43.569479+0000","last_undegraded":"2024-01-25T15:05:43.569479+0000","last_fullsized":"2024-01-25T15:05:43.569479+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:12:44.093299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.580321+0000","last_change":"2024-01-25T15:05:43.575038+0000","last_active":"2024-01-25T15:05:43.580321+0000","last_peered":"2024-01-25T15:05:43.580321+0000","last_clean":"2024-01-25T15:05:43.580321+0000","last_became_active":"2024-01-25T15:05:43.574766+0000","last_became_peered":"2024-01-25T15:05:43.574766+0000","last_unstale":"2024-01-25T15:05:43.580321+0000","last_undegraded":"2024-01-25T15:05:43.580321+0000","last_fullsized":"2024-01-25T15:05:43.580321+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:56:03.181534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.565659+0000","last_change":"2024-01-25T15:05:42.572990+0000","last_active":"2024-01-25T15:05:43.565659+0000","last_peered":"2024-01-25T15:05:43.565659+0000","last_clean":"2024-01-25T15:05:43.565659+0000","last_became_active":"2024-01-25T15:05:42.572686+0000","last_became_peered":"2024-01-25T15:05:42.572686+0000","last_unstale":"2024-01-25T15:05:43.565659+0000","last_undegraded":"2024-01-25T15:05:43.565659+0000","last_fullsized":"2024-01-25T15:05:43.565659+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:49:45.016507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.571700+0000","last_change":"2024-01-25T15:05:27.235292+0000","last_active":"2024-01-25T15:05:43.571700+0000","last_peered":"2024-01-25T15:05:43.571700+0000","last_clean":"2024-01-25T15:05:43.571700+0000","last_became_active":"2024-01-25T15:05:27.234825+0000","last_became_peered":"2024-01-25T15:05:27.234825+0000","last_unstale":"2024-01-25T15:05:43.571700+0000","last_undegraded":"2024-01-25T15:05:43.571700+0000","last_fullsized":"2024-01-25T15:05:43.571700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:16:02.607369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.566290+0000","last_change":"2024-01-25T15:05:26.227384+0000","last_active":"2024-01-25T15:05:43.566290+0000","last_peered":"2024-01-25T15:05:43.566290+0000","last_clean":"2024-01-25T15:05:43.566290+0000","last_became_active":"2024-01-25T15:05:26.227112+0000","last_became_peered":"2024-01-25T15:05:26.227112+0000","last_unstale":"2024-01-25T15:05:43.566290+0000","last_undegraded":"2024-01-25T15:05:43.566290+0000","last_fullsized":"2024-01-25T15:05:43.566290+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:05:00.172648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.575518+0000","last_change":"2024-01-25T15:05:43.574511+0000","last_active":"2024-01-25T15:05:43.575518+0000","last_peered":"2024-01-25T15:05:43.575518+0000","last_clean":"2024-01-25T15:05:43.575518+0000","last_became_active":"2024-01-25T15:05:43.574193+0000","last_became_peered":"2024-01-25T15:05:43.574193+0000","last_unstale":"2024-01-25T15:05:43.575518+0000","last_undegraded":"2024-01-25T15:05:43.575518+0000","last_fullsized":"2024-01-25T15:05:43.575518+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:29:14.876032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"41'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.594859+0000","last_change":"2024-01-25T15:05:42.575645+0000","last_active":"2024-01-25T15:05:43.594859+0000","last_peered":"2024-01-25T15:05:43.594859+0000","last_clean":"2024-01-25T15:05:43.594859+0000","last_became_active":"2024-01-25T15:05:42.574424+0000","last_became_peered":"2024-01-25T15:05:42.574424+0000","last_unstale":"2024-01-25T15:05:43.594859+0000","last_undegraded":"2024-01-25T15:05:43.594859+0000","last_fullsized":"2024-01-25T15:05:43.594859+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:52.154622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.571178+0000","last_change":"2024-01-25T15:05:27.245885+0000","last_active":"2024-01-25T15:05:43.571178+0000","last_peered":"2024-01-25T15:05:43.571178+0000","last_clean":"2024-01-25T15:05:43.571178+0000","last_became_active":"2024-01-25T15:05:27.245616+0000","last_became_peered":"2024-01-25T15:05:27.245616+0000","last_unstale":"2024-01-25T15:05:43.571178+0000","last_undegraded":"2024-01-25T15:05:43.571178+0000","last_fullsized":"2024-01-25T15:05:43.571178+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:02:27.622813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559859+0000","last_change":"2024-01-25T15:05:26.221180+0000","last_active":"2024-01-25T15:05:43.559859+0000","last_peered":"2024-01-25T15:05:43.559859+0000","last_clean":"2024-01-25T15:05:43.559859+0000","last_became_active":"2024-01-25T15:05:26.220911+0000","last_became_peered":"2024-01-25T15:05:26.220911+0000","last_unstale":"2024-01-25T15:05:43.559859+0000","last_undegraded":"2024-01-25T15:05:43.559859+0000","last_fullsized":"2024-01-25T15:05:43.559859+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:00:52.590768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.579583+0000","last_change":"2024-01-25T15:05:43.575652+0000","last_active":"2024-01-25T15:05:43.579583+0000","last_peered":"2024-01-25T15:05:43.579583+0000","last_clean":"2024-01-25T15:05:43.579583+0000","last_became_active":"2024-01-25T15:05:43.574574+0000","last_became_peered":"2024-01-25T15:05:43.574574+0000","last_unstale":"2024-01-25T15:05:43.579583+0000","last_undegraded":"2024-01-25T15:05:43.579583+0000","last_fullsized":"2024-01-25T15:05:43.579583+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:44:42.682512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.558128+0000","last_change":"2024-01-25T15:05:42.568742+0000","last_active":"2024-01-25T15:05:43.558128+0000","last_peered":"2024-01-25T15:05:43.558128+0000","last_clean":"2024-01-25T15:05:43.558128+0000","last_became_active":"2024-01-25T15:05:42.568470+0000","last_became_peered":"2024-01-25T15:05:42.568470+0000","last_unstale":"2024-01-25T15:05:43.558128+0000","last_undegraded":"2024-01-25T15:05:43.558128+0000","last_fullsized":"2024-01-25T15:05:43.558128+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:21:38.657023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559537+0000","last_change":"2024-01-25T15:05:27.229523+0000","last_active":"2024-01-25T15:05:43.559537+0000","last_peered":"2024-01-25T15:05:43.559537+0000","last_clean":"2024-01-25T15:05:43.559537+0000","last_became_active":"2024-01-25T15:05:27.229254+0000","last_became_peered":"2024-01-25T15:05:27.229254+0000","last_unstale":"2024-01-25T15:05:43.559537+0000","last_undegraded":"2024-01-25T15:05:43.559537+0000","last_fullsized":"2024-01-25T15:05:43.559537+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:47:01.188072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.565943+0000","last_change":"2024-01-25T15:05:26.220823+0000","last_active":"2024-01-25T15:05:43.565943+0000","last_peered":"2024-01-25T15:05:43.565943+0000","last_clean":"2024-01-25T15:05:43.565943+0000","last_became_active":"2024-01-25T15:05:26.220552+0000","last_became_peered":"2024-01-25T15:05:26.220552+0000","last_unstale":"2024-01-25T15:05:43.565943+0000","last_undegraded":"2024-01-25T15:05:43.565943+0000","last_fullsized":"2024-01-25T15:05:43.565943+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:27:08.783181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.580417+0000","last_change":"2024-01-25T15:05:43.576421+0000","last_active":"2024-01-25T15:05:43.580417+0000","last_peered":"2024-01-25T15:05:43.580417+0000","last_clean":"2024-01-25T15:05:43.580417+0000","last_became_active":"2024-01-25T15:05:43.576155+0000","last_became_peered":"2024-01-25T15:05:43.576155+0000","last_unstale":"2024-01-25T15:05:43.580417+0000","last_undegraded":"2024-01-25T15:05:43.580417+0000","last_fullsized":"2024-01-25T15:05:43.580417+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:00:44.093143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560899+0000","last_change":"2024-01-25T15:05:42.573201+0000","last_active":"2024-01-25T15:05:43.560899+0000","last_peered":"2024-01-25T15:05:43.560899+0000","last_clean":"2024-01-25T15:05:43.560899+0000","last_became_active":"2024-01-25T15:05:42.572904+0000","last_became_peered":"2024-01-25T15:05:42.572904+0000","last_unstale":"2024-01-25T15:05:43.560899+0000","last_undegraded":"2024-01-25T15:05:43.560899+0000","last_fullsized":"2024-01-25T15:05:43.560899+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:29:13.871680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.561460+0000","last_change":"2024-01-25T15:05:27.242991+0000","last_active":"2024-01-25T15:05:43.561460+0000","last_peered":"2024-01-25T15:05:43.561460+0000","last_clean":"2024-01-25T15:05:43.561460+0000","last_became_active":"2024-01-25T15:05:27.241347+0000","last_became_peered":"2024-01-25T15:05:27.241347+0000","last_unstale":"2024-01-25T15:05:43.561460+0000","last_undegraded":"2024-01-25T15:05:43.561460+0000","last_fullsized":"2024-01-25T15:05:43.561460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:54:18.204207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.572624+0000","last_change":"2024-01-25T15:05:26.227334+0000","last_active":"2024-01-25T15:05:43.572624+0000","last_peered":"2024-01-25T15:05:43.572624+0000","last_clean":"2024-01-25T15:05:43.572624+0000","last_became_active":"2024-01-25T15:05:26.227016+0000","last_became_peered":"2024-01-25T15:05:26.227016+0000","last_unstale":"2024-01-25T15:05:43.572624+0000","last_undegraded":"2024-01-25T15:05:43.572624+0000","last_fullsized":"2024-01-25T15:05:43.572624+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:29.999087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.583441+0000","last_change":"2024-01-25T15:05:43.579370+0000","last_active":"2024-01-25T15:05:43.583441+0000","last_peered":"2024-01-25T15:05:43.583441+0000","last_clean":"2024-01-25T15:05:43.583441+0000","last_became_active":"2024-01-25T15:05:43.579100+0000","last_became_peered":"2024-01-25T15:05:43.579100+0000","last_unstale":"2024-01-25T15:05:43.583441+0000","last_undegraded":"2024-01-25T15:05:43.583441+0000","last_fullsized":"2024-01-25T15:05:43.583441+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:05:22.923400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.570353+0000","last_change":"2024-01-25T15:05:42.579960+0000","last_active":"2024-01-25T15:05:43.570353+0000","last_peered":"2024-01-25T15:05:43.570353+0000","last_clean":"2024-01-25T15:05:43.570353+0000","last_became_active":"2024-01-25T15:05:42.579056+0000","last_became_peered":"2024-01-25T15:05:42.579056+0000","last_unstale":"2024-01-25T15:05:43.570353+0000","last_undegraded":"2024-01-25T15:05:43.570353+0000","last_fullsized":"2024-01-25T15:05:43.570353+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:29:13.871680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.562927+0000","last_change":"2024-01-25T15:05:27.242175+0000","last_active":"2024-01-25T15:05:43.562927+0000","last_peered":"2024-01-25T15:05:43.562927+0000","last_clean":"2024-01-25T15:05:43.562927+0000","last_became_active":"2024-01-25T15:05:27.241892+0000","last_became_peered":"2024-01-25T15:05:27.241892+0000","last_unstale":"2024-01-25T15:05:43.562927+0000","last_undegraded":"2024-01-25T15:05:43.562927+0000","last_fullsized":"2024-01-25T15:05:43.562927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:17:07.138969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.568616+0000","last_change":"2024-01-25T15:05:26.220140+0000","last_active":"2024-01-25T15:05:43.568616+0000","last_peered":"2024-01-25T15:05:43.568616+0000","last_clean":"2024-01-25T15:05:43.568616+0000","last_became_active":"2024-01-25T15:05:26.219823+0000","last_became_peered":"2024-01-25T15:05:26.219823+0000","last_unstale":"2024-01-25T15:05:43.568616+0000","last_undegraded":"2024-01-25T15:05:43.568616+0000","last_fullsized":"2024-01-25T15:05:43.568616+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:53:24.322574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.576418+0000","last_change":"2024-01-25T15:05:43.575336+0000","last_active":"2024-01-25T15:05:43.576418+0000","last_peered":"2024-01-25T15:05:43.576418+0000","last_clean":"2024-01-25T15:05:43.576418+0000","last_became_active":"2024-01-25T15:05:43.575073+0000","last_became_peered":"2024-01-25T15:05:43.575073+0000","last_unstale":"2024-01-25T15:05:43.576418+0000","last_undegraded":"2024-01-25T15:05:43.576418+0000","last_fullsized":"2024-01-25T15:05:43.576418+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:00:46.450293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"41'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.593416+0000","last_change":"2024-01-25T15:05:42.575698+0000","last_active":"2024-01-25T15:05:43.593416+0000","last_peered":"2024-01-25T15:05:43.593416+0000","last_clean":"2024-01-25T15:05:43.593416+0000","last_became_active":"2024-01-25T15:05:42.575426+0000","last_became_peered":"2024-01-25T15:05:42.575426+0000","last_unstale":"2024-01-25T15:05:43.593416+0000","last_undegraded":"2024-01-25T15:05:43.593416+0000","last_fullsized":"2024-01-25T15:05:43.593416+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:52.154622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560556+0000","last_change":"2024-01-25T15:05:27.229536+0000","last_active":"2024-01-25T15:05:43.560556+0000","last_peered":"2024-01-25T15:05:43.560556+0000","last_clean":"2024-01-25T15:05:43.560556+0000","last_became_active":"2024-01-25T15:05:27.228565+0000","last_became_peered":"2024-01-25T15:05:27.228565+0000","last_unstale":"2024-01-25T15:05:43.560556+0000","last_undegraded":"2024-01-25T15:05:43.560556+0000","last_fullsized":"2024-01-25T15:05:43.560556+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:01:33.031259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.576725+0000","last_change":"2024-01-25T15:05:26.225379+0000","last_active":"2024-01-25T15:05:43.576725+0000","last_peered":"2024-01-25T15:05:43.576725+0000","last_clean":"2024-01-25T15:05:43.576725+0000","last_became_active":"2024-01-25T15:05:26.225106+0000","last_became_peered":"2024-01-25T15:05:26.225106+0000","last_unstale":"2024-01-25T15:05:43.576725+0000","last_undegraded":"2024-01-25T15:05:43.576725+0000","last_fullsized":"2024-01-25T15:05:43.576725+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:21:43.851971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.592320+0000","last_change":"2024-01-25T15:05:43.582956+0000","last_active":"2024-01-25T15:05:43.592320+0000","last_peered":"2024-01-25T15:05:43.592320+0000","last_clean":"2024-01-25T15:05:43.592320+0000","last_became_active":"2024-01-25T15:05:43.582707+0000","last_became_peered":"2024-01-25T15:05:43.582707+0000","last_unstale":"2024-01-25T15:05:43.592320+0000","last_undegraded":"2024-01-25T15:05:43.592320+0000","last_fullsized":"2024-01-25T15:05:43.592320+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:26:26.772555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.564441+0000","last_change":"2024-01-25T15:05:42.572255+0000","last_active":"2024-01-25T15:05:43.564441+0000","last_peered":"2024-01-25T15:05:43.564441+0000","last_clean":"2024-01-25T15:05:43.564441+0000","last_became_active":"2024-01-25T15:05:42.571907+0000","last_became_peered":"2024-01-25T15:05:42.571907+0000","last_unstale":"2024-01-25T15:05:43.564441+0000","last_undegraded":"2024-01-25T15:05:43.564441+0000","last_fullsized":"2024-01-25T15:05:43.564441+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:06:30.121915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.563511+0000","last_change":"2024-01-25T15:05:27.229007+0000","last_active":"2024-01-25T15:05:43.563511+0000","last_peered":"2024-01-25T15:05:43.563511+0000","last_clean":"2024-01-25T15:05:43.563511+0000","last_became_active":"2024-01-25T15:05:27.228729+0000","last_became_peered":"2024-01-25T15:05:27.228729+0000","last_unstale":"2024-01-25T15:05:43.563511+0000","last_undegraded":"2024-01-25T15:05:43.563511+0000","last_fullsized":"2024-01-25T15:05:43.563511+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:13:38.590014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.570454+0000","last_change":"2024-01-25T15:05:26.226470+0000","last_active":"2024-01-25T15:05:43.570454+0000","last_peered":"2024-01-25T15:05:43.570454+0000","last_clean":"2024-01-25T15:05:43.570454+0000","last_became_active":"2024-01-25T15:05:26.226185+0000","last_became_peered":"2024-01-25T15:05:26.226185+0000","last_unstale":"2024-01-25T15:05:43.570454+0000","last_undegraded":"2024-01-25T15:05:43.570454+0000","last_fullsized":"2024-01-25T15:05:43.570454+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:00:52.590768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.585862+0000","last_change":"2024-01-25T15:05:43.580637+0000","last_active":"2024-01-25T15:05:43.585862+0000","last_peered":"2024-01-25T15:05:43.585862+0000","last_clean":"2024-01-25T15:05:43.585862+0000","last_became_active":"2024-01-25T15:05:43.580379+0000","last_became_peered":"2024-01-25T15:05:43.580379+0000","last_unstale":"2024-01-25T15:05:43.585862+0000","last_undegraded":"2024-01-25T15:05:43.585862+0000","last_fullsized":"2024-01-25T15:05:43.585862+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:47:17.200557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.570887+0000","last_change":"2024-01-25T15:05:42.571496+0000","last_active":"2024-01-25T15:05:43.570887+0000","last_peered":"2024-01-25T15:05:43.570887+0000","last_clean":"2024-01-25T15:05:43.570887+0000","last_became_active":"2024-01-25T15:05:42.569820+0000","last_became_peered":"2024-01-25T15:05:42.569820+0000","last_unstale":"2024-01-25T15:05:43.570887+0000","last_undegraded":"2024-01-25T15:05:43.570887+0000","last_fullsized":"2024-01-25T15:05:43.570887+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:40:09.070760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.563105+0000","last_change":"2024-01-25T15:05:27.236625+0000","last_active":"2024-01-25T15:05:43.563105+0000","last_peered":"2024-01-25T15:05:43.563105+0000","last_clean":"2024-01-25T15:05:43.563105+0000","last_became_active":"2024-01-25T15:05:27.236387+0000","last_became_peered":"2024-01-25T15:05:27.236387+0000","last_unstale":"2024-01-25T15:05:43.563105+0000","last_undegraded":"2024-01-25T15:05:43.563105+0000","last_fullsized":"2024-01-25T15:05:43.563105+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:43:59.664529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.561414+0000","last_change":"2024-01-25T15:05:26.224342+0000","last_active":"2024-01-25T15:05:43.561414+0000","last_peered":"2024-01-25T15:05:43.561414+0000","last_clean":"2024-01-25T15:05:43.561414+0000","last_became_active":"2024-01-25T15:05:26.224074+0000","last_became_peered":"2024-01-25T15:05:26.224074+0000","last_unstale":"2024-01-25T15:05:43.561414+0000","last_undegraded":"2024-01-25T15:05:43.561414+0000","last_fullsized":"2024-01-25T15:05:43.561414+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:22:35.220728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.590738+0000","last_change":"2024-01-25T15:05:43.577530+0000","last_active":"2024-01-25T15:05:43.590738+0000","last_peered":"2024-01-25T15:05:43.590738+0000","last_clean":"2024-01-25T15:05:43.590738+0000","last_became_active":"2024-01-25T15:05:43.575895+0000","last_became_peered":"2024-01-25T15:05:43.575895+0000","last_unstale":"2024-01-25T15:05:43.590738+0000","last_undegraded":"2024-01-25T15:05:43.590738+0000","last_fullsized":"2024-01-25T15:05:43.590738+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:10:36.558502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.558840+0000","last_change":"2024-01-25T15:05:42.571658+0000","last_active":"2024-01-25T15:05:43.558840+0000","last_peered":"2024-01-25T15:05:43.558840+0000","last_clean":"2024-01-25T15:05:43.558840+0000","last_became_active":"2024-01-25T15:05:42.571274+0000","last_became_peered":"2024-01-25T15:05:42.571274+0000","last_unstale":"2024-01-25T15:05:43.558840+0000","last_undegraded":"2024-01-25T15:05:43.558840+0000","last_fullsized":"2024-01-25T15:05:43.558840+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:30:41.033538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.566760+0000","last_change":"2024-01-25T15:05:27.234553+0000","last_active":"2024-01-25T15:05:43.566760+0000","last_peered":"2024-01-25T15:05:43.566760+0000","last_clean":"2024-01-25T15:05:43.566760+0000","last_became_active":"2024-01-25T15:05:27.234266+0000","last_became_peered":"2024-01-25T15:05:27.234266+0000","last_unstale":"2024-01-25T15:05:43.566760+0000","last_undegraded":"2024-01-25T15:05:43.566760+0000","last_fullsized":"2024-01-25T15:05:43.566760+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:26:19.413150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.564563+0000","last_change":"2024-01-25T15:05:26.210731+0000","last_active":"2024-01-25T15:05:43.564563+0000","last_peered":"2024-01-25T15:05:43.564563+0000","last_clean":"2024-01-25T15:05:43.564563+0000","last_became_active":"2024-01-25T15:05:26.210193+0000","last_became_peered":"2024-01-25T15:05:26.210193+0000","last_unstale":"2024-01-25T15:05:43.564563+0000","last_undegraded":"2024-01-25T15:05:43.564563+0000","last_fullsized":"2024-01-25T15:05:43.564563+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:35:19.247290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.582661+0000","last_change":"2024-01-25T15:05:43.581661+0000","last_active":"2024-01-25T15:05:43.582661+0000","last_peered":"2024-01-25T15:05:43.582661+0000","last_clean":"2024-01-25T15:05:43.582661+0000","last_became_active":"2024-01-25T15:05:43.581376+0000","last_became_peered":"2024-01-25T15:05:43.581376+0000","last_unstale":"2024-01-25T15:05:43.582661+0000","last_undegraded":"2024-01-25T15:05:43.582661+0000","last_fullsized":"2024-01-25T15:05:43.582661+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:10:36.558502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.558275+0000","last_change":"2024-01-25T15:05:42.569360+0000","last_active":"2024-01-25T15:05:43.558275+0000","last_peered":"2024-01-25T15:05:43.558275+0000","last_clean":"2024-01-25T15:05:43.558275+0000","last_became_active":"2024-01-25T15:05:42.569079+0000","last_became_peered":"2024-01-25T15:05:42.569079+0000","last_unstale":"2024-01-25T15:05:43.558275+0000","last_undegraded":"2024-01-25T15:05:43.558275+0000","last_fullsized":"2024-01-25T15:05:43.558275+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:10:35.554151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.561158+0000","last_change":"2024-01-25T15:05:27.240670+0000","last_active":"2024-01-25T15:05:43.561158+0000","last_peered":"2024-01-25T15:05:43.561158+0000","last_clean":"2024-01-25T15:05:43.561158+0000","last_became_active":"2024-01-25T15:05:27.240409+0000","last_became_peered":"2024-01-25T15:05:27.240409+0000","last_unstale":"2024-01-25T15:05:43.561158+0000","last_undegraded":"2024-01-25T15:05:43.561158+0000","last_fullsized":"2024-01-25T15:05:43.561158+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:24:11.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.558606+0000","last_change":"2024-01-25T15:05:26.215779+0000","last_active":"2024-01-25T15:05:43.558606+0000","last_peered":"2024-01-25T15:05:43.558606+0000","last_clean":"2024-01-25T15:05:43.558606+0000","last_became_active":"2024-01-25T15:05:26.215521+0000","last_became_peered":"2024-01-25T15:05:26.215521+0000","last_unstale":"2024-01-25T15:05:43.558606+0000","last_undegraded":"2024-01-25T15:05:43.558606+0000","last_fullsized":"2024-01-25T15:05:43.558606+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:33:04.010404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.579740+0000","last_change":"2024-01-25T15:05:43.576360+0000","last_active":"2024-01-25T15:05:43.579740+0000","last_peered":"2024-01-25T15:05:43.579740+0000","last_clean":"2024-01-25T15:05:43.579740+0000","last_became_active":"2024-01-25T15:05:43.576013+0000","last_became_peered":"2024-01-25T15:05:43.576013+0000","last_unstale":"2024-01-25T15:05:43.579740+0000","last_undegraded":"2024-01-25T15:05:43.579740+0000","last_fullsized":"2024-01-25T15:05:43.579740+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:17:02.746946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.576578+0000","last_change":"2024-01-25T15:05:42.578086+0000","last_active":"2024-01-25T15:05:43.576578+0000","last_peered":"2024-01-25T15:05:43.576578+0000","last_clean":"2024-01-25T15:05:43.576578+0000","last_became_active":"2024-01-25T15:05:42.577592+0000","last_became_peered":"2024-01-25T15:05:42.577592+0000","last_unstale":"2024-01-25T15:05:43.576578+0000","last_undegraded":"2024-01-25T15:05:43.576578+0000","last_fullsized":"2024-01-25T15:05:43.576578+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:07:47.334162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.571914+0000","last_change":"2024-01-25T15:05:27.236929+0000","last_active":"2024-01-25T15:05:43.571914+0000","last_peered":"2024-01-25T15:05:43.571914+0000","last_clean":"2024-01-25T15:05:43.571914+0000","last_became_active":"2024-01-25T15:05:27.236388+0000","last_became_peered":"2024-01-25T15:05:27.236388+0000","last_unstale":"2024-01-25T15:05:43.571914+0000","last_undegraded":"2024-01-25T15:05:43.571914+0000","last_fullsized":"2024-01-25T15:05:43.571914+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:55:46.833186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560906+0000","last_change":"2024-01-25T15:05:26.221948+0000","last_active":"2024-01-25T15:05:43.560906+0000","last_peered":"2024-01-25T15:05:43.560906+0000","last_clean":"2024-01-25T15:05:43.560906+0000","last_became_active":"2024-01-25T15:05:26.221678+0000","last_became_peered":"2024-01-25T15:05:26.221678+0000","last_unstale":"2024-01-25T15:05:43.560906+0000","last_undegraded":"2024-01-25T15:05:43.560906+0000","last_fullsized":"2024-01-25T15:05:43.560906+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:21:43.851971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":207,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560687+0000","last_change":"2024-01-25T15:04:16.181635+0000","last_active":"2024-01-25T15:05:43.560687+0000","last_peered":"2024-01-25T15:05:43.560687+0000","last_clean":"2024-01-25T15:05:43.560687+0000","last_became_active":"2024-01-25T15:04:16.179890+0000","last_became_peered":"2024-01-25T15:04:16.179890+0000","last_unstale":"2024-01-25T15:05:43.560687+0000","last_undegraded":"2024-01-25T15:05:43.560687+0000","last_fullsized":"2024-01-25T15:05:43.560687+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_clean_scrub_stamp":"2024-01-25T15:04:14.956188+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:49:00.618327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":3909,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1073152,"data_stored":796628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.437},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.38800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":487424,"data_stored":212266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.66600000000000004}]},{"osd":1,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.377}]},{"osd":5,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.35499999999999998}]},{"osd":7,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.5},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.42999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":471040,"data_stored":203191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.63900000000000001}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.70099999999999996}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.74099999999999999}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.82199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31664,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":487424,"data_stored":212218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.437},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.629},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.67000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":479232,"data_stored":206224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":3.3559999999999999,"5min":3.3559999999999999,"15min":3.3559999999999999},"last":0.245},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.27200000000000002}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.4209999999999998,"5min":3.4209999999999998,"15min":3.4209999999999998},"last":0.309}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.4689999999999999,"5min":3.4689999999999999,"15min":3.4689999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":3.508,"5min":3.508,"15min":3.508},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.5449999999999999,"5min":3.5449999999999999,"15min":3.5449999999999999},"last":0.56399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":466944,"data_stored":203149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.439},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.501},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.87},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.79600000000000004}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.70199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":466944,"data_stored":203169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.255},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.311}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.498},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.622}]},{"osd":7,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1060864,"data_stored":793481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.377}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.65300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:05:46.574 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-25T15:05:46.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.706+0000 7fc4b4432640 1 Processor -- start 2024-01-25T15:05:46.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.706+0000 7fc4b4432640 1 -- start start 2024-01-25T15:05:46.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.707+0000 7fc4b4432640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc4ac151f30 0x7fc4ac0c04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.707+0000 7fc4b4432640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc4ac0a8490 0x7fc4ac0c0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.707+0000 7fc4b4432640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ac152310 con 0x7fc4ac06a6c0 2024-01-25T15:05:46.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.707+0000 7fc4b4432640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ac0c1a90 con 0x7fc4ac0a8490 2024-01-25T15:05:46.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.707+0000 7fc4b4432640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ac0c1d70 con 0x7fc4ac151f30 2024-01-25T15:05:46.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.707+0000 7fc4b19cd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc4ac0a8490 0x7fc4ac0c0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:46.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.707+0000 7fc4b19cd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc4ac0a8490 0x7fc4ac0c0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55490/0 (socket says 172.21.15.29:55490) 2024-01-25T15:05:46.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.707+0000 7fc4b19cd640 1 -- 172.21.15.29:0/1629921182 learned_addr learned my addr 172.21.15.29:0/1629921182 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:46.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.707+0000 7fc4b19cd640 1 -- 172.21.15.29:0/1629921182 >> v2:172.21.15.52:3300/0 conn(0x7fc4ac151f30 msgr2=0x7fc4ac0c04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:46.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.707+0000 7fc4b19cd640 1 --2- 172.21.15.29:0/1629921182 >> v2:172.21.15.52:3300/0 conn(0x7fc4ac151f30 0x7fc4ac0c04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.707+0000 7fc4b19cd640 1 -- 172.21.15.29:0/1629921182 >> v1:172.21.15.29:6789/0 conn(0x7fc4ac06a6c0 legacy=0x7fc4ac06ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:46.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.707+0000 7fc4b11cc640 1 -- 172.21.15.29:0/1629921182 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338569213 0 0) 0x7fc4a8001490 con 0x7fc4ac06a6c0 2024-01-25T15:05:46.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.707+0000 7fc4b19cd640 1 -- 172.21.15.29:0/1629921182 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac0c2200 con 0x7fc4ac0a8490 2024-01-25T15:05:46.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.708+0000 7fc4b19cd640 1 --2- 172.21.15.29:0/1629921182 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4ac0a8490 0x7fc4ac0c0a00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac04faf0 tx=0x7fc49c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1221640ad3d8e06e server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:46.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.708+0000 7fc4b11cc640 1 -- 172.21.15.29:0/1629921182 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c0317e0 con 0x7fc4ac0a8490 2024-01-25T15:05:46.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.708+0000 7fc4b11cc640 1 -- 172.21.15.29:0/1629921182 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49c031940 con 0x7fc4ac0a8490 2024-01-25T15:05:46.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.708+0000 7fc4b11cc640 1 -- 172.21.15.29:0/1629921182 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c031cd0 con 0x7fc4ac0a8490 2024-01-25T15:05:46.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.709+0000 7fc4b4432640 1 -- 172.21.15.29:0/1629921182 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4ac0a8490 msgr2=0x7fc4ac0c0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:46.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.709+0000 7fc4b4432640 1 --2- 172.21.15.29:0/1629921182 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4ac0a8490 0x7fc4ac0c0a00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac04faf0 tx=0x7fc49c02b880 comp rx=0 tx=0).stop 2024-01-25T15:05:46.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.709+0000 7fc4b4432640 1 -- 172.21.15.29:0/1629921182 shutdown_connections 2024-01-25T15:05:46.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.709+0000 7fc4b4432640 1 --2- 172.21.15.29:0/1629921182 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4ac0a8490 0x7fc4ac0c0a00 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.709+0000 7fc4b4432640 1 --2- 172.21.15.29:0/1629921182 >> v2:172.21.15.52:3300/0 conn(0x7fc4ac151f30 0x7fc4ac0c04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.709+0000 7fc4b4432640 1 -- 172.21.15.29:0/1629921182 >> 172.21.15.29:0/1629921182 conn(0x7fc4ac0c3b90 msgr2=0x7fc4ac0c3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:46.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.709+0000 7fc4b4432640 1 -- 172.21.15.29:0/1629921182 shutdown_connections 2024-01-25T15:05:46.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.709+0000 7fc4b4432640 1 -- 172.21.15.29:0/1629921182 wait complete. 2024-01-25T15:05:46.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.710+0000 7fc4b4432640 1 Processor -- start 2024-01-25T15:05:46.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.710+0000 7fc4b4432640 1 -- start start 2024-01-25T15:05:46.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.711+0000 7fc4b4432640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4ac06a6c0 0x7fc4ac13c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.711+0000 7fc4b4432640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4ac0a8490 0x7fc4ac13cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.711+0000 7fc4b4432640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4ac151f30 0x7fc4ac0ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.711+0000 7fc4b4432640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac1ee400 con 0x7fc4ac06a6c0 2024-01-25T15:05:46.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.711+0000 7fc4b4432640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac1524b0 con 0x7fc4ac151f30 2024-01-25T15:05:46.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.711+0000 7fc4b4432640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac0aa2e0 con 0x7fc4ac0a8490 2024-01-25T15:05:46.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.711+0000 7fc4b21ce640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4ac06a6c0 0x7fc4ac13c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:46.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.711+0000 7fc4b21ce640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4ac06a6c0 0x7fc4ac13c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55506/0 (socket says 172.21.15.29:55506) 2024-01-25T15:05:46.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.711+0000 7fc4b21ce640 1 -- 172.21.15.29:0/690558102 learned_addr learned my addr 172.21.15.29:0/690558102 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.711+0000 7fc4b29cf640 1 --2- 172.21.15.29:0/690558102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4ac151f30 0x7fc4ac0ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.711+0000 7fc4b19cd640 1 --2- 172.21.15.29:0/690558102 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4ac0a8490 0x7fc4ac13cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.711+0000 7fc4b21ce640 1 -- 172.21.15.29:0/690558102 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4ac0a8490 msgr2=0x7fc4ac13cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.711+0000 7fc4b21ce640 1 --2- 172.21.15.29:0/690558102 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4ac0a8490 0x7fc4ac13cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.711+0000 7fc4b21ce640 1 -- 172.21.15.29:0/690558102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4ac151f30 msgr2=0x7fc4ac0ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.711+0000 7fc4b21ce640 1 --2- 172.21.15.29:0/690558102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4ac151f30 0x7fc4ac0ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.711+0000 7fc4b21ce640 1 -- 172.21.15.29:0/690558102 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c0094d0 con 0x7fc4ac06a6c0 2024-01-25T15:05:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.711+0000 7fc4b29cf640 1 --2- 172.21.15.29:0/690558102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4ac151f30 0x7fc4ac0ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.711+0000 7fc4b21ce640 1 --2- 172.21.15.29:0/690558102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4ac06a6c0 0x7fc4ac13c820 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400b410 tx=0x7fc4a400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.711+0000 7fc4a2ffd640 1 -- 172.21.15.29:0/690558102 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4011830 con 0x7fc4ac06a6c0 2024-01-25T15:05:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.712+0000 7fc4a2ffd640 1 -- 172.21.15.29:0/690558102 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a40119b0 con 0x7fc4ac06a6c0 2024-01-25T15:05:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.712+0000 7fc4b4432640 1 -- 172.21.15.29:0/690558102 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4ac0aa5c0 con 0x7fc4ac06a6c0 2024-01-25T15:05:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.712+0000 7fc4a2ffd640 1 -- 172.21.15.29:0/690558102 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4011d60 con 0x7fc4ac06a6c0 2024-01-25T15:05:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.712+0000 7fc4b4432640 1 -- 172.21.15.29:0/690558102 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ac0ac750 con 0x7fc4ac06a6c0 2024-01-25T15:05:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.712+0000 7fc4b4432640 1 -- 172.21.15.29:0/690558102 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4ac06b1a0 con 0x7fc4ac06a6c0 2024-01-25T15:05:46.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.713+0000 7fc4a2ffd640 1 -- 172.21.15.29:0/690558102 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fc4a401a400 con 0x7fc4ac06a6c0 2024-01-25T15:05:46.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.713+0000 7fc4a2ffd640 1 --2- 172.21.15.29:0/690558102 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc49006aed0 0x7fc49006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:46.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.713+0000 7fc4a2ffd640 1 -- 172.21.15.29:0/690558102 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fc4a4089c00 con 0x7fc4ac06a6c0 2024-01-25T15:05:46.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.713+0000 7fc4b19cd640 1 --2- 172.21.15.29:0/690558102 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc49006aed0 0x7fc49006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:46.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.714+0000 7fc4b19cd640 1 --2- 172.21.15.29:0/690558102 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc49006aed0 0x7fc49006d390 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc49c036000 tx=0x7fc49c03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:46.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.718+0000 7fc4a2ffd640 1 -- 172.21.15.29:0/690558102 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fc4a4090080 con 0x7fc4ac06a6c0 2024-01-25T15:05:46.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.893+0000 7fc4b4432640 1 -- 172.21.15.29:0/690558102 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4ac068b40 con 0x7fc49006aed0 2024-01-25T15:05:46.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.907+0000 7fc4a2ffd640 1 -- 172.21.15.29:0/690558102 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527237 (secure 0 0 0) 0x7fc4ac068b40 con 0x7fc49006aed0 2024-01-25T15:05:46.914 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:46.918 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-25T15:05:46.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.912+0000 7fc4b4432640 1 -- 172.21.15.29:0/690558102 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc49006aed0 msgr2=0x7fc49006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:46.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.912+0000 7fc4b4432640 1 --2- 172.21.15.29:0/690558102 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc49006aed0 0x7fc49006d390 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc49c036000 tx=0x7fc49c03d040 comp rx=0 tx=0).stop 2024-01-25T15:05:46.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.912+0000 7fc4b4432640 1 -- 172.21.15.29:0/690558102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4ac06a6c0 msgr2=0x7fc4ac13c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:46.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.912+0000 7fc4b4432640 1 --2- 172.21.15.29:0/690558102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4ac06a6c0 0x7fc4ac13c820 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400b410 tx=0x7fc4a400b8d0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.912+0000 7fc4b4432640 1 -- 172.21.15.29:0/690558102 shutdown_connections 2024-01-25T15:05:46.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.912+0000 7fc4b4432640 1 --2- 172.21.15.29:0/690558102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4ac151f30 0x7fc4ac0ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.912+0000 7fc4b4432640 1 --2- 172.21.15.29:0/690558102 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4ac0a8490 0x7fc4ac13cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.912+0000 7fc4b4432640 1 --2- 172.21.15.29:0/690558102 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc49006aed0 0x7fc49006d390 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.912+0000 7fc4b4432640 1 --2- 172.21.15.29:0/690558102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4ac06a6c0 0x7fc4ac13c820 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:46.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.912+0000 7fc4b4432640 1 -- 172.21.15.29:0/690558102 >> 172.21.15.29:0/690558102 conn(0x7fc4ac0c3b90 msgr2=0x7fc4ac071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:46.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.912+0000 7fc4b4432640 1 -- 172.21.15.29:0/690558102 shutdown_connections 2024-01-25T15:05:46.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:46.912+0000 7fc4b4432640 1 -- 172.21.15.29:0/690558102 wait complete. 2024-01-25T15:05:46.923 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-01-25T15:05:44.935222+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596687,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":260,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254328,"kb_used_data":4876,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720392,"statfs":{"total":773094113280,"available":772833681408,"internally_reserved":0,"allocated":4993024,"data_stored":2830326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001015"},"pg_stats":[{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.577035+0000","last_change":"2024-01-25T15:05:43.565058+0000","last_active":"2024-01-25T15:05:43.577035+0000","last_peered":"2024-01-25T15:05:43.577035+0000","last_clean":"2024-01-25T15:05:43.577035+0000","last_became_active":"2024-01-25T15:05:43.564786+0000","last_became_peered":"2024-01-25T15:05:43.564786+0000","last_unstale":"2024-01-25T15:05:43.577035+0000","last_undegraded":"2024-01-25T15:05:43.577035+0000","last_fullsized":"2024-01-25T15:05:43.577035+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:21:44.556343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559638+0000","last_change":"2024-01-25T15:05:27.231656+0000","last_active":"2024-01-25T15:05:43.559638+0000","last_peered":"2024-01-25T15:05:43.559638+0000","last_clean":"2024-01-25T15:05:43.559638+0000","last_became_active":"2024-01-25T15:05:27.228184+0000","last_became_peered":"2024-01-25T15:05:27.228184+0000","last_unstale":"2024-01-25T15:05:43.559638+0000","last_undegraded":"2024-01-25T15:05:43.559638+0000","last_fullsized":"2024-01-25T15:05:43.559638+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:44:26.334164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.577973+0000","last_change":"2024-01-25T15:05:43.573666+0000","last_active":"2024-01-25T15:05:43.577973+0000","last_peered":"2024-01-25T15:05:43.577973+0000","last_clean":"2024-01-25T15:05:43.577973+0000","last_became_active":"2024-01-25T15:05:43.573347+0000","last_became_peered":"2024-01-25T15:05:43.573347+0000","last_unstale":"2024-01-25T15:05:43.577973+0000","last_undegraded":"2024-01-25T15:05:43.577973+0000","last_fullsized":"2024-01-25T15:05:43.577973+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:43:49.484854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560466+0000","last_change":"2024-01-25T15:05:27.235003+0000","last_active":"2024-01-25T15:05:43.560466+0000","last_peered":"2024-01-25T15:05:43.560466+0000","last_clean":"2024-01-25T15:05:43.560466+0000","last_became_active":"2024-01-25T15:05:27.234734+0000","last_became_peered":"2024-01-25T15:05:27.234734+0000","last_unstale":"2024-01-25T15:05:43.560466+0000","last_undegraded":"2024-01-25T15:05:43.560466+0000","last_fullsized":"2024-01-25T15:05:43.560466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:55:46.833186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.577996+0000","last_change":"2024-01-25T15:05:43.574434+0000","last_active":"2024-01-25T15:05:43.577996+0000","last_peered":"2024-01-25T15:05:43.577996+0000","last_clean":"2024-01-25T15:05:43.577996+0000","last_became_active":"2024-01-25T15:05:43.574150+0000","last_became_peered":"2024-01-25T15:05:43.574150+0000","last_unstale":"2024-01-25T15:05:43.577996+0000","last_undegraded":"2024-01-25T15:05:43.577996+0000","last_fullsized":"2024-01-25T15:05:43.577996+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:47:17.536420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.576602+0000","last_change":"2024-01-25T15:05:27.239434+0000","last_active":"2024-01-25T15:05:43.576602+0000","last_peered":"2024-01-25T15:05:43.576602+0000","last_clean":"2024-01-25T15:05:43.576602+0000","last_became_active":"2024-01-25T15:05:27.239182+0000","last_became_peered":"2024-01-25T15:05:27.239182+0000","last_unstale":"2024-01-25T15:05:43.576602+0000","last_undegraded":"2024-01-25T15:05:43.576602+0000","last_fullsized":"2024-01-25T15:05:43.576602+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:02:27.702949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.591335+0000","last_change":"2024-01-25T15:05:43.580805+0000","last_active":"2024-01-25T15:05:43.591335+0000","last_peered":"2024-01-25T15:05:43.591335+0000","last_clean":"2024-01-25T15:05:43.591335+0000","last_became_active":"2024-01-25T15:05:43.580537+0000","last_became_peered":"2024-01-25T15:05:43.580537+0000","last_unstale":"2024-01-25T15:05:43.591335+0000","last_undegraded":"2024-01-25T15:05:43.591335+0000","last_fullsized":"2024-01-25T15:05:43.591335+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:27:43.538770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.566964+0000","last_change":"2024-01-25T15:05:27.243839+0000","last_active":"2024-01-25T15:05:43.566964+0000","last_peered":"2024-01-25T15:05:43.566964+0000","last_clean":"2024-01-25T15:05:43.566964+0000","last_became_active":"2024-01-25T15:05:27.243563+0000","last_became_peered":"2024-01-25T15:05:27.243563+0000","last_unstale":"2024-01-25T15:05:43.566964+0000","last_undegraded":"2024-01-25T15:05:43.566964+0000","last_fullsized":"2024-01-25T15:05:43.566964+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:18:52.758791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.588650+0000","last_change":"2024-01-25T15:05:43.579902+0000","last_active":"2024-01-25T15:05:43.588650+0000","last_peered":"2024-01-25T15:05:43.588650+0000","last_clean":"2024-01-25T15:05:43.588650+0000","last_became_active":"2024-01-25T15:05:43.579629+0000","last_became_peered":"2024-01-25T15:05:43.579629+0000","last_unstale":"2024-01-25T15:05:43.588650+0000","last_undegraded":"2024-01-25T15:05:43.588650+0000","last_fullsized":"2024-01-25T15:05:43.588650+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:26:35.761498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.569392+0000","last_change":"2024-01-25T15:05:27.230988+0000","last_active":"2024-01-25T15:05:43.569392+0000","last_peered":"2024-01-25T15:05:43.569392+0000","last_clean":"2024-01-25T15:05:43.569392+0000","last_became_active":"2024-01-25T15:05:27.230740+0000","last_became_peered":"2024-01-25T15:05:27.230740+0000","last_unstale":"2024-01-25T15:05:43.569392+0000","last_undegraded":"2024-01-25T15:05:43.569392+0000","last_fullsized":"2024-01-25T15:05:43.569392+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:22:36.224608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.573206+0000","last_change":"2024-01-25T15:05:43.565145+0000","last_active":"2024-01-25T15:05:43.573206+0000","last_peered":"2024-01-25T15:05:43.573206+0000","last_clean":"2024-01-25T15:05:43.573206+0000","last_became_active":"2024-01-25T15:05:43.564897+0000","last_became_peered":"2024-01-25T15:05:43.564897+0000","last_unstale":"2024-01-25T15:05:43.573206+0000","last_undegraded":"2024-01-25T15:05:43.573206+0000","last_fullsized":"2024-01-25T15:05:43.573206+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:27:43.538770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.561969+0000","last_change":"2024-01-25T15:05:27.239531+0000","last_active":"2024-01-25T15:05:43.561969+0000","last_peered":"2024-01-25T15:05:43.561969+0000","last_clean":"2024-01-25T15:05:43.561969+0000","last_became_active":"2024-01-25T15:05:27.238884+0000","last_became_peered":"2024-01-25T15:05:27.238884+0000","last_unstale":"2024-01-25T15:05:43.561969+0000","last_undegraded":"2024-01-25T15:05:43.561969+0000","last_fullsized":"2024-01-25T15:05:43.561969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:26:19.413150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.574121+0000","last_change":"2024-01-25T15:05:43.573222+0000","last_active":"2024-01-25T15:05:43.574121+0000","last_peered":"2024-01-25T15:05:43.574121+0000","last_clean":"2024-01-25T15:05:43.574121+0000","last_became_active":"2024-01-25T15:05:43.572898+0000","last_became_peered":"2024-01-25T15:05:43.572898+0000","last_unstale":"2024-01-25T15:05:43.574121+0000","last_undegraded":"2024-01-25T15:05:43.574121+0000","last_fullsized":"2024-01-25T15:05:43.574121+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:26:18.604996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.570719+0000","last_change":"2024-01-25T15:05:27.236157+0000","last_active":"2024-01-25T15:05:43.570719+0000","last_peered":"2024-01-25T15:05:43.570719+0000","last_clean":"2024-01-25T15:05:43.570719+0000","last_became_active":"2024-01-25T15:05:27.235882+0000","last_became_peered":"2024-01-25T15:05:27.235882+0000","last_unstale":"2024-01-25T15:05:43.570719+0000","last_undegraded":"2024-01-25T15:05:43.570719+0000","last_fullsized":"2024-01-25T15:05:43.570719+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:53:45.905579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.580368+0000","last_change":"2024-01-25T15:05:43.575607+0000","last_active":"2024-01-25T15:05:43.580368+0000","last_peered":"2024-01-25T15:05:43.580368+0000","last_clean":"2024-01-25T15:05:43.580368+0000","last_became_active":"2024-01-25T15:05:43.575358+0000","last_became_peered":"2024-01-25T15:05:43.575358+0000","last_unstale":"2024-01-25T15:05:43.580368+0000","last_undegraded":"2024-01-25T15:05:43.580368+0000","last_fullsized":"2024-01-25T15:05:43.580368+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:01:49.379607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.558510+0000","last_change":"2024-01-25T15:05:27.242301+0000","last_active":"2024-01-25T15:05:43.558510+0000","last_peered":"2024-01-25T15:05:43.558510+0000","last_clean":"2024-01-25T15:05:43.558510+0000","last_became_active":"2024-01-25T15:05:27.242077+0000","last_became_peered":"2024-01-25T15:05:27.242077+0000","last_unstale":"2024-01-25T15:05:43.558510+0000","last_undegraded":"2024-01-25T15:05:43.558510+0000","last_fullsized":"2024-01-25T15:05:43.558510+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:17:07.138969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.592312+0000","last_change":"2024-01-25T15:05:43.580667+0000","last_active":"2024-01-25T15:05:43.592312+0000","last_peered":"2024-01-25T15:05:43.592312+0000","last_clean":"2024-01-25T15:05:43.592312+0000","last_became_active":"2024-01-25T15:05:43.580403+0000","last_became_peered":"2024-01-25T15:05:43.580403+0000","last_unstale":"2024-01-25T15:05:43.592312+0000","last_undegraded":"2024-01-25T15:05:43.592312+0000","last_fullsized":"2024-01-25T15:05:43.592312+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:37:58.901484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.576579+0000","last_change":"2024-01-25T15:05:27.236734+0000","last_active":"2024-01-25T15:05:43.576579+0000","last_peered":"2024-01-25T15:05:43.576579+0000","last_clean":"2024-01-25T15:05:43.576579+0000","last_became_active":"2024-01-25T15:05:27.236377+0000","last_became_peered":"2024-01-25T15:05:27.236377+0000","last_unstale":"2024-01-25T15:05:43.576579+0000","last_undegraded":"2024-01-25T15:05:43.576579+0000","last_fullsized":"2024-01-25T15:05:43.576579+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:02:27.622813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.573059+0000","last_change":"2024-01-25T15:05:43.571115+0000","last_active":"2024-01-25T15:05:43.573059+0000","last_peered":"2024-01-25T15:05:43.573059+0000","last_clean":"2024-01-25T15:05:43.573059+0000","last_became_active":"2024-01-25T15:05:43.570862+0000","last_became_peered":"2024-01-25T15:05:43.570862+0000","last_unstale":"2024-01-25T15:05:43.573059+0000","last_undegraded":"2024-01-25T15:05:43.573059+0000","last_fullsized":"2024-01-25T15:05:43.573059+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:29:25.351790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.571720+0000","last_change":"2024-01-25T15:05:27.244798+0000","last_active":"2024-01-25T15:05:43.571720+0000","last_peered":"2024-01-25T15:05:43.571720+0000","last_clean":"2024-01-25T15:05:43.571720+0000","last_became_active":"2024-01-25T15:05:27.244547+0000","last_became_peered":"2024-01-25T15:05:27.244547+0000","last_unstale":"2024-01-25T15:05:43.571720+0000","last_undegraded":"2024-01-25T15:05:43.571720+0000","last_fullsized":"2024-01-25T15:05:43.571720+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:47:01.188072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.580714+0000","last_change":"2024-01-25T15:05:43.580255+0000","last_active":"2024-01-25T15:05:43.580714+0000","last_peered":"2024-01-25T15:05:43.580714+0000","last_clean":"2024-01-25T15:05:43.580714+0000","last_became_active":"2024-01-25T15:05:43.579855+0000","last_became_peered":"2024-01-25T15:05:43.579855+0000","last_unstale":"2024-01-25T15:05:43.580714+0000","last_undegraded":"2024-01-25T15:05:43.580714+0000","last_fullsized":"2024-01-25T15:05:43.580714+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:00:44.093143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.571636+0000","last_change":"2024-01-25T15:05:27.238399+0000","last_active":"2024-01-25T15:05:43.571636+0000","last_peered":"2024-01-25T15:05:43.571636+0000","last_clean":"2024-01-25T15:05:43.571636+0000","last_became_active":"2024-01-25T15:05:27.237999+0000","last_became_peered":"2024-01-25T15:05:27.237999+0000","last_unstale":"2024-01-25T15:05:43.571636+0000","last_undegraded":"2024-01-25T15:05:43.571636+0000","last_fullsized":"2024-01-25T15:05:43.571636+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:43:33.136506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.590029+0000","last_change":"2024-01-25T15:05:43.581011+0000","last_active":"2024-01-25T15:05:43.590029+0000","last_peered":"2024-01-25T15:05:43.590029+0000","last_clean":"2024-01-25T15:05:43.590029+0000","last_became_active":"2024-01-25T15:05:43.580720+0000","last_became_peered":"2024-01-25T15:05:43.580720+0000","last_unstale":"2024-01-25T15:05:43.590029+0000","last_undegraded":"2024-01-25T15:05:43.590029+0000","last_fullsized":"2024-01-25T15:05:43.590029+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:22:30.262070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.570397+0000","last_change":"2024-01-25T15:05:27.230234+0000","last_active":"2024-01-25T15:05:43.570397+0000","last_peered":"2024-01-25T15:05:43.570397+0000","last_clean":"2024-01-25T15:05:43.570397+0000","last_became_active":"2024-01-25T15:05:27.229945+0000","last_became_peered":"2024-01-25T15:05:27.229945+0000","last_unstale":"2024-01-25T15:05:43.570397+0000","last_undegraded":"2024-01-25T15:05:43.570397+0000","last_fullsized":"2024-01-25T15:05:43.570397+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:10.931099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.592328+0000","last_change":"2024-01-25T15:05:43.581085+0000","last_active":"2024-01-25T15:05:43.592328+0000","last_peered":"2024-01-25T15:05:43.592328+0000","last_clean":"2024-01-25T15:05:43.592328+0000","last_became_active":"2024-01-25T15:05:43.580816+0000","last_became_peered":"2024-01-25T15:05:43.580816+0000","last_unstale":"2024-01-25T15:05:43.592328+0000","last_undegraded":"2024-01-25T15:05:43.592328+0000","last_fullsized":"2024-01-25T15:05:43.592328+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:29:25.351790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.571302+0000","last_change":"2024-01-25T15:05:27.244146+0000","last_active":"2024-01-25T15:05:43.571302+0000","last_peered":"2024-01-25T15:05:43.571302+0000","last_clean":"2024-01-25T15:05:43.571302+0000","last_became_active":"2024-01-25T15:05:27.243861+0000","last_became_peered":"2024-01-25T15:05:27.243861+0000","last_unstale":"2024-01-25T15:05:43.571302+0000","last_undegraded":"2024-01-25T15:05:43.571302+0000","last_fullsized":"2024-01-25T15:05:43.571302+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:06:14.777919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.578900+0000","last_change":"2024-01-25T15:05:43.572731+0000","last_active":"2024-01-25T15:05:43.578900+0000","last_peered":"2024-01-25T15:05:43.578900+0000","last_clean":"2024-01-25T15:05:43.578900+0000","last_became_active":"2024-01-25T15:05:43.572476+0000","last_became_peered":"2024-01-25T15:05:43.572476+0000","last_unstale":"2024-01-25T15:05:43.578900+0000","last_undegraded":"2024-01-25T15:05:43.578900+0000","last_fullsized":"2024-01-25T15:05:43.578900+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:49:14.172453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.566670+0000","last_change":"2024-01-25T15:05:27.236676+0000","last_active":"2024-01-25T15:05:43.566670+0000","last_peered":"2024-01-25T15:05:43.566670+0000","last_clean":"2024-01-25T15:05:43.566670+0000","last_became_active":"2024-01-25T15:05:27.236411+0000","last_became_peered":"2024-01-25T15:05:27.236411+0000","last_unstale":"2024-01-25T15:05:43.566670+0000","last_undegraded":"2024-01-25T15:05:43.566670+0000","last_fullsized":"2024-01-25T15:05:43.566670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:43:59.664529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.584535+0000","last_change":"2024-01-25T15:05:43.583944+0000","last_active":"2024-01-25T15:05:43.584535+0000","last_peered":"2024-01-25T15:05:43.584535+0000","last_clean":"2024-01-25T15:05:43.584535+0000","last_became_active":"2024-01-25T15:05:43.583664+0000","last_became_peered":"2024-01-25T15:05:43.583664+0000","last_unstale":"2024-01-25T15:05:43.584535+0000","last_undegraded":"2024-01-25T15:05:43.584535+0000","last_fullsized":"2024-01-25T15:05:43.584535+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:44:42.682512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.570819+0000","last_change":"2024-01-25T15:05:27.234767+0000","last_active":"2024-01-25T15:05:43.570819+0000","last_peered":"2024-01-25T15:05:43.570819+0000","last_clean":"2024-01-25T15:05:43.570819+0000","last_became_active":"2024-01-25T15:05:27.234370+0000","last_became_peered":"2024-01-25T15:05:27.234370+0000","last_unstale":"2024-01-25T15:05:43.570819+0000","last_undegraded":"2024-01-25T15:05:43.570819+0000","last_fullsized":"2024-01-25T15:05:43.570819+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:24:11.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.580662+0000","last_change":"2024-01-25T15:05:43.576484+0000","last_active":"2024-01-25T15:05:43.580662+0000","last_peered":"2024-01-25T15:05:43.580662+0000","last_clean":"2024-01-25T15:05:43.580662+0000","last_became_active":"2024-01-25T15:05:43.576086+0000","last_became_peered":"2024-01-25T15:05:43.576086+0000","last_unstale":"2024-01-25T15:05:43.580662+0000","last_undegraded":"2024-01-25T15:05:43.580662+0000","last_fullsized":"2024-01-25T15:05:43.580662+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:37:58.901484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560382+0000","last_change":"2024-01-25T15:05:27.246760+0000","last_active":"2024-01-25T15:05:43.560382+0000","last_peered":"2024-01-25T15:05:43.560382+0000","last_clean":"2024-01-25T15:05:43.560382+0000","last_became_active":"2024-01-25T15:05:27.246482+0000","last_became_peered":"2024-01-25T15:05:27.246482+0000","last_unstale":"2024-01-25T15:05:43.560382+0000","last_undegraded":"2024-01-25T15:05:43.560382+0000","last_fullsized":"2024-01-25T15:05:43.560382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:10.931099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.590742+0000","last_change":"2024-01-25T15:05:43.577811+0000","last_active":"2024-01-25T15:05:43.590742+0000","last_peered":"2024-01-25T15:05:43.590742+0000","last_clean":"2024-01-25T15:05:43.590742+0000","last_became_active":"2024-01-25T15:05:43.576939+0000","last_became_peered":"2024-01-25T15:05:43.576939+0000","last_unstale":"2024-01-25T15:05:43.590742+0000","last_undegraded":"2024-01-25T15:05:43.590742+0000","last_fullsized":"2024-01-25T15:05:43.590742+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:30:42.037889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.562569+0000","last_change":"2024-01-25T15:05:27.246282+0000","last_active":"2024-01-25T15:05:43.562569+0000","last_peered":"2024-01-25T15:05:43.562569+0000","last_clean":"2024-01-25T15:05:43.562569+0000","last_became_active":"2024-01-25T15:05:27.245958+0000","last_became_peered":"2024-01-25T15:05:27.245958+0000","last_unstale":"2024-01-25T15:05:43.562569+0000","last_undegraded":"2024-01-25T15:05:43.562569+0000","last_fullsized":"2024-01-25T15:05:43.562569+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:06:14.777919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.579020+0000","last_change":"2024-01-25T15:05:43.576149+0000","last_active":"2024-01-25T15:05:43.579020+0000","last_peered":"2024-01-25T15:05:43.579020+0000","last_clean":"2024-01-25T15:05:43.579020+0000","last_became_active":"2024-01-25T15:05:43.575855+0000","last_became_peered":"2024-01-25T15:05:43.575855+0000","last_unstale":"2024-01-25T15:05:43.579020+0000","last_undegraded":"2024-01-25T15:05:43.579020+0000","last_fullsized":"2024-01-25T15:05:43.579020+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:21:44.556343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559247+0000","last_change":"2024-01-25T15:05:27.229020+0000","last_active":"2024-01-25T15:05:43.559247+0000","last_peered":"2024-01-25T15:05:43.559247+0000","last_clean":"2024-01-25T15:05:43.559247+0000","last_became_active":"2024-01-25T15:05:27.228749+0000","last_became_peered":"2024-01-25T15:05:27.228749+0000","last_unstale":"2024-01-25T15:05:43.559247+0000","last_undegraded":"2024-01-25T15:05:43.559247+0000","last_fullsized":"2024-01-25T15:05:43.559247+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:49:29.672511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.592996+0000","last_change":"2024-01-25T15:05:43.588467+0000","last_active":"2024-01-25T15:05:43.592996+0000","last_peered":"2024-01-25T15:05:43.592996+0000","last_clean":"2024-01-25T15:05:43.592996+0000","last_became_active":"2024-01-25T15:05:43.584179+0000","last_became_peered":"2024-01-25T15:05:43.584179+0000","last_unstale":"2024-01-25T15:05:43.592996+0000","last_undegraded":"2024-01-25T15:05:43.592996+0000","last_fullsized":"2024-01-25T15:05:43.592996+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:38:33.531978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.569427+0000","last_change":"2024-01-25T15:05:27.244605+0000","last_active":"2024-01-25T15:05:43.569427+0000","last_peered":"2024-01-25T15:05:43.569427+0000","last_clean":"2024-01-25T15:05:43.569427+0000","last_became_active":"2024-01-25T15:05:27.244345+0000","last_became_peered":"2024-01-25T15:05:27.244345+0000","last_unstale":"2024-01-25T15:05:43.569427+0000","last_undegraded":"2024-01-25T15:05:43.569427+0000","last_fullsized":"2024-01-25T15:05:43.569427+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:23:26.096821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.578690+0000","last_change":"2024-01-25T15:05:43.570240+0000","last_active":"2024-01-25T15:05:43.578690+0000","last_peered":"2024-01-25T15:05:43.578690+0000","last_clean":"2024-01-25T15:05:43.578690+0000","last_became_active":"2024-01-25T15:05:43.569958+0000","last_became_peered":"2024-01-25T15:05:43.569958+0000","last_unstale":"2024-01-25T15:05:43.578690+0000","last_undegraded":"2024-01-25T15:05:43.578690+0000","last_fullsized":"2024-01-25T15:05:43.578690+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:07:48.338513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560952+0000","last_change":"2024-01-25T15:05:27.229918+0000","last_active":"2024-01-25T15:05:43.560952+0000","last_peered":"2024-01-25T15:05:43.560952+0000","last_clean":"2024-01-25T15:05:43.560952+0000","last_became_active":"2024-01-25T15:05:27.229636+0000","last_became_peered":"2024-01-25T15:05:27.229636+0000","last_unstale":"2024-01-25T15:05:43.560952+0000","last_undegraded":"2024-01-25T15:05:43.560952+0000","last_fullsized":"2024-01-25T15:05:43.560952+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:31.002968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.584945+0000","last_change":"2024-01-25T15:05:43.584130+0000","last_active":"2024-01-25T15:05:43.584945+0000","last_peered":"2024-01-25T15:05:43.584945+0000","last_clean":"2024-01-25T15:05:43.584945+0000","last_became_active":"2024-01-25T15:05:43.583876+0000","last_became_peered":"2024-01-25T15:05:43.583876+0000","last_unstale":"2024-01-25T15:05:43.584945+0000","last_undegraded":"2024-01-25T15:05:43.584945+0000","last_fullsized":"2024-01-25T15:05:43.584945+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:17:02.746946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.571361+0000","last_change":"2024-01-25T15:05:27.240952+0000","last_active":"2024-01-25T15:05:43.571361+0000","last_peered":"2024-01-25T15:05:43.571361+0000","last_clean":"2024-01-25T15:05:43.571361+0000","last_became_active":"2024-01-25T15:05:27.240683+0000","last_became_peered":"2024-01-25T15:05:27.240683+0000","last_unstale":"2024-01-25T15:05:43.571361+0000","last_undegraded":"2024-01-25T15:05:43.571361+0000","last_fullsized":"2024-01-25T15:05:43.571361+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:44:30.520452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.579616+0000","last_change":"2024-01-25T15:05:43.574951+0000","last_active":"2024-01-25T15:05:43.579616+0000","last_peered":"2024-01-25T15:05:43.579616+0000","last_clean":"2024-01-25T15:05:43.579616+0000","last_became_active":"2024-01-25T15:05:43.574693+0000","last_became_peered":"2024-01-25T15:05:43.574693+0000","last_unstale":"2024-01-25T15:05:43.579616+0000","last_undegraded":"2024-01-25T15:05:43.579616+0000","last_fullsized":"2024-01-25T15:05:43.579616+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:22:30.262070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.567065+0000","last_change":"2024-01-25T15:05:27.235172+0000","last_active":"2024-01-25T15:05:43.567065+0000","last_peered":"2024-01-25T15:05:43.567065+0000","last_clean":"2024-01-25T15:05:43.567065+0000","last_became_active":"2024-01-25T15:05:27.234884+0000","last_became_peered":"2024-01-25T15:05:27.234884+0000","last_unstale":"2024-01-25T15:05:43.567065+0000","last_undegraded":"2024-01-25T15:05:43.567065+0000","last_fullsized":"2024-01-25T15:05:43.567065+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:14:28.578562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.592086+0000","last_change":"2024-01-25T15:05:43.578485+0000","last_active":"2024-01-25T15:05:43.592086+0000","last_peered":"2024-01-25T15:05:43.592086+0000","last_clean":"2024-01-25T15:05:43.592086+0000","last_became_active":"2024-01-25T15:05:43.578202+0000","last_became_peered":"2024-01-25T15:05:43.578202+0000","last_unstale":"2024-01-25T15:05:43.592086+0000","last_undegraded":"2024-01-25T15:05:43.592086+0000","last_fullsized":"2024-01-25T15:05:43.592086+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:21:12.963843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559737+0000","last_change":"2024-01-25T15:05:27.233225+0000","last_active":"2024-01-25T15:05:43.559737+0000","last_peered":"2024-01-25T15:05:43.559737+0000","last_clean":"2024-01-25T15:05:43.559737+0000","last_became_active":"2024-01-25T15:05:27.232731+0000","last_became_peered":"2024-01-25T15:05:27.232731+0000","last_unstale":"2024-01-25T15:05:43.559737+0000","last_undegraded":"2024-01-25T15:05:43.559737+0000","last_fullsized":"2024-01-25T15:05:43.559737+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:53:45.905579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.591081+0000","last_change":"2024-01-25T15:05:43.585880+0000","last_active":"2024-01-25T15:05:43.591081+0000","last_peered":"2024-01-25T15:05:43.591081+0000","last_clean":"2024-01-25T15:05:43.591081+0000","last_became_active":"2024-01-25T15:05:43.584940+0000","last_became_peered":"2024-01-25T15:05:43.584940+0000","last_unstale":"2024-01-25T15:05:43.591081+0000","last_undegraded":"2024-01-25T15:05:43.591081+0000","last_fullsized":"2024-01-25T15:05:43.591081+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:38:33.531978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.565840+0000","last_change":"2024-01-25T15:05:27.226292+0000","last_active":"2024-01-25T15:05:43.565840+0000","last_peered":"2024-01-25T15:05:43.565840+0000","last_clean":"2024-01-25T15:05:43.565840+0000","last_became_active":"2024-01-25T15:05:27.226037+0000","last_became_peered":"2024-01-25T15:05:27.226037+0000","last_unstale":"2024-01-25T15:05:43.565840+0000","last_undegraded":"2024-01-25T15:05:43.565840+0000","last_fullsized":"2024-01-25T15:05:43.565840+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:35:20.251170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.587385+0000","last_change":"2024-01-25T15:05:43.578521+0000","last_active":"2024-01-25T15:05:43.587385+0000","last_peered":"2024-01-25T15:05:43.587385+0000","last_clean":"2024-01-25T15:05:43.587385+0000","last_became_active":"2024-01-25T15:05:43.578269+0000","last_became_peered":"2024-01-25T15:05:43.578269+0000","last_unstale":"2024-01-25T15:05:43.587385+0000","last_undegraded":"2024-01-25T15:05:43.587385+0000","last_fullsized":"2024-01-25T15:05:43.587385+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:44:16.012877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559636+0000","last_change":"2024-01-25T15:05:27.229896+0000","last_active":"2024-01-25T15:05:43.559636+0000","last_peered":"2024-01-25T15:05:43.559636+0000","last_clean":"2024-01-25T15:05:43.559636+0000","last_became_active":"2024-01-25T15:05:27.229558+0000","last_became_peered":"2024-01-25T15:05:27.229558+0000","last_unstale":"2024-01-25T15:05:43.559636+0000","last_undegraded":"2024-01-25T15:05:43.559636+0000","last_fullsized":"2024-01-25T15:05:43.559636+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:43:59.664529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.590782+0000","last_change":"2024-01-25T15:05:43.577672+0000","last_active":"2024-01-25T15:05:43.590782+0000","last_peered":"2024-01-25T15:05:43.590782+0000","last_clean":"2024-01-25T15:05:43.590782+0000","last_became_active":"2024-01-25T15:05:43.575906+0000","last_became_peered":"2024-01-25T15:05:43.575906+0000","last_unstale":"2024-01-25T15:05:43.590782+0000","last_undegraded":"2024-01-25T15:05:43.590782+0000","last_fullsized":"2024-01-25T15:05:43.590782+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:49:14.172453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.562278+0000","last_change":"2024-01-25T15:05:27.242603+0000","last_active":"2024-01-25T15:05:43.562278+0000","last_peered":"2024-01-25T15:05:43.562278+0000","last_clean":"2024-01-25T15:05:43.562278+0000","last_became_active":"2024-01-25T15:05:27.241732+0000","last_became_peered":"2024-01-25T15:05:27.241732+0000","last_unstale":"2024-01-25T15:05:43.562278+0000","last_undegraded":"2024-01-25T15:05:43.562278+0000","last_fullsized":"2024-01-25T15:05:43.562278+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:14:28.578562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.574830+0000","last_change":"2024-01-25T15:05:43.567926+0000","last_active":"2024-01-25T15:05:43.574830+0000","last_peered":"2024-01-25T15:05:43.574830+0000","last_clean":"2024-01-25T15:05:43.574830+0000","last_became_active":"2024-01-25T15:05:43.567637+0000","last_became_peered":"2024-01-25T15:05:43.567637+0000","last_unstale":"2024-01-25T15:05:43.574830+0000","last_undegraded":"2024-01-25T15:05:43.574830+0000","last_fullsized":"2024-01-25T15:05:43.574830+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:01:49.379607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.561131+0000","last_change":"2024-01-25T15:05:27.229445+0000","last_active":"2024-01-25T15:05:43.561131+0000","last_peered":"2024-01-25T15:05:43.561131+0000","last_clean":"2024-01-25T15:05:43.561131+0000","last_became_active":"2024-01-25T15:05:27.229198+0000","last_became_peered":"2024-01-25T15:05:27.229198+0000","last_unstale":"2024-01-25T15:05:43.561131+0000","last_undegraded":"2024-01-25T15:05:43.561131+0000","last_fullsized":"2024-01-25T15:05:43.561131+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:26:19.413150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.575560+0000","last_change":"2024-01-25T15:05:43.574437+0000","last_active":"2024-01-25T15:05:43.575560+0000","last_peered":"2024-01-25T15:05:43.575560+0000","last_clean":"2024-01-25T15:05:43.575560+0000","last_became_active":"2024-01-25T15:05:43.574181+0000","last_became_peered":"2024-01-25T15:05:43.574181+0000","last_unstale":"2024-01-25T15:05:43.575560+0000","last_undegraded":"2024-01-25T15:05:43.575560+0000","last_fullsized":"2024-01-25T15:05:43.575560+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:26:26.772555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.571091+0000","last_change":"2024-01-25T15:05:27.238720+0000","last_active":"2024-01-25T15:05:43.571091+0000","last_peered":"2024-01-25T15:05:43.571091+0000","last_clean":"2024-01-25T15:05:43.571091+0000","last_became_active":"2024-01-25T15:05:27.238362+0000","last_became_peered":"2024-01-25T15:05:27.238362+0000","last_unstale":"2024-01-25T15:05:43.571091+0000","last_undegraded":"2024-01-25T15:05:43.571091+0000","last_fullsized":"2024-01-25T15:05:43.571091+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:36.810625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.590713+0000","last_change":"2024-01-25T15:05:43.576898+0000","last_active":"2024-01-25T15:05:43.590713+0000","last_peered":"2024-01-25T15:05:43.590713+0000","last_clean":"2024-01-25T15:05:43.590713+0000","last_became_active":"2024-01-25T15:05:43.576317+0000","last_became_peered":"2024-01-25T15:05:43.576317+0000","last_unstale":"2024-01-25T15:05:43.590713+0000","last_undegraded":"2024-01-25T15:05:43.590713+0000","last_fullsized":"2024-01-25T15:05:43.590713+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:21:39.661375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560531+0000","last_change":"2024-01-25T15:05:27.229034+0000","last_active":"2024-01-25T15:05:43.560531+0000","last_peered":"2024-01-25T15:05:43.560531+0000","last_clean":"2024-01-25T15:05:43.560531+0000","last_became_active":"2024-01-25T15:05:27.227681+0000","last_became_peered":"2024-01-25T15:05:27.227681+0000","last_unstale":"2024-01-25T15:05:43.560531+0000","last_undegraded":"2024-01-25T15:05:43.560531+0000","last_fullsized":"2024-01-25T15:05:43.560531+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:33:05.014284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.579397+0000","last_change":"2024-01-25T15:05:43.574228+0000","last_active":"2024-01-25T15:05:43.579397+0000","last_peered":"2024-01-25T15:05:43.579397+0000","last_clean":"2024-01-25T15:05:43.579397+0000","last_became_active":"2024-01-25T15:05:43.573856+0000","last_became_peered":"2024-01-25T15:05:43.573856+0000","last_unstale":"2024-01-25T15:05:43.579397+0000","last_undegraded":"2024-01-25T15:05:43.579397+0000","last_fullsized":"2024-01-25T15:05:43.579397+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:00:44.093143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.561373+0000","last_change":"2024-01-25T15:05:27.227464+0000","last_active":"2024-01-25T15:05:43.561373+0000","last_peered":"2024-01-25T15:05:43.561373+0000","last_clean":"2024-01-25T15:05:43.561373+0000","last_became_active":"2024-01-25T15:05:27.227162+0000","last_became_peered":"2024-01-25T15:05:27.227162+0000","last_unstale":"2024-01-25T15:05:43.561373+0000","last_undegraded":"2024-01-25T15:05:43.561373+0000","last_fullsized":"2024-01-25T15:05:43.561373+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:16:31.883434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.592105+0000","last_change":"2024-01-25T15:05:43.582235+0000","last_active":"2024-01-25T15:05:43.592105+0000","last_peered":"2024-01-25T15:05:43.592105+0000","last_clean":"2024-01-25T15:05:43.592105+0000","last_became_active":"2024-01-25T15:05:43.581973+0000","last_became_peered":"2024-01-25T15:05:43.581973+0000","last_unstale":"2024-01-25T15:05:43.592105+0000","last_undegraded":"2024-01-25T15:05:43.592105+0000","last_fullsized":"2024-01-25T15:05:43.592105+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:26:18.604996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560884+0000","last_change":"2024-01-25T15:05:27.233301+0000","last_active":"2024-01-25T15:05:43.560884+0000","last_peered":"2024-01-25T15:05:43.560884+0000","last_clean":"2024-01-25T15:05:43.560884+0000","last_became_active":"2024-01-25T15:05:27.233035+0000","last_became_peered":"2024-01-25T15:05:27.233035+0000","last_unstale":"2024-01-25T15:05:43.560884+0000","last_undegraded":"2024-01-25T15:05:43.560884+0000","last_fullsized":"2024-01-25T15:05:43.560884+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:02:27.622813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.580642+0000","last_change":"2024-01-25T15:05:43.575707+0000","last_active":"2024-01-25T15:05:43.580642+0000","last_peered":"2024-01-25T15:05:43.580642+0000","last_clean":"2024-01-25T15:05:43.580642+0000","last_became_active":"2024-01-25T15:05:43.575402+0000","last_became_peered":"2024-01-25T15:05:43.575402+0000","last_unstale":"2024-01-25T15:05:43.580642+0000","last_undegraded":"2024-01-25T15:05:43.580642+0000","last_fullsized":"2024-01-25T15:05:43.580642+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:21:12.963843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.561675+0000","last_change":"2024-01-25T15:05:27.237586+0000","last_active":"2024-01-25T15:05:43.561675+0000","last_peered":"2024-01-25T15:05:43.561675+0000","last_clean":"2024-01-25T15:05:43.561675+0000","last_became_active":"2024-01-25T15:05:27.237334+0000","last_became_peered":"2024-01-25T15:05:27.237334+0000","last_unstale":"2024-01-25T15:05:43.561675+0000","last_undegraded":"2024-01-25T15:05:43.561675+0000","last_fullsized":"2024-01-25T15:05:43.561675+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:33:05.014284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.567157+0000","last_change":"2024-01-25T15:05:43.565792+0000","last_active":"2024-01-25T15:05:43.567157+0000","last_peered":"2024-01-25T15:05:43.567157+0000","last_clean":"2024-01-25T15:05:43.567157+0000","last_became_active":"2024-01-25T15:05:43.565531+0000","last_became_peered":"2024-01-25T15:05:43.565531+0000","last_unstale":"2024-01-25T15:05:43.567157+0000","last_undegraded":"2024-01-25T15:05:43.567157+0000","last_fullsized":"2024-01-25T15:05:43.567157+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:56:03.181534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"41'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.595518+0000","last_change":"2024-01-25T15:05:42.573987+0000","last_active":"2024-01-25T15:05:43.595518+0000","last_peered":"2024-01-25T15:05:43.595518+0000","last_clean":"2024-01-25T15:05:43.595518+0000","last_became_active":"2024-01-25T15:05:42.573714+0000","last_became_peered":"2024-01-25T15:05:42.573714+0000","last_unstale":"2024-01-25T15:05:43.595518+0000","last_undegraded":"2024-01-25T15:05:43.595518+0000","last_fullsized":"2024-01-25T15:05:43.595518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:17:22.482965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560804+0000","last_change":"2024-01-25T15:05:27.247070+0000","last_active":"2024-01-25T15:05:43.560804+0000","last_peered":"2024-01-25T15:05:43.560804+0000","last_clean":"2024-01-25T15:05:43.560804+0000","last_became_active":"2024-01-25T15:05:27.246793+0000","last_became_peered":"2024-01-25T15:05:27.246793+0000","last_unstale":"2024-01-25T15:05:43.560804+0000","last_undegraded":"2024-01-25T15:05:43.560804+0000","last_fullsized":"2024-01-25T15:05:43.560804+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:13:38.590014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559879+0000","last_change":"2024-01-25T15:05:26.223571+0000","last_active":"2024-01-25T15:05:43.559879+0000","last_peered":"2024-01-25T15:05:43.559879+0000","last_clean":"2024-01-25T15:05:43.559879+0000","last_became_active":"2024-01-25T15:05:26.223239+0000","last_became_peered":"2024-01-25T15:05:26.223239+0000","last_unstale":"2024-01-25T15:05:43.559879+0000","last_undegraded":"2024-01-25T15:05:43.559879+0000","last_fullsized":"2024-01-25T15:05:43.559879+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:23:25.092941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.585455+0000","last_change":"2024-01-25T15:05:43.581236+0000","last_active":"2024-01-25T15:05:43.585455+0000","last_peered":"2024-01-25T15:05:43.585455+0000","last_clean":"2024-01-25T15:05:43.585455+0000","last_became_active":"2024-01-25T15:05:43.580988+0000","last_became_peered":"2024-01-25T15:05:43.580988+0000","last_unstale":"2024-01-25T15:05:43.585455+0000","last_undegraded":"2024-01-25T15:05:43.585455+0000","last_fullsized":"2024-01-25T15:05:43.585455+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:38:07.709476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"41'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.588511+0000","last_change":"2024-01-25T15:05:42.572919+0000","last_active":"2024-01-25T15:05:43.588511+0000","last_peered":"2024-01-25T15:05:43.588511+0000","last_clean":"2024-01-25T15:05:43.588511+0000","last_became_active":"2024-01-25T15:05:42.571944+0000","last_became_peered":"2024-01-25T15:05:42.571944+0000","last_unstale":"2024-01-25T15:05:43.588511+0000","last_undegraded":"2024-01-25T15:05:43.588511+0000","last_fullsized":"2024-01-25T15:05:43.588511+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:16:41.975458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.565487+0000","last_change":"2024-01-25T15:05:27.243468+0000","last_active":"2024-01-25T15:05:43.565487+0000","last_peered":"2024-01-25T15:05:43.565487+0000","last_clean":"2024-01-25T15:05:43.565487+0000","last_became_active":"2024-01-25T15:05:27.241288+0000","last_became_peered":"2024-01-25T15:05:27.241288+0000","last_unstale":"2024-01-25T15:05:43.565487+0000","last_undegraded":"2024-01-25T15:05:43.565487+0000","last_fullsized":"2024-01-25T15:05:43.565487+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:46:52.035987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.576642+0000","last_change":"2024-01-25T15:05:26.222363+0000","last_active":"2024-01-25T15:05:43.576642+0000","last_peered":"2024-01-25T15:05:43.576642+0000","last_clean":"2024-01-25T15:05:43.576642+0000","last_became_active":"2024-01-25T15:05:26.222076+0000","last_became_peered":"2024-01-25T15:05:26.222076+0000","last_unstale":"2024-01-25T15:05:43.576642+0000","last_undegraded":"2024-01-25T15:05:43.576642+0000","last_fullsized":"2024-01-25T15:05:43.576642+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:25:54.998838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.580684+0000","last_change":"2024-01-25T15:05:43.575601+0000","last_active":"2024-01-25T15:05:43.580684+0000","last_peered":"2024-01-25T15:05:43.580684+0000","last_clean":"2024-01-25T15:05:43.580684+0000","last_became_active":"2024-01-25T15:05:43.575327+0000","last_became_peered":"2024-01-25T15:05:43.575327+0000","last_unstale":"2024-01-25T15:05:43.580684+0000","last_undegraded":"2024-01-25T15:05:43.580684+0000","last_fullsized":"2024-01-25T15:05:43.580684+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:30:42.037889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"41'4","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.586159+0000","last_change":"2024-01-25T15:05:42.571914+0000","last_active":"2024-01-25T15:05:43.586159+0000","last_peered":"2024-01-25T15:05:43.586159+0000","last_clean":"2024-01-25T15:05:43.586159+0000","last_became_active":"2024-01-25T15:05:42.571659+0000","last_became_peered":"2024-01-25T15:05:42.571659+0000","last_unstale":"2024-01-25T15:05:43.586159+0000","last_undegraded":"2024-01-25T15:05:43.586159+0000","last_fullsized":"2024-01-25T15:05:43.586159+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:44:45.864448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.565772+0000","last_change":"2024-01-25T15:05:27.236309+0000","last_active":"2024-01-25T15:05:43.565772+0000","last_peered":"2024-01-25T15:05:43.565772+0000","last_clean":"2024-01-25T15:05:43.565772+0000","last_became_active":"2024-01-25T15:05:27.236051+0000","last_became_peered":"2024-01-25T15:05:27.236051+0000","last_unstale":"2024-01-25T15:05:43.565772+0000","last_undegraded":"2024-01-25T15:05:43.565772+0000","last_fullsized":"2024-01-25T15:05:43.565772+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:16:02.607369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.565644+0000","last_change":"2024-01-25T15:05:26.222345+0000","last_active":"2024-01-25T15:05:43.565644+0000","last_peered":"2024-01-25T15:05:43.565644+0000","last_clean":"2024-01-25T15:05:43.565644+0000","last_became_active":"2024-01-25T15:05:26.221552+0000","last_became_peered":"2024-01-25T15:05:26.221552+0000","last_unstale":"2024-01-25T15:05:43.565644+0000","last_undegraded":"2024-01-25T15:05:43.565644+0000","last_fullsized":"2024-01-25T15:05:43.565644+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:31:52.278724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.581980+0000","last_change":"2024-01-25T15:05:43.580058+0000","last_active":"2024-01-25T15:05:43.581980+0000","last_peered":"2024-01-25T15:05:43.581980+0000","last_clean":"2024-01-25T15:05:43.581980+0000","last_became_active":"2024-01-25T15:05:43.579774+0000","last_became_peered":"2024-01-25T15:05:43.579774+0000","last_unstale":"2024-01-25T15:05:43.581980+0000","last_undegraded":"2024-01-25T15:05:43.581980+0000","last_fullsized":"2024-01-25T15:05:43.581980+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:07:48.338513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"41'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.595485+0000","last_change":"2024-01-25T15:05:42.576483+0000","last_active":"2024-01-25T15:05:43.595485+0000","last_peered":"2024-01-25T15:05:43.595485+0000","last_clean":"2024-01-25T15:05:43.595485+0000","last_became_active":"2024-01-25T15:05:42.576222+0000","last_became_peered":"2024-01-25T15:05:42.576222+0000","last_unstale":"2024-01-25T15:05:43.595485+0000","last_undegraded":"2024-01-25T15:05:43.595485+0000","last_fullsized":"2024-01-25T15:05:43.595485+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:06:30.121915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559536+0000","last_change":"2024-01-25T15:05:27.224791+0000","last_active":"2024-01-25T15:05:43.559536+0000","last_peered":"2024-01-25T15:05:43.559536+0000","last_clean":"2024-01-25T15:05:43.559536+0000","last_became_active":"2024-01-25T15:05:27.224542+0000","last_became_peered":"2024-01-25T15:05:27.224542+0000","last_unstale":"2024-01-25T15:05:43.559536+0000","last_undegraded":"2024-01-25T15:05:43.559536+0000","last_fullsized":"2024-01-25T15:05:43.559536+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:22:13.913722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.565632+0000","last_change":"2024-01-25T15:05:26.217509+0000","last_active":"2024-01-25T15:05:43.565632+0000","last_peered":"2024-01-25T15:05:43.565632+0000","last_clean":"2024-01-25T15:05:43.565632+0000","last_became_active":"2024-01-25T15:05:26.217198+0000","last_became_peered":"2024-01-25T15:05:26.217198+0000","last_unstale":"2024-01-25T15:05:43.565632+0000","last_undegraded":"2024-01-25T15:05:43.565632+0000","last_fullsized":"2024-01-25T15:05:43.565632+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:23:25.092941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.591884+0000","last_change":"2024-01-25T15:05:43.588206+0000","last_active":"2024-01-25T15:05:43.591884+0000","last_peered":"2024-01-25T15:05:43.591884+0000","last_clean":"2024-01-25T15:05:43.591884+0000","last_became_active":"2024-01-25T15:05:43.586250+0000","last_became_peered":"2024-01-25T15:05:43.586250+0000","last_unstale":"2024-01-25T15:05:43.591884+0000","last_undegraded":"2024-01-25T15:05:43.591884+0000","last_fullsized":"2024-01-25T15:05:43.591884+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:25:24.134995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559533+0000","last_change":"2024-01-25T15:05:42.569299+0000","last_active":"2024-01-25T15:05:43.559533+0000","last_peered":"2024-01-25T15:05:43.559533+0000","last_clean":"2024-01-25T15:05:43.559533+0000","last_became_active":"2024-01-25T15:05:42.569003+0000","last_became_peered":"2024-01-25T15:05:42.569003+0000","last_unstale":"2024-01-25T15:05:43.559533+0000","last_undegraded":"2024-01-25T15:05:43.559533+0000","last_fullsized":"2024-01-25T15:05:43.559533+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:06:30.121915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.563290+0000","last_change":"2024-01-25T15:05:27.241011+0000","last_active":"2024-01-25T15:05:43.563290+0000","last_peered":"2024-01-25T15:05:43.563290+0000","last_clean":"2024-01-25T15:05:43.563290+0000","last_became_active":"2024-01-25T15:05:27.240732+0000","last_became_peered":"2024-01-25T15:05:27.240732+0000","last_unstale":"2024-01-25T15:05:43.563290+0000","last_undegraded":"2024-01-25T15:05:43.563290+0000","last_fullsized":"2024-01-25T15:05:43.563290+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:53:45.905579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.571398+0000","last_change":"2024-01-25T15:05:26.224826+0000","last_active":"2024-01-25T15:05:43.571398+0000","last_peered":"2024-01-25T15:05:43.571398+0000","last_clean":"2024-01-25T15:05:43.571398+0000","last_became_active":"2024-01-25T15:05:26.224517+0000","last_became_peered":"2024-01-25T15:05:26.224517+0000","last_unstale":"2024-01-25T15:05:43.571398+0000","last_undegraded":"2024-01-25T15:05:43.571398+0000","last_fullsized":"2024-01-25T15:05:43.571398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:00:52.590768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.578817+0000","last_change":"2024-01-25T15:05:43.572442+0000","last_active":"2024-01-25T15:05:43.578817+0000","last_peered":"2024-01-25T15:05:43.578817+0000","last_clean":"2024-01-25T15:05:43.578817+0000","last_became_active":"2024-01-25T15:05:43.572150+0000","last_became_peered":"2024-01-25T15:05:43.572150+0000","last_unstale":"2024-01-25T15:05:43.578817+0000","last_undegraded":"2024-01-25T15:05:43.578817+0000","last_fullsized":"2024-01-25T15:05:43.578817+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:10:36.558502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.563218+0000","last_change":"2024-01-25T15:05:42.579428+0000","last_active":"2024-01-25T15:05:43.563218+0000","last_peered":"2024-01-25T15:05:43.563218+0000","last_clean":"2024-01-25T15:05:43.563218+0000","last_became_active":"2024-01-25T15:05:42.579097+0000","last_became_peered":"2024-01-25T15:05:42.579097+0000","last_unstale":"2024-01-25T15:05:43.563218+0000","last_undegraded":"2024-01-25T15:05:43.563218+0000","last_fullsized":"2024-01-25T15:05:43.563218+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:40:09.070760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.570907+0000","last_change":"2024-01-25T15:05:27.243054+0000","last_active":"2024-01-25T15:05:43.570907+0000","last_peered":"2024-01-25T15:05:43.570907+0000","last_clean":"2024-01-25T15:05:43.570907+0000","last_became_active":"2024-01-25T15:05:27.240995+0000","last_became_peered":"2024-01-25T15:05:27.240995+0000","last_unstale":"2024-01-25T15:05:43.570907+0000","last_undegraded":"2024-01-25T15:05:43.570907+0000","last_fullsized":"2024-01-25T15:05:43.570907+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:17:07.138969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560423+0000","last_change":"2024-01-25T15:05:26.220260+0000","last_active":"2024-01-25T15:05:43.560423+0000","last_peered":"2024-01-25T15:05:43.560423+0000","last_clean":"2024-01-25T15:05:43.560423+0000","last_became_active":"2024-01-25T15:05:26.219815+0000","last_became_peered":"2024-01-25T15:05:26.219815+0000","last_unstale":"2024-01-25T15:05:43.560423+0000","last_undegraded":"2024-01-25T15:05:43.560423+0000","last_fullsized":"2024-01-25T15:05:43.560423+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:25:54.998838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.578718+0000","last_change":"2024-01-25T15:05:43.577316+0000","last_active":"2024-01-25T15:05:43.578718+0000","last_peered":"2024-01-25T15:05:43.578718+0000","last_clean":"2024-01-25T15:05:43.578718+0000","last_became_active":"2024-01-25T15:05:43.577035+0000","last_became_peered":"2024-01-25T15:05:43.577035+0000","last_unstale":"2024-01-25T15:05:43.578718+0000","last_undegraded":"2024-01-25T15:05:43.578718+0000","last_fullsized":"2024-01-25T15:05:43.578718+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:56:03.181534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"41'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.594394+0000","last_change":"2024-01-25T15:05:42.579557+0000","last_active":"2024-01-25T15:05:43.594394+0000","last_peered":"2024-01-25T15:05:43.594394+0000","last_clean":"2024-01-25T15:05:43.594394+0000","last_became_active":"2024-01-25T15:05:42.577295+0000","last_became_peered":"2024-01-25T15:05:42.577295+0000","last_unstale":"2024-01-25T15:05:43.594394+0000","last_undegraded":"2024-01-25T15:05:43.594394+0000","last_fullsized":"2024-01-25T15:05:43.594394+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:16:41.975458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.566902+0000","last_change":"2024-01-25T15:05:27.241873+0000","last_active":"2024-01-25T15:05:43.566902+0000","last_peered":"2024-01-25T15:05:43.566902+0000","last_clean":"2024-01-25T15:05:43.566902+0000","last_became_active":"2024-01-25T15:05:27.241586+0000","last_became_peered":"2024-01-25T15:05:27.241586+0000","last_unstale":"2024-01-25T15:05:43.566902+0000","last_undegraded":"2024-01-25T15:05:43.566902+0000","last_fullsized":"2024-01-25T15:05:43.566902+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:54:18.204207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.564459+0000","last_change":"2024-01-25T15:05:26.223828+0000","last_active":"2024-01-25T15:05:43.564459+0000","last_peered":"2024-01-25T15:05:43.564459+0000","last_clean":"2024-01-25T15:05:43.564459+0000","last_became_active":"2024-01-25T15:05:26.223568+0000","last_became_peered":"2024-01-25T15:05:26.223568+0000","last_unstale":"2024-01-25T15:05:43.564459+0000","last_undegraded":"2024-01-25T15:05:43.564459+0000","last_fullsized":"2024-01-25T15:05:43.564459+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:22:35.220728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.578885+0000","last_change":"2024-01-25T15:05:43.570972+0000","last_active":"2024-01-25T15:05:43.578885+0000","last_peered":"2024-01-25T15:05:43.578885+0000","last_clean":"2024-01-25T15:05:43.578885+0000","last_became_active":"2024-01-25T15:05:43.570699+0000","last_became_peered":"2024-01-25T15:05:43.570699+0000","last_unstale":"2024-01-25T15:05:43.578885+0000","last_undegraded":"2024-01-25T15:05:43.578885+0000","last_fullsized":"2024-01-25T15:05:43.578885+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:21:39.661375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"41'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.585272+0000","last_change":"2024-01-25T15:05:42.568160+0000","last_active":"2024-01-25T15:05:43.585272+0000","last_peered":"2024-01-25T15:05:43.585272+0000","last_clean":"2024-01-25T15:05:43.585272+0000","last_became_active":"2024-01-25T15:05:42.567865+0000","last_became_peered":"2024-01-25T15:05:42.567865+0000","last_unstale":"2024-01-25T15:05:43.585272+0000","last_undegraded":"2024-01-25T15:05:43.585272+0000","last_fullsized":"2024-01-25T15:05:43.585272+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:52.154622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559486+0000","last_change":"2024-01-25T15:05:27.230178+0000","last_active":"2024-01-25T15:05:43.559486+0000","last_peered":"2024-01-25T15:05:43.559486+0000","last_clean":"2024-01-25T15:05:43.559486+0000","last_became_active":"2024-01-25T15:05:27.229928+0000","last_became_peered":"2024-01-25T15:05:27.229928+0000","last_unstale":"2024-01-25T15:05:43.559486+0000","last_undegraded":"2024-01-25T15:05:43.559486+0000","last_fullsized":"2024-01-25T15:05:43.559486+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:43:33.136506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.564691+0000","last_change":"2024-01-25T15:05:26.221805+0000","last_active":"2024-01-25T15:05:43.564691+0000","last_peered":"2024-01-25T15:05:43.564691+0000","last_clean":"2024-01-25T15:05:43.564691+0000","last_became_active":"2024-01-25T15:05:26.221380+0000","last_became_peered":"2024-01-25T15:05:26.221380+0000","last_unstale":"2024-01-25T15:05:43.564691+0000","last_undegraded":"2024-01-25T15:05:43.564691+0000","last_fullsized":"2024-01-25T15:05:43.564691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:22:35.220728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.592218+0000","last_change":"2024-01-25T15:05:43.583155+0000","last_active":"2024-01-25T15:05:43.592218+0000","last_peered":"2024-01-25T15:05:43.592218+0000","last_clean":"2024-01-25T15:05:43.592218+0000","last_became_active":"2024-01-25T15:05:43.582879+0000","last_became_peered":"2024-01-25T15:05:43.582879+0000","last_unstale":"2024-01-25T15:05:43.592218+0000","last_undegraded":"2024-01-25T15:05:43.592218+0000","last_fullsized":"2024-01-25T15:05:43.592218+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:05:22.923400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"41'3","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.591689+0000","last_change":"2024-01-25T15:05:42.575256+0000","last_active":"2024-01-25T15:05:43.591689+0000","last_peered":"2024-01-25T15:05:43.591689+0000","last_clean":"2024-01-25T15:05:43.591689+0000","last_became_active":"2024-01-25T15:05:42.574972+0000","last_became_peered":"2024-01-25T15:05:42.574972+0000","last_unstale":"2024-01-25T15:05:43.591689+0000","last_undegraded":"2024-01-25T15:05:43.591689+0000","last_fullsized":"2024-01-25T15:05:43.591689+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:54:04.739775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.567057+0000","last_change":"2024-01-25T15:05:27.243866+0000","last_active":"2024-01-25T15:05:43.567057+0000","last_peered":"2024-01-25T15:05:43.567057+0000","last_clean":"2024-01-25T15:05:43.567057+0000","last_became_active":"2024-01-25T15:05:27.243596+0000","last_became_peered":"2024-01-25T15:05:27.243596+0000","last_unstale":"2024-01-25T15:05:43.567057+0000","last_undegraded":"2024-01-25T15:05:43.567057+0000","last_fullsized":"2024-01-25T15:05:43.567057+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:31:53.282604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559734+0000","last_change":"2024-01-25T15:05:26.219579+0000","last_active":"2024-01-25T15:05:43.559734+0000","last_peered":"2024-01-25T15:05:43.559734+0000","last_clean":"2024-01-25T15:05:43.559734+0000","last_became_active":"2024-01-25T15:05:26.219276+0000","last_became_peered":"2024-01-25T15:05:26.219276+0000","last_unstale":"2024-01-25T15:05:43.559734+0000","last_undegraded":"2024-01-25T15:05:43.559734+0000","last_fullsized":"2024-01-25T15:05:43.559734+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:26:18.409269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.580045+0000","last_change":"2024-01-25T15:05:43.578157+0000","last_active":"2024-01-25T15:05:43.580045+0000","last_peered":"2024-01-25T15:05:43.580045+0000","last_clean":"2024-01-25T15:05:43.580045+0000","last_became_active":"2024-01-25T15:05:43.577697+0000","last_became_peered":"2024-01-25T15:05:43.577697+0000","last_unstale":"2024-01-25T15:05:43.580045+0000","last_undegraded":"2024-01-25T15:05:43.580045+0000","last_fullsized":"2024-01-25T15:05:43.580045+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:01:49.379607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"41'6","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.596118+0000","last_change":"2024-01-25T15:05:42.570508+0000","last_active":"2024-01-25T15:05:43.596118+0000","last_peered":"2024-01-25T15:05:43.596118+0000","last_clean":"2024-01-25T15:05:43.596118+0000","last_became_active":"2024-01-25T15:05:42.570228+0000","last_became_peered":"2024-01-25T15:05:42.570228+0000","last_unstale":"2024-01-25T15:05:43.596118+0000","last_undegraded":"2024-01-25T15:05:43.596118+0000","last_fullsized":"2024-01-25T15:05:43.596118+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:21:11.959492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.562474+0000","last_change":"2024-01-25T15:05:27.241962+0000","last_active":"2024-01-25T15:05:43.562474+0000","last_peered":"2024-01-25T15:05:43.562474+0000","last_clean":"2024-01-25T15:05:43.562474+0000","last_became_active":"2024-01-25T15:05:27.241674+0000","last_became_peered":"2024-01-25T15:05:27.241674+0000","last_unstale":"2024-01-25T15:05:43.562474+0000","last_undegraded":"2024-01-25T15:05:43.562474+0000","last_fullsized":"2024-01-25T15:05:43.562474+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:36.810625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.572025+0000","last_change":"2024-01-25T15:05:26.223146+0000","last_active":"2024-01-25T15:05:43.572025+0000","last_peered":"2024-01-25T15:05:43.572025+0000","last_clean":"2024-01-25T15:05:43.572025+0000","last_became_active":"2024-01-25T15:05:26.222888+0000","last_became_peered":"2024-01-25T15:05:26.222888+0000","last_unstale":"2024-01-25T15:05:43.572025+0000","last_undegraded":"2024-01-25T15:05:43.572025+0000","last_fullsized":"2024-01-25T15:05:43.572025+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:05:05.431051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.576275+0000","last_change":"2024-01-25T15:05:43.574086+0000","last_active":"2024-01-25T15:05:43.576275+0000","last_peered":"2024-01-25T15:05:43.576275+0000","last_clean":"2024-01-25T15:05:43.576275+0000","last_became_active":"2024-01-25T15:05:43.573797+0000","last_became_peered":"2024-01-25T15:05:43.573797+0000","last_unstale":"2024-01-25T15:05:43.576275+0000","last_undegraded":"2024-01-25T15:05:43.576275+0000","last_fullsized":"2024-01-25T15:05:43.576275+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:47:17.536420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.562492+0000","last_change":"2024-01-25T15:05:42.568353+0000","last_active":"2024-01-25T15:05:43.562492+0000","last_peered":"2024-01-25T15:05:43.562492+0000","last_clean":"2024-01-25T15:05:43.562492+0000","last_became_active":"2024-01-25T15:05:42.568028+0000","last_became_peered":"2024-01-25T15:05:42.568028+0000","last_unstale":"2024-01-25T15:05:43.562492+0000","last_undegraded":"2024-01-25T15:05:43.562492+0000","last_fullsized":"2024-01-25T15:05:43.562492+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:00:45.445942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.576365+0000","last_change":"2024-01-25T15:05:27.235466+0000","last_active":"2024-01-25T15:05:43.576365+0000","last_peered":"2024-01-25T15:05:43.576365+0000","last_clean":"2024-01-25T15:05:43.576365+0000","last_became_active":"2024-01-25T15:05:27.235043+0000","last_became_peered":"2024-01-25T15:05:27.235043+0000","last_unstale":"2024-01-25T15:05:43.576365+0000","last_undegraded":"2024-01-25T15:05:43.576365+0000","last_fullsized":"2024-01-25T15:05:43.576365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:24:11.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.572117+0000","last_change":"2024-01-25T15:05:26.227418+0000","last_active":"2024-01-25T15:05:43.572117+0000","last_peered":"2024-01-25T15:05:43.572117+0000","last_clean":"2024-01-25T15:05:43.572117+0000","last_became_active":"2024-01-25T15:05:26.227133+0000","last_became_peered":"2024-01-25T15:05:26.227133+0000","last_unstale":"2024-01-25T15:05:43.572117+0000","last_undegraded":"2024-01-25T15:05:43.572117+0000","last_fullsized":"2024-01-25T15:05:43.572117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:25:54.998838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.575482+0000","last_change":"2024-01-25T15:05:43.573777+0000","last_active":"2024-01-25T15:05:43.575482+0000","last_peered":"2024-01-25T15:05:43.575482+0000","last_clean":"2024-01-25T15:05:43.575482+0000","last_became_active":"2024-01-25T15:05:43.573511+0000","last_became_peered":"2024-01-25T15:05:43.573511+0000","last_unstale":"2024-01-25T15:05:43.575482+0000","last_undegraded":"2024-01-25T15:05:43.575482+0000","last_fullsized":"2024-01-25T15:05:43.575482+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:54:05.744126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.565494+0000","last_change":"2024-01-25T15:05:42.577148+0000","last_active":"2024-01-25T15:05:43.565494+0000","last_peered":"2024-01-25T15:05:43.565494+0000","last_clean":"2024-01-25T15:05:43.565494+0000","last_became_active":"2024-01-25T15:05:42.576868+0000","last_became_peered":"2024-01-25T15:05:42.576868+0000","last_unstale":"2024-01-25T15:05:43.565494+0000","last_undegraded":"2024-01-25T15:05:43.565494+0000","last_fullsized":"2024-01-25T15:05:43.565494+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:17:22.482965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.566416+0000","last_change":"2024-01-25T15:05:27.235111+0000","last_active":"2024-01-25T15:05:43.566416+0000","last_peered":"2024-01-25T15:05:43.566416+0000","last_clean":"2024-01-25T15:05:43.566416+0000","last_became_active":"2024-01-25T15:05:27.234825+0000","last_became_peered":"2024-01-25T15:05:27.234825+0000","last_unstale":"2024-01-25T15:05:43.566416+0000","last_undegraded":"2024-01-25T15:05:43.566416+0000","last_fullsized":"2024-01-25T15:05:43.566416+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:10.931099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'8","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560153+0000","last_change":"2024-01-25T15:05:26.213663+0000","last_active":"2024-01-25T15:05:43.560153+0000","last_peered":"2024-01-25T15:05:43.560153+0000","last_clean":"2024-01-25T15:05:43.560153+0000","last_became_active":"2024-01-25T15:05:26.213360+0000","last_became_peered":"2024-01-25T15:05:26.213360+0000","last_unstale":"2024-01-25T15:05:43.560153+0000","last_undegraded":"2024-01-25T15:05:43.560153+0000","last_fullsized":"2024-01-25T15:05:43.560153+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:43:58.660649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3111,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.572569+0000","last_change":"2024-01-25T15:05:43.564471+0000","last_active":"2024-01-25T15:05:43.572569+0000","last_peered":"2024-01-25T15:05:43.572569+0000","last_clean":"2024-01-25T15:05:43.572569+0000","last_became_active":"2024-01-25T15:05:43.564182+0000","last_became_peered":"2024-01-25T15:05:43.564182+0000","last_unstale":"2024-01-25T15:05:43.572569+0000","last_undegraded":"2024-01-25T15:05:43.572569+0000","last_fullsized":"2024-01-25T15:05:43.572569+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:37:58.901484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559627+0000","last_change":"2024-01-25T15:05:42.571418+0000","last_active":"2024-01-25T15:05:43.559627+0000","last_peered":"2024-01-25T15:05:43.559627+0000","last_clean":"2024-01-25T15:05:43.559627+0000","last_became_active":"2024-01-25T15:05:42.571136+0000","last_became_peered":"2024-01-25T15:05:42.571136+0000","last_unstale":"2024-01-25T15:05:43.559627+0000","last_undegraded":"2024-01-25T15:05:43.559627+0000","last_fullsized":"2024-01-25T15:05:43.559627+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:16:41.975458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.563405+0000","last_change":"2024-01-25T15:05:27.244333+0000","last_active":"2024-01-25T15:05:43.563405+0000","last_peered":"2024-01-25T15:05:43.563405+0000","last_clean":"2024-01-25T15:05:43.563405+0000","last_became_active":"2024-01-25T15:05:27.244050+0000","last_became_peered":"2024-01-25T15:05:27.244050+0000","last_unstale":"2024-01-25T15:05:43.563405+0000","last_undegraded":"2024-01-25T15:05:43.563405+0000","last_fullsized":"2024-01-25T15:05:43.563405+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:14:28.578562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559619+0000","last_change":"2024-01-25T15:05:26.224736+0000","last_active":"2024-01-25T15:05:43.559619+0000","last_peered":"2024-01-25T15:05:43.559619+0000","last_clean":"2024-01-25T15:05:43.559619+0000","last_became_active":"2024-01-25T15:05:26.224440+0000","last_became_peered":"2024-01-25T15:05:26.224440+0000","last_unstale":"2024-01-25T15:05:43.559619+0000","last_undegraded":"2024-01-25T15:05:43.559619+0000","last_fullsized":"2024-01-25T15:05:43.559619+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:54:17.200327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.592122+0000","last_change":"2024-01-25T15:05:43.582817+0000","last_active":"2024-01-25T15:05:43.592122+0000","last_peered":"2024-01-25T15:05:43.592122+0000","last_clean":"2024-01-25T15:05:43.592122+0000","last_became_active":"2024-01-25T15:05:43.582548+0000","last_became_peered":"2024-01-25T15:05:43.582548+0000","last_unstale":"2024-01-25T15:05:43.592122+0000","last_undegraded":"2024-01-25T15:05:43.592122+0000","last_fullsized":"2024-01-25T15:05:43.592122+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:46:28.624685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"41'8","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.594607+0000","last_change":"2024-01-25T15:05:42.570582+0000","last_active":"2024-01-25T15:05:43.594607+0000","last_peered":"2024-01-25T15:05:43.594607+0000","last_clean":"2024-01-25T15:05:43.594607+0000","last_became_active":"2024-01-25T15:05:42.570297+0000","last_became_peered":"2024-01-25T15:05:42.570297+0000","last_unstale":"2024-01-25T15:05:43.594607+0000","last_undegraded":"2024-01-25T15:05:43.594607+0000","last_fullsized":"2024-01-25T15:05:43.594607+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:49:13.168101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.558051+0000","last_change":"2024-01-25T15:05:27.225582+0000","last_active":"2024-01-25T15:05:43.558051+0000","last_peered":"2024-01-25T15:05:43.558051+0000","last_clean":"2024-01-25T15:05:43.558051+0000","last_became_active":"2024-01-25T15:05:27.225337+0000","last_became_peered":"2024-01-25T15:05:27.225337+0000","last_unstale":"2024-01-25T15:05:43.558051+0000","last_undegraded":"2024-01-25T15:05:43.558051+0000","last_fullsized":"2024-01-25T15:05:43.558051+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:06:14.777919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.562321+0000","last_change":"2024-01-25T15:05:26.224964+0000","last_active":"2024-01-25T15:05:43.562321+0000","last_peered":"2024-01-25T15:05:43.562321+0000","last_clean":"2024-01-25T15:05:43.562321+0000","last_became_active":"2024-01-25T15:05:26.224350+0000","last_became_peered":"2024-01-25T15:05:26.224350+0000","last_unstale":"2024-01-25T15:05:43.562321+0000","last_undegraded":"2024-01-25T15:05:43.562321+0000","last_fullsized":"2024-01-25T15:05:43.562321+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:23:25.092941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.582551+0000","last_change":"2024-01-25T15:05:43.580930+0000","last_active":"2024-01-25T15:05:43.582551+0000","last_peered":"2024-01-25T15:05:43.582551+0000","last_clean":"2024-01-25T15:05:43.582551+0000","last_became_active":"2024-01-25T15:05:43.580563+0000","last_became_peered":"2024-01-25T15:05:43.580563+0000","last_unstale":"2024-01-25T15:05:43.582551+0000","last_undegraded":"2024-01-25T15:05:43.582551+0000","last_fullsized":"2024-01-25T15:05:43.582551+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:21:39.661375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"41'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.593260+0000","last_change":"2024-01-25T15:05:42.576849+0000","last_active":"2024-01-25T15:05:43.593260+0000","last_peered":"2024-01-25T15:05:43.593260+0000","last_clean":"2024-01-25T15:05:43.593260+0000","last_became_active":"2024-01-25T15:05:42.575264+0000","last_became_peered":"2024-01-25T15:05:42.575264+0000","last_unstale":"2024-01-25T15:05:43.593260+0000","last_undegraded":"2024-01-25T15:05:43.593260+0000","last_fullsized":"2024-01-25T15:05:43.593260+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:54:04.739775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560326+0000","last_change":"2024-01-25T15:05:27.230302+0000","last_active":"2024-01-25T15:05:43.560326+0000","last_peered":"2024-01-25T15:05:43.560326+0000","last_clean":"2024-01-25T15:05:43.560326+0000","last_became_active":"2024-01-25T15:05:27.230047+0000","last_became_peered":"2024-01-25T15:05:27.230047+0000","last_unstale":"2024-01-25T15:05:43.560326+0000","last_undegraded":"2024-01-25T15:05:43.560326+0000","last_fullsized":"2024-01-25T15:05:43.560326+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:02:27.702949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559703+0000","last_change":"2024-01-25T15:05:26.223718+0000","last_active":"2024-01-25T15:05:43.559703+0000","last_peered":"2024-01-25T15:05:43.559703+0000","last_clean":"2024-01-25T15:05:43.559703+0000","last_became_active":"2024-01-25T15:05:26.222346+0000","last_became_peered":"2024-01-25T15:05:26.222346+0000","last_unstale":"2024-01-25T15:05:43.559703+0000","last_undegraded":"2024-01-25T15:05:43.559703+0000","last_fullsized":"2024-01-25T15:05:43.559703+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:35:19.247290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.592345+0000","last_change":"2024-01-25T15:05:43.583456+0000","last_active":"2024-01-25T15:05:43.592345+0000","last_peered":"2024-01-25T15:05:43.592345+0000","last_clean":"2024-01-25T15:05:43.592345+0000","last_became_active":"2024-01-25T15:05:43.583183+0000","last_became_peered":"2024-01-25T15:05:43.583183+0000","last_unstale":"2024-01-25T15:05:43.592345+0000","last_undegraded":"2024-01-25T15:05:43.592345+0000","last_fullsized":"2024-01-25T15:05:43.592345+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:47:17.200557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559751+0000","last_change":"2024-01-25T15:05:42.576874+0000","last_active":"2024-01-25T15:05:43.559751+0000","last_peered":"2024-01-25T15:05:43.559751+0000","last_clean":"2024-01-25T15:05:43.559751+0000","last_became_active":"2024-01-25T15:05:42.576568+0000","last_became_peered":"2024-01-25T15:05:42.576568+0000","last_unstale":"2024-01-25T15:05:43.559751+0000","last_undegraded":"2024-01-25T15:05:43.559751+0000","last_fullsized":"2024-01-25T15:05:43.559751+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:17:22.482965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559436+0000","last_change":"2024-01-25T15:05:27.226239+0000","last_active":"2024-01-25T15:05:43.559436+0000","last_peered":"2024-01-25T15:05:43.559436+0000","last_clean":"2024-01-25T15:05:43.559436+0000","last_became_active":"2024-01-25T15:05:27.225978+0000","last_became_peered":"2024-01-25T15:05:27.225978+0000","last_unstale":"2024-01-25T15:05:43.559436+0000","last_undegraded":"2024-01-25T15:05:43.559436+0000","last_fullsized":"2024-01-25T15:05:43.559436+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:36.810625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560482+0000","last_change":"2024-01-25T15:05:26.222694+0000","last_active":"2024-01-25T15:05:43.560482+0000","last_peered":"2024-01-25T15:05:43.560482+0000","last_clean":"2024-01-25T15:05:43.560482+0000","last_became_active":"2024-01-25T15:05:26.222439+0000","last_became_peered":"2024-01-25T15:05:26.222439+0000","last_unstale":"2024-01-25T15:05:43.560482+0000","last_undegraded":"2024-01-25T15:05:43.560482+0000","last_fullsized":"2024-01-25T15:05:43.560482+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:48:18.501092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.576174+0000","last_change":"2024-01-25T15:05:43.573732+0000","last_active":"2024-01-25T15:05:43.576174+0000","last_peered":"2024-01-25T15:05:43.576174+0000","last_clean":"2024-01-25T15:05:43.576174+0000","last_became_active":"2024-01-25T15:05:43.573449+0000","last_became_peered":"2024-01-25T15:05:43.573449+0000","last_unstale":"2024-01-25T15:05:43.576174+0000","last_undegraded":"2024-01-25T15:05:43.576174+0000","last_fullsized":"2024-01-25T15:05:43.576174+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:43:49.484854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"41'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.590533+0000","last_change":"2024-01-25T15:05:42.575342+0000","last_active":"2024-01-25T15:05:43.590533+0000","last_peered":"2024-01-25T15:05:43.590533+0000","last_clean":"2024-01-25T15:05:43.590533+0000","last_became_active":"2024-01-25T15:05:42.575050+0000","last_became_peered":"2024-01-25T15:05:42.575050+0000","last_unstale":"2024-01-25T15:05:43.590533+0000","last_undegraded":"2024-01-25T15:05:43.590533+0000","last_fullsized":"2024-01-25T15:05:43.590533+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:47:16.532068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559996+0000","last_change":"2024-01-25T15:05:27.233916+0000","last_active":"2024-01-25T15:05:43.559996+0000","last_peered":"2024-01-25T15:05:43.559996+0000","last_clean":"2024-01-25T15:05:43.559996+0000","last_became_active":"2024-01-25T15:05:27.233305+0000","last_became_peered":"2024-01-25T15:05:27.233305+0000","last_unstale":"2024-01-25T15:05:43.559996+0000","last_undegraded":"2024-01-25T15:05:43.559996+0000","last_fullsized":"2024-01-25T15:05:43.559996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:00:27.744795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.572350+0000","last_change":"2024-01-25T15:05:26.225673+0000","last_active":"2024-01-25T15:05:43.572350+0000","last_peered":"2024-01-25T15:05:43.572350+0000","last_clean":"2024-01-25T15:05:43.572350+0000","last_became_active":"2024-01-25T15:05:26.225411+0000","last_became_peered":"2024-01-25T15:05:26.225411+0000","last_unstale":"2024-01-25T15:05:43.572350+0000","last_undegraded":"2024-01-25T15:05:43.572350+0000","last_fullsized":"2024-01-25T15:05:43.572350+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:16:30.879553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.590249+0000","last_change":"2024-01-25T15:05:43.584758+0000","last_active":"2024-01-25T15:05:43.590249+0000","last_peered":"2024-01-25T15:05:43.590249+0000","last_clean":"2024-01-25T15:05:43.590249+0000","last_became_active":"2024-01-25T15:05:43.584490+0000","last_became_peered":"2024-01-25T15:05:43.584490+0000","last_unstale":"2024-01-25T15:05:43.590249+0000","last_undegraded":"2024-01-25T15:05:43.590249+0000","last_fullsized":"2024-01-25T15:05:43.590249+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:40:10.075112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560434+0000","last_change":"2024-01-25T15:05:42.572792+0000","last_active":"2024-01-25T15:05:43.560434+0000","last_peered":"2024-01-25T15:05:43.560434+0000","last_clean":"2024-01-25T15:05:43.560434+0000","last_became_active":"2024-01-25T15:05:42.572497+0000","last_became_peered":"2024-01-25T15:05:42.572497+0000","last_unstale":"2024-01-25T15:05:43.560434+0000","last_undegraded":"2024-01-25T15:05:43.560434+0000","last_fullsized":"2024-01-25T15:05:43.560434+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:43:48.480502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.571996+0000","last_change":"2024-01-25T15:05:27.247875+0000","last_active":"2024-01-25T15:05:43.571996+0000","last_peered":"2024-01-25T15:05:43.571996+0000","last_clean":"2024-01-25T15:05:43.571996+0000","last_became_active":"2024-01-25T15:05:27.247493+0000","last_became_peered":"2024-01-25T15:05:27.247493+0000","last_unstale":"2024-01-25T15:05:43.571996+0000","last_undegraded":"2024-01-25T15:05:43.571996+0000","last_fullsized":"2024-01-25T15:05:43.571996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:01:33.031259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.565873+0000","last_change":"2024-01-25T15:05:26.220907+0000","last_active":"2024-01-25T15:05:43.565873+0000","last_peered":"2024-01-25T15:05:43.565873+0000","last_clean":"2024-01-25T15:05:43.565873+0000","last_became_active":"2024-01-25T15:05:26.220539+0000","last_became_peered":"2024-01-25T15:05:26.220539+0000","last_unstale":"2024-01-25T15:05:43.565873+0000","last_undegraded":"2024-01-25T15:05:43.565873+0000","last_fullsized":"2024-01-25T15:05:43.565873+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:18:51.754911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.575586+0000","last_change":"2024-01-25T15:05:43.574330+0000","last_active":"2024-01-25T15:05:43.575586+0000","last_peered":"2024-01-25T15:05:43.575586+0000","last_clean":"2024-01-25T15:05:43.575586+0000","last_became_active":"2024-01-25T15:05:43.574064+0000","last_became_peered":"2024-01-25T15:05:43.574064+0000","last_unstale":"2024-01-25T15:05:43.575586+0000","last_undegraded":"2024-01-25T15:05:43.575586+0000","last_fullsized":"2024-01-25T15:05:43.575586+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:46:28.624685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"41'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.594357+0000","last_change":"2024-01-25T15:05:42.579365+0000","last_active":"2024-01-25T15:05:43.594357+0000","last_peered":"2024-01-25T15:05:43.594357+0000","last_clean":"2024-01-25T15:05:43.594357+0000","last_became_active":"2024-01-25T15:05:42.578110+0000","last_became_peered":"2024-01-25T15:05:42.578110+0000","last_unstale":"2024-01-25T15:05:43.594357+0000","last_undegraded":"2024-01-25T15:05:43.594357+0000","last_fullsized":"2024-01-25T15:05:43.594357+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:21:43.551991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.565671+0000","last_change":"2024-01-25T15:05:27.242875+0000","last_active":"2024-01-25T15:05:43.565671+0000","last_peered":"2024-01-25T15:05:43.565671+0000","last_clean":"2024-01-25T15:05:43.565671+0000","last_became_active":"2024-01-25T15:05:27.241953+0000","last_became_peered":"2024-01-25T15:05:27.241953+0000","last_unstale":"2024-01-25T15:05:43.565671+0000","last_undegraded":"2024-01-25T15:05:43.565671+0000","last_fullsized":"2024-01-25T15:05:43.565671+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:46:52.035987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.569521+0000","last_change":"2024-01-25T15:05:26.218250+0000","last_active":"2024-01-25T15:05:43.569521+0000","last_peered":"2024-01-25T15:05:43.569521+0000","last_clean":"2024-01-25T15:05:43.569521+0000","last_became_active":"2024-01-25T15:05:26.217965+0000","last_became_peered":"2024-01-25T15:05:26.217965+0000","last_unstale":"2024-01-25T15:05:43.569521+0000","last_undegraded":"2024-01-25T15:05:43.569521+0000","last_fullsized":"2024-01-25T15:05:43.569521+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:03:01.180813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.584964+0000","last_change":"2024-01-25T15:05:43.584177+0000","last_active":"2024-01-25T15:05:43.584964+0000","last_peered":"2024-01-25T15:05:43.584964+0000","last_clean":"2024-01-25T15:05:43.584964+0000","last_became_active":"2024-01-25T15:05:43.583858+0000","last_became_peered":"2024-01-25T15:05:43.583858+0000","last_unstale":"2024-01-25T15:05:43.584964+0000","last_undegraded":"2024-01-25T15:05:43.584964+0000","last_fullsized":"2024-01-25T15:05:43.584964+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:43:00.062741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"41'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.589473+0000","last_change":"2024-01-25T15:05:42.572403+0000","last_active":"2024-01-25T15:05:43.589473+0000","last_peered":"2024-01-25T15:05:43.589473+0000","last_clean":"2024-01-25T15:05:43.589473+0000","last_became_active":"2024-01-25T15:05:42.572015+0000","last_became_peered":"2024-01-25T15:05:42.572015+0000","last_unstale":"2024-01-25T15:05:43.589473+0000","last_undegraded":"2024-01-25T15:05:43.589473+0000","last_fullsized":"2024-01-25T15:05:43.589473+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:33:20.358280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.567788+0000","last_change":"2024-01-25T15:05:27.236656+0000","last_active":"2024-01-25T15:05:43.567788+0000","last_peered":"2024-01-25T15:05:43.567788+0000","last_clean":"2024-01-25T15:05:43.567788+0000","last_became_active":"2024-01-25T15:05:27.236391+0000","last_became_peered":"2024-01-25T15:05:27.236391+0000","last_unstale":"2024-01-25T15:05:43.567788+0000","last_undegraded":"2024-01-25T15:05:43.567788+0000","last_fullsized":"2024-01-25T15:05:43.567788+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:48:19.504972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.561562+0000","last_change":"2024-01-25T15:05:26.218267+0000","last_active":"2024-01-25T15:05:43.561562+0000","last_peered":"2024-01-25T15:05:43.561562+0000","last_clean":"2024-01-25T15:05:43.561562+0000","last_became_active":"2024-01-25T15:05:26.217935+0000","last_became_peered":"2024-01-25T15:05:26.217935+0000","last_unstale":"2024-01-25T15:05:43.561562+0000","last_undegraded":"2024-01-25T15:05:43.561562+0000","last_fullsized":"2024-01-25T15:05:43.561562+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:18:51.754911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.592341+0000","last_change":"2024-01-25T15:05:43.583952+0000","last_active":"2024-01-25T15:05:43.592341+0000","last_peered":"2024-01-25T15:05:43.592341+0000","last_clean":"2024-01-25T15:05:43.592341+0000","last_became_active":"2024-01-25T15:05:43.583701+0000","last_became_peered":"2024-01-25T15:05:43.583701+0000","last_unstale":"2024-01-25T15:05:43.592341+0000","last_undegraded":"2024-01-25T15:05:43.592341+0000","last_fullsized":"2024-01-25T15:05:43.592341+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:38:07.709476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.570974+0000","last_change":"2024-01-25T15:05:42.579740+0000","last_active":"2024-01-25T15:05:43.570974+0000","last_peered":"2024-01-25T15:05:43.570974+0000","last_clean":"2024-01-25T15:05:43.570974+0000","last_became_active":"2024-01-25T15:05:42.579450+0000","last_became_peered":"2024-01-25T15:05:42.579450+0000","last_unstale":"2024-01-25T15:05:43.570974+0000","last_undegraded":"2024-01-25T15:05:43.570974+0000","last_fullsized":"2024-01-25T15:05:43.570974+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:00:45.445942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560586+0000","last_change":"2024-01-25T15:05:27.229184+0000","last_active":"2024-01-25T15:05:43.560586+0000","last_peered":"2024-01-25T15:05:43.560586+0000","last_clean":"2024-01-25T15:05:43.560586+0000","last_became_active":"2024-01-25T15:05:27.228691+0000","last_became_peered":"2024-01-25T15:05:27.228691+0000","last_unstale":"2024-01-25T15:05:43.560586+0000","last_undegraded":"2024-01-25T15:05:43.560586+0000","last_fullsized":"2024-01-25T15:05:43.560586+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:44:30.520452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.569479+0000","last_change":"2024-01-25T15:05:26.224643+0000","last_active":"2024-01-25T15:05:43.569479+0000","last_peered":"2024-01-25T15:05:43.569479+0000","last_clean":"2024-01-25T15:05:43.569479+0000","last_became_active":"2024-01-25T15:05:26.224395+0000","last_became_peered":"2024-01-25T15:05:26.224395+0000","last_unstale":"2024-01-25T15:05:43.569479+0000","last_undegraded":"2024-01-25T15:05:43.569479+0000","last_fullsized":"2024-01-25T15:05:43.569479+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:12:44.093299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.580321+0000","last_change":"2024-01-25T15:05:43.575038+0000","last_active":"2024-01-25T15:05:43.580321+0000","last_peered":"2024-01-25T15:05:43.580321+0000","last_clean":"2024-01-25T15:05:43.580321+0000","last_became_active":"2024-01-25T15:05:43.574766+0000","last_became_peered":"2024-01-25T15:05:43.574766+0000","last_unstale":"2024-01-25T15:05:43.580321+0000","last_undegraded":"2024-01-25T15:05:43.580321+0000","last_fullsized":"2024-01-25T15:05:43.580321+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:56:03.181534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.565659+0000","last_change":"2024-01-25T15:05:42.572990+0000","last_active":"2024-01-25T15:05:43.565659+0000","last_peered":"2024-01-25T15:05:43.565659+0000","last_clean":"2024-01-25T15:05:43.565659+0000","last_became_active":"2024-01-25T15:05:42.572686+0000","last_became_peered":"2024-01-25T15:05:42.572686+0000","last_unstale":"2024-01-25T15:05:43.565659+0000","last_undegraded":"2024-01-25T15:05:43.565659+0000","last_fullsized":"2024-01-25T15:05:43.565659+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:49:45.016507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.571700+0000","last_change":"2024-01-25T15:05:27.235292+0000","last_active":"2024-01-25T15:05:43.571700+0000","last_peered":"2024-01-25T15:05:43.571700+0000","last_clean":"2024-01-25T15:05:43.571700+0000","last_became_active":"2024-01-25T15:05:27.234825+0000","last_became_peered":"2024-01-25T15:05:27.234825+0000","last_unstale":"2024-01-25T15:05:43.571700+0000","last_undegraded":"2024-01-25T15:05:43.571700+0000","last_fullsized":"2024-01-25T15:05:43.571700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:16:02.607369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.566290+0000","last_change":"2024-01-25T15:05:26.227384+0000","last_active":"2024-01-25T15:05:43.566290+0000","last_peered":"2024-01-25T15:05:43.566290+0000","last_clean":"2024-01-25T15:05:43.566290+0000","last_became_active":"2024-01-25T15:05:26.227112+0000","last_became_peered":"2024-01-25T15:05:26.227112+0000","last_unstale":"2024-01-25T15:05:43.566290+0000","last_undegraded":"2024-01-25T15:05:43.566290+0000","last_fullsized":"2024-01-25T15:05:43.566290+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:05:00.172648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.575518+0000","last_change":"2024-01-25T15:05:43.574511+0000","last_active":"2024-01-25T15:05:43.575518+0000","last_peered":"2024-01-25T15:05:43.575518+0000","last_clean":"2024-01-25T15:05:43.575518+0000","last_became_active":"2024-01-25T15:05:43.574193+0000","last_became_peered":"2024-01-25T15:05:43.574193+0000","last_unstale":"2024-01-25T15:05:43.575518+0000","last_undegraded":"2024-01-25T15:05:43.575518+0000","last_fullsized":"2024-01-25T15:05:43.575518+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:29:14.876032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"41'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.594859+0000","last_change":"2024-01-25T15:05:42.575645+0000","last_active":"2024-01-25T15:05:43.594859+0000","last_peered":"2024-01-25T15:05:43.594859+0000","last_clean":"2024-01-25T15:05:43.594859+0000","last_became_active":"2024-01-25T15:05:42.574424+0000","last_became_peered":"2024-01-25T15:05:42.574424+0000","last_unstale":"2024-01-25T15:05:43.594859+0000","last_undegraded":"2024-01-25T15:05:43.594859+0000","last_fullsized":"2024-01-25T15:05:43.594859+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:52.154622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.571178+0000","last_change":"2024-01-25T15:05:27.245885+0000","last_active":"2024-01-25T15:05:43.571178+0000","last_peered":"2024-01-25T15:05:43.571178+0000","last_clean":"2024-01-25T15:05:43.571178+0000","last_became_active":"2024-01-25T15:05:27.245616+0000","last_became_peered":"2024-01-25T15:05:27.245616+0000","last_unstale":"2024-01-25T15:05:43.571178+0000","last_undegraded":"2024-01-25T15:05:43.571178+0000","last_fullsized":"2024-01-25T15:05:43.571178+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:02:27.622813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559859+0000","last_change":"2024-01-25T15:05:26.221180+0000","last_active":"2024-01-25T15:05:43.559859+0000","last_peered":"2024-01-25T15:05:43.559859+0000","last_clean":"2024-01-25T15:05:43.559859+0000","last_became_active":"2024-01-25T15:05:26.220911+0000","last_became_peered":"2024-01-25T15:05:26.220911+0000","last_unstale":"2024-01-25T15:05:43.559859+0000","last_undegraded":"2024-01-25T15:05:43.559859+0000","last_fullsized":"2024-01-25T15:05:43.559859+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:00:52.590768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.579583+0000","last_change":"2024-01-25T15:05:43.575652+0000","last_active":"2024-01-25T15:05:43.579583+0000","last_peered":"2024-01-25T15:05:43.579583+0000","last_clean":"2024-01-25T15:05:43.579583+0000","last_became_active":"2024-01-25T15:05:43.574574+0000","last_became_peered":"2024-01-25T15:05:43.574574+0000","last_unstale":"2024-01-25T15:05:43.579583+0000","last_undegraded":"2024-01-25T15:05:43.579583+0000","last_fullsized":"2024-01-25T15:05:43.579583+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:44:42.682512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.558128+0000","last_change":"2024-01-25T15:05:42.568742+0000","last_active":"2024-01-25T15:05:43.558128+0000","last_peered":"2024-01-25T15:05:43.558128+0000","last_clean":"2024-01-25T15:05:43.558128+0000","last_became_active":"2024-01-25T15:05:42.568470+0000","last_became_peered":"2024-01-25T15:05:42.568470+0000","last_unstale":"2024-01-25T15:05:43.558128+0000","last_undegraded":"2024-01-25T15:05:43.558128+0000","last_fullsized":"2024-01-25T15:05:43.558128+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:21:38.657023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.559537+0000","last_change":"2024-01-25T15:05:27.229523+0000","last_active":"2024-01-25T15:05:43.559537+0000","last_peered":"2024-01-25T15:05:43.559537+0000","last_clean":"2024-01-25T15:05:43.559537+0000","last_became_active":"2024-01-25T15:05:27.229254+0000","last_became_peered":"2024-01-25T15:05:27.229254+0000","last_unstale":"2024-01-25T15:05:43.559537+0000","last_undegraded":"2024-01-25T15:05:43.559537+0000","last_fullsized":"2024-01-25T15:05:43.559537+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:47:01.188072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.565943+0000","last_change":"2024-01-25T15:05:26.220823+0000","last_active":"2024-01-25T15:05:43.565943+0000","last_peered":"2024-01-25T15:05:43.565943+0000","last_clean":"2024-01-25T15:05:43.565943+0000","last_became_active":"2024-01-25T15:05:26.220552+0000","last_became_peered":"2024-01-25T15:05:26.220552+0000","last_unstale":"2024-01-25T15:05:43.565943+0000","last_undegraded":"2024-01-25T15:05:43.565943+0000","last_fullsized":"2024-01-25T15:05:43.565943+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:27:08.783181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.580417+0000","last_change":"2024-01-25T15:05:43.576421+0000","last_active":"2024-01-25T15:05:43.580417+0000","last_peered":"2024-01-25T15:05:43.580417+0000","last_clean":"2024-01-25T15:05:43.580417+0000","last_became_active":"2024-01-25T15:05:43.576155+0000","last_became_peered":"2024-01-25T15:05:43.576155+0000","last_unstale":"2024-01-25T15:05:43.580417+0000","last_undegraded":"2024-01-25T15:05:43.580417+0000","last_fullsized":"2024-01-25T15:05:43.580417+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:00:44.093143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560899+0000","last_change":"2024-01-25T15:05:42.573201+0000","last_active":"2024-01-25T15:05:43.560899+0000","last_peered":"2024-01-25T15:05:43.560899+0000","last_clean":"2024-01-25T15:05:43.560899+0000","last_became_active":"2024-01-25T15:05:42.572904+0000","last_became_peered":"2024-01-25T15:05:42.572904+0000","last_unstale":"2024-01-25T15:05:43.560899+0000","last_undegraded":"2024-01-25T15:05:43.560899+0000","last_fullsized":"2024-01-25T15:05:43.560899+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:29:13.871680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.561460+0000","last_change":"2024-01-25T15:05:27.242991+0000","last_active":"2024-01-25T15:05:43.561460+0000","last_peered":"2024-01-25T15:05:43.561460+0000","last_clean":"2024-01-25T15:05:43.561460+0000","last_became_active":"2024-01-25T15:05:27.241347+0000","last_became_peered":"2024-01-25T15:05:27.241347+0000","last_unstale":"2024-01-25T15:05:43.561460+0000","last_undegraded":"2024-01-25T15:05:43.561460+0000","last_fullsized":"2024-01-25T15:05:43.561460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:54:18.204207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.572624+0000","last_change":"2024-01-25T15:05:26.227334+0000","last_active":"2024-01-25T15:05:43.572624+0000","last_peered":"2024-01-25T15:05:43.572624+0000","last_clean":"2024-01-25T15:05:43.572624+0000","last_became_active":"2024-01-25T15:05:26.227016+0000","last_became_peered":"2024-01-25T15:05:26.227016+0000","last_unstale":"2024-01-25T15:05:43.572624+0000","last_undegraded":"2024-01-25T15:05:43.572624+0000","last_fullsized":"2024-01-25T15:05:43.572624+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:54:29.999087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.583441+0000","last_change":"2024-01-25T15:05:43.579370+0000","last_active":"2024-01-25T15:05:43.583441+0000","last_peered":"2024-01-25T15:05:43.583441+0000","last_clean":"2024-01-25T15:05:43.583441+0000","last_became_active":"2024-01-25T15:05:43.579100+0000","last_became_peered":"2024-01-25T15:05:43.579100+0000","last_unstale":"2024-01-25T15:05:43.583441+0000","last_undegraded":"2024-01-25T15:05:43.583441+0000","last_fullsized":"2024-01-25T15:05:43.583441+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:05:22.923400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.570353+0000","last_change":"2024-01-25T15:05:42.579960+0000","last_active":"2024-01-25T15:05:43.570353+0000","last_peered":"2024-01-25T15:05:43.570353+0000","last_clean":"2024-01-25T15:05:43.570353+0000","last_became_active":"2024-01-25T15:05:42.579056+0000","last_became_peered":"2024-01-25T15:05:42.579056+0000","last_unstale":"2024-01-25T15:05:43.570353+0000","last_undegraded":"2024-01-25T15:05:43.570353+0000","last_fullsized":"2024-01-25T15:05:43.570353+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:29:13.871680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.562927+0000","last_change":"2024-01-25T15:05:27.242175+0000","last_active":"2024-01-25T15:05:43.562927+0000","last_peered":"2024-01-25T15:05:43.562927+0000","last_clean":"2024-01-25T15:05:43.562927+0000","last_became_active":"2024-01-25T15:05:27.241892+0000","last_became_peered":"2024-01-25T15:05:27.241892+0000","last_unstale":"2024-01-25T15:05:43.562927+0000","last_undegraded":"2024-01-25T15:05:43.562927+0000","last_fullsized":"2024-01-25T15:05:43.562927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:17:07.138969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.568616+0000","last_change":"2024-01-25T15:05:26.220140+0000","last_active":"2024-01-25T15:05:43.568616+0000","last_peered":"2024-01-25T15:05:43.568616+0000","last_clean":"2024-01-25T15:05:43.568616+0000","last_became_active":"2024-01-25T15:05:26.219823+0000","last_became_peered":"2024-01-25T15:05:26.219823+0000","last_unstale":"2024-01-25T15:05:43.568616+0000","last_undegraded":"2024-01-25T15:05:43.568616+0000","last_fullsized":"2024-01-25T15:05:43.568616+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:53:24.322574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.576418+0000","last_change":"2024-01-25T15:05:43.575336+0000","last_active":"2024-01-25T15:05:43.576418+0000","last_peered":"2024-01-25T15:05:43.576418+0000","last_clean":"2024-01-25T15:05:43.576418+0000","last_became_active":"2024-01-25T15:05:43.575073+0000","last_became_peered":"2024-01-25T15:05:43.575073+0000","last_unstale":"2024-01-25T15:05:43.576418+0000","last_undegraded":"2024-01-25T15:05:43.576418+0000","last_fullsized":"2024-01-25T15:05:43.576418+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:00:46.450293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"41'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.593416+0000","last_change":"2024-01-25T15:05:42.575698+0000","last_active":"2024-01-25T15:05:43.593416+0000","last_peered":"2024-01-25T15:05:43.593416+0000","last_clean":"2024-01-25T15:05:43.593416+0000","last_became_active":"2024-01-25T15:05:42.575426+0000","last_became_peered":"2024-01-25T15:05:42.575426+0000","last_unstale":"2024-01-25T15:05:43.593416+0000","last_undegraded":"2024-01-25T15:05:43.593416+0000","last_fullsized":"2024-01-25T15:05:43.593416+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:52.154622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560556+0000","last_change":"2024-01-25T15:05:27.229536+0000","last_active":"2024-01-25T15:05:43.560556+0000","last_peered":"2024-01-25T15:05:43.560556+0000","last_clean":"2024-01-25T15:05:43.560556+0000","last_became_active":"2024-01-25T15:05:27.228565+0000","last_became_peered":"2024-01-25T15:05:27.228565+0000","last_unstale":"2024-01-25T15:05:43.560556+0000","last_undegraded":"2024-01-25T15:05:43.560556+0000","last_fullsized":"2024-01-25T15:05:43.560556+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:01:33.031259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.576725+0000","last_change":"2024-01-25T15:05:26.225379+0000","last_active":"2024-01-25T15:05:43.576725+0000","last_peered":"2024-01-25T15:05:43.576725+0000","last_clean":"2024-01-25T15:05:43.576725+0000","last_became_active":"2024-01-25T15:05:26.225106+0000","last_became_peered":"2024-01-25T15:05:26.225106+0000","last_unstale":"2024-01-25T15:05:43.576725+0000","last_undegraded":"2024-01-25T15:05:43.576725+0000","last_fullsized":"2024-01-25T15:05:43.576725+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:21:43.851971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.592320+0000","last_change":"2024-01-25T15:05:43.582956+0000","last_active":"2024-01-25T15:05:43.592320+0000","last_peered":"2024-01-25T15:05:43.592320+0000","last_clean":"2024-01-25T15:05:43.592320+0000","last_became_active":"2024-01-25T15:05:43.582707+0000","last_became_peered":"2024-01-25T15:05:43.582707+0000","last_unstale":"2024-01-25T15:05:43.592320+0000","last_undegraded":"2024-01-25T15:05:43.592320+0000","last_fullsized":"2024-01-25T15:05:43.592320+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:26:26.772555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.564441+0000","last_change":"2024-01-25T15:05:42.572255+0000","last_active":"2024-01-25T15:05:43.564441+0000","last_peered":"2024-01-25T15:05:43.564441+0000","last_clean":"2024-01-25T15:05:43.564441+0000","last_became_active":"2024-01-25T15:05:42.571907+0000","last_became_peered":"2024-01-25T15:05:42.571907+0000","last_unstale":"2024-01-25T15:05:43.564441+0000","last_undegraded":"2024-01-25T15:05:43.564441+0000","last_fullsized":"2024-01-25T15:05:43.564441+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:06:30.121915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.563511+0000","last_change":"2024-01-25T15:05:27.229007+0000","last_active":"2024-01-25T15:05:43.563511+0000","last_peered":"2024-01-25T15:05:43.563511+0000","last_clean":"2024-01-25T15:05:43.563511+0000","last_became_active":"2024-01-25T15:05:27.228729+0000","last_became_peered":"2024-01-25T15:05:27.228729+0000","last_unstale":"2024-01-25T15:05:43.563511+0000","last_undegraded":"2024-01-25T15:05:43.563511+0000","last_fullsized":"2024-01-25T15:05:43.563511+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:13:38.590014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.570454+0000","last_change":"2024-01-25T15:05:26.226470+0000","last_active":"2024-01-25T15:05:43.570454+0000","last_peered":"2024-01-25T15:05:43.570454+0000","last_clean":"2024-01-25T15:05:43.570454+0000","last_became_active":"2024-01-25T15:05:26.226185+0000","last_became_peered":"2024-01-25T15:05:26.226185+0000","last_unstale":"2024-01-25T15:05:43.570454+0000","last_undegraded":"2024-01-25T15:05:43.570454+0000","last_fullsized":"2024-01-25T15:05:43.570454+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:00:52.590768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.585862+0000","last_change":"2024-01-25T15:05:43.580637+0000","last_active":"2024-01-25T15:05:43.585862+0000","last_peered":"2024-01-25T15:05:43.585862+0000","last_clean":"2024-01-25T15:05:43.585862+0000","last_became_active":"2024-01-25T15:05:43.580379+0000","last_became_peered":"2024-01-25T15:05:43.580379+0000","last_unstale":"2024-01-25T15:05:43.585862+0000","last_undegraded":"2024-01-25T15:05:43.585862+0000","last_fullsized":"2024-01-25T15:05:43.585862+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:47:17.200557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.570887+0000","last_change":"2024-01-25T15:05:42.571496+0000","last_active":"2024-01-25T15:05:43.570887+0000","last_peered":"2024-01-25T15:05:43.570887+0000","last_clean":"2024-01-25T15:05:43.570887+0000","last_became_active":"2024-01-25T15:05:42.569820+0000","last_became_peered":"2024-01-25T15:05:42.569820+0000","last_unstale":"2024-01-25T15:05:43.570887+0000","last_undegraded":"2024-01-25T15:05:43.570887+0000","last_fullsized":"2024-01-25T15:05:43.570887+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:40:09.070760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.563105+0000","last_change":"2024-01-25T15:05:27.236625+0000","last_active":"2024-01-25T15:05:43.563105+0000","last_peered":"2024-01-25T15:05:43.563105+0000","last_clean":"2024-01-25T15:05:43.563105+0000","last_became_active":"2024-01-25T15:05:27.236387+0000","last_became_peered":"2024-01-25T15:05:27.236387+0000","last_unstale":"2024-01-25T15:05:43.563105+0000","last_undegraded":"2024-01-25T15:05:43.563105+0000","last_fullsized":"2024-01-25T15:05:43.563105+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:43:59.664529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.561414+0000","last_change":"2024-01-25T15:05:26.224342+0000","last_active":"2024-01-25T15:05:43.561414+0000","last_peered":"2024-01-25T15:05:43.561414+0000","last_clean":"2024-01-25T15:05:43.561414+0000","last_became_active":"2024-01-25T15:05:26.224074+0000","last_became_peered":"2024-01-25T15:05:26.224074+0000","last_unstale":"2024-01-25T15:05:43.561414+0000","last_undegraded":"2024-01-25T15:05:43.561414+0000","last_fullsized":"2024-01-25T15:05:43.561414+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:22:35.220728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.590738+0000","last_change":"2024-01-25T15:05:43.577530+0000","last_active":"2024-01-25T15:05:43.590738+0000","last_peered":"2024-01-25T15:05:43.590738+0000","last_clean":"2024-01-25T15:05:43.590738+0000","last_became_active":"2024-01-25T15:05:43.575895+0000","last_became_peered":"2024-01-25T15:05:43.575895+0000","last_unstale":"2024-01-25T15:05:43.590738+0000","last_undegraded":"2024-01-25T15:05:43.590738+0000","last_fullsized":"2024-01-25T15:05:43.590738+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:10:36.558502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.558840+0000","last_change":"2024-01-25T15:05:42.571658+0000","last_active":"2024-01-25T15:05:43.558840+0000","last_peered":"2024-01-25T15:05:43.558840+0000","last_clean":"2024-01-25T15:05:43.558840+0000","last_became_active":"2024-01-25T15:05:42.571274+0000","last_became_peered":"2024-01-25T15:05:42.571274+0000","last_unstale":"2024-01-25T15:05:43.558840+0000","last_undegraded":"2024-01-25T15:05:43.558840+0000","last_fullsized":"2024-01-25T15:05:43.558840+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:30:41.033538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.566760+0000","last_change":"2024-01-25T15:05:27.234553+0000","last_active":"2024-01-25T15:05:43.566760+0000","last_peered":"2024-01-25T15:05:43.566760+0000","last_clean":"2024-01-25T15:05:43.566760+0000","last_became_active":"2024-01-25T15:05:27.234266+0000","last_became_peered":"2024-01-25T15:05:27.234266+0000","last_unstale":"2024-01-25T15:05:43.566760+0000","last_undegraded":"2024-01-25T15:05:43.566760+0000","last_fullsized":"2024-01-25T15:05:43.566760+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:26:19.413150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.564563+0000","last_change":"2024-01-25T15:05:26.210731+0000","last_active":"2024-01-25T15:05:43.564563+0000","last_peered":"2024-01-25T15:05:43.564563+0000","last_clean":"2024-01-25T15:05:43.564563+0000","last_became_active":"2024-01-25T15:05:26.210193+0000","last_became_peered":"2024-01-25T15:05:26.210193+0000","last_unstale":"2024-01-25T15:05:43.564563+0000","last_undegraded":"2024-01-25T15:05:43.564563+0000","last_fullsized":"2024-01-25T15:05:43.564563+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:35:19.247290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.582661+0000","last_change":"2024-01-25T15:05:43.581661+0000","last_active":"2024-01-25T15:05:43.582661+0000","last_peered":"2024-01-25T15:05:43.582661+0000","last_clean":"2024-01-25T15:05:43.582661+0000","last_became_active":"2024-01-25T15:05:43.581376+0000","last_became_peered":"2024-01-25T15:05:43.581376+0000","last_unstale":"2024-01-25T15:05:43.582661+0000","last_undegraded":"2024-01-25T15:05:43.582661+0000","last_fullsized":"2024-01-25T15:05:43.582661+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:10:36.558502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.558275+0000","last_change":"2024-01-25T15:05:42.569360+0000","last_active":"2024-01-25T15:05:43.558275+0000","last_peered":"2024-01-25T15:05:43.558275+0000","last_clean":"2024-01-25T15:05:43.558275+0000","last_became_active":"2024-01-25T15:05:42.569079+0000","last_became_peered":"2024-01-25T15:05:42.569079+0000","last_unstale":"2024-01-25T15:05:43.558275+0000","last_undegraded":"2024-01-25T15:05:43.558275+0000","last_fullsized":"2024-01-25T15:05:43.558275+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:10:35.554151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.561158+0000","last_change":"2024-01-25T15:05:27.240670+0000","last_active":"2024-01-25T15:05:43.561158+0000","last_peered":"2024-01-25T15:05:43.561158+0000","last_clean":"2024-01-25T15:05:43.561158+0000","last_became_active":"2024-01-25T15:05:27.240409+0000","last_became_peered":"2024-01-25T15:05:27.240409+0000","last_unstale":"2024-01-25T15:05:43.561158+0000","last_undegraded":"2024-01-25T15:05:43.561158+0000","last_fullsized":"2024-01-25T15:05:43.561158+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:24:11.287963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.558606+0000","last_change":"2024-01-25T15:05:26.215779+0000","last_active":"2024-01-25T15:05:43.558606+0000","last_peered":"2024-01-25T15:05:43.558606+0000","last_clean":"2024-01-25T15:05:43.558606+0000","last_became_active":"2024-01-25T15:05:26.215521+0000","last_became_peered":"2024-01-25T15:05:26.215521+0000","last_unstale":"2024-01-25T15:05:43.558606+0000","last_undegraded":"2024-01-25T15:05:43.558606+0000","last_fullsized":"2024-01-25T15:05:43.558606+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:33:04.010404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.579740+0000","last_change":"2024-01-25T15:05:43.576360+0000","last_active":"2024-01-25T15:05:43.579740+0000","last_peered":"2024-01-25T15:05:43.579740+0000","last_clean":"2024-01-25T15:05:43.579740+0000","last_became_active":"2024-01-25T15:05:43.576013+0000","last_became_peered":"2024-01-25T15:05:43.576013+0000","last_unstale":"2024-01-25T15:05:43.579740+0000","last_undegraded":"2024-01-25T15:05:43.579740+0000","last_fullsized":"2024-01-25T15:05:43.579740+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:42.550396+0000","last_clean_scrub_stamp":"2024-01-25T15:05:42.550396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:17:02.746946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.576578+0000","last_change":"2024-01-25T15:05:42.578086+0000","last_active":"2024-01-25T15:05:43.576578+0000","last_peered":"2024-01-25T15:05:43.576578+0000","last_clean":"2024-01-25T15:05:43.576578+0000","last_became_active":"2024-01-25T15:05:42.577592+0000","last_became_peered":"2024-01-25T15:05:42.577592+0000","last_unstale":"2024-01-25T15:05:43.576578+0000","last_undegraded":"2024-01-25T15:05:43.576578+0000","last_fullsized":"2024-01-25T15:05:43.576578+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:41.546044+0000","last_clean_scrub_stamp":"2024-01-25T15:05:41.546044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:07:47.334162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.571914+0000","last_change":"2024-01-25T15:05:27.236929+0000","last_active":"2024-01-25T15:05:43.571914+0000","last_peered":"2024-01-25T15:05:43.571914+0000","last_clean":"2024-01-25T15:05:43.571914+0000","last_became_active":"2024-01-25T15:05:27.236388+0000","last_became_peered":"2024-01-25T15:05:27.236388+0000","last_unstale":"2024-01-25T15:05:43.571914+0000","last_undegraded":"2024-01-25T15:05:43.571914+0000","last_fullsized":"2024-01-25T15:05:43.571914+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:26.202048+0000","last_clean_scrub_stamp":"2024-01-25T15:05:26.202048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:55:46.833186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560906+0000","last_change":"2024-01-25T15:05:26.221948+0000","last_active":"2024-01-25T15:05:43.560906+0000","last_peered":"2024-01-25T15:05:43.560906+0000","last_clean":"2024-01-25T15:05:43.560906+0000","last_became_active":"2024-01-25T15:05:26.221678+0000","last_became_peered":"2024-01-25T15:05:26.221678+0000","last_unstale":"2024-01-25T15:05:43.560906+0000","last_undegraded":"2024-01-25T15:05:43.560906+0000","last_fullsized":"2024-01-25T15:05:43.560906+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:05:25.198167+0000","last_clean_scrub_stamp":"2024-01-25T15:05:25.198167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:21:43.851971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":207,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-01-25T15:05:43.560687+0000","last_change":"2024-01-25T15:04:16.181635+0000","last_active":"2024-01-25T15:05:43.560687+0000","last_peered":"2024-01-25T15:05:43.560687+0000","last_clean":"2024-01-25T15:05:43.560687+0000","last_became_active":"2024-01-25T15:04:16.179890+0000","last_became_peered":"2024-01-25T15:04:16.179890+0000","last_unstale":"2024-01-25T15:05:43.560687+0000","last_undegraded":"2024-01-25T15:05:43.560687+0000","last_fullsized":"2024-01-25T15:05:43.560687+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_clean_scrub_stamp":"2024-01-25T15:04:14.956188+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:49:00.618327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":3909,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1073152,"data_stored":796628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.437},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.38800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":487424,"data_stored":212266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.66600000000000004}]},{"osd":1,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.377}]},{"osd":5,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.35499999999999998}]},{"osd":7,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.5},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.42999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":471040,"data_stored":203191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.63900000000000001}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.70099999999999996}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.74099999999999999}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.82199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31664,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":487424,"data_stored":212218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.437},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.629},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.67000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":479232,"data_stored":206224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":3.3559999999999999,"5min":3.3559999999999999,"15min":3.3559999999999999},"last":0.245},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.27200000000000002}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.4209999999999998,"5min":3.4209999999999998,"15min":3.4209999999999998},"last":0.309}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.4689999999999999,"5min":3.4689999999999999,"15min":3.4689999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":3.508,"5min":3.508,"15min":3.508},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.5449999999999999,"5min":3.5449999999999999,"15min":3.5449999999999999},"last":0.56399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":466944,"data_stored":203149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.439},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.501},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.87},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.79600000000000004}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.70199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":466944,"data_stored":203169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.255},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.311}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.498},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.622}]},{"osd":7,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1060864,"data_stored":793481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.377}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.65300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:05:46.932 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-25T15:05:46.932 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2024-01-25T15:05:47.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.071+0000 7f1c13e1e640 1 Processor -- start 2024-01-25T15:05:47.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.071+0000 7f1c13e1e640 1 -- start start 2024-01-25T15:05:47.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.072+0000 7f1c13e1e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1c0c0c7580 0x7f1c0c0c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:47.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.072+0000 7f1c13e1e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0c070e20 con 0x7f1c0c0c4a10 2024-01-25T15:05:47.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.072+0000 7f1c13e1e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0c0c7b60 con 0x7f1c0c158950 2024-01-25T15:05:47.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.072+0000 7f1c13e1e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c0c0c7e40 con 0x7f1c0c0c7580 2024-01-25T15:05:47.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.072+0000 7f1c11bba640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1c0c0c4a10 0x7f1c0c0c60a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54518/0 (socket says 172.21.15.29:54518) 2024-01-25T15:05:47.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.072+0000 7f1c11bba640 1 -- 172.21.15.29:0/468931627 learned_addr learned my addr 172.21.15.29:0/468931627 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:47.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.072+0000 7f1c123bb640 1 --2- 172.21.15.29:0/468931627 >> v2:172.21.15.52:3300/0 conn(0x7f1c0c0c7580 0x7f1c0c0c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:47.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.072+0000 7f1c10bb8640 1 -- 172.21.15.29:0/468931627 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547142492 0 0) 0x7f1c0c070e20 con 0x7f1c0c0c4a10 2024-01-25T15:05:47.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.072+0000 7f1c10bb8640 1 -- 172.21.15.29:0/468931627 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bf8003520 con 0x7f1c0c0c4a10 2024-01-25T15:05:47.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.072+0000 7f1c10bb8640 1 -- 172.21.15.29:0/468931627 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3961312682 0 0) 0x7f1bf8003520 con 0x7f1c0c0c4a10 2024-01-25T15:05:47.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.072+0000 7f1c10bb8640 1 -- 172.21.15.29:0/468931627 >> v2:172.21.15.52:3300/0 conn(0x7f1c0c0c7580 msgr2=0x7f1c0c0c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:47.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.072+0000 7f1c10bb8640 1 --2- 172.21.15.29:0/468931627 >> v2:172.21.15.52:3300/0 conn(0x7f1c0c0c7580 0x7f1c0c0c4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.072+0000 7f1c10bb8640 1 -- 172.21.15.29:0/468931627 >> v1:172.21.15.52:6789/0 conn(0x7f1c0c158950 legacy=0x7f1c0c15d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:47.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.072+0000 7f1c10bb8640 1 -- 172.21.15.29:0/468931627 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c157e70 con 0x7f1c0c0c4a10 2024-01-25T15:05:47.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.072+0000 7f1c10bb8640 1 -- 172.21.15.29:0/468931627 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f1c08001670 con 0x7f1c0c0c4a10 2024-01-25T15:05:47.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.072+0000 7f1c10bb8640 1 -- 172.21.15.29:0/468931627 >> v1:172.21.15.29:6789/0 conn(0x7f1c0c0c4a10 legacy=0x7f1c0c0c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:47.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.072+0000 7f1c10bb8640 1 --2- 172.21.15.29:0/468931627 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1bf80039e0 0x7f1bf8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:47.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.072+0000 7f1c10bb8640 1 --2- 172.21.15.29:0/468931627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bf80047c0 0x7f1bf8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:47.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.072+0000 7f1c10bb8640 1 --2- 172.21.15.29:0/468931627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bf8005180 0x7f1bf800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:47.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.072+0000 7f1c10bb8640 1 -- 172.21.15.29:0/468931627 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c0c7e40 con 0x7f1bf80047c0 2024-01-25T15:05:47.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.072+0000 7f1c10bb8640 1 -- 172.21.15.29:0/468931627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf800c0b0 con 0x7f1bf8005180 2024-01-25T15:05:47.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.072+0000 7f1c10bb8640 1 -- 172.21.15.29:0/468931627 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf800c270 con 0x7f1bf80039e0 2024-01-25T15:05:47.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.073+0000 7f1c113b9640 1 --2- 172.21.15.29:0/468931627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bf80047c0 0x7f1bf8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:47.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.073+0000 7f1c11bba640 1 --2- 172.21.15.29:0/468931627 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1bf80039e0 0x7f1bf8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:47.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.073+0000 7f1c123bb640 1 --2- 172.21.15.29:0/468931627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bf8005180 0x7f1bf800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:47.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.073+0000 7f1c113b9640 1 -- 172.21.15.29:0/468931627 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1bf80039e0 msgr2=0x7f1bf8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:47.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.073+0000 7f1c113b9640 1 --2- 172.21.15.29:0/468931627 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1bf80039e0 0x7f1bf8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.073+0000 7f1c113b9640 1 -- 172.21.15.29:0/468931627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bf8005180 msgr2=0x7f1bf800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:47.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.073+0000 7f1c113b9640 1 --2- 172.21.15.29:0/468931627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bf8005180 0x7f1bf800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.073+0000 7f1c113b9640 1 -- 172.21.15.29:0/468931627 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf8003520 con 0x7f1bf80047c0 2024-01-25T15:05:47.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.073+0000 7f1c123bb640 1 -- 172.21.15.29:0/468931627 reap_dead start 2024-01-25T15:05:47.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.073+0000 7f1c11bba640 1 --2- 172.21.15.29:0/468931627 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1bf80039e0 0x7f1bf8003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:47.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.074+0000 7f1c113b9640 1 --2- 172.21.15.29:0/468931627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bf80047c0 0x7f1bf8004c40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc001750 tx=0x7f1bf80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0726a7c0dba3a4 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:47.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.074+0000 7f1c10bb8640 1 -- 172.21.15.29:0/468931627 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc0052d0 con 0x7f1bf80047c0 2024-01-25T15:05:47.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.074+0000 7f1c10bb8640 1 -- 172.21.15.29:0/468931627 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc02e050 con 0x7f1bf80047c0 2024-01-25T15:05:47.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.074+0000 7f1c10bb8640 1 -- 172.21.15.29:0/468931627 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc003830 con 0x7f1bf80047c0 2024-01-25T15:05:47.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.074+0000 7f1c13e1e640 1 -- 172.21.15.29:0/468931627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bf80047c0 msgr2=0x7f1bf8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:47.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.074+0000 7f1c13e1e640 1 --2- 172.21.15.29:0/468931627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bf80047c0 0x7f1bf8004c40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc001750 tx=0x7f1bf80057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.074+0000 7f1c13e1e640 1 -- 172.21.15.29:0/468931627 shutdown_connections 2024-01-25T15:05:47.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.074+0000 7f1c13e1e640 1 --2- 172.21.15.29:0/468931627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bf80047c0 0x7f1bf8004c40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.074+0000 7f1c13e1e640 1 -- 172.21.15.29:0/468931627 >> 172.21.15.29:0/468931627 conn(0x7f1c0c0c7f80 msgr2=0x7f1c0c0c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:47.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.074+0000 7f1c13e1e640 1 -- 172.21.15.29:0/468931627 shutdown_connections 2024-01-25T15:05:47.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.074+0000 7f1c13e1e640 1 -- 172.21.15.29:0/468931627 wait complete. 2024-01-25T15:05:47.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.075+0000 7f1c13e1e640 1 Processor -- start 2024-01-25T15:05:47.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.076+0000 7f1c13e1e640 1 -- start start 2024-01-25T15:05:47.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.076+0000 7f1c13e1e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1bf80047c0 0x7f1c0c147970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:47.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.076+0000 7f1c13e1e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c0c147eb0 0x7f1c0c1ed750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:47.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.076+0000 7f1c13e1e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c0c06fef0 0x7f1c0c1edc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:47.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.076+0000 7f1c13e1e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c156490 con 0x7f1c0c147eb0 2024-01-25T15:05:47.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.076+0000 7f1c13e1e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c1566c0 con 0x7f1c0c06fef0 2024-01-25T15:05:47.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.076+0000 7f1c13e1e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c1569a0 con 0x7f1bf80047c0 2024-01-25T15:05:47.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.076+0000 7f1c113b9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c0c147eb0 0x7f1c0c1ed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:47.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.076+0000 7f1c113b9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c0c147eb0 0x7f1c0c1ed750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55530/0 (socket says 172.21.15.29:55530) 2024-01-25T15:05:47.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.076+0000 7f1c113b9640 1 -- 172.21.15.29:0/3277080878 learned_addr learned my addr 172.21.15.29:0/3277080878 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:47.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.077+0000 7f1c113b9640 1 -- 172.21.15.29:0/3277080878 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1bf80047c0 msgr2=0x7f1c0c147970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:47.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.077+0000 7f1c113b9640 1 --2- 172.21.15.29:0/3277080878 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1bf80047c0 0x7f1c0c147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.077+0000 7f1c113b9640 1 -- 172.21.15.29:0/3277080878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c0c06fef0 msgr2=0x7f1c0c1edc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:47.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.077+0000 7f1c113b9640 1 --2- 172.21.15.29:0/3277080878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c0c06fef0 0x7f1c0c1edc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.077+0000 7f1c113b9640 1 -- 172.21.15.29:0/3277080878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c156c80 con 0x7f1c0c147eb0 2024-01-25T15:05:47.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.077+0000 7f1c113b9640 1 --2- 172.21.15.29:0/3277080878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c0c147eb0 0x7f1c0c1ed750 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc005040 tx=0x7f1bfc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:47.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.077+0000 7f1c027fc640 1 -- 172.21.15.29:0/3277080878 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc007a30 con 0x7f1c0c147eb0 2024-01-25T15:05:47.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.077+0000 7f1c027fc640 1 -- 172.21.15.29:0/3277080878 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc007640 con 0x7f1c0c147eb0 2024-01-25T15:05:47.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.077+0000 7f1c13e1e640 1 -- 172.21.15.29:0/3277080878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c0c156f60 con 0x7f1c0c147eb0 2024-01-25T15:05:47.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.077+0000 7f1c027fc640 1 -- 172.21.15.29:0/3277080878 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc006be0 con 0x7f1c0c147eb0 2024-01-25T15:05:47.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.077+0000 7f1c13e1e640 1 -- 172.21.15.29:0/3277080878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0c0acf10 con 0x7f1c0c147eb0 2024-01-25T15:05:47.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.078+0000 7f1c13e1e640 1 -- 172.21.15.29:0/3277080878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0c04eb10 con 0x7f1c0c147eb0 2024-01-25T15:05:47.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.078+0000 7f1c027fc640 1 -- 172.21.15.29:0/3277080878 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f1bfc006d40 con 0x7f1c0c147eb0 2024-01-25T15:05:47.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.079+0000 7f1c027fc640 1 --2- 172.21.15.29:0/3277080878 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1bf006aed0 0x7f1bf006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:47.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.079+0000 7f1c027fc640 1 -- 172.21.15.29:0/3277080878 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f1bfc0ab6b0 con 0x7f1c0c147eb0 2024-01-25T15:05:47.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.079+0000 7f1c11bba640 1 --2- 172.21.15.29:0/3277080878 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1bf006aed0 0x7f1bf006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:47.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.079+0000 7f1c11bba640 1 --2- 172.21.15.29:0/3277080878 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1bf006aed0 0x7f1bf006d390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1c080018e0 tx=0x7f1c08001dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:47.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.083+0000 7f1c027fc640 1 -- 172.21.15.29:0/3277080878 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f1bfc076170 con 0x7f1c0c147eb0 2024-01-25T15:05:47.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.328+0000 7f1c13e1e640 1 -- 172.21.15.29:0/3277080878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f1c0c156490 con 0x7f1c0c147eb0 2024-01-25T15:05:47.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.330+0000 7f1c027fc640 1 -- 172.21.15.29:0/3277080878 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v12) v1 ==== 185+0+142 (secure 0 0 0) 0x7f1bfc079790 con 0x7f1c0c147eb0 2024-01-25T15:05:47.332 INFO:teuthology.orchestra.run.smithi029.stdout:[client.1] 2024-01-25T15:05:47.332 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBFeLJlX8/WKxAA0Acmb/XM79+7u0ZYjqLfSw== 2024-01-25T15:05:47.332 INFO:teuthology.orchestra.run.smithi029.stdout: caps mds = "allow" 2024-01-25T15:05:47.333 INFO:teuthology.orchestra.run.smithi029.stdout: caps mon = "allow r" 2024-01-25T15:05:47.333 INFO:teuthology.orchestra.run.smithi029.stdout: caps osd = "allow rw pool=cephfs2_data" 2024-01-25T15:05:47.333 INFO:teuthology.orchestra.run.smithi029.stderr:updated caps for client.1 2024-01-25T15:05:47.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.333+0000 7f1c13e1e640 1 -- 172.21.15.29:0/3277080878 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1bf006aed0 msgr2=0x7f1bf006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:47.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.333+0000 7f1c13e1e640 1 --2- 172.21.15.29:0/3277080878 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1bf006aed0 0x7f1bf006d390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1c080018e0 tx=0x7f1c08001dc0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.333+0000 7f1c13e1e640 1 -- 172.21.15.29:0/3277080878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c0c147eb0 msgr2=0x7f1c0c1ed750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:47.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.333+0000 7f1c13e1e640 1 --2- 172.21.15.29:0/3277080878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c0c147eb0 0x7f1c0c1ed750 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc005040 tx=0x7f1bfc001120 comp rx=0 tx=0).stop 2024-01-25T15:05:47.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.333+0000 7f1c13e1e640 1 -- 172.21.15.29:0/3277080878 shutdown_connections 2024-01-25T15:05:47.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.333+0000 7f1c13e1e640 1 --2- 172.21.15.29:0/3277080878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c0c06fef0 0x7f1c0c1edc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.333+0000 7f1c13e1e640 1 --2- 172.21.15.29:0/3277080878 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1bf006aed0 0x7f1bf006d390 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.333+0000 7f1c13e1e640 1 --2- 172.21.15.29:0/3277080878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c0c147eb0 0x7f1c0c1ed750 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.333+0000 7f1c13e1e640 1 --2- 172.21.15.29:0/3277080878 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1bf80047c0 0x7f1c0c147970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.333+0000 7f1c13e1e640 1 -- 172.21.15.29:0/3277080878 >> 172.21.15.29:0/3277080878 conn(0x7f1c0c0c7f80 msgr2=0x7f1c0c06b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:47.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.333+0000 7f1c13e1e640 1 -- 172.21.15.29:0/3277080878 shutdown_connections 2024-01-25T15:05:47.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.333+0000 7f1c13e1e640 1 -- 172.21.15.29:0/3277080878 wait complete. 2024-01-25T15:05:47.345 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:05:47.345 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:05:47.364 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:05:47.365 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:05:47.423 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:47.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.524+0000 7fece50ec640 1 Processor -- start 2024-01-25T15:05:47.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.524+0000 7fece50ec640 1 -- start start 2024-01-25T15:05:47.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.524+0000 7fece50ec640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fece0151e90 0x7fece006b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:47.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.524+0000 7fece50ec640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece006b760 0x7fece015f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:47.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.524+0000 7fece50ec640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece00c5b40 con 0x7fece00c7f00 2024-01-25T15:05:47.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.524+0000 7fece50ec640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece0154c50 con 0x7fece0151e90 2024-01-25T15:05:47.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.524+0000 7fece50ec640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece006c0f0 con 0x7fece006b760 2024-01-25T15:05:47.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.525+0000 7fecdf59e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece006b760 0x7fece015f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:47.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.525+0000 7fecded9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fece0151e90 0x7fece006b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:47.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.525+0000 7fecde59c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fece00c7f00 0x7fece00c5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:55486/0 (socket says 172.21.15.29:55486) 2024-01-25T15:05:47.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.525+0000 7fecde59c640 1 -- 172.21.15.29:0/2781724287 learned_addr learned my addr 172.21.15.29:0/2781724287 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:47.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.525+0000 7fecdf59e640 1 -- 172.21.15.29:0/2781724287 >> v2:172.21.15.52:3300/0 conn(0x7fece0151e90 msgr2=0x7fece006b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:47.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.525+0000 7fecdf59e640 1 --2- 172.21.15.29:0/2781724287 >> v2:172.21.15.52:3300/0 conn(0x7fece0151e90 0x7fece006b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.525+0000 7fecdf59e640 1 -- 172.21.15.29:0/2781724287 >> v1:172.21.15.52:6789/0 conn(0x7fece00c7f00 legacy=0x7fece00c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:47.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.525+0000 7fecdf59e640 1 -- 172.21.15.29:0/2781724287 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece00c9d90 con 0x7fece006b760 2024-01-25T15:05:47.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.525+0000 7fecded9d640 1 --2- 172.21.15.29:0/2781724287 >> v2:172.21.15.52:3300/0 conn(0x7fece0151e90 0x7fece006b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:05:47.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.526+0000 7fecdf59e640 1 --2- 172.21.15.29:0/2781724287 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece006b760 0x7fece015f130 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009d90 tx=0x7fecd002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec21abf67cbe9d1a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:47.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.526+0000 7fecddd9b640 1 -- 172.21.15.29:0/2781724287 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd002cce0 con 0x7fece006b760 2024-01-25T15:05:47.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.526+0000 7fecddd9b640 1 -- 172.21.15.29:0/2781724287 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd002ce40 con 0x7fece006b760 2024-01-25T15:05:47.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.526+0000 7fecddd9b640 1 -- 172.21.15.29:0/2781724287 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd0034660 con 0x7fece006b760 2024-01-25T15:05:47.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.527+0000 7fece50ec640 1 -- 172.21.15.29:0/2781724287 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece006b760 msgr2=0x7fece015f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:47.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.527+0000 7fece50ec640 1 --2- 172.21.15.29:0/2781724287 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece006b760 0x7fece015f130 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009d90 tx=0x7fecd002bf30 comp rx=0 tx=0).stop 2024-01-25T15:05:47.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.527+0000 7fece50ec640 1 -- 172.21.15.29:0/2781724287 shutdown_connections 2024-01-25T15:05:47.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.527+0000 7fece50ec640 1 --2- 172.21.15.29:0/2781724287 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece006b760 0x7fece015f130 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.527+0000 7fece50ec640 1 --2- 172.21.15.29:0/2781724287 >> v2:172.21.15.52:3300/0 conn(0x7fece0151e90 0x7fece006b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.527+0000 7fece50ec640 1 -- 172.21.15.29:0/2781724287 >> 172.21.15.29:0/2781724287 conn(0x7fece00ca000 msgr2=0x7fece00ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:47.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.527+0000 7fece50ec640 1 -- 172.21.15.29:0/2781724287 shutdown_connections 2024-01-25T15:05:47.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.527+0000 7fece50ec640 1 -- 172.21.15.29:0/2781724287 wait complete. 2024-01-25T15:05:47.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.528+0000 7fece50ec640 1 Processor -- start 2024-01-25T15:05:47.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.528+0000 7fece50ec640 1 -- start start 2024-01-25T15:05:47.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.529+0000 7fece50ec640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece006b760 0x7fece00c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:47.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.529+0000 7fece50ec640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fece00c7f00 0x7fece0150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:47.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.529+0000 7fece50ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece0151e90 0x7fece01edc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:47.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.529+0000 7fece50ec640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece01ed780 con 0x7fece00c7f00 2024-01-25T15:05:47.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.529+0000 7fece50ec640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece0157c50 con 0x7fece0151e90 2024-01-25T15:05:47.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.529+0000 7fece50ec640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece0157f10 con 0x7fece006b760 2024-01-25T15:05:47.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.529+0000 7fecde59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fece00c7f00 0x7fece0150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:47.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.529+0000 7fecde59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fece00c7f00 0x7fece0150c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55542/0 (socket says 172.21.15.29:55542) 2024-01-25T15:05:47.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.529+0000 7fecde59c640 1 -- 172.21.15.29:0/3441884035 learned_addr learned my addr 172.21.15.29:0/3441884035 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:47.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.529+0000 7fecdf59e640 1 --2- 172.21.15.29:0/3441884035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece0151e90 0x7fece01edc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:47.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.529+0000 7fecded9d640 1 --2- 172.21.15.29:0/3441884035 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece006b760 0x7fece00c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:47.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.529+0000 7fecde59c640 1 -- 172.21.15.29:0/3441884035 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece006b760 msgr2=0x7fece00c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:47.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.529+0000 7fecde59c640 1 --2- 172.21.15.29:0/3441884035 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece006b760 0x7fece00c10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.529+0000 7fecde59c640 1 -- 172.21.15.29:0/3441884035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece0151e90 msgr2=0x7fece01edc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:47.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.529+0000 7fecde59c640 1 --2- 172.21.15.29:0/3441884035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece0151e90 0x7fece01edc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.529+0000 7fecde59c640 1 -- 172.21.15.29:0/3441884035 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd8009400 con 0x7fece00c7f00 2024-01-25T15:05:47.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.530+0000 7fecde59c640 1 --2- 172.21.15.29:0/3441884035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fece00c7f00 0x7fece0150c00 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fecd400c440 tx=0x7fecd4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:47.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.530+0000 7fecc77fe640 1 -- 172.21.15.29:0/3441884035 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4005ce0 con 0x7fece00c7f00 2024-01-25T15:05:47.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.530+0000 7fecc77fe640 1 -- 172.21.15.29:0/3441884035 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd4005e40 con 0x7fece00c7f00 2024-01-25T15:05:47.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.530+0000 7fecc77fe640 1 -- 172.21.15.29:0/3441884035 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40072f0 con 0x7fece00c7f00 2024-01-25T15:05:47.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.530+0000 7fece50ec640 1 -- 172.21.15.29:0/3441884035 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd0009a70 con 0x7fece00c7f00 2024-01-25T15:05:47.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.530+0000 7fece50ec640 1 -- 172.21.15.29:0/3441884035 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece0151140 con 0x7fece00c7f00 2024-01-25T15:05:47.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.531+0000 7fece50ec640 1 -- 172.21.15.29:0/3441884035 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece01ed930 con 0x7fece00c7f00 2024-01-25T15:05:47.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.531+0000 7fecc77fe640 1 -- 172.21.15.29:0/3441884035 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fecd4007450 con 0x7fece00c7f00 2024-01-25T15:05:47.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.532+0000 7fecc77fe640 1 --2- 172.21.15.29:0/3441884035 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7feccc06af00 0x7feccc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:47.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.532+0000 7fecc77fe640 1 -- 172.21.15.29:0/3441884035 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fecd4088f60 con 0x7fece00c7f00 2024-01-25T15:05:47.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.532+0000 7fecded9d640 1 --2- 172.21.15.29:0/3441884035 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7feccc06af00 0x7feccc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:47.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.532+0000 7fecded9d640 1 --2- 172.21.15.29:0/3441884035 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7feccc06af00 0x7feccc06d3c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fece0153750 tx=0x7fecd8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:47.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.536+0000 7fecc77fe640 1 -- 172.21.15.29:0/3441884035 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fece01ed930 con 0x7fece00c7f00 2024-01-25T15:05:47.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.717+0000 7fece50ec640 1 -- 172.21.15.29:0/3441884035 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fece0074080 con 0x7fece00c7f00 2024-01-25T15:05:47.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.718+0000 7fecc77fe640 1 -- 172.21.15.29:0/3441884035 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+20455 (secure 0 0 0) 0x7fecd4017020 con 0x7fece00c7f00 2024-01-25T15:05:47.719 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:47.719 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":42,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:05:44.564655+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:05:25.099043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-25T15:05:25.537967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-25T15:05:40.935431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-25T15:05:41.895611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:47.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.720+0000 7fece50ec640 1 -- 172.21.15.29:0/3441884035 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7feccc06af00 msgr2=0x7feccc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:47.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.720+0000 7fece50ec640 1 --2- 172.21.15.29:0/3441884035 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7feccc06af00 0x7feccc06d3c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fece0153750 tx=0x7fecd8009190 comp rx=0 tx=0).stop 2024-01-25T15:05:47.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.720+0000 7fece50ec640 1 -- 172.21.15.29:0/3441884035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fece00c7f00 msgr2=0x7fece0150c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:47.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.720+0000 7fece50ec640 1 --2- 172.21.15.29:0/3441884035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fece00c7f00 0x7fece0150c00 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fecd400c440 tx=0x7fecd4001e70 comp rx=0 tx=0).stop 2024-01-25T15:05:47.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.720+0000 7fece50ec640 1 -- 172.21.15.29:0/3441884035 shutdown_connections 2024-01-25T15:05:47.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.720+0000 7fece50ec640 1 --2- 172.21.15.29:0/3441884035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece0151e90 0x7fece01edc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.720+0000 7fece50ec640 1 --2- 172.21.15.29:0/3441884035 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7feccc06af00 0x7feccc06d3c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.720+0000 7fece50ec640 1 --2- 172.21.15.29:0/3441884035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fece00c7f00 0x7fece0150c00 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.720+0000 7fece50ec640 1 --2- 172.21.15.29:0/3441884035 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fece006b760 0x7fece00c10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.720+0000 7fece50ec640 1 -- 172.21.15.29:0/3441884035 >> 172.21.15.29:0/3441884035 conn(0x7fece00ca000 msgr2=0x7fece00ca3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:47.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.720+0000 7fece50ec640 1 -- 172.21.15.29:0/3441884035 shutdown_connections 2024-01-25T15:05:47.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.720+0000 7fece50ec640 1 -- 172.21.15.29:0/3441884035 wait complete. 2024-01-25T15:05:47.732 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T15:04:14.955791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T15:05:25.099043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T15:05:25.537967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-25T15:05:40.935431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-25T15:05:41.895611+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-25T15:05:47.732 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:05:47.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.836+0000 7fa4cff01640 1 Processor -- start 2024-01-25T15:05:47.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.836+0000 7fa4cff01640 1 -- start start 2024-01-25T15:05:47.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.837+0000 7fa4cff01640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4c8151f80 0x7fa4c80c6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:47.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.837+0000 7fa4cff01640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa4c80c48d0 0x7fa4c8155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:47.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.837+0000 7fa4cff01640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c8158120 con 0x7fa4c81585b0 2024-01-25T15:05:47.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.837+0000 7fa4cff01640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c81556d0 con 0x7fa4c80c48d0 2024-01-25T15:05:47.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.837+0000 7fa4cff01640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c80c4db0 con 0x7fa4c8151f80 2024-01-25T15:05:47.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.837+0000 7fa4cd49c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa4c80c48d0 0x7fa4c8155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:47.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.837+0000 7fa4ce49e640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa4c81585b0 0x7fa4c80c74f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54532/0 (socket says 172.21.15.29:54532) 2024-01-25T15:05:47.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.837+0000 7fa4ce49e640 1 -- 172.21.15.29:0/1989060428 learned_addr learned my addr 172.21.15.29:0/1989060428 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:47.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.837+0000 7fa4cdc9d640 1 --2- 172.21.15.29:0/1989060428 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4c8151f80 0x7fa4c80c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:47.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.837+0000 7fa4ccc9b640 1 -- 172.21.15.29:0/1989060428 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082088309 0 0) 0x7fa4c8158120 con 0x7fa4c81585b0 2024-01-25T15:05:47.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.837+0000 7fa4ccc9b640 1 -- 172.21.15.29:0/1989060428 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4b0003520 con 0x7fa4c81585b0 2024-01-25T15:05:47.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.837+0000 7fa4cd49c640 1 -- 172.21.15.29:0/1989060428 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4c8151f80 msgr2=0x7fa4c80c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:47.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.837+0000 7fa4cd49c640 1 --2- 172.21.15.29:0/1989060428 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4c8151f80 0x7fa4c80c6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.837+0000 7fa4cd49c640 1 -- 172.21.15.29:0/1989060428 >> v1:172.21.15.29:6789/0 conn(0x7fa4c81585b0 legacy=0x7fa4c80c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:47.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.837+0000 7fa4cd49c640 1 -- 172.21.15.29:0/1989060428 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c80c5090 con 0x7fa4c80c48d0 2024-01-25T15:05:47.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.837+0000 7fa4cdc9d640 1 --2- 172.21.15.29:0/1989060428 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4c8151f80 0x7fa4c80c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:47.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.838+0000 7fa4cd49c640 1 --2- 172.21.15.29:0/1989060428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c80c48d0 0x7fa4c8155190 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0097a0 tx=0x7fa4bc02b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18537ab83fee3d70 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:47.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.838+0000 7fa4ccc9b640 1 -- 172.21.15.29:0/1989060428 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc030800 con 0x7fa4c80c48d0 2024-01-25T15:05:47.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.838+0000 7fa4ccc9b640 1 -- 172.21.15.29:0/1989060428 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc030960 con 0x7fa4c80c48d0 2024-01-25T15:05:47.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.838+0000 7fa4ccc9b640 1 -- 172.21.15.29:0/1989060428 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc030cf0 con 0x7fa4c80c48d0 2024-01-25T15:05:47.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.839+0000 7fa4cff01640 1 -- 172.21.15.29:0/1989060428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c80c48d0 msgr2=0x7fa4c8155190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:47.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.839+0000 7fa4cff01640 1 --2- 172.21.15.29:0/1989060428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c80c48d0 0x7fa4c8155190 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0097a0 tx=0x7fa4bc02b940 comp rx=0 tx=0).stop 2024-01-25T15:05:47.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.839+0000 7fa4cff01640 1 -- 172.21.15.29:0/1989060428 shutdown_connections 2024-01-25T15:05:47.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.839+0000 7fa4cff01640 1 --2- 172.21.15.29:0/1989060428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c80c48d0 0x7fa4c8155190 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.839+0000 7fa4cff01640 1 --2- 172.21.15.29:0/1989060428 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4c8151f80 0x7fa4c80c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.839+0000 7fa4cff01640 1 -- 172.21.15.29:0/1989060428 >> 172.21.15.29:0/1989060428 conn(0x7fa4c80c7f10 msgr2=0x7fa4c80c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:47.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.839+0000 7fa4cff01640 1 -- 172.21.15.29:0/1989060428 shutdown_connections 2024-01-25T15:05:47.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.839+0000 7fa4cff01640 1 -- 172.21.15.29:0/1989060428 wait complete. 2024-01-25T15:05:47.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.840+0000 7fa4cff01640 1 Processor -- start 2024-01-25T15:05:47.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.840+0000 7fa4cff01640 1 -- start start 2024-01-25T15:05:47.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.841+0000 7fa4cff01640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c80c48d0 0x7fa4c80c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:47.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.841+0000 7fa4cff01640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4c8151f80 0x7fa4c80aa500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:47.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.841+0000 7fa4cff01640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4c81585b0 0x7fa4c814c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:47.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.841+0000 7fa4cff01640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c81e9c20 con 0x7fa4c80c48d0 2024-01-25T15:05:47.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.841+0000 7fa4cff01640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c81e9f00 con 0x7fa4c8151f80 2024-01-25T15:05:47.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.841+0000 7fa4cff01640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c81ea1e0 con 0x7fa4c81585b0 2024-01-25T15:05:47.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.841+0000 7fa4cdc9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c80c48d0 0x7fa4c80c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:47.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.841+0000 7fa4cdc9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c80c48d0 0x7fa4c80c2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55558/0 (socket says 172.21.15.29:55558) 2024-01-25T15:05:47.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.841+0000 7fa4cdc9d640 1 -- 172.21.15.29:0/2213408741 learned_addr learned my addr 172.21.15.29:0/2213408741 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:47.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.841+0000 7fa4ce49e640 1 --2- 172.21.15.29:0/2213408741 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4c81585b0 0x7fa4c814c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:47.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.841+0000 7fa4cd49c640 1 --2- 172.21.15.29:0/2213408741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4c8151f80 0x7fa4c80aa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:47.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.841+0000 7fa4cdc9d640 1 -- 172.21.15.29:0/2213408741 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4c81585b0 msgr2=0x7fa4c814c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:47.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.841+0000 7fa4cdc9d640 1 --2- 172.21.15.29:0/2213408741 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4c81585b0 0x7fa4c814c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.841+0000 7fa4cdc9d640 1 -- 172.21.15.29:0/2213408741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4c8151f80 msgr2=0x7fa4c80aa500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:47.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.841+0000 7fa4cdc9d640 1 --2- 172.21.15.29:0/2213408741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4c8151f80 0x7fa4c80aa500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:47.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.841+0000 7fa4cdc9d640 1 -- 172.21.15.29:0/2213408741 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc009400 con 0x7fa4c80c48d0 2024-01-25T15:05:47.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.841+0000 7fa4cdc9d640 1 --2- 172.21.15.29:0/2213408741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c80c48d0 0x7fa4c80c2a80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000e730 tx=0x7fa4c000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:47.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.842+0000 7fa4c67fc640 1 -- 172.21.15.29:0/2213408741 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0004230 con 0x7fa4c80c48d0 2024-01-25T15:05:47.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.842+0000 7fa4c67fc640 1 -- 172.21.15.29:0/2213408741 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c0004390 con 0x7fa4c80c48d0 2024-01-25T15:05:47.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.842+0000 7fa4cff01640 1 -- 172.21.15.29:0/2213408741 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c81ea4c0 con 0x7fa4c80c48d0 2024-01-25T15:05:47.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.842+0000 7fa4c67fc640 1 -- 172.21.15.29:0/2213408741 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c000c8f0 con 0x7fa4c80c48d0 2024-01-25T15:05:47.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.842+0000 7fa4cff01640 1 -- 172.21.15.29:0/2213408741 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c80c2fc0 con 0x7fa4c80c48d0 2024-01-25T15:05:47.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.843+0000 7fa4cff01640 1 -- 172.21.15.29:0/2213408741 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c804eb10 con 0x7fa4c80c48d0 2024-01-25T15:05:47.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.843+0000 7fa4c67fc640 1 -- 172.21.15.29:0/2213408741 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fa4c000ca50 con 0x7fa4c80c48d0 2024-01-25T15:05:47.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.843+0000 7fa4c67fc640 1 --2- 172.21.15.29:0/2213408741 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa4b406aed0 0x7fa4b406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:47.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.843+0000 7fa4c67fc640 1 -- 172.21.15.29:0/2213408741 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fa4c00896a0 con 0x7fa4c80c48d0 2024-01-25T15:05:47.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.844+0000 7fa4cd49c640 1 --2- 172.21.15.29:0/2213408741 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa4b406aed0 0x7fa4b406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:47.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.844+0000 7fa4cd49c640 1 --2- 172.21.15.29:0/2213408741 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa4b406aed0 0x7fa4b406d390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc036000 tx=0x7fa4bc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:47.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:47.848+0000 7fa4c67fc640 1 -- 172.21.15.29:0/2213408741 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fa4c0054160 con 0x7fa4c80c48d0 2024-01-25T15:05:48.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.025+0000 7fa4cff01640 1 -- 172.21.15.29:0/2213408741 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa4c8074010 con 0x7fa4c80c48d0 2024-01-25T15:05:48.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.026+0000 7fa4c67fc640 1 -- 172.21.15.29:0/2213408741 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa4c0057780 con 0x7fa4c80c48d0 2024-01-25T15:05:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-25T15:05:48.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.028+0000 7fa4cff01640 1 -- 172.21.15.29:0/2213408741 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa4b406aed0 msgr2=0x7fa4b406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:48.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.028+0000 7fa4cff01640 1 --2- 172.21.15.29:0/2213408741 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa4b406aed0 0x7fa4b406d390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc036000 tx=0x7fa4bc008030 comp rx=0 tx=0).stop 2024-01-25T15:05:48.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.028+0000 7fa4cff01640 1 -- 172.21.15.29:0/2213408741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c80c48d0 msgr2=0x7fa4c80c2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:48.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.028+0000 7fa4cff01640 1 --2- 172.21.15.29:0/2213408741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c80c48d0 0x7fa4c80c2a80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000e730 tx=0x7fa4c000ebf0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.028+0000 7fa4cff01640 1 -- 172.21.15.29:0/2213408741 shutdown_connections 2024-01-25T15:05:48.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.028+0000 7fa4cff01640 1 --2- 172.21.15.29:0/2213408741 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4c81585b0 0x7fa4c814c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.028+0000 7fa4cff01640 1 --2- 172.21.15.29:0/2213408741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4c8151f80 0x7fa4c80aa500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.028+0000 7fa4cff01640 1 --2- 172.21.15.29:0/2213408741 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa4b406aed0 0x7fa4b406d390 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.028+0000 7fa4cff01640 1 --2- 172.21.15.29:0/2213408741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c80c48d0 0x7fa4c80c2a80 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.028+0000 7fa4cff01640 1 -- 172.21.15.29:0/2213408741 >> 172.21.15.29:0/2213408741 conn(0x7fa4c80c7f10 msgr2=0x7fa4c8155ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:48.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.028+0000 7fa4cff01640 1 -- 172.21.15.29:0/2213408741 shutdown_connections 2024-01-25T15:05:48.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.028+0000 7fa4cff01640 1 -- 172.21.15.29:0/2213408741 wait complete. 2024-01-25T15:05:48.039 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:05:48.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.142+0000 7f30c6aad640 1 Processor -- start 2024-01-25T15:05:48.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.143+0000 7f30c6aad640 1 -- start start 2024-01-25T15:05:48.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.143+0000 7f30c6aad640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f30c00af6c0 0x7f30c00c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:48.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.143+0000 7f30c6aad640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30c006d560 0x7f30c006b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:48.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.143+0000 7f30c6aad640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c00afaa0 con 0x7f30c00c5a70 2024-01-25T15:05:48.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.143+0000 7f30c6aad640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c006c480 con 0x7f30c00af6c0 2024-01-25T15:05:48.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.143+0000 7f30c6aad640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c0155290 con 0x7f30c006d560 2024-01-25T15:05:48.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.143+0000 7f30c4849640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f30c00af6c0 0x7f30c00c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:48.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.143+0000 7f30c4849640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f30c00af6c0 0x7f30c00c5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55570/0 (socket says 172.21.15.29:55570) 2024-01-25T15:05:48.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.143+0000 7f30c4849640 1 -- 172.21.15.29:0/4104308609 learned_addr learned my addr 172.21.15.29:0/4104308609 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:48.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.143+0000 7f30c504a640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f30c00c5a70 0x7f30c006b760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54536/0 (socket says 172.21.15.29:54536) 2024-01-25T15:05:48.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.144+0000 7f30bffff640 1 --2- 172.21.15.29:0/4104308609 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30c006d560 0x7f30c006b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:48.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.144+0000 7f30c4849640 1 -- 172.21.15.29:0/4104308609 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30c006d560 msgr2=0x7f30c006b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:48.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.144+0000 7f30c4849640 1 --2- 172.21.15.29:0/4104308609 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30c006d560 0x7f30c006b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.144+0000 7f30c4849640 1 -- 172.21.15.29:0/4104308609 >> v1:172.21.15.29:6789/0 conn(0x7f30c00c5a70 legacy=0x7f30c006b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:48.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.144+0000 7f30bf7fe640 1 -- 172.21.15.29:0/4104308609 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 580887591 0 0) 0x7f30c00afaa0 con 0x7f30c00c5a70 2024-01-25T15:05:48.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.144+0000 7f30c4849640 1 -- 172.21.15.29:0/4104308609 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c00c6060 con 0x7f30c00af6c0 2024-01-25T15:05:48.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.144+0000 7f30bffff640 1 --2- 172.21.15.29:0/4104308609 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30c006d560 0x7f30c006b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:48.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.144+0000 7f30c4849640 1 --2- 172.21.15.29:0/4104308609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30c00af6c0 0x7f30c00c5530 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009870 tx=0x7f30b402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d1494ffb068efd server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:48.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.145+0000 7f30bf7fe640 1 -- 172.21.15.29:0/4104308609 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4030840 con 0x7f30c00af6c0 2024-01-25T15:05:48.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.145+0000 7f30bf7fe640 1 -- 172.21.15.29:0/4104308609 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b40309a0 con 0x7f30c00af6c0 2024-01-25T15:05:48.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.145+0000 7f30bf7fe640 1 -- 172.21.15.29:0/4104308609 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4030d30 con 0x7f30c00af6c0 2024-01-25T15:05:48.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.145+0000 7f30c6aad640 1 -- 172.21.15.29:0/4104308609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30c00af6c0 msgr2=0x7f30c00c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:48.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.145+0000 7f30c6aad640 1 --2- 172.21.15.29:0/4104308609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30c00af6c0 0x7f30c00c5530 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009870 tx=0x7f30b402b980 comp rx=0 tx=0).stop 2024-01-25T15:05:48.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.145+0000 7f30c6aad640 1 -- 172.21.15.29:0/4104308609 shutdown_connections 2024-01-25T15:05:48.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.145+0000 7f30c6aad640 1 --2- 172.21.15.29:0/4104308609 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30c006d560 0x7f30c006b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.145+0000 7f30c6aad640 1 --2- 172.21.15.29:0/4104308609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30c00af6c0 0x7f30c00c5530 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.145+0000 7f30c6aad640 1 -- 172.21.15.29:0/4104308609 >> 172.21.15.29:0/4104308609 conn(0x7f30c00c6ca0 msgr2=0x7f30c00c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:48.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.145+0000 7f30c6aad640 1 -- 172.21.15.29:0/4104308609 shutdown_connections 2024-01-25T15:05:48.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.145+0000 7f30c6aad640 1 -- 172.21.15.29:0/4104308609 wait complete. 2024-01-25T15:05:48.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.146+0000 7f30c6aad640 1 Processor -- start 2024-01-25T15:05:48.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.146+0000 7f30c6aad640 1 -- start start 2024-01-25T15:05:48.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.147+0000 7f30c6aad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30c006d560 0x7f30c01ed5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:48.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.147+0000 7f30c6aad640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30c00af6c0 0x7f30c014cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:48.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.147+0000 7f30c6aad640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30c00c5a70 0x7f30c0155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:48.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.147+0000 7f30c6aad640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c014b940 con 0x7f30c00c5a70 2024-01-25T15:05:48.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.147+0000 7f30c6aad640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c01ee260 con 0x7f30c006d560 2024-01-25T15:05:48.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.147+0000 7f30c6aad640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c014b1b0 con 0x7f30c00af6c0 2024-01-25T15:05:48.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.147+0000 7f30c504a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30c00c5a70 0x7f30c0155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:48.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.147+0000 7f30c504a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30c00c5a70 0x7f30c0155bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55580/0 (socket says 172.21.15.29:55580) 2024-01-25T15:05:48.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.147+0000 7f30c504a640 1 -- 172.21.15.29:0/3392240571 learned_addr learned my addr 172.21.15.29:0/3392240571 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:48.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.147+0000 7f30bffff640 1 --2- 172.21.15.29:0/3392240571 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30c00af6c0 0x7f30c014cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:48.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.147+0000 7f30c4849640 1 --2- 172.21.15.29:0/3392240571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30c006d560 0x7f30c01ed5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:48.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.147+0000 7f30c504a640 1 -- 172.21.15.29:0/3392240571 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30c00af6c0 msgr2=0x7f30c014cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:48.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.147+0000 7f30c504a640 1 --2- 172.21.15.29:0/3392240571 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30c00af6c0 0x7f30c014cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.147+0000 7f30c504a640 1 -- 172.21.15.29:0/3392240571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30c006d560 msgr2=0x7f30c01ed5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:48.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.147+0000 7f30c504a640 1 --2- 172.21.15.29:0/3392240571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30c006d560 0x7f30c01ed5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.147+0000 7f30c504a640 1 -- 172.21.15.29:0/3392240571 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b40094d0 con 0x7f30c00c5a70 2024-01-25T15:05:48.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.148+0000 7f30c4849640 1 --2- 172.21.15.29:0/3392240571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30c006d560 0x7f30c01ed5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:48.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.148+0000 7f30c504a640 1 --2- 172.21.15.29:0/3392240571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30c00c5a70 0x7f30c0155bd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f30b800c6d0 tx=0x7f30b800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:48.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.148+0000 7f30bd7fa640 1 -- 172.21.15.29:0/3392240571 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b8004d60 con 0x7f30c00c5a70 2024-01-25T15:05:48.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.148+0000 7f30bd7fa640 1 -- 172.21.15.29:0/3392240571 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b800a640 con 0x7f30c00c5a70 2024-01-25T15:05:48.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.148+0000 7f30bd7fa640 1 -- 172.21.15.29:0/3392240571 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b800aa70 con 0x7f30c00c5a70 2024-01-25T15:05:48.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.148+0000 7f30c6aad640 1 -- 172.21.15.29:0/3392240571 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c01edef0 con 0x7f30c00c5a70 2024-01-25T15:05:48.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.148+0000 7f30c6aad640 1 -- 172.21.15.29:0/3392240571 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c00c1600 con 0x7f30c00c5a70 2024-01-25T15:05:48.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.149+0000 7f30c6aad640 1 -- 172.21.15.29:0/3392240571 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c0074010 con 0x7f30c00c5a70 2024-01-25T15:05:48.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.149+0000 7f30bd7fa640 1 -- 172.21.15.29:0/3392240571 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f30b80070d0 con 0x7f30c00c5a70 2024-01-25T15:05:48.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.150+0000 7f30bd7fa640 1 --2- 172.21.15.29:0/3392240571 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f30a406aed0 0x7f30a406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:48.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.150+0000 7f30bd7fa640 1 -- 172.21.15.29:0/3392240571 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f30b80891c0 con 0x7f30c00c5a70 2024-01-25T15:05:48.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.150+0000 7f30c4849640 1 --2- 172.21.15.29:0/3392240571 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f30a406aed0 0x7f30a406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:48.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.150+0000 7f30c4849640 1 --2- 172.21.15.29:0/3392240571 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f30a406aed0 0x7f30a406d390 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f30b4036000 tx=0x7f30b403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.154+0000 7f30bd7fa640 1 -- 172.21.15.29:0/3392240571 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f30b8053be0 con 0x7f30c00c5a70 2024-01-25T15:05:48.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.336+0000 7f30c6aad640 1 -- 172.21.15.29:0/3392240571 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f30c0158680 con 0x7f30c00c5a70 2024-01-25T15:05:48.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.336+0000 7f30bd7fa640 1 -- 172.21.15.29:0/3392240571 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f30b8057200 con 0x7f30c00c5a70 2024-01-25T15:05:48.337 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:48.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.338+0000 7f30c6aad640 1 -- 172.21.15.29:0/3392240571 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f30a406aed0 msgr2=0x7f30a406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:48.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.338+0000 7f30c6aad640 1 --2- 172.21.15.29:0/3392240571 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f30a406aed0 0x7f30a406d390 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f30b4036000 tx=0x7f30b403b040 comp rx=0 tx=0).stop 2024-01-25T15:05:48.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.338+0000 7f30c6aad640 1 -- 172.21.15.29:0/3392240571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30c00c5a70 msgr2=0x7f30c0155bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:48.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.338+0000 7f30c6aad640 1 --2- 172.21.15.29:0/3392240571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30c00c5a70 0x7f30c0155bd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f30b800c6d0 tx=0x7f30b800cb90 comp rx=0 tx=0).stop 2024-01-25T15:05:48.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.339+0000 7f30c6aad640 1 -- 172.21.15.29:0/3392240571 shutdown_connections 2024-01-25T15:05:48.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.339+0000 7f30c6aad640 1 --2- 172.21.15.29:0/3392240571 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f30a406aed0 0x7f30a406d390 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.339+0000 7f30c6aad640 1 --2- 172.21.15.29:0/3392240571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30c00c5a70 0x7f30c0155bd0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.339+0000 7f30c6aad640 1 --2- 172.21.15.29:0/3392240571 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30c00af6c0 0x7f30c014cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.339+0000 7f30c6aad640 1 --2- 172.21.15.29:0/3392240571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30c006d560 0x7f30c01ed5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.339+0000 7f30c6aad640 1 -- 172.21.15.29:0/3392240571 >> 172.21.15.29:0/3392240571 conn(0x7f30c00c6ca0 msgr2=0x7f30c00c7080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:48.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.339+0000 7f30c6aad640 1 -- 172.21.15.29:0/3392240571 shutdown_connections 2024-01-25T15:05:48.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.339+0000 7f30c6aad640 1 -- 172.21.15.29:0/3392240571 wait complete. 2024-01-25T15:05:48.350 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:05:48.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.453+0000 7fb045f2c640 1 Processor -- start 2024-01-25T15:05:48.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.453+0000 7fb045f2c640 1 -- start start 2024-01-25T15:05:48.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.454+0000 7fb045f2c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0400c5ef0 0x7fb040154860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:48.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.454+0000 7fb045f2c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb0400c6e10 0x7fb0400c6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:48.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.454+0000 7fb045f2c640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb040157db0 con 0x7fb040151ff0 2024-01-25T15:05:48.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.454+0000 7fb045f2c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb040158090 con 0x7fb0400c6e10 2024-01-25T15:05:48.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.454+0000 7fb045f2c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0400c7390 con 0x7fb0400c5ef0 2024-01-25T15:05:48.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.454+0000 7fb03ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb0400c6e10 0x7fb0400c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:48.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.454+0000 7fb03ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb0400c6e10 0x7fb0400c6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55590/0 (socket says 172.21.15.29:55590) 2024-01-25T15:05:48.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.454+0000 7fb03ffff640 1 -- 172.21.15.29:0/2702675970 learned_addr learned my addr 172.21.15.29:0/2702675970 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:48.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.454+0000 7fb03effd640 1 --2- 172.21.15.29:0/2702675970 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0400c5ef0 0x7fb040154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:48.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.455+0000 7fb03ffff640 1 -- 172.21.15.29:0/2702675970 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0400c5ef0 msgr2=0x7fb040154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:48.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.455+0000 7fb03ffff640 1 --2- 172.21.15.29:0/2702675970 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0400c5ef0 0x7fb040154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.455+0000 7fb03ffff640 1 -- 172.21.15.29:0/2702675970 >> v1:172.21.15.52:6789/0 conn(0x7fb040151ff0 legacy=0x7fb040158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.455+0000 7fb03ffff640 1 -- 172.21.15.29:0/2702675970 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb040158c30 con 0x7fb0400c6e10 2024-01-25T15:05:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.455+0000 7fb03ffff640 1 --2- 172.21.15.29:0/2702675970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0400c6e10 0x7fb0400c6390 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb038009e50 tx=0x7fb03802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c163995de2282b server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.455+0000 7fb03e7fc640 1 -- 172.21.15.29:0/2702675970 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03802c9e0 con 0x7fb0400c6e10 2024-01-25T15:05:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.456+0000 7fb03e7fc640 1 -- 172.21.15.29:0/2702675970 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03802cb40 con 0x7fb0400c6e10 2024-01-25T15:05:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.456+0000 7fb03e7fc640 1 -- 172.21.15.29:0/2702675970 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0380343f0 con 0x7fb0400c6e10 2024-01-25T15:05:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.456+0000 7fb045f2c640 1 -- 172.21.15.29:0/2702675970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0400c6e10 msgr2=0x7fb0400c6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.456+0000 7fb045f2c640 1 --2- 172.21.15.29:0/2702675970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0400c6e10 0x7fb0400c6390 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb038009e50 tx=0x7fb03802be40 comp rx=0 tx=0).stop 2024-01-25T15:05:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.456+0000 7fb045f2c640 1 -- 172.21.15.29:0/2702675970 shutdown_connections 2024-01-25T15:05:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.456+0000 7fb045f2c640 1 --2- 172.21.15.29:0/2702675970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0400c6e10 0x7fb0400c6390 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.456+0000 7fb045f2c640 1 --2- 172.21.15.29:0/2702675970 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb0400c5ef0 0x7fb040154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.456+0000 7fb045f2c640 1 -- 172.21.15.29:0/2702675970 >> 172.21.15.29:0/2702675970 conn(0x7fb0400c7f80 msgr2=0x7fb0400c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.456+0000 7fb045f2c640 1 -- 172.21.15.29:0/2702675970 shutdown_connections 2024-01-25T15:05:48.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.456+0000 7fb045f2c640 1 -- 172.21.15.29:0/2702675970 wait complete. 2024-01-25T15:05:48.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.457+0000 7fb045f2c640 1 Processor -- start 2024-01-25T15:05:48.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.457+0000 7fb045f2c640 1 -- start start 2024-01-25T15:05:48.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.458+0000 7fb045f2c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0400c6e10 0x7fb0401ee0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:48.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.458+0000 7fb045f2c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb040151ff0 0x7fb0401eaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:48.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.458+0000 7fb045f2c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb040153500 0x7fb04009d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:48.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.458+0000 7fb045f2c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0401edc60 con 0x7fb040153500 2024-01-25T15:05:48.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.458+0000 7fb045f2c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0401eaf60 con 0x7fb0400c6e10 2024-01-25T15:05:48.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.458+0000 7fb045f2c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb040153aa0 con 0x7fb040151ff0 2024-01-25T15:05:48.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.458+0000 7fb03ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb040153500 0x7fb04009d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:48.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.458+0000 7fb03ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb040153500 0x7fb04009d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55606/0 (socket says 172.21.15.29:55606) 2024-01-25T15:05:48.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.458+0000 7fb03ffff640 1 -- 172.21.15.29:0/3889923329 learned_addr learned my addr 172.21.15.29:0/3889923329 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:48.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.458+0000 7fb03effd640 1 --2- 172.21.15.29:0/3889923329 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb040151ff0 0x7fb0401eaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:48.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.458+0000 7fb03f7fe640 1 --2- 172.21.15.29:0/3889923329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0400c6e10 0x7fb0401ee0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:48.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.458+0000 7fb03ffff640 1 -- 172.21.15.29:0/3889923329 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb040151ff0 msgr2=0x7fb0401eaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:48.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.458+0000 7fb03ffff640 1 --2- 172.21.15.29:0/3889923329 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb040151ff0 0x7fb0401eaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.458+0000 7fb03ffff640 1 -- 172.21.15.29:0/3889923329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0400c6e10 msgr2=0x7fb0401ee0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:48.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.458+0000 7fb03ffff640 1 --2- 172.21.15.29:0/3889923329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0400c6e10 0x7fb0401ee0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.458+0000 7fb03ffff640 1 -- 172.21.15.29:0/3889923329 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb038009b30 con 0x7fb040153500 2024-01-25T15:05:48.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.459+0000 7fb03ffff640 1 --2- 172.21.15.29:0/3889923329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb040153500 0x7fb04009d1e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb038009e50 tx=0x7fb038004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:48.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.459+0000 7fb027fff640 1 -- 172.21.15.29:0/3889923329 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb038009510 con 0x7fb040153500 2024-01-25T15:05:48.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.459+0000 7fb027fff640 1 -- 172.21.15.29:0/3889923329 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03803e450 con 0x7fb040153500 2024-01-25T15:05:48.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.459+0000 7fb045f2c640 1 -- 172.21.15.29:0/3889923329 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0401ed610 con 0x7fb040153500 2024-01-25T15:05:48.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.459+0000 7fb027fff640 1 -- 172.21.15.29:0/3889923329 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03803e800 con 0x7fb040153500 2024-01-25T15:05:48.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.459+0000 7fb045f2c640 1 -- 172.21.15.29:0/3889923329 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04009d720 con 0x7fb040153500 2024-01-25T15:05:48.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.460+0000 7fb045f2c640 1 -- 172.21.15.29:0/3889923329 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0401ede10 con 0x7fb040153500 2024-01-25T15:05:48.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.460+0000 7fb027fff640 1 -- 172.21.15.29:0/3889923329 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fb03803e960 con 0x7fb040153500 2024-01-25T15:05:48.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.461+0000 7fb027fff640 1 --2- 172.21.15.29:0/3889923329 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb02c06aed0 0x7fb02c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:48.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.461+0000 7fb027fff640 1 -- 172.21.15.29:0/3889923329 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fb0380ac660 con 0x7fb040153500 2024-01-25T15:05:48.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.461+0000 7fb03f7fe640 1 --2- 172.21.15.29:0/3889923329 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb02c06aed0 0x7fb02c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:48.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.461+0000 7fb03f7fe640 1 --2- 172.21.15.29:0/3889923329 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb02c06aed0 0x7fb02c06d390 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb030007fd0 tx=0x7fb030009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:48.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.465+0000 7fb027fff640 1 -- 172.21.15.29:0/3889923329 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fb0401ede10 con 0x7fb040153500 2024-01-25T15:05:48.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.646+0000 7fb045f2c640 1 -- 172.21.15.29:0/3889923329 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb040074010 con 0x7fb040153500 2024-01-25T15:05:48.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.646+0000 7fb027fff640 1 -- 172.21.15.29:0/3889923329 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb038077120 con 0x7fb040153500 2024-01-25T15:05:48.647 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-25T15:05:48.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.648+0000 7fb045f2c640 1 -- 172.21.15.29:0/3889923329 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb02c06aed0 msgr2=0x7fb02c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:48.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.648+0000 7fb045f2c640 1 --2- 172.21.15.29:0/3889923329 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb02c06aed0 0x7fb02c06d390 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb030007fd0 tx=0x7fb030009040 comp rx=0 tx=0).stop 2024-01-25T15:05:48.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.648+0000 7fb045f2c640 1 -- 172.21.15.29:0/3889923329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb040153500 msgr2=0x7fb04009d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:48.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.648+0000 7fb045f2c640 1 --2- 172.21.15.29:0/3889923329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb040153500 0x7fb04009d1e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb038009e50 tx=0x7fb038004a40 comp rx=0 tx=0).stop 2024-01-25T15:05:48.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.649+0000 7fb045f2c640 1 -- 172.21.15.29:0/3889923329 shutdown_connections 2024-01-25T15:05:48.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.649+0000 7fb045f2c640 1 --2- 172.21.15.29:0/3889923329 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb02c06aed0 0x7fb02c06d390 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.649+0000 7fb045f2c640 1 --2- 172.21.15.29:0/3889923329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb040153500 0x7fb04009d1e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.649+0000 7fb045f2c640 1 --2- 172.21.15.29:0/3889923329 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb040151ff0 0x7fb0401eaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.649+0000 7fb045f2c640 1 --2- 172.21.15.29:0/3889923329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0400c6e10 0x7fb0401ee0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.649+0000 7fb045f2c640 1 -- 172.21.15.29:0/3889923329 >> 172.21.15.29:0/3889923329 conn(0x7fb0400c7f80 msgr2=0x7fb0401567c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:48.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.649+0000 7fb045f2c640 1 -- 172.21.15.29:0/3889923329 shutdown_connections 2024-01-25T15:05:48.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.649+0000 7fb045f2c640 1 -- 172.21.15.29:0/3889923329 wait complete. 2024-01-25T15:05:48.660 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-25T15:05:48.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.764+0000 7f9aca3d1640 1 Processor -- start 2024-01-25T15:05:48.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.764+0000 7f9aca3d1640 1 -- start start 2024-01-25T15:05:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.765+0000 7f9aca3d1640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ac40c4a10 0x7f9ac40c7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.765+0000 7f9aca3d1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9ac4158950 0x7f9ac40c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.765+0000 7f9aca3d1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9ac41551c0 0x7f9ac40c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.765+0000 7f9aca3d1640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac40c7e40 con 0x7f9ac41551c0 2024-01-25T15:05:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.765+0000 7f9aca3d1640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac4070e20 con 0x7f9ac4158950 2024-01-25T15:05:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.765+0000 7f9aca3d1640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40c7b60 con 0x7f9ac40c4a10 2024-01-25T15:05:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.765+0000 7f9ac896e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9ac41551c0 0x7f9ac40c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.765+0000 7f9ac896e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9ac41551c0 0x7f9ac40c60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55610/0 (socket says 172.21.15.29:55610) 2024-01-25T15:05:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.765+0000 7f9ac896e640 1 -- 172.21.15.29:0/3823565427 learned_addr learned my addr 172.21.15.29:0/3823565427 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.765+0000 7f9ac3fff640 1 --2- 172.21.15.29:0/3823565427 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ac40c4a10 0x7f9ac40c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.765+0000 7f9ac37fe640 1 --2- 172.21.15.29:0/3823565427 >> v2:172.21.15.52:3300/0 conn(0x7f9ac4158950 0x7f9ac40c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.765+0000 7f9ac896e640 1 -- 172.21.15.29:0/3823565427 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ac40c4a10 msgr2=0x7f9ac40c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.765+0000 7f9ac896e640 1 --2- 172.21.15.29:0/3823565427 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ac40c4a10 0x7f9ac40c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.765+0000 7f9ac896e640 1 -- 172.21.15.29:0/3823565427 >> v2:172.21.15.52:3300/0 conn(0x7f9ac4158950 msgr2=0x7f9ac40c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:48.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.765+0000 7f9ac896e640 1 --2- 172.21.15.29:0/3823565427 >> v2:172.21.15.52:3300/0 conn(0x7f9ac4158950 0x7f9ac40c4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.765+0000 7f9ac896e640 1 -- 172.21.15.29:0/3823565427 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac4157e70 con 0x7f9ac41551c0 2024-01-25T15:05:48.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.766+0000 7f9ac896e640 1 --2- 172.21.15.29:0/3823565427 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ac41551c0 0x7f9ac40c60a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4071f90 tx=0x7f9abc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808007f7291801c0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:48.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.766+0000 7f9ac2ffd640 1 -- 172.21.15.29:0/3823565427 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc02ca70 con 0x7f9ac41551c0 2024-01-25T15:05:48.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.766+0000 7f9ac2ffd640 1 -- 172.21.15.29:0/3823565427 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc02cbd0 con 0x7f9ac41551c0 2024-01-25T15:05:48.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.766+0000 7f9ac2ffd640 1 -- 172.21.15.29:0/3823565427 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0343f0 con 0x7f9ac41551c0 2024-01-25T15:05:48.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.767+0000 7f9aca3d1640 1 -- 172.21.15.29:0/3823565427 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ac41551c0 msgr2=0x7f9ac40c60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:48.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.767+0000 7f9aca3d1640 1 --2- 172.21.15.29:0/3823565427 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ac41551c0 0x7f9ac40c60a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4071f90 tx=0x7f9abc02bed0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.767+0000 7f9aca3d1640 1 -- 172.21.15.29:0/3823565427 shutdown_connections 2024-01-25T15:05:48.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.767+0000 7f9aca3d1640 1 --2- 172.21.15.29:0/3823565427 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ac41551c0 0x7f9ac40c60a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.767+0000 7f9aca3d1640 1 --2- 172.21.15.29:0/3823565427 >> v2:172.21.15.52:3300/0 conn(0x7f9ac4158950 0x7f9ac40c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.767+0000 7f9aca3d1640 1 --2- 172.21.15.29:0/3823565427 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ac40c4a10 0x7f9ac40c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.767+0000 7f9aca3d1640 1 -- 172.21.15.29:0/3823565427 >> 172.21.15.29:0/3823565427 conn(0x7f9ac40c7f80 msgr2=0x7f9ac40c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:48.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.767+0000 7f9aca3d1640 1 -- 172.21.15.29:0/3823565427 shutdown_connections 2024-01-25T15:05:48.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.767+0000 7f9aca3d1640 1 -- 172.21.15.29:0/3823565427 wait complete. 2024-01-25T15:05:48.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.768+0000 7f9aca3d1640 1 Processor -- start 2024-01-25T15:05:48.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.768+0000 7f9aca3d1640 1 -- start start 2024-01-25T15:05:48.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.769+0000 7f9aca3d1640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ac40c4a10 0x7f9ac409bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:48.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.769+0000 7f9aca3d1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac41551c0 0x7f9ac4153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:48.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.769+0000 7f9aca3d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ac4158950 0x7f9ac41ea1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:48.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.769+0000 7f9aca3d1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac41eaab0 con 0x7f9ac4158950 2024-01-25T15:05:48.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.769+0000 7f9aca3d1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac41ead90 con 0x7f9ac41551c0 2024-01-25T15:05:48.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.769+0000 7f9aca3d1640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac41eb070 con 0x7f9ac40c4a10 2024-01-25T15:05:48.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.769+0000 7f9ac896e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ac4158950 0x7f9ac41ea1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:48.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.769+0000 7f9ac896e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ac4158950 0x7f9ac41ea1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55628/0 (socket says 172.21.15.29:55628) 2024-01-25T15:05:48.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.769+0000 7f9ac896e640 1 -- 172.21.15.29:0/460129162 learned_addr learned my addr 172.21.15.29:0/460129162 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:48.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.769+0000 7f9ac3fff640 1 --2- 172.21.15.29:0/460129162 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ac40c4a10 0x7f9ac409bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:48.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.769+0000 7f9ac37fe640 1 --2- 172.21.15.29:0/460129162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac41551c0 0x7f9ac4153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:48.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.769+0000 7f9ac896e640 1 -- 172.21.15.29:0/460129162 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ac40c4a10 msgr2=0x7f9ac409bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:48.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.769+0000 7f9ac896e640 1 --2- 172.21.15.29:0/460129162 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ac40c4a10 0x7f9ac409bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.769+0000 7f9ac896e640 1 -- 172.21.15.29:0/460129162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac41551c0 msgr2=0x7f9ac4153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:48.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.769+0000 7f9ac896e640 1 --2- 172.21.15.29:0/460129162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac41551c0 0x7f9ac4153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.769+0000 7f9ac896e640 1 -- 172.21.15.29:0/460129162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc009b30 con 0x7f9ac4158950 2024-01-25T15:05:48.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.769+0000 7f9ac896e640 1 --2- 172.21.15.29:0/460129162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ac4158950 0x7f9ac41ea1f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9abc036040 tx=0x7f9abc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:48.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.769+0000 7f9ac0ff9640 1 -- 172.21.15.29:0/460129162 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc009510 con 0x7f9ac4158950 2024-01-25T15:05:48.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.769+0000 7f9ac0ff9640 1 -- 172.21.15.29:0/460129162 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc03e450 con 0x7f9ac4158950 2024-01-25T15:05:48.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.769+0000 7f9aca3d1640 1 -- 172.21.15.29:0/460129162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac4099a30 con 0x7f9ac4158950 2024-01-25T15:05:48.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.769+0000 7f9ac0ff9640 1 -- 172.21.15.29:0/460129162 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc03e800 con 0x7f9ac4158950 2024-01-25T15:05:48.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.769+0000 7f9aca3d1640 1 -- 172.21.15.29:0/460129162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac4154010 con 0x7f9ac4158950 2024-01-25T15:05:48.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.770+0000 7f9aca3d1640 1 -- 172.21.15.29:0/460129162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac404eb10 con 0x7f9ac4158950 2024-01-25T15:05:48.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.771+0000 7f9ac0ff9640 1 -- 172.21.15.29:0/460129162 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9abc03e960 con 0x7f9ac4158950 2024-01-25T15:05:48.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.771+0000 7f9ac0ff9640 1 --2- 172.21.15.29:0/460129162 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9ab006aed0 0x7f9ab006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:48.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.771+0000 7f9ac0ff9640 1 -- 172.21.15.29:0/460129162 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f9abc0ac690 con 0x7f9ac4158950 2024-01-25T15:05:48.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.772+0000 7f9ac3fff640 1 --2- 172.21.15.29:0/460129162 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9ab006aed0 0x7f9ab006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:48.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.772+0000 7f9ac3fff640 1 --2- 172.21.15.29:0/460129162 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9ab006aed0 0x7f9ab006d390 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8009b40 tx=0x7f9ab8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:48.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.775+0000 7f9ac0ff9640 1 -- 172.21.15.29:0/460129162 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f9abc077170 con 0x7f9ac4158950 2024-01-25T15:05:48.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.954+0000 7f9aca3d1640 1 -- 172.21.15.29:0/460129162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ac4099f50 con 0x7f9ac4158950 2024-01-25T15:05:48.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.955+0000 7f9ac0ff9640 1 -- 172.21.15.29:0/460129162 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v42) v1 ==== 105+0+11 (secure 0 0 0) 0x7f9ac4099f50 con 0x7f9ac4158950 2024-01-25T15:05:48.956 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:48.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.957+0000 7f9aca3d1640 1 -- 172.21.15.29:0/460129162 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9ab006aed0 msgr2=0x7f9ab006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:48.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.957+0000 7f9aca3d1640 1 --2- 172.21.15.29:0/460129162 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9ab006aed0 0x7f9ab006d390 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8009b40 tx=0x7f9ab8009190 comp rx=0 tx=0).stop 2024-01-25T15:05:48.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.957+0000 7f9aca3d1640 1 -- 172.21.15.29:0/460129162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ac4158950 msgr2=0x7f9ac41ea1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:48.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.957+0000 7f9aca3d1640 1 --2- 172.21.15.29:0/460129162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ac4158950 0x7f9ac41ea1f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9abc036040 tx=0x7f9abc004a40 comp rx=0 tx=0).stop 2024-01-25T15:05:48.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.957+0000 7f9aca3d1640 1 -- 172.21.15.29:0/460129162 shutdown_connections 2024-01-25T15:05:48.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.957+0000 7f9aca3d1640 1 --2- 172.21.15.29:0/460129162 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9ab006aed0 0x7f9ab006d390 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.957+0000 7f9aca3d1640 1 --2- 172.21.15.29:0/460129162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ac4158950 0x7f9ac41ea1f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.957+0000 7f9aca3d1640 1 --2- 172.21.15.29:0/460129162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac41551c0 0x7f9ac4153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.957+0000 7f9aca3d1640 1 --2- 172.21.15.29:0/460129162 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ac40c4a10 0x7f9ac409bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:48.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.957+0000 7f9aca3d1640 1 -- 172.21.15.29:0/460129162 >> 172.21.15.29:0/460129162 conn(0x7f9ac40c7f80 msgr2=0x7f9ac40c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:48.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.957+0000 7f9aca3d1640 1 -- 172.21.15.29:0/460129162 shutdown_connections 2024-01-25T15:05:48.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:48.957+0000 7f9aca3d1640 1 -- 172.21.15.29:0/460129162 wait complete. 2024-01-25T15:05:48.968 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-25T15:05:49.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.073+0000 7f1990456640 1 Processor -- start 2024-01-25T15:05:49.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.073+0000 7f1990456640 1 -- start start 2024-01-25T15:05:49.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.073+0000 7f1990456640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1988149190 0x7f19880c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:49.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.073+0000 7f1990456640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f19880c7820 0x7f19880c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:49.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.073+0000 7f1990456640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19880c4ee0 0x7f19881526a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:49.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.073+0000 7f1990456640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19880ad2e0 con 0x7f1988149190 2024-01-25T15:05:49.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.073+0000 7f1990456640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19880ac6f0 con 0x7f19880c7820 2024-01-25T15:05:49.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.073+0000 7f1990456640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19880ac9b0 con 0x7f19880c4ee0 2024-01-25T15:05:49.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.074+0000 7f198e1f2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1988149190 0x7f19880c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:49.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.074+0000 7f198e1f2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1988149190 0x7f19880c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55640/0 (socket says 172.21.15.29:55640) 2024-01-25T15:05:49.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.074+0000 7f198e1f2640 1 -- 172.21.15.29:0/1693392584 learned_addr learned my addr 172.21.15.29:0/1693392584 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:49.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.074+0000 7f198e1f2640 1 -- 172.21.15.29:0/1693392584 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19880c4ee0 msgr2=0x7f19881526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:49.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.074+0000 7f198e9f3640 1 --2- 172.21.15.29:0/1693392584 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19880c4ee0 0x7f19881526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:49.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.074+0000 7f198e1f2640 1 --2- 172.21.15.29:0/1693392584 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19880c4ee0 0x7f19881526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.074+0000 7f198e1f2640 1 -- 172.21.15.29:0/1693392584 >> v2:172.21.15.52:3300/0 conn(0x7f19880c7820 msgr2=0x7f19880c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:49.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.074+0000 7f198e1f2640 1 --2- 172.21.15.29:0/1693392584 >> v2:172.21.15.52:3300/0 conn(0x7f19880c7820 0x7f19880c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.074+0000 7f198e1f2640 1 -- 172.21.15.29:0/1693392584 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19880acc90 con 0x7f1988149190 2024-01-25T15:05:49.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.075+0000 7f198e1f2640 1 --2- 172.21.15.29:0/1693392584 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1988149190 0x7f19880c72e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1988150070 tx=0x7f198402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ca8421b829fe0c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:49.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.075+0000 7f198d1f0640 1 -- 172.21.15.29:0/1693392584 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984031870 con 0x7f1988149190 2024-01-25T15:05:49.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.075+0000 7f198d1f0640 1 -- 172.21.15.29:0/1693392584 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19840319d0 con 0x7f1988149190 2024-01-25T15:05:49.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.075+0000 7f198d1f0640 1 -- 172.21.15.29:0/1693392584 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984031d60 con 0x7f1988149190 2024-01-25T15:05:49.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.075+0000 7f1990456640 1 -- 172.21.15.29:0/1693392584 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1988149190 msgr2=0x7f19880c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:49.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.075+0000 7f1990456640 1 --2- 172.21.15.29:0/1693392584 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1988149190 0x7f19880c72e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1988150070 tx=0x7f198402b910 comp rx=0 tx=0).stop 2024-01-25T15:05:49.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.076+0000 7f1990456640 1 -- 172.21.15.29:0/1693392584 shutdown_connections 2024-01-25T15:05:49.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.076+0000 7f1990456640 1 --2- 172.21.15.29:0/1693392584 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19880c4ee0 0x7f19881526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.076+0000 7f1990456640 1 --2- 172.21.15.29:0/1693392584 >> v2:172.21.15.52:3300/0 conn(0x7f19880c7820 0x7f19880c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.076+0000 7f1990456640 1 --2- 172.21.15.29:0/1693392584 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1988149190 0x7f19880c72e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.076+0000 7f1990456640 1 -- 172.21.15.29:0/1693392584 >> 172.21.15.29:0/1693392584 conn(0x7f19880c7f10 msgr2=0x7f19880c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:49.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.076+0000 7f1990456640 1 -- 172.21.15.29:0/1693392584 shutdown_connections 2024-01-25T15:05:49.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.076+0000 7f1990456640 1 -- 172.21.15.29:0/1693392584 wait complete. 2024-01-25T15:05:49.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.077+0000 7f1990456640 1 Processor -- start 2024-01-25T15:05:49.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.077+0000 7f1990456640 1 -- start start 2024-01-25T15:05:49.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.077+0000 7f1990456640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19880c4ee0 0x7f1988140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:49.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.077+0000 7f1990456640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19880c7820 0x7f19881516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:49.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.077+0000 7f1990456640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1988149190 0x7f198814ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:49.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.077+0000 7f1990456640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198814ea80 con 0x7f19880c7820 2024-01-25T15:05:49.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.077+0000 7f1990456640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19881405e0 con 0x7f1988149190 2024-01-25T15:05:49.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.077+0000 7f1990456640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19881569d0 con 0x7f19880c4ee0 2024-01-25T15:05:49.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.077+0000 7f198d9f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19880c7820 0x7f19881516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:49.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.077+0000 7f198d9f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19880c7820 0x7f19881516d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55648/0 (socket says 172.21.15.29:55648) 2024-01-25T15:05:49.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.077+0000 7f198d9f1640 1 -- 172.21.15.29:0/501723046 learned_addr learned my addr 172.21.15.29:0/501723046 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:49.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.078+0000 7f198e9f3640 1 --2- 172.21.15.29:0/501723046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1988149190 0x7f198814ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:49.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.078+0000 7f198e1f2640 1 --2- 172.21.15.29:0/501723046 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19880c4ee0 0x7f1988140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:49.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.078+0000 7f198d9f1640 1 -- 172.21.15.29:0/501723046 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19880c4ee0 msgr2=0x7f1988140a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:49.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.078+0000 7f198d9f1640 1 --2- 172.21.15.29:0/501723046 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19880c4ee0 0x7f1988140a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.078+0000 7f198d9f1640 1 -- 172.21.15.29:0/501723046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1988149190 msgr2=0x7f198814ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:49.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.078+0000 7f198d9f1640 1 --2- 172.21.15.29:0/501723046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1988149190 0x7f198814ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.078+0000 7f198d9f1640 1 -- 172.21.15.29:0/501723046 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19840094d0 con 0x7f19880c7820 2024-01-25T15:05:49.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.078+0000 7f198e1f2640 1 --2- 172.21.15.29:0/501723046 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19880c4ee0 0x7f1988140a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:49.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.078+0000 7f198d9f1640 1 --2- 172.21.15.29:0/501723046 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19880c7820 0x7f19881516d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f197800b4d0 tx=0x7f197800b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:49.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.078+0000 7f197effd640 1 -- 172.21.15.29:0/501723046 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978010870 con 0x7f19880c7820 2024-01-25T15:05:49.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.078+0000 7f197effd640 1 -- 172.21.15.29:0/501723046 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19780109d0 con 0x7f19880c7820 2024-01-25T15:05:49.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.078+0000 7f1990456640 1 -- 172.21.15.29:0/501723046 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19881ec0d0 con 0x7f19880c7820 2024-01-25T15:05:49.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.078+0000 7f197effd640 1 -- 172.21.15.29:0/501723046 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978010d80 con 0x7f19880c7820 2024-01-25T15:05:49.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.078+0000 7f1990456640 1 -- 172.21.15.29:0/501723046 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198813ff90 con 0x7f19880c7820 2024-01-25T15:05:49.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.079+0000 7f1990456640 1 -- 172.21.15.29:0/501723046 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198804eb10 con 0x7f19880c7820 2024-01-25T15:05:49.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.079+0000 7f197effd640 1 -- 172.21.15.29:0/501723046 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f197800f3c0 con 0x7f19880c7820 2024-01-25T15:05:49.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.080+0000 7f197effd640 1 --2- 172.21.15.29:0/501723046 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f196c06af00 0x7f196c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:49.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.080+0000 7f197effd640 1 -- 172.21.15.29:0/501723046 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f1978089a80 con 0x7f19880c7820 2024-01-25T15:05:49.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.080+0000 7f198e1f2640 1 --2- 172.21.15.29:0/501723046 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f196c06af00 0x7f196c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:49.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.081+0000 7f198e1f2640 1 --2- 172.21.15.29:0/501723046 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f196c06af00 0x7f196c06d3c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1984036000 tx=0x7f198403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:49.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.084+0000 7f197effd640 1 -- 172.21.15.29:0/501723046 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f19780544b0 con 0x7f19880c7820 2024-01-25T15:05:49.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.265+0000 7f1990456640 1 -- 172.21.15.29:0/501723046 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f1988074010 con 0x7f19880c7820 2024-01-25T15:05:49.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.266+0000 7f197effd640 1 -- 172.21.15.29:0/501723046 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v42) v1 ==== 101+0+11 (secure 0 0 0) 0x7f1978057ad0 con 0x7f19880c7820 2024-01-25T15:05:49.267 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-25T15:05:49.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.267+0000 7f1990456640 1 -- 172.21.15.29:0/501723046 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f196c06af00 msgr2=0x7f196c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:49.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.267+0000 7f1990456640 1 --2- 172.21.15.29:0/501723046 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f196c06af00 0x7f196c06d3c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1984036000 tx=0x7f198403c040 comp rx=0 tx=0).stop 2024-01-25T15:05:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.267+0000 7f1990456640 1 -- 172.21.15.29:0/501723046 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19880c7820 msgr2=0x7f19881516d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.267+0000 7f1990456640 1 --2- 172.21.15.29:0/501723046 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19880c7820 0x7f19881516d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f197800b4d0 tx=0x7f197800b990 comp rx=0 tx=0).stop 2024-01-25T15:05:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.267+0000 7f1990456640 1 -- 172.21.15.29:0/501723046 shutdown_connections 2024-01-25T15:05:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.267+0000 7f1990456640 1 --2- 172.21.15.29:0/501723046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1988149190 0x7f198814ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.268+0000 7f1990456640 1 --2- 172.21.15.29:0/501723046 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f196c06af00 0x7f196c06d3c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.268+0000 7f1990456640 1 --2- 172.21.15.29:0/501723046 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19880c7820 0x7f19881516d0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.268+0000 7f1990456640 1 --2- 172.21.15.29:0/501723046 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19880c4ee0 0x7f1988140a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.268+0000 7f1990456640 1 -- 172.21.15.29:0/501723046 >> 172.21.15.29:0/501723046 conn(0x7f19880c7f10 msgr2=0x7f1988148250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:49.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.268+0000 7f1990456640 1 -- 172.21.15.29:0/501723046 shutdown_connections 2024-01-25T15:05:49.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.268+0000 7f1990456640 1 -- 172.21.15.29:0/501723046 wait complete. 2024-01-25T15:05:49.279 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-25T15:05:49.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.381+0000 7f7dc8087640 1 Processor -- start 2024-01-25T15:05:49.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.381+0000 7f7dc8087640 1 -- start start 2024-01-25T15:05:49.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.382+0000 7f7dc8087640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7dc0149190 0x7f7dc00c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:49.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.382+0000 7f7dc8087640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7dc00c7820 0x7f7dc00c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:49.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.382+0000 7f7dc8087640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc00ad2e0 con 0x7f7dc00c4ee0 2024-01-25T15:05:49.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.382+0000 7f7dc8087640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc00ac6f0 con 0x7f7dc0149190 2024-01-25T15:05:49.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.382+0000 7f7dc8087640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc00ac9b0 con 0x7f7dc00c7820 2024-01-25T15:05:49.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.382+0000 7f7dc5622640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7dc00c7820 0x7f7dc00c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:49.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.382+0000 7f7dc5e23640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7dc0149190 0x7f7dc00c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:49.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.382+0000 7f7dc5622640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7dc00c7820 0x7f7dc00c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:34352/0 (socket says 172.21.15.29:34352) 2024-01-25T15:05:49.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.382+0000 7f7dc5622640 1 -- 172.21.15.29:0/3009812885 learned_addr learned my addr 172.21.15.29:0/3009812885 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:49.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.382+0000 7f7dc6624640 1 --1- 172.21.15.29:0/3009812885 >> v1:172.21.15.52:6789/0 conn(0x7f7dc00c4ee0 0x7f7dc01526a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:55502/0 (socket says 172.21.15.29:55502) 2024-01-25T15:05:49.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.382+0000 7f7dc5e23640 1 -- 172.21.15.29:0/3009812885 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7dc00c7820 msgr2=0x7f7dc00c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:49.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.382+0000 7f7dc5e23640 1 --2- 172.21.15.29:0/3009812885 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7dc00c7820 0x7f7dc00c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.382+0000 7f7dc5e23640 1 -- 172.21.15.29:0/3009812885 >> v1:172.21.15.52:6789/0 conn(0x7f7dc00c4ee0 legacy=0x7f7dc01526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:49.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.382+0000 7f7dc5e23640 1 -- 172.21.15.29:0/3009812885 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc00acc90 con 0x7f7dc0149190 2024-01-25T15:05:49.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.382+0000 7f7dc4e21640 1 -- 172.21.15.29:0/3009812885 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617558522 0 0) 0x7f7dc00ad2e0 con 0x7f7dc00c4ee0 2024-01-25T15:05:49.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.382+0000 7f7dc5622640 1 --2- 172.21.15.29:0/3009812885 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7dc00c7820 0x7f7dc00c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:05:49.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.383+0000 7f7dc5e23640 1 --2- 172.21.15.29:0/3009812885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dc0149190 0x7f7dc00c72e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0097a0 tx=0x7f7dbc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b83651558b550d5c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:49.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.383+0000 7f7dc4e21640 1 -- 172.21.15.29:0/3009812885 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc031830 con 0x7f7dc0149190 2024-01-25T15:05:49.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.383+0000 7f7dc4e21640 1 -- 172.21.15.29:0/3009812885 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dbc031990 con 0x7f7dc0149190 2024-01-25T15:05:49.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.384+0000 7f7dc4e21640 1 -- 172.21.15.29:0/3009812885 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc031d20 con 0x7f7dc0149190 2024-01-25T15:05:49.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.384+0000 7f7dc8087640 1 -- 172.21.15.29:0/3009812885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dc0149190 msgr2=0x7f7dc00c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:49.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.384+0000 7f7dc8087640 1 --2- 172.21.15.29:0/3009812885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dc0149190 0x7f7dc00c72e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0097a0 tx=0x7f7dbc02b8d0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.384+0000 7f7dc8087640 1 -- 172.21.15.29:0/3009812885 shutdown_connections 2024-01-25T15:05:49.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.384+0000 7f7dc8087640 1 --2- 172.21.15.29:0/3009812885 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7dc00c7820 0x7f7dc00c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.384+0000 7f7dc8087640 1 --2- 172.21.15.29:0/3009812885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dc0149190 0x7f7dc00c72e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.384+0000 7f7dc8087640 1 -- 172.21.15.29:0/3009812885 >> 172.21.15.29:0/3009812885 conn(0x7f7dc00c7f10 msgr2=0x7f7dc00c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:49.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.384+0000 7f7dc8087640 1 -- 172.21.15.29:0/3009812885 shutdown_connections 2024-01-25T15:05:49.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.384+0000 7f7dc8087640 1 -- 172.21.15.29:0/3009812885 wait complete. 2024-01-25T15:05:49.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.385+0000 7f7dc8087640 1 Processor -- start 2024-01-25T15:05:49.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.385+0000 7f7dc8087640 1 -- start start 2024-01-25T15:05:49.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.386+0000 7f7dc8087640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7dc00c4ee0 0x7f7dc00c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:49.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.386+0000 7f7dc8087640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dc00c7820 0x7f7dc014e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:49.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.386+0000 7f7dc8087640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dc0149190 0x7f7dc014eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:49.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.386+0000 7f7dc8087640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc014ce20 con 0x7f7dc00c7820 2024-01-25T15:05:49.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.386+0000 7f7dc8087640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc014d6c0 con 0x7f7dc0149190 2024-01-25T15:05:49.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.386+0000 7f7dc8087640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc0156260 con 0x7f7dc00c4ee0 2024-01-25T15:05:49.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.386+0000 7f7dc5622640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dc00c7820 0x7f7dc014e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:49.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.386+0000 7f7dc5622640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dc00c7820 0x7f7dc014e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55652/0 (socket says 172.21.15.29:55652) 2024-01-25T15:05:49.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.386+0000 7f7dc5622640 1 -- 172.21.15.29:0/919016142 learned_addr learned my addr 172.21.15.29:0/919016142 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:49.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.386+0000 7f7dc5e23640 1 --2- 172.21.15.29:0/919016142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7dc00c4ee0 0x7f7dc00c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:49.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.386+0000 7f7dc6624640 1 --2- 172.21.15.29:0/919016142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dc0149190 0x7f7dc014eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:49.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.386+0000 7f7dc5622640 1 -- 172.21.15.29:0/919016142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7dc00c4ee0 msgr2=0x7f7dc00c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:49.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.386+0000 7f7dc5622640 1 --2- 172.21.15.29:0/919016142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7dc00c4ee0 0x7f7dc00c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.386+0000 7f7dc5622640 1 -- 172.21.15.29:0/919016142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dc0149190 msgr2=0x7f7dc014eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:49.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.386+0000 7f7dc5622640 1 --2- 172.21.15.29:0/919016142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dc0149190 0x7f7dc014eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.386+0000 7f7dc5622640 1 -- 172.21.15.29:0/919016142 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db00094d0 con 0x7f7dc00c7820 2024-01-25T15:05:49.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.386+0000 7f7dc5622640 1 --2- 172.21.15.29:0/919016142 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dc00c7820 0x7f7dc014e9b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7db000e9d0 tx=0x7f7db000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:49.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.387+0000 7f7db67fc640 1 -- 172.21.15.29:0/919016142 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db000ca60 con 0x7f7dc00c7820 2024-01-25T15:05:49.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.387+0000 7f7db67fc640 1 -- 172.21.15.29:0/919016142 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db000cbc0 con 0x7f7dc00c7820 2024-01-25T15:05:49.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.387+0000 7f7dc8087640 1 -- 172.21.15.29:0/919016142 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dbc009400 con 0x7f7dc00c7820 2024-01-25T15:05:49.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.387+0000 7f7db67fc640 1 -- 172.21.15.29:0/919016142 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db0013470 con 0x7f7dc00c7820 2024-01-25T15:05:49.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.387+0000 7f7dc8087640 1 -- 172.21.15.29:0/919016142 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc014d070 con 0x7f7dc00c7820 2024-01-25T15:05:49.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.388+0000 7f7dc8087640 1 -- 172.21.15.29:0/919016142 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc004eb10 con 0x7f7dc00c7820 2024-01-25T15:05:49.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.388+0000 7f7db67fc640 1 -- 172.21.15.29:0/919016142 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7db00135d0 con 0x7f7dc00c7820 2024-01-25T15:05:49.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.388+0000 7f7db67fc640 1 --2- 172.21.15.29:0/919016142 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7da406aed0 0x7f7da406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:49.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.388+0000 7f7db67fc640 1 -- 172.21.15.29:0/919016142 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f7db0089d50 con 0x7f7dc00c7820 2024-01-25T15:05:49.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.389+0000 7f7dc5e23640 1 --2- 172.21.15.29:0/919016142 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7da406aed0 0x7f7da406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:49.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.389+0000 7f7dc5e23640 1 --2- 172.21.15.29:0/919016142 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7da406aed0 0x7f7da406d390 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc036000 tx=0x7f7dbc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:49.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.393+0000 7f7db67fc640 1 -- 172.21.15.29:0/919016142 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7db008d030 con 0x7f7dc00c7820 2024-01-25T15:05:49.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.589+0000 7f7dc8087640 1 -- 172.21.15.29:0/919016142 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7dc0074010 con 0x7f7dc00c7820 2024-01-25T15:05:49.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.589+0000 7f7db67fc640 1 -- 172.21.15.29:0/919016142 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7db0054810 con 0x7f7dc00c7820 2024-01-25T15:05:49.593 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-25T15:05:49.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.591+0000 7f7dc8087640 1 -- 172.21.15.29:0/919016142 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7da406aed0 msgr2=0x7f7da406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:49.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.591+0000 7f7dc8087640 1 --2- 172.21.15.29:0/919016142 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7da406aed0 0x7f7da406d390 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc036000 tx=0x7f7dbc008030 comp rx=0 tx=0).stop 2024-01-25T15:05:49.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.591+0000 7f7dc8087640 1 -- 172.21.15.29:0/919016142 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dc00c7820 msgr2=0x7f7dc014e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:49.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.591+0000 7f7dc8087640 1 --2- 172.21.15.29:0/919016142 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dc00c7820 0x7f7dc014e9b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7db000e9d0 tx=0x7f7db000ee90 comp rx=0 tx=0).stop 2024-01-25T15:05:49.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.591+0000 7f7dc8087640 1 -- 172.21.15.29:0/919016142 shutdown_connections 2024-01-25T15:05:49.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.591+0000 7f7dc8087640 1 --2- 172.21.15.29:0/919016142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dc0149190 0x7f7dc014eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.591+0000 7f7dc8087640 1 --2- 172.21.15.29:0/919016142 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7da406aed0 0x7f7da406d390 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.591+0000 7f7dc8087640 1 --2- 172.21.15.29:0/919016142 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dc00c7820 0x7f7dc014e9b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.591+0000 7f7dc8087640 1 --2- 172.21.15.29:0/919016142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7dc00c4ee0 0x7f7dc00c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.591+0000 7f7dc8087640 1 -- 172.21.15.29:0/919016142 >> 172.21.15.29:0/919016142 conn(0x7f7dc00c7f10 msgr2=0x7f7dc01464e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:49.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.591+0000 7f7dc8087640 1 -- 172.21.15.29:0/919016142 shutdown_connections 2024-01-25T15:05:49.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.591+0000 7f7dc8087640 1 -- 172.21.15.29:0/919016142 wait complete. 2024-01-25T15:05:49.603 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-25T15:05:49.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:49.603 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-01-25T15:05:49.638 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-01-25T15:05:49.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:49.639 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-25T15:05:49.696 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:05:49.696 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:05:49.753 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057151,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498940k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15783 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249468k,nr_inodes=812367,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498940k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-01-25T15:05:49.753 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-25T15:05:49.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.855+0000 7fc6920e5640 1 Processor -- start 2024-01-25T15:05:49.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.855+0000 7fc6920e5640 1 -- start start 2024-01-25T15:05:49.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.856+0000 7fc6920e5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc68c06b2b0 0x7fc68c06b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:49.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.856+0000 7fc6920e5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc68c1551a0 0x7fc68c0c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:49.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.856+0000 7fc6920e5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc68c0c64e0 0x7fc68c157d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:49.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.856+0000 7fc6920e5640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68c06be50 con 0x7fc68c06b2b0 2024-01-25T15:05:49.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.856+0000 7fc6920e5640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68c1521d0 con 0x7fc68c0c64e0 2024-01-25T15:05:49.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.856+0000 7fc6920e5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0c5b10 con 0x7fc68c1551a0 2024-01-25T15:05:49.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.856+0000 7fc68b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc68c06b2b0 0x7fc68c06b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:49.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.856+0000 7fc68b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc68c06b2b0 0x7fc68c06b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55662/0 (socket says 172.21.15.29:55662) 2024-01-25T15:05:49.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.856+0000 7fc68b7fe640 1 -- 172.21.15.29:0/3083078625 learned_addr learned my addr 172.21.15.29:0/3083078625 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:49.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.856+0000 7fc68bfff640 1 --2- 172.21.15.29:0/3083078625 >> v2:172.21.15.52:3300/0 conn(0x7fc68c0c64e0 0x7fc68c157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:49.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.856+0000 7fc68affd640 1 --2- 172.21.15.29:0/3083078625 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc68c1551a0 0x7fc68c0c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:49.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.856+0000 7fc68b7fe640 1 -- 172.21.15.29:0/3083078625 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc68c1551a0 msgr2=0x7fc68c0c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:49.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.856+0000 7fc68b7fe640 1 --2- 172.21.15.29:0/3083078625 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc68c1551a0 0x7fc68c0c5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.856+0000 7fc68b7fe640 1 -- 172.21.15.29:0/3083078625 >> v2:172.21.15.52:3300/0 conn(0x7fc68c0c64e0 msgr2=0x7fc68c157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:49.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.856+0000 7fc68b7fe640 1 --2- 172.21.15.29:0/3083078625 >> v2:172.21.15.52:3300/0 conn(0x7fc68c0c64e0 0x7fc68c157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.856+0000 7fc68b7fe640 1 -- 172.21.15.29:0/3083078625 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c0c4f20 con 0x7fc68c06b2b0 2024-01-25T15:05:49.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.857+0000 7fc68b7fe640 1 --2- 172.21.15.29:0/3083078625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc68c06b2b0 0x7fc68c06b690 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc68c08c250 tx=0x7fc68002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e7fe9bfa5bfe9 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:49.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.857+0000 7fc68a7fc640 1 -- 172.21.15.29:0/3083078625 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6800317e0 con 0x7fc68c06b2b0 2024-01-25T15:05:49.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.857+0000 7fc68a7fc640 1 -- 172.21.15.29:0/3083078625 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc680031940 con 0x7fc68c06b2b0 2024-01-25T15:05:49.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.857+0000 7fc68a7fc640 1 -- 172.21.15.29:0/3083078625 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc680031cd0 con 0x7fc68c06b2b0 2024-01-25T15:05:49.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.857+0000 7fc6920e5640 1 -- 172.21.15.29:0/3083078625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc68c06b2b0 msgr2=0x7fc68c06b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:49.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.857+0000 7fc6920e5640 1 --2- 172.21.15.29:0/3083078625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc68c06b2b0 0x7fc68c06b690 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc68c08c250 tx=0x7fc68002b880 comp rx=0 tx=0).stop 2024-01-25T15:05:49.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.858+0000 7fc6920e5640 1 -- 172.21.15.29:0/3083078625 shutdown_connections 2024-01-25T15:05:49.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.858+0000 7fc6920e5640 1 --2- 172.21.15.29:0/3083078625 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc68c1551a0 0x7fc68c0c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.858+0000 7fc6920e5640 1 --2- 172.21.15.29:0/3083078625 >> v2:172.21.15.52:3300/0 conn(0x7fc68c0c64e0 0x7fc68c157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.858+0000 7fc6920e5640 1 --2- 172.21.15.29:0/3083078625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc68c06b2b0 0x7fc68c06b690 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.858+0000 7fc6920e5640 1 -- 172.21.15.29:0/3083078625 >> 172.21.15.29:0/3083078625 conn(0x7fc68c0ca1f0 msgr2=0x7fc68c0ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:49.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.858+0000 7fc6920e5640 1 -- 172.21.15.29:0/3083078625 shutdown_connections 2024-01-25T15:05:49.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.858+0000 7fc6920e5640 1 -- 172.21.15.29:0/3083078625 wait complete. 2024-01-25T15:05:49.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.859+0000 7fc6920e5640 1 Processor -- start 2024-01-25T15:05:49.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.859+0000 7fc6920e5640 1 -- start start 2024-01-25T15:05:49.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.859+0000 7fc6920e5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc68c06b2b0 0x7fc68c148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:49.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.859+0000 7fc6920e5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc68c0c64e0 0x7fc68c0c2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:49.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.860+0000 7fc6920e5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc68c1551a0 0x7fc68c14a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:49.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.860+0000 7fc6920e5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c1ee900 con 0x7fc68c0c64e0 2024-01-25T15:05:49.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.860+0000 7fc6920e5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0c3230 con 0x7fc68c06b2b0 2024-01-25T15:05:49.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.860+0000 7fc6920e5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0c2e70 con 0x7fc68c1551a0 2024-01-25T15:05:49.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.860+0000 7fc68affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc68c0c64e0 0x7fc68c0c2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:49.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.860+0000 7fc68affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc68c0c64e0 0x7fc68c0c2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55668/0 (socket says 172.21.15.29:55668) 2024-01-25T15:05:49.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.860+0000 7fc68affd640 1 -- 172.21.15.29:0/991418449 learned_addr learned my addr 172.21.15.29:0/991418449 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:49.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.860+0000 7fc68b7fe640 1 --2- 172.21.15.29:0/991418449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc68c06b2b0 0x7fc68c148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:49.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.860+0000 7fc68bfff640 1 --2- 172.21.15.29:0/991418449 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc68c1551a0 0x7fc68c14a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:49.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.860+0000 7fc68affd640 1 -- 172.21.15.29:0/991418449 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc68c1551a0 msgr2=0x7fc68c14a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:49.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.860+0000 7fc68affd640 1 --2- 172.21.15.29:0/991418449 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc68c1551a0 0x7fc68c14a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.860+0000 7fc68affd640 1 -- 172.21.15.29:0/991418449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc68c06b2b0 msgr2=0x7fc68c148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:49.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.860+0000 7fc68affd640 1 --2- 172.21.15.29:0/991418449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc68c06b2b0 0x7fc68c148f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:49.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.860+0000 7fc68affd640 1 -- 172.21.15.29:0/991418449 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6800094d0 con 0x7fc68c0c64e0 2024-01-25T15:05:49.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.860+0000 7fc68affd640 1 --2- 172.21.15.29:0/991418449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc68c0c64e0 0x7fc68c0c2930 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc67c00e870 tx=0x7fc67c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:49.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.860+0000 7fc673fff640 1 -- 172.21.15.29:0/991418449 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c0094f0 con 0x7fc68c0c64e0 2024-01-25T15:05:49.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.860+0000 7fc673fff640 1 -- 172.21.15.29:0/991418449 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c00c940 con 0x7fc68c0c64e0 2024-01-25T15:05:49.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.860+0000 7fc673fff640 1 -- 172.21.15.29:0/991418449 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c00ccf0 con 0x7fc68c0c64e0 2024-01-25T15:05:49.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.860+0000 7fc6920e5640 1 -- 172.21.15.29:0/991418449 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68c154690 con 0x7fc68c0c64e0 2024-01-25T15:05:49.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.860+0000 7fc6920e5640 1 -- 172.21.15.29:0/991418449 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68c1543b0 con 0x7fc68c0c64e0 2024-01-25T15:05:49.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.861+0000 7fc6920e5640 1 -- 172.21.15.29:0/991418449 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc68c074080 con 0x7fc68c0c64e0 2024-01-25T15:05:49.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.862+0000 7fc673fff640 1 -- 172.21.15.29:0/991418449 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fc67c013470 con 0x7fc68c0c64e0 2024-01-25T15:05:49.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.862+0000 7fc673fff640 1 --2- 172.21.15.29:0/991418449 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc67806aed0 0x7fc67806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:49.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.862+0000 7fc673fff640 1 -- 172.21.15.29:0/991418449 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fc67c0899f0 con 0x7fc68c0c64e0 2024-01-25T15:05:49.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.862+0000 7fc68b7fe640 1 --2- 172.21.15.29:0/991418449 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc67806aed0 0x7fc67806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:49.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.863+0000 7fc68b7fe640 1 --2- 172.21.15.29:0/991418449 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc67806aed0 0x7fc67806d390 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc680036000 tx=0x7fc68003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:49.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:49.867+0000 7fc673fff640 1 -- 172.21.15.29:0/991418449 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fc67c054560 con 0x7fc68c0c64e0 2024-01-25T15:05:50.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.082+0000 7fc6920e5640 1 -- 172.21.15.29:0/991418449 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc68c0c9a70 con 0x7fc68c0c64e0 2024-01-25T15:05:50.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.083+0000 7fc673fff640 1 -- 172.21.15.29:0/991418449 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) v1 ==== 53+0+149 (secure 0 0 0) 0x7fc67c057b80 con 0x7fc68c0c64e0 2024-01-25T15:05:50.083 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-25T15:05:50.084 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-01-25T15:05:50.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.084+0000 7fc6920e5640 1 -- 172.21.15.29:0/991418449 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc67806aed0 msgr2=0x7fc67806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:50.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.084+0000 7fc6920e5640 1 --2- 172.21.15.29:0/991418449 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc67806aed0 0x7fc67806d390 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc680036000 tx=0x7fc68003d040 comp rx=0 tx=0).stop 2024-01-25T15:05:50.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.085+0000 7fc6920e5640 1 -- 172.21.15.29:0/991418449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc68c0c64e0 msgr2=0x7fc68c0c2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:50.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.085+0000 7fc6920e5640 1 --2- 172.21.15.29:0/991418449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc68c0c64e0 0x7fc68c0c2930 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc67c00e870 tx=0x7fc67c00ed30 comp rx=0 tx=0).stop 2024-01-25T15:05:50.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.085+0000 7fc6920e5640 1 -- 172.21.15.29:0/991418449 shutdown_connections 2024-01-25T15:05:50.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.085+0000 7fc6920e5640 1 --2- 172.21.15.29:0/991418449 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc68c1551a0 0x7fc68c14a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:50.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.085+0000 7fc6920e5640 1 --2- 172.21.15.29:0/991418449 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc67806aed0 0x7fc67806d390 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:50.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.085+0000 7fc6920e5640 1 --2- 172.21.15.29:0/991418449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc68c0c64e0 0x7fc68c0c2930 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:50.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.085+0000 7fc6920e5640 1 --2- 172.21.15.29:0/991418449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc68c06b2b0 0x7fc68c148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:50.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.085+0000 7fc6920e5640 1 -- 172.21.15.29:0/991418449 >> 172.21.15.29:0/991418449 conn(0x7fc68c0ca1f0 msgr2=0x7fc68c1ddd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:50.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.085+0000 7fc6920e5640 1 -- 172.21.15.29:0/991418449 shutdown_connections 2024-01-25T15:05:50.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.085+0000 7fc6920e5640 1 -- 172.21.15.29:0/991418449 wait complete. 2024-01-25T15:05:50.096 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2024-01-25T15:05:50.096 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-25T15:05:50.096 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-01-25T15:05:50.096 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-25T15:05:50.096 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-25T15:05:50.096 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2024-01-25T15:05:50.097 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-25T15:05:50.097 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-25T15:05:50.097 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-25T15:05:50.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:50.097 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-01-25T15:05:50.115 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-25T15:05:50.116 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-25T15:05:50.116 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-01-25T15:05:50.116 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:50.116 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-01-25T15:05:50.116 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:50.116 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:05:50.116 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-01-25T15:05:50.116 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-01-25T15:05:50.116 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:05:50.116 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-01-25T15:05:50.116 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-01-25T15:05:50.116 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-25T15:05:50.117 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-01-25T15:05:50.117 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-01-25T15:05:50.117 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-01-25T15:05:50.117 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42627sec preferred_lft 42627sec 2024-01-25T15:05:50.117 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link noprefixroute 2024-01-25T15:05:50.117 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:50.117 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:05:50.117 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-01-25T15:05:50.117 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-01-25T15:05:50.117 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-25T15:05:50.117 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether de:0a:fe:fc:c7:d3 brd ff:ff:ff:ff:ff:ff 2024-01-25T15:05:50.117 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-25T15:05:50.117 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:50.117 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::9810:c4ff:fe64:1765/64 scope link 2024-01-25T15:05:50.118 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:50.118 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-25T15:05:50.118 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether de:0a:fe:fc:c7:d3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-25T15:05:50.118 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::dc0a:feff:fefc:c7d3/64 scope link 2024-01-25T15:05:50.118 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:50.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:50.118 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-25T15:05:50.186 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-01-25T15:05:50.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:50.189 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-01-25T15:05:50.246 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-01-25T15:05:50.246 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-25T15:05:50.246 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-01-25T15:05:50.247 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-01-25T15:05:50.247 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-25T15:05:50.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:50.247 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2024-01-25T15:05:50.247 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-01-25T15:05:50.247 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-25T15:05:50.247 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-25T15:05:50.247 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-25T15:05:50.247 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-01-25T15:05:50.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:50.346 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-01-25T15:05:50.361 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-25T15:05:50.362 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-25T15:05:50.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:50.362 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-01-25T15:05:50.429 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-25T15:05:50.429 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-25T15:05:50.485 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-25T15:05:50.486 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-25T15:05:50.486 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-25T15:05:50.540 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2024-01-25T15:05:50.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:50.541 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-25T15:05:50.626 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-25T15:05:50.626 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-25T15:05:50.633 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-25T15:05:50.633 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-25T15:05:50.634 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.52:3300,172.21.15.52:3301" 2024-01-25T15:05:50.634 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with new device syntax: 1@3f65c5fb-9e8c-471f-b2c4-a9841e901c7a.cephfs2=/ 2024-01-25T15:05:50.634 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.29:3300/172.21.15.52:3300/172.21.15.52:3301" will pass to kernel 2024-01-25T15:05:50.634 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-01-25T15:05:50.635 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-01-25T15:05:50.635 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-25T15:05:50.635 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-01-25T15:05:50.635 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-25T15:05:50.637 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-25T15:05:50.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:50.637 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-25T15:05:50.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:50.669 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-25T15:05:50.730 INFO:teuthology.orchestra.run.smithi052.stdout:client5637 2024-01-25T15:05:50.730 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:05:50.731 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:05:50.786 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs authorize cephfs client.testuser / rw 2024-01-25T15:05:50.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.898+0000 7f9508fa1640 1 Processor -- start 2024-01-25T15:05:50.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.898+0000 7f9508fa1640 1 -- start start 2024-01-25T15:05:50.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.898+0000 7f9508fa1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f95040c7e80 0x7f95040c8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:50.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.898+0000 7f9508fa1640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9504157d40 0x7f95041581d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:50.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.898+0000 7f9508fa1640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95040c88d0 con 0x7f9504151e10 2024-01-25T15:05:50.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.898+0000 7f9508fa1640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95041521f0 con 0x7f95040c7e80 2024-01-25T15:05:50.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.898+0000 7f9508fa1640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950406ced0 con 0x7f9504157d40 2024-01-25T15:05:50.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.898+0000 7f9502ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f95040c7e80 0x7f95040c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:50.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.898+0000 7f9502ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f95040c7e80 0x7f95040c8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55684/0 (socket says 172.21.15.29:55684) 2024-01-25T15:05:50.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.898+0000 7f9502ffd640 1 -- 172.21.15.29:0/341550246 learned_addr learned my addr 172.21.15.29:0/341550246 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:50.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.899+0000 7f9503fff640 1 --2- 172.21.15.29:0/341550246 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9504157d40 0x7f95041581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:50.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.899+0000 7f9502ffd640 1 -- 172.21.15.29:0/341550246 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9504157d40 msgr2=0x7f95041581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:50.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.899+0000 7f9502ffd640 1 --2- 172.21.15.29:0/341550246 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9504157d40 0x7f95041581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:50.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.899+0000 7f9502ffd640 1 -- 172.21.15.29:0/341550246 >> v1:172.21.15.52:6789/0 conn(0x7f9504151e10 legacy=0x7f95040abfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:50.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.899+0000 7f9502ffd640 1 -- 172.21.15.29:0/341550246 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9504154750 con 0x7f95040c7e80 2024-01-25T15:05:50.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.900+0000 7f9502ffd640 1 --2- 172.21.15.29:0/341550246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95040c7e80 0x7f95040c8390 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009870 tx=0x7f94f802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e635b04804dfa66 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:50.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.900+0000 7f95027fc640 1 -- 172.21.15.29:0/341550246 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f8031640 con 0x7f95040c7e80 2024-01-25T15:05:50.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.900+0000 7f95027fc640 1 -- 172.21.15.29:0/341550246 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f80317a0 con 0x7f95040c7e80 2024-01-25T15:05:50.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.900+0000 7f95027fc640 1 -- 172.21.15.29:0/341550246 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f8031b30 con 0x7f95040c7e80 2024-01-25T15:05:50.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.900+0000 7f9508fa1640 1 -- 172.21.15.29:0/341550246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95040c7e80 msgr2=0x7f95040c8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:50.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.900+0000 7f9508fa1640 1 --2- 172.21.15.29:0/341550246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95040c7e80 0x7f95040c8390 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009870 tx=0x7f94f802b8f0 comp rx=0 tx=0).stop 2024-01-25T15:05:50.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.900+0000 7f9508fa1640 1 -- 172.21.15.29:0/341550246 shutdown_connections 2024-01-25T15:05:50.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.900+0000 7f9508fa1640 1 --2- 172.21.15.29:0/341550246 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9504157d40 0x7f95041581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:50.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.900+0000 7f9508fa1640 1 --2- 172.21.15.29:0/341550246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95040c7e80 0x7f95040c8390 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:50.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.900+0000 7f9508fa1640 1 -- 172.21.15.29:0/341550246 >> 172.21.15.29:0/341550246 conn(0x7f9504072210 msgr2=0x7f9504072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:50.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.900+0000 7f9508fa1640 1 -- 172.21.15.29:0/341550246 shutdown_connections 2024-01-25T15:05:50.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.900+0000 7f9508fa1640 1 -- 172.21.15.29:0/341550246 wait complete. 2024-01-25T15:05:50.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.901+0000 7f9508fa1640 1 Processor -- start 2024-01-25T15:05:50.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.902+0000 7f9508fa1640 1 -- start start 2024-01-25T15:05:50.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.902+0000 7f9508fa1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95040c7e80 0x7f95040a9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:50.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.902+0000 7f9508fa1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9504151e10 0x7f9504148410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:50.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.902+0000 7f9508fa1640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9504157d40 0x7f9504148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:50.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.902+0000 7f9508fa1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95040aae90 con 0x7f95040c7e80 2024-01-25T15:05:50.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.902+0000 7f9508fa1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95041560a0 con 0x7f9504151e10 2024-01-25T15:05:50.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.902+0000 7f9508fa1640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9504156380 con 0x7f9504157d40 2024-01-25T15:05:50.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.902+0000 7f95037fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95040c7e80 0x7f95040a9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:50.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.902+0000 7f95037fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95040c7e80 0x7f95040a9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55698/0 (socket says 172.21.15.29:55698) 2024-01-25T15:05:50.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.902+0000 7f95037fe640 1 -- 172.21.15.29:0/2498408708 learned_addr learned my addr 172.21.15.29:0/2498408708 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:50.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.903+0000 7f9503fff640 1 --2- 172.21.15.29:0/2498408708 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9504157d40 0x7f9504148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:50.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.903+0000 7f9502ffd640 1 --2- 172.21.15.29:0/2498408708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9504151e10 0x7f9504148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:50.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.903+0000 7f95037fe640 1 -- 172.21.15.29:0/2498408708 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9504157d40 msgr2=0x7f9504148950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:50.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.903+0000 7f95037fe640 1 --2- 172.21.15.29:0/2498408708 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9504157d40 0x7f9504148950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:50.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.903+0000 7f95037fe640 1 -- 172.21.15.29:0/2498408708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9504151e10 msgr2=0x7f9504148410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:50.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.903+0000 7f95037fe640 1 --2- 172.21.15.29:0/2498408708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9504151e10 0x7f9504148410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:50.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.903+0000 7f95037fe640 1 -- 172.21.15.29:0/2498408708 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f80094d0 con 0x7f95040c7e80 2024-01-25T15:05:50.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.903+0000 7f9502ffd640 1 --2- 172.21.15.29:0/2498408708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9504151e10 0x7f9504148410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:50.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.903+0000 7f95037fe640 1 --2- 172.21.15.29:0/2498408708 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95040c7e80 0x7f95040a9ca0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f94f400c400 tx=0x7f94f400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:50.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.903+0000 7f94ebfff640 1 -- 172.21.15.29:0/2498408708 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f40052d0 con 0x7f95040c7e80 2024-01-25T15:05:50.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.903+0000 7f94ebfff640 1 -- 172.21.15.29:0/2498408708 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f4005450 con 0x7f95040c7e80 2024-01-25T15:05:50.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.903+0000 7f9508fa1640 1 -- 172.21.15.29:0/2498408708 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9504156660 con 0x7f95040c7e80 2024-01-25T15:05:50.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.903+0000 7f94ebfff640 1 -- 172.21.15.29:0/2498408708 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f4007260 con 0x7f95040c7e80 2024-01-25T15:05:50.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.903+0000 7f9508fa1640 1 -- 172.21.15.29:0/2498408708 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95040ab3c0 con 0x7f95040c7e80 2024-01-25T15:05:50.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.904+0000 7f9508fa1640 1 -- 172.21.15.29:0/2498408708 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9504074010 con 0x7f95040c7e80 2024-01-25T15:05:50.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.905+0000 7f94ebfff640 1 -- 172.21.15.29:0/2498408708 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f94f40073c0 con 0x7f95040c7e80 2024-01-25T15:05:50.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.905+0000 7f94ebfff640 1 --2- 172.21.15.29:0/2498408708 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f94f006aed0 0x7f94f006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:50.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.905+0000 7f94ebfff640 1 -- 172.21.15.29:0/2498408708 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f94f4088e60 con 0x7f95040c7e80 2024-01-25T15:05:50.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.905+0000 7f9502ffd640 1 --2- 172.21.15.29:0/2498408708 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f94f006aed0 0x7f94f006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:50.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.906+0000 7f9502ffd640 1 --2- 172.21.15.29:0/2498408708 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f94f006aed0 0x7f94f006d390 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f94f8036000 tx=0x7f94f803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:50.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:50.909+0000 7f94ebfff640 1 -- 172.21.15.29:0/2498408708 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f94f4053920 con 0x7f95040c7e80 2024-01-25T15:05:51.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.123+0000 7f9508fa1640 1 -- 172.21.15.29:0/2498408708 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]} v 0) v1 -- 0x7f950406cc40 con 0x7f95040c7e80 2024-01-25T15:05:51.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.125+0000 7f94ebfff640 1 -- 172.21.15.29:0/2498408708 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]}]=0 v13) v1 ==== 134+0+185 (secure 0 0 0) 0x7f94f4056f40 con 0x7f95040c7e80 2024-01-25T15:05:51.126 INFO:teuthology.orchestra.run.smithi029.stdout:[client.testuser] 2024-01-25T15:05:51.126 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDPeLJlxLZuBxAA/8ujRSojtEUokTSb0g9dxQ== 2024-01-25T15:05:51.126 INFO:teuthology.orchestra.run.smithi029.stdout: caps mds = "allow rw fsname=cephfs" 2024-01-25T15:05:51.126 INFO:teuthology.orchestra.run.smithi029.stdout: caps mon = "allow r fsname=cephfs" 2024-01-25T15:05:51.126 INFO:teuthology.orchestra.run.smithi029.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-01-25T15:05:51.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.127+0000 7f9508fa1640 1 -- 172.21.15.29:0/2498408708 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f94f006aed0 msgr2=0x7f94f006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:51.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.127+0000 7f9508fa1640 1 --2- 172.21.15.29:0/2498408708 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f94f006aed0 0x7f94f006d390 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f94f8036000 tx=0x7f94f803c040 comp rx=0 tx=0).stop 2024-01-25T15:05:51.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.127+0000 7f9508fa1640 1 -- 172.21.15.29:0/2498408708 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95040c7e80 msgr2=0x7f95040a9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:51.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.127+0000 7f9508fa1640 1 --2- 172.21.15.29:0/2498408708 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95040c7e80 0x7f95040a9ca0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f94f400c400 tx=0x7f94f400c8c0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.127+0000 7f9508fa1640 1 -- 172.21.15.29:0/2498408708 shutdown_connections 2024-01-25T15:05:51.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.127+0000 7f9508fa1640 1 --2- 172.21.15.29:0/2498408708 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9504157d40 0x7f9504148950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.127+0000 7f9508fa1640 1 --2- 172.21.15.29:0/2498408708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9504151e10 0x7f9504148410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.127+0000 7f9508fa1640 1 --2- 172.21.15.29:0/2498408708 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f94f006aed0 0x7f94f006d390 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.127+0000 7f9508fa1640 1 --2- 172.21.15.29:0/2498408708 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95040c7e80 0x7f95040a9ca0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.127+0000 7f9508fa1640 1 -- 172.21.15.29:0/2498408708 >> 172.21.15.29:0/2498408708 conn(0x7f9504072210 msgr2=0x7f950414e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:51.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.127+0000 7f9508fa1640 1 -- 172.21.15.29:0/2498408708 shutdown_connections 2024-01-25T15:05:51.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.127+0000 7f9508fa1640 1 -- 172.21.15.29:0/2498408708 wait complete. 2024-01-25T15:05:51.138 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-01-25T15:05:51.153 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.AbkvMbv41K 2024-01-25T15:05:51.153 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:05:51.153 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/tmp/tmp.AbkvMbv41K 2024-01-25T15:05:51.207 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:05:51.207 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:05:51.262 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:05:51.262 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:05:51.317 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:51.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.458+0000 7f3dedd68640 1 Processor -- start 2024-01-25T15:05:51.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.458+0000 7f3dedd68640 1 -- start start 2024-01-25T15:05:51.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.459+0000 7f3dedd68640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3de8152060 0x7f3de806db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:51.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.459+0000 7f3dedd68640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3de806e090 0x7f3de806b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:51.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.459+0000 7f3dedd68640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3de806bc10 0x7f3de81548b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:51.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.459+0000 7f3dedd68640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de8152440 con 0x7f3de8152060 2024-01-25T15:05:51.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.459+0000 7f3dedd68640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de80c2eb0 con 0x7f3de806e090 2024-01-25T15:05:51.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.459+0000 7f3dedd68640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de80c2030 con 0x7f3de806bc10 2024-01-25T15:05:51.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.459+0000 7f3de77fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3de8152060 0x7f3de806db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:51.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.459+0000 7f3de77fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3de8152060 0x7f3de806db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55704/0 (socket says 172.21.15.29:55704) 2024-01-25T15:05:51.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.459+0000 7f3de77fe640 1 -- 172.21.15.29:0/1918398610 learned_addr learned my addr 172.21.15.29:0/1918398610 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:51.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.459+0000 7f3de6ffd640 1 --2- 172.21.15.29:0/1918398610 >> v2:172.21.15.52:3300/0 conn(0x7f3de806e090 0x7f3de806b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:51.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.459+0000 7f3de7fff640 1 --2- 172.21.15.29:0/1918398610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3de806bc10 0x7f3de81548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:51.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.459+0000 7f3de77fe640 1 -- 172.21.15.29:0/1918398610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3de806bc10 msgr2=0x7f3de81548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:51.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.459+0000 7f3de77fe640 1 --2- 172.21.15.29:0/1918398610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3de806bc10 0x7f3de81548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.459+0000 7f3de77fe640 1 -- 172.21.15.29:0/1918398610 >> v2:172.21.15.52:3300/0 conn(0x7f3de806e090 msgr2=0x7f3de806b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:51.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.459+0000 7f3de77fe640 1 --2- 172.21.15.29:0/1918398610 >> v2:172.21.15.52:3300/0 conn(0x7f3de806e090 0x7f3de806b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.459+0000 7f3de77fe640 1 -- 172.21.15.29:0/1918398610 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de80c1ba0 con 0x7f3de8152060 2024-01-25T15:05:51.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.459+0000 7f3de7fff640 1 --2- 172.21.15.29:0/1918398610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3de806bc10 0x7f3de81548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:51.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.460+0000 7f3de77fe640 1 --2- 172.21.15.29:0/1918398610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3de8152060 0x7f3de806db50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3de80c28f0 tx=0x7f3dd802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9adfb3e53deb948 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:51.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.460+0000 7f3de67fc640 1 -- 172.21.15.29:0/1918398610 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd802c9e0 con 0x7f3de8152060 2024-01-25T15:05:51.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.460+0000 7f3de67fc640 1 -- 172.21.15.29:0/1918398610 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd802cb40 con 0x7f3de8152060 2024-01-25T15:05:51.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.460+0000 7f3de67fc640 1 -- 172.21.15.29:0/1918398610 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd80343f0 con 0x7f3de8152060 2024-01-25T15:05:51.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.461+0000 7f3dedd68640 1 -- 172.21.15.29:0/1918398610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3de8152060 msgr2=0x7f3de806db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:51.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.461+0000 7f3dedd68640 1 --2- 172.21.15.29:0/1918398610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3de8152060 0x7f3de806db50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3de80c28f0 tx=0x7f3dd802be40 comp rx=0 tx=0).stop 2024-01-25T15:05:51.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.461+0000 7f3dedd68640 1 -- 172.21.15.29:0/1918398610 shutdown_connections 2024-01-25T15:05:51.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.461+0000 7f3dedd68640 1 --2- 172.21.15.29:0/1918398610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3de806bc10 0x7f3de81548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.461+0000 7f3dedd68640 1 --2- 172.21.15.29:0/1918398610 >> v2:172.21.15.52:3300/0 conn(0x7f3de806e090 0x7f3de806b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.461+0000 7f3dedd68640 1 --2- 172.21.15.29:0/1918398610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3de8152060 0x7f3de806db50 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.461+0000 7f3dedd68640 1 -- 172.21.15.29:0/1918398610 >> 172.21.15.29:0/1918398610 conn(0x7f3de80c3260 msgr2=0x7f3de80c3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:51.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.461+0000 7f3dedd68640 1 -- 172.21.15.29:0/1918398610 shutdown_connections 2024-01-25T15:05:51.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.461+0000 7f3dedd68640 1 -- 172.21.15.29:0/1918398610 wait complete. 2024-01-25T15:05:51.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.462+0000 7f3dedd68640 1 Processor -- start 2024-01-25T15:05:51.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.462+0000 7f3dedd68640 1 -- start start 2024-01-25T15:05:51.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.463+0000 7f3dedd68640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3de806bc10 0x7f3de81eab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:51.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.463+0000 7f3dedd68640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3de806e090 0x7f3de8154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:51.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.463+0000 7f3dedd68640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3de8152060 0x7f3de8154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:51.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.463+0000 7f3dedd68640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de81589c0 con 0x7f3de806e090 2024-01-25T15:05:51.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.463+0000 7f3dedd68640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de8155230 con 0x7f3de806bc10 2024-01-25T15:05:51.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.463+0000 7f3dedd68640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de8155440 con 0x7f3de8152060 2024-01-25T15:05:51.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.463+0000 7f3de6ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3de806e090 0x7f3de8154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:51.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.463+0000 7f3de6ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3de806e090 0x7f3de8154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55720/0 (socket says 172.21.15.29:55720) 2024-01-25T15:05:51.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.463+0000 7f3de6ffd640 1 -- 172.21.15.29:0/636392291 learned_addr learned my addr 172.21.15.29:0/636392291 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:51.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.463+0000 7f3de77fe640 1 --2- 172.21.15.29:0/636392291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3de806bc10 0x7f3de81eab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:51.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.463+0000 7f3de7fff640 1 --2- 172.21.15.29:0/636392291 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3de8152060 0x7f3de8154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:51.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.463+0000 7f3de6ffd640 1 -- 172.21.15.29:0/636392291 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3de8152060 msgr2=0x7f3de8154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:51.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.463+0000 7f3de6ffd640 1 --2- 172.21.15.29:0/636392291 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3de8152060 0x7f3de8154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.463+0000 7f3de6ffd640 1 -- 172.21.15.29:0/636392291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3de806bc10 msgr2=0x7f3de81eab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:51.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.463+0000 7f3de6ffd640 1 --2- 172.21.15.29:0/636392291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3de806bc10 0x7f3de81eab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.463+0000 7f3de6ffd640 1 -- 172.21.15.29:0/636392291 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd8009b30 con 0x7f3de806e090 2024-01-25T15:05:51.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.463+0000 7f3de7fff640 1 --2- 172.21.15.29:0/636392291 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3de8152060 0x7f3de8154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:51.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.463+0000 7f3de6ffd640 1 --2- 172.21.15.29:0/636392291 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3de806e090 0x7f3de8154360 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00e840 tx=0x7f3ddc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:51.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.464+0000 7f3dcffff640 1 -- 172.21.15.29:0/636392291 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0094f0 con 0x7f3de806e090 2024-01-25T15:05:51.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.464+0000 7f3dcffff640 1 -- 172.21.15.29:0/636392291 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc00c940 con 0x7f3de806e090 2024-01-25T15:05:51.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.464+0000 7f3dedd68640 1 -- 172.21.15.29:0/636392291 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de8155720 con 0x7f3de806e090 2024-01-25T15:05:51.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.464+0000 7f3dcffff640 1 -- 172.21.15.29:0/636392291 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc00ccd0 con 0x7f3de806e090 2024-01-25T15:05:51.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.464+0000 7f3dedd68640 1 -- 172.21.15.29:0/636392291 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de8153b60 con 0x7f3de806e090 2024-01-25T15:05:51.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.465+0000 7f3dedd68640 1 -- 172.21.15.29:0/636392291 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de81548a0 con 0x7f3de806e090 2024-01-25T15:05:51.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.465+0000 7f3dcffff640 1 -- 172.21.15.29:0/636392291 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f3ddc013470 con 0x7f3de806e090 2024-01-25T15:05:51.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.465+0000 7f3dcffff640 1 --2- 172.21.15.29:0/636392291 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3dd406af00 0x7f3dd406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:51.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.465+0000 7f3dcffff640 1 -- 172.21.15.29:0/636392291 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f3ddc089a20 con 0x7f3de806e090 2024-01-25T15:05:51.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.466+0000 7f3de77fe640 1 --2- 172.21.15.29:0/636392291 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3dd406af00 0x7f3dd406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:51.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.466+0000 7f3de77fe640 1 --2- 172.21.15.29:0/636392291 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3dd406af00 0x7f3dd406d3c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8035000 tx=0x7f3dd8030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:51.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.470+0000 7f3dcffff640 1 -- 172.21.15.29:0/636392291 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f3ddc054500 con 0x7f3de806e090 2024-01-25T15:05:51.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.654+0000 7f3dedd68640 1 -- 172.21.15.29:0/636392291 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3de8074080 con 0x7f3de806e090 2024-01-25T15:05:51.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.655+0000 7f3dcffff640 1 -- 172.21.15.29:0/636392291 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+20455 (secure 0 0 0) 0x7f3ddc057b20 con 0x7f3de806e090 2024-01-25T15:05:51.656 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:51.656 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":42,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:05:44.564655+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:05:25.099043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-25T15:05:25.537967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-25T15:05:40.935431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-25T15:05:41.895611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:51.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.657+0000 7f3dedd68640 1 -- 172.21.15.29:0/636392291 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3dd406af00 msgr2=0x7f3dd406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:51.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.657+0000 7f3dedd68640 1 --2- 172.21.15.29:0/636392291 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3dd406af00 0x7f3dd406d3c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8035000 tx=0x7f3dd8030000 comp rx=0 tx=0).stop 2024-01-25T15:05:51.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.657+0000 7f3dedd68640 1 -- 172.21.15.29:0/636392291 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3de806e090 msgr2=0x7f3de8154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:51.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.657+0000 7f3dedd68640 1 --2- 172.21.15.29:0/636392291 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3de806e090 0x7f3de8154360 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00e840 tx=0x7f3ddc00ed00 comp rx=0 tx=0).stop 2024-01-25T15:05:51.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.657+0000 7f3dedd68640 1 -- 172.21.15.29:0/636392291 shutdown_connections 2024-01-25T15:05:51.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.657+0000 7f3dedd68640 1 --2- 172.21.15.29:0/636392291 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3de8152060 0x7f3de8154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.657+0000 7f3dedd68640 1 --2- 172.21.15.29:0/636392291 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3dd406af00 0x7f3dd406d3c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.657+0000 7f3dedd68640 1 --2- 172.21.15.29:0/636392291 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3de806e090 0x7f3de8154360 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.657+0000 7f3dedd68640 1 --2- 172.21.15.29:0/636392291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3de806bc10 0x7f3de81eab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.657+0000 7f3dedd68640 1 -- 172.21.15.29:0/636392291 >> 172.21.15.29:0/636392291 conn(0x7f3de80c3260 msgr2=0x7f3de806a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:51.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.657+0000 7f3dedd68640 1 -- 172.21.15.29:0/636392291 shutdown_connections 2024-01-25T15:05:51.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.657+0000 7f3dedd68640 1 -- 172.21.15.29:0/636392291 wait complete. 2024-01-25T15:05:51.669 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T15:04:14.955791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T15:05:25.099043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T15:05:25.537967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-25T15:05:40.935431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-25T15:05:41.895611+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-25T15:05:51.669 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:05:51.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.774+0000 7fecfe6c2640 1 Processor -- start 2024-01-25T15:05:51.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.774+0000 7fecfe6c2640 1 -- start start 2024-01-25T15:05:51.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecfe6c2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecf8154090 0x7fecf80ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:51.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecfe6c2640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf8154fd0 con 0x7fecf806dbc0 2024-01-25T15:05:51.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecfe6c2640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf8071da0 con 0x7fecf80abcf0 2024-01-25T15:05:51.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecfe6c2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf80a9540 con 0x7fecf8154090 2024-01-25T15:05:51.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecfcc5f640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fecf806dbc0 0x7fecf806e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54546/0 (socket says 172.21.15.29:54546) 2024-01-25T15:05:51.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecfcc5f640 1 -- 172.21.15.29:0/2466830975 learned_addr learned my addr 172.21.15.29:0/2466830975 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:51.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecf7fff640 1 --2- 172.21.15.29:0/2466830975 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecf8154090 0x7fecf80ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:51.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecf6ffd640 1 -- 172.21.15.29:0/2466830975 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759265187 0 0) 0x7fecf8154fd0 con 0x7fecf806dbc0 2024-01-25T15:05:51.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecf6ffd640 1 -- 172.21.15.29:0/2466830975 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fece0003520 con 0x7fecf806dbc0 2024-01-25T15:05:51.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecf6ffd640 1 -- 172.21.15.29:0/2466830975 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2084283419 0 0) 0x7fece0003520 con 0x7fecf806dbc0 2024-01-25T15:05:51.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecf6ffd640 1 -- 172.21.15.29:0/2466830975 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecf8154090 msgr2=0x7fecf80ab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:51.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecf6ffd640 1 --2- 172.21.15.29:0/2466830975 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecf8154090 0x7fecf80ab6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecf6ffd640 1 -- 172.21.15.29:0/2466830975 >> v1:172.21.15.52:6789/0 conn(0x7fecf80abcf0 legacy=0x7fecf8154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:51.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecf6ffd640 1 -- 172.21.15.29:0/2466830975 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf8072760 con 0x7fecf806dbc0 2024-01-25T15:05:51.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecf6ffd640 1 -- 172.21.15.29:0/2466830975 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7fecf00019f0 con 0x7fecf806dbc0 2024-01-25T15:05:51.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecf6ffd640 1 -- 172.21.15.29:0/2466830975 >> v1:172.21.15.29:6789/0 conn(0x7fecf806dbc0 legacy=0x7fecf806e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:51.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecf6ffd640 1 --2- 172.21.15.29:0/2466830975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece0003a10 0x7fece0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:51.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecf6ffd640 1 --2- 172.21.15.29:0/2466830975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fece00047c0 0x7fece0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:51.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecf6ffd640 1 --2- 172.21.15.29:0/2466830975 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecf8154090 0x7fece0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:51.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecf6ffd640 1 -- 172.21.15.29:0/2466830975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf80a9540 con 0x7fece00047c0 2024-01-25T15:05:51.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecf6ffd640 1 -- 172.21.15.29:0/2466830975 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece000bb40 con 0x7fece0003a10 2024-01-25T15:05:51.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecf6ffd640 1 -- 172.21.15.29:0/2466830975 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece000df10 con 0x7fecf8154090 2024-01-25T15:05:51.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.775+0000 7fecf77fe640 1 --2- 172.21.15.29:0/2466830975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fece00047c0 0x7fece0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:51.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.776+0000 7fecf7fff640 1 --2- 172.21.15.29:0/2466830975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece0003a10 0x7fece0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:51.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.776+0000 7fecfcc5f640 1 --2- 172.21.15.29:0/2466830975 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecf8154090 0x7fece0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:51.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.776+0000 7fecf77fe640 1 -- 172.21.15.29:0/2466830975 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecf8154090 msgr2=0x7fece0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:51.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.776+0000 7fecf77fe640 1 --2- 172.21.15.29:0/2466830975 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecf8154090 0x7fece0005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.776+0000 7fecf77fe640 1 -- 172.21.15.29:0/2466830975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece0003a10 msgr2=0x7fece0003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:51.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.776+0000 7fecf77fe640 1 --2- 172.21.15.29:0/2466830975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece0003a10 0x7fece0003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.776+0000 7fecf77fe640 1 -- 172.21.15.29:0/2466830975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece0003520 con 0x7fece00047c0 2024-01-25T15:05:51.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.776+0000 7fecf77fe640 1 --2- 172.21.15.29:0/2466830975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fece00047c0 0x7fece0004c40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fece8001860 tx=0x7fece00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d991701c507c120 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:51.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.777+0000 7fecf6ffd640 1 -- 172.21.15.29:0/2466830975 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8033410 con 0x7fece00047c0 2024-01-25T15:05:51.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.777+0000 7fecf6ffd640 1 -- 172.21.15.29:0/2466830975 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece8033590 con 0x7fece00047c0 2024-01-25T15:05:51.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.777+0000 7fecf6ffd640 1 -- 172.21.15.29:0/2466830975 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8033940 con 0x7fece00047c0 2024-01-25T15:05:51.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.777+0000 7fecfe6c2640 1 -- 172.21.15.29:0/2466830975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fece00047c0 msgr2=0x7fece0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:51.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.777+0000 7fecfe6c2640 1 --2- 172.21.15.29:0/2466830975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fece00047c0 0x7fece0004c40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fece8001860 tx=0x7fece00057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.777+0000 7fecfcc5f640 1 -- 172.21.15.29:0/2466830975 reap_dead start 2024-01-25T15:05:51.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.777+0000 7fecfe6c2640 1 -- 172.21.15.29:0/2466830975 shutdown_connections 2024-01-25T15:05:51.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.777+0000 7fecfe6c2640 1 -- 172.21.15.29:0/2466830975 >> 172.21.15.29:0/2466830975 conn(0x7fecf80c2a10 msgr2=0x7fecf80c2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:51.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.777+0000 7fecfe6c2640 1 -- 172.21.15.29:0/2466830975 shutdown_connections 2024-01-25T15:05:51.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.777+0000 7fecfe6c2640 1 -- 172.21.15.29:0/2466830975 wait complete. 2024-01-25T15:05:51.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.778+0000 7fecfe6c2640 1 Processor -- start 2024-01-25T15:05:51.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.779+0000 7fecfe6c2640 1 -- start start 2024-01-25T15:05:51.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.779+0000 7fecfe6c2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fece00047c0 0x7fecf80703a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:51.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.779+0000 7fecfe6c2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecf81da910 0x7fecf81e52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:51.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.779+0000 7fecfe6c2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecf81e9460 0x7fecf81e5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:51.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.779+0000 7fecfe6c2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf81e8fd0 con 0x7fece00047c0 2024-01-25T15:05:51.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.779+0000 7fecfe6c2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf81db080 con 0x7fecf81e9460 2024-01-25T15:05:51.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.779+0000 7fecfe6c2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf81dada0 con 0x7fecf81da910 2024-01-25T15:05:51.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.779+0000 7fecf7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fece00047c0 0x7fecf80703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:51.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.779+0000 7fecf7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fece00047c0 0x7fecf80703a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55726/0 (socket says 172.21.15.29:55726) 2024-01-25T15:05:51.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.779+0000 7fecf7fff640 1 -- 172.21.15.29:0/187021026 learned_addr learned my addr 172.21.15.29:0/187021026 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:51.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.780+0000 7fecf7fff640 1 -- 172.21.15.29:0/187021026 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecf81da910 msgr2=0x7fecf81e52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:51.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.780+0000 7fecf7fff640 1 --2- 172.21.15.29:0/187021026 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecf81da910 0x7fecf81e52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.780+0000 7fecf7fff640 1 -- 172.21.15.29:0/187021026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecf81e9460 msgr2=0x7fecf81e5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:51.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.780+0000 7fecfcc5f640 1 --2- 172.21.15.29:0/187021026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecf81e9460 0x7fecf81e5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:51.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.780+0000 7fecf7fff640 1 --2- 172.21.15.29:0/187021026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecf81e9460 0x7fecf81e5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.780+0000 7fecf7fff640 1 -- 172.21.15.29:0/187021026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf81e8980 con 0x7fece00047c0 2024-01-25T15:05:51.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.780+0000 7fecf7fff640 1 --2- 172.21.15.29:0/187021026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fece00047c0 0x7fecf80703a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fecec011600 tx=0x7fecec011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:51.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.780+0000 7fecf4ff9640 1 -- 172.21.15.29:0/187021026 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec00f920 con 0x7fece00047c0 2024-01-25T15:05:51.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.780+0000 7fecf4ff9640 1 -- 172.21.15.29:0/187021026 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecec00fa80 con 0x7fece00047c0 2024-01-25T15:05:51.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.780+0000 7fecfe6c2640 1 -- 172.21.15.29:0/187021026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf81e8c60 con 0x7fece00047c0 2024-01-25T15:05:51.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.780+0000 7fecf4ff9640 1 -- 172.21.15.29:0/187021026 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec00fdf0 con 0x7fece00047c0 2024-01-25T15:05:51.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.780+0000 7fecfe6c2640 1 -- 172.21.15.29:0/187021026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf8148b00 con 0x7fece00047c0 2024-01-25T15:05:51.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.781+0000 7fecfe6c2640 1 -- 172.21.15.29:0/187021026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf8074010 con 0x7fece00047c0 2024-01-25T15:05:51.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.781+0000 7fecf4ff9640 1 -- 172.21.15.29:0/187021026 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fecec015460 con 0x7fece00047c0 2024-01-25T15:05:51.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.782+0000 7fecf4ff9640 1 --2- 172.21.15.29:0/187021026 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fece406aed0 0x7fece406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:51.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.782+0000 7fecf4ff9640 1 -- 172.21.15.29:0/187021026 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fecec08a310 con 0x7fece00047c0 2024-01-25T15:05:51.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.782+0000 7fecf77fe640 1 --2- 172.21.15.29:0/187021026 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fece406aed0 0x7fece406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:51.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.783+0000 7fecf77fe640 1 --2- 172.21.15.29:0/187021026 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fece406aed0 0x7fece406d390 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fece8035000 tx=0x7fece8030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:51.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.786+0000 7fecf4ff9640 1 -- 172.21.15.29:0/187021026 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fecec054dd0 con 0x7fece00047c0 2024-01-25T15:05:51.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.963+0000 7fecfe6c2640 1 -- 172.21.15.29:0/187021026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fecf806b6d0 con 0x7fece00047c0 2024-01-25T15:05:51.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.963+0000 7fecf4ff9640 1 -- 172.21.15.29:0/187021026 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7fecec0583f0 con 0x7fece00047c0 2024-01-25T15:05:51.964 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-25T15:05:51.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.965+0000 7fecfe6c2640 1 -- 172.21.15.29:0/187021026 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fece406aed0 msgr2=0x7fece406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:51.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.965+0000 7fecfe6c2640 1 --2- 172.21.15.29:0/187021026 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fece406aed0 0x7fece406d390 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fece8035000 tx=0x7fece8030000 comp rx=0 tx=0).stop 2024-01-25T15:05:51.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.965+0000 7fecfe6c2640 1 -- 172.21.15.29:0/187021026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fece00047c0 msgr2=0x7fecf80703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:51.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.965+0000 7fecfe6c2640 1 --2- 172.21.15.29:0/187021026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fece00047c0 0x7fecf80703a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fecec011600 tx=0x7fecec011ac0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.965+0000 7fecfe6c2640 1 -- 172.21.15.29:0/187021026 shutdown_connections 2024-01-25T15:05:51.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.965+0000 7fecfe6c2640 1 --2- 172.21.15.29:0/187021026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecf81e9460 0x7fecf81e5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.965+0000 7fecfe6c2640 1 --2- 172.21.15.29:0/187021026 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fecf81da910 0x7fecf81e52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.965+0000 7fecfe6c2640 1 --2- 172.21.15.29:0/187021026 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fece406aed0 0x7fece406d390 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.965+0000 7fecfe6c2640 1 --2- 172.21.15.29:0/187021026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fece00047c0 0x7fecf80703a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:51.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.965+0000 7fecfe6c2640 1 -- 172.21.15.29:0/187021026 >> 172.21.15.29:0/187021026 conn(0x7fecf80c2a10 msgr2=0x7fecf80730a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:51.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.965+0000 7fecfe6c2640 1 -- 172.21.15.29:0/187021026 shutdown_connections 2024-01-25T15:05:51.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:51.965+0000 7fecfe6c2640 1 -- 172.21.15.29:0/187021026 wait complete. 2024-01-25T15:05:51.977 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:05:52.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.081+0000 7f48efeee640 1 Processor -- start 2024-01-25T15:05:52.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.081+0000 7f48efeee640 1 -- start start 2024-01-25T15:05:52.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.081+0000 7f48efeee640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f48e80c8620 0x7f48e80c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:52.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.081+0000 7f48efeee640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f48e8158b80 0x7f48e8151c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:52.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.081+0000 7f48efeee640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e8159030 con 0x7f48e806b490 2024-01-25T15:05:52.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.082+0000 7f48efeee640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e80c6770 con 0x7f48e80c8620 2024-01-25T15:05:52.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.082+0000 7f48efeee640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e8154f10 con 0x7f48e8158b80 2024-01-25T15:05:52.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.082+0000 7f48ed489640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f48e80c8620 0x7f48e80c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:52.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.082+0000 7f48ed489640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f48e80c8620 0x7f48e80c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55734/0 (socket says 172.21.15.29:55734) 2024-01-25T15:05:52.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.082+0000 7f48ed489640 1 -- 172.21.15.29:0/2900732014 learned_addr learned my addr 172.21.15.29:0/2900732014 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:52.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.082+0000 7f48ed489640 1 -- 172.21.15.29:0/2900732014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f48e8158b80 msgr2=0x7f48e8151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:52.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.082+0000 7f48ed489640 1 --2- 172.21.15.29:0/2900732014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f48e8158b80 0x7f48e8151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.082+0000 7f48ed489640 1 -- 172.21.15.29:0/2900732014 >> v1:172.21.15.52:6789/0 conn(0x7f48e806b490 legacy=0x7f48e80c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:52.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.082+0000 7f48ed489640 1 -- 172.21.15.29:0/2900732014 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e81551f0 con 0x7f48e80c8620 2024-01-25T15:05:52.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.083+0000 7f48ed489640 1 --2- 172.21.15.29:0/2900732014 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48e80c8620 0x7f48e80c6120 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f48dc009870 tx=0x7f48dc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15813d0059933b5b server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:52.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.083+0000 7f48ecc88640 1 -- 172.21.15.29:0/2900732014 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc0317c0 con 0x7f48e80c8620 2024-01-25T15:05:52.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.083+0000 7f48ecc88640 1 -- 172.21.15.29:0/2900732014 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48dc031920 con 0x7f48e80c8620 2024-01-25T15:05:52.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.083+0000 7f48ecc88640 1 -- 172.21.15.29:0/2900732014 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc031cb0 con 0x7f48e80c8620 2024-01-25T15:05:52.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.083+0000 7f48efeee640 1 -- 172.21.15.29:0/2900732014 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48e80c8620 msgr2=0x7f48e80c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:52.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.083+0000 7f48efeee640 1 --2- 172.21.15.29:0/2900732014 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48e80c8620 0x7f48e80c6120 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f48dc009870 tx=0x7f48dc02b860 comp rx=0 tx=0).stop 2024-01-25T15:05:52.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.083+0000 7f48efeee640 1 -- 172.21.15.29:0/2900732014 shutdown_connections 2024-01-25T15:05:52.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.083+0000 7f48efeee640 1 --2- 172.21.15.29:0/2900732014 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f48e8158b80 0x7f48e8151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.083+0000 7f48efeee640 1 --2- 172.21.15.29:0/2900732014 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48e80c8620 0x7f48e80c6120 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.083+0000 7f48efeee640 1 -- 172.21.15.29:0/2900732014 >> 172.21.15.29:0/2900732014 conn(0x7f48e80ca010 msgr2=0x7f48e80ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:52.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.083+0000 7f48efeee640 1 -- 172.21.15.29:0/2900732014 shutdown_connections 2024-01-25T15:05:52.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.083+0000 7f48efeee640 1 -- 172.21.15.29:0/2900732014 wait complete. 2024-01-25T15:05:52.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.084+0000 7f48efeee640 1 Processor -- start 2024-01-25T15:05:52.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.085+0000 7f48efeee640 1 -- start start 2024-01-25T15:05:52.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.085+0000 7f48efeee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48e806b490 0x7f48e81ee250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:52.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.085+0000 7f48efeee640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f48e80c8620 0x7f48e8150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:52.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.085+0000 7f48efeee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48e8158b80 0x7f48e81566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:52.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.085+0000 7f48efeee640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e8155ee0 con 0x7f48e806b490 2024-01-25T15:05:52.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.085+0000 7f48efeee640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e8157180 con 0x7f48e8158b80 2024-01-25T15:05:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.085+0000 7f48efeee640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e8157460 con 0x7f48e80c8620 2024-01-25T15:05:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.085+0000 7f48edc8a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48e806b490 0x7f48e81ee250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.085+0000 7f48edc8a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48e806b490 0x7f48e81ee250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55744/0 (socket says 172.21.15.29:55744) 2024-01-25T15:05:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.085+0000 7f48edc8a640 1 -- 172.21.15.29:0/1515775144 learned_addr learned my addr 172.21.15.29:0/1515775144 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.085+0000 7f48ee48b640 1 --2- 172.21.15.29:0/1515775144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48e8158b80 0x7f48e81566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.085+0000 7f48ed489640 1 --2- 172.21.15.29:0/1515775144 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f48e80c8620 0x7f48e8150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.086+0000 7f48edc8a640 1 -- 172.21.15.29:0/1515775144 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f48e80c8620 msgr2=0x7f48e8150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.086+0000 7f48edc8a640 1 --2- 172.21.15.29:0/1515775144 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f48e80c8620 0x7f48e8150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.086+0000 7f48edc8a640 1 -- 172.21.15.29:0/1515775144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48e8158b80 msgr2=0x7f48e81566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.086+0000 7f48edc8a640 1 --2- 172.21.15.29:0/1515775144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48e8158b80 0x7f48e81566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.086+0000 7f48edc8a640 1 -- 172.21.15.29:0/1515775144 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48dc0094d0 con 0x7f48e806b490 2024-01-25T15:05:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.086+0000 7f48edc8a640 1 --2- 172.21.15.29:0/1515775144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48e806b490 0x7f48e81ee250 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f48e000c410 tx=0x7f48e000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.086+0000 7f48e67fc640 1 -- 172.21.15.29:0/1515775144 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e00035f0 con 0x7f48e806b490 2024-01-25T15:05:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.086+0000 7f48e67fc640 1 -- 172.21.15.29:0/1515775144 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e0003750 con 0x7f48e806b490 2024-01-25T15:05:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.086+0000 7f48efeee640 1 -- 172.21.15.29:0/1515775144 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e8155b70 con 0x7f48e806b490 2024-01-25T15:05:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.086+0000 7f48e67fc640 1 -- 172.21.15.29:0/1515775144 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e0003b40 con 0x7f48e806b490 2024-01-25T15:05:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.086+0000 7f48efeee640 1 -- 172.21.15.29:0/1515775144 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e8156180 con 0x7f48e806b490 2024-01-25T15:05:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.087+0000 7f48efeee640 1 -- 172.21.15.29:0/1515775144 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e8074010 con 0x7f48e806b490 2024-01-25T15:05:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.087+0000 7f48e67fc640 1 -- 172.21.15.29:0/1515775144 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f48e0003ca0 con 0x7f48e806b490 2024-01-25T15:05:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.088+0000 7f48e67fc640 1 --2- 172.21.15.29:0/1515775144 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f48d406aed0 0x7f48d406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.088+0000 7f48e67fc640 1 -- 172.21.15.29:0/1515775144 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f48e0089130 con 0x7f48e806b490 2024-01-25T15:05:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.088+0000 7f48ed489640 1 --2- 172.21.15.29:0/1515775144 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f48d406aed0 0x7f48d406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.088+0000 7f48ed489640 1 --2- 172.21.15.29:0/1515775144 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f48d406aed0 0x7f48d406d390 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f48dc036000 tx=0x7f48dc03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:52.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.092+0000 7f48e67fc640 1 -- 172.21.15.29:0/1515775144 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f48e0053bf0 con 0x7f48e806b490 2024-01-25T15:05:52.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.269+0000 7f48efeee640 1 -- 172.21.15.29:0/1515775144 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f48e806bda0 con 0x7f48e806b490 2024-01-25T15:05:52.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.270+0000 7f48e67fc640 1 -- 172.21.15.29:0/1515775144 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f48e0057210 con 0x7f48e806b490 2024-01-25T15:05:52.270 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:52.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.271+0000 7f48efeee640 1 -- 172.21.15.29:0/1515775144 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f48d406aed0 msgr2=0x7f48d406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:52.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.271+0000 7f48efeee640 1 --2- 172.21.15.29:0/1515775144 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f48d406aed0 0x7f48d406d390 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f48dc036000 tx=0x7f48dc03d040 comp rx=0 tx=0).stop 2024-01-25T15:05:52.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.271+0000 7f48efeee640 1 -- 172.21.15.29:0/1515775144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48e806b490 msgr2=0x7f48e81ee250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:52.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.271+0000 7f48efeee640 1 --2- 172.21.15.29:0/1515775144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48e806b490 0x7f48e81ee250 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f48e000c410 tx=0x7f48e000c8d0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.271+0000 7f48efeee640 1 -- 172.21.15.29:0/1515775144 shutdown_connections 2024-01-25T15:05:52.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.271+0000 7f48efeee640 1 --2- 172.21.15.29:0/1515775144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48e8158b80 0x7f48e81566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.271+0000 7f48efeee640 1 --2- 172.21.15.29:0/1515775144 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f48e80c8620 0x7f48e8150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.271+0000 7f48efeee640 1 --2- 172.21.15.29:0/1515775144 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f48d406aed0 0x7f48d406d390 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.271+0000 7f48efeee640 1 --2- 172.21.15.29:0/1515775144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48e806b490 0x7f48e81ee250 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.271+0000 7f48efeee640 1 -- 172.21.15.29:0/1515775144 >> 172.21.15.29:0/1515775144 conn(0x7f48e80ca010 msgr2=0x7f48e8152f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:52.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.271+0000 7f48efeee640 1 -- 172.21.15.29:0/1515775144 shutdown_connections 2024-01-25T15:05:52.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.271+0000 7f48efeee640 1 -- 172.21.15.29:0/1515775144 wait complete. 2024-01-25T15:05:52.283 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:05:52.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.387+0000 7fa35e4fc640 1 Processor -- start 2024-01-25T15:05:52.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.387+0000 7fa35e4fc640 1 -- start start 2024-01-25T15:05:52.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.387+0000 7fa35e4fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa3580c8620 0x7fa3580c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:52.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.387+0000 7fa35e4fc640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3580c6770 con 0x7fa358158b80 2024-01-25T15:05:52.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.387+0000 7fa35e4fc640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa358154f10 con 0x7fa35806b490 2024-01-25T15:05:52.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.387+0000 7fa35e4fc640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3581551f0 con 0x7fa3580c8620 2024-01-25T15:05:52.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.388+0000 7fa3577fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa3580c8620 0x7fa3580c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:52.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.388+0000 7fa35ca99640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa358158b80 0x7fa358151c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54554/0 (socket says 172.21.15.29:54554) 2024-01-25T15:05:52.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.388+0000 7fa35ca99640 1 -- 172.21.15.29:0/49215516 learned_addr learned my addr 172.21.15.29:0/49215516 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:52.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.388+0000 7fa3577fe640 1 -- 172.21.15.29:0/49215516 >> v1:172.21.15.52:6789/0 conn(0x7fa35806b490 legacy=0x7fa3580c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:52.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.388+0000 7fa3577fe640 1 -- 172.21.15.29:0/49215516 >> v1:172.21.15.29:6789/0 conn(0x7fa358158b80 legacy=0x7fa358151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:52.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.388+0000 7fa356ffd640 1 -- 172.21.15.29:0/49215516 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2362018348 0 0) 0x7fa3580c6770 con 0x7fa358158b80 2024-01-25T15:05:52.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.388+0000 7fa3577fe640 1 -- 172.21.15.29:0/49215516 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3581554d0 con 0x7fa3580c8620 2024-01-25T15:05:52.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.389+0000 7fa3577fe640 1 --2- 172.21.15.29:0/49215516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3580c8620 0x7fa3580c6120 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0097a0 tx=0x7fa34c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4a9729a2eda39f server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:52.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.389+0000 7fa356ffd640 1 -- 172.21.15.29:0/49215516 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c031830 con 0x7fa3580c8620 2024-01-25T15:05:52.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.389+0000 7fa356ffd640 1 -- 172.21.15.29:0/49215516 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34c031990 con 0x7fa3580c8620 2024-01-25T15:05:52.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.389+0000 7fa356ffd640 1 -- 172.21.15.29:0/49215516 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c031d20 con 0x7fa3580c8620 2024-01-25T15:05:52.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.389+0000 7fa35e4fc640 1 -- 172.21.15.29:0/49215516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3580c8620 msgr2=0x7fa3580c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:52.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.389+0000 7fa35e4fc640 1 --2- 172.21.15.29:0/49215516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3580c8620 0x7fa3580c6120 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0097a0 tx=0x7fa34c02b8d0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.389+0000 7fa35e4fc640 1 -- 172.21.15.29:0/49215516 shutdown_connections 2024-01-25T15:05:52.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.389+0000 7fa35e4fc640 1 --2- 172.21.15.29:0/49215516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3580c8620 0x7fa3580c6120 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.389+0000 7fa35e4fc640 1 -- 172.21.15.29:0/49215516 >> 172.21.15.29:0/49215516 conn(0x7fa3580ca010 msgr2=0x7fa3580ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:52.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.389+0000 7fa35e4fc640 1 -- 172.21.15.29:0/49215516 shutdown_connections 2024-01-25T15:05:52.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.389+0000 7fa35e4fc640 1 -- 172.21.15.29:0/49215516 wait complete. 2024-01-25T15:05:52.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.390+0000 7fa35e4fc640 1 Processor -- start 2024-01-25T15:05:52.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.391+0000 7fa35e4fc640 1 -- start start 2024-01-25T15:05:52.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.391+0000 7fa35e4fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa35806b490 0x7fa358157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:52.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.391+0000 7fa35e4fc640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3580c8620 0x7fa3581e76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:52.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.391+0000 7fa35e4fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa358158b80 0x7fa3581eb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:52.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.391+0000 7fa35e4fc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3580c1400 con 0x7fa358158b80 2024-01-25T15:05:52.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.391+0000 7fa35e4fc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3581578d0 con 0x7fa35806b490 2024-01-25T15:05:52.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.391+0000 7fa35e4fc640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa358156940 con 0x7fa3580c8620 2024-01-25T15:05:52.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.391+0000 7fa35ca99640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa358158b80 0x7fa3581eb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:52.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.391+0000 7fa35ca99640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa358158b80 0x7fa3581eb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55760/0 (socket says 172.21.15.29:55760) 2024-01-25T15:05:52.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.391+0000 7fa35ca99640 1 -- 172.21.15.29:0/527637390 learned_addr learned my addr 172.21.15.29:0/527637390 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:52.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.391+0000 7fa3577fe640 1 --2- 172.21.15.29:0/527637390 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3580c8620 0x7fa3581e76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:52.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.391+0000 7fa357fff640 1 --2- 172.21.15.29:0/527637390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa35806b490 0x7fa358157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:52.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.392+0000 7fa35ca99640 1 -- 172.21.15.29:0/527637390 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3580c8620 msgr2=0x7fa3581e76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:52.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.392+0000 7fa35ca99640 1 --2- 172.21.15.29:0/527637390 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3580c8620 0x7fa3581e76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.392+0000 7fa35ca99640 1 -- 172.21.15.29:0/527637390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa35806b490 msgr2=0x7fa358157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:52.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.392+0000 7fa35ca99640 1 --2- 172.21.15.29:0/527637390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa35806b490 0x7fa358157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.392+0000 7fa35ca99640 1 -- 172.21.15.29:0/527637390 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34c009400 con 0x7fa358158b80 2024-01-25T15:05:52.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.392+0000 7fa35ca99640 1 --2- 172.21.15.29:0/527637390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa358158b80 0x7fa3581eb430 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa35000c730 tx=0x7fa35000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:52.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.392+0000 7fa354ff9640 1 -- 172.21.15.29:0/527637390 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa350004d60 con 0x7fa358158b80 2024-01-25T15:05:52.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.392+0000 7fa354ff9640 1 -- 172.21.15.29:0/527637390 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35000a5e0 con 0x7fa358158b80 2024-01-25T15:05:52.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.392+0000 7fa35e4fc640 1 -- 172.21.15.29:0/527637390 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa358155b70 con 0x7fa358158b80 2024-01-25T15:05:52.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.392+0000 7fa354ff9640 1 -- 172.21.15.29:0/527637390 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35000a9d0 con 0x7fa358158b80 2024-01-25T15:05:52.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.392+0000 7fa35e4fc640 1 -- 172.21.15.29:0/527637390 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa35814c5c0 con 0x7fa358158b80 2024-01-25T15:05:52.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.393+0000 7fa35e4fc640 1 -- 172.21.15.29:0/527637390 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3580a97d0 con 0x7fa358158b80 2024-01-25T15:05:52.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.393+0000 7fa354ff9640 1 -- 172.21.15.29:0/527637390 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fa35000ad40 con 0x7fa358158b80 2024-01-25T15:05:52.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.394+0000 7fa354ff9640 1 --2- 172.21.15.29:0/527637390 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa34406af00 0x7fa34406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:52.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.394+0000 7fa354ff9640 1 -- 172.21.15.29:0/527637390 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fa350089260 con 0x7fa358158b80 2024-01-25T15:05:52.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.394+0000 7fa357fff640 1 --2- 172.21.15.29:0/527637390 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa34406af00 0x7fa34406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:52.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.394+0000 7fa357fff640 1 --2- 172.21.15.29:0/527637390 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa34406af00 0x7fa34406d3c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa348000f60 tx=0x7fa348009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:52.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.398+0000 7fa354ff9640 1 -- 172.21.15.29:0/527637390 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fa350053dd0 con 0x7fa358158b80 2024-01-25T15:05:52.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.578+0000 7fa35e4fc640 1 -- 172.21.15.29:0/527637390 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa358074010 con 0x7fa358158b80 2024-01-25T15:05:52.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.578+0000 7fa354ff9640 1 -- 172.21.15.29:0/527637390 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa3500573f0 con 0x7fa358158b80 2024-01-25T15:05:52.579 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-25T15:05:52.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.580+0000 7fa35e4fc640 1 -- 172.21.15.29:0/527637390 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa34406af00 msgr2=0x7fa34406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:52.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.580+0000 7fa35e4fc640 1 --2- 172.21.15.29:0/527637390 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa34406af00 0x7fa34406d3c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa348000f60 tx=0x7fa348009040 comp rx=0 tx=0).stop 2024-01-25T15:05:52.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.580+0000 7fa35e4fc640 1 -- 172.21.15.29:0/527637390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa358158b80 msgr2=0x7fa3581eb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:52.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.580+0000 7fa35e4fc640 1 --2- 172.21.15.29:0/527637390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa358158b80 0x7fa3581eb430 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa35000c730 tx=0x7fa35000cbf0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.580+0000 7fa35e4fc640 1 -- 172.21.15.29:0/527637390 shutdown_connections 2024-01-25T15:05:52.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.580+0000 7fa35e4fc640 1 --2- 172.21.15.29:0/527637390 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa34406af00 0x7fa34406d3c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.580+0000 7fa35e4fc640 1 --2- 172.21.15.29:0/527637390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa358158b80 0x7fa3581eb430 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.580+0000 7fa35e4fc640 1 --2- 172.21.15.29:0/527637390 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3580c8620 0x7fa3581e76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.580+0000 7fa35e4fc640 1 --2- 172.21.15.29:0/527637390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa35806b490 0x7fa358157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.580+0000 7fa35e4fc640 1 -- 172.21.15.29:0/527637390 >> 172.21.15.29:0/527637390 conn(0x7fa3580ca010 msgr2=0x7fa3580c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:52.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.580+0000 7fa35e4fc640 1 -- 172.21.15.29:0/527637390 shutdown_connections 2024-01-25T15:05:52.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.580+0000 7fa35e4fc640 1 -- 172.21.15.29:0/527637390 wait complete. 2024-01-25T15:05:52.591 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-25T15:05:52.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.695+0000 7f5f5e6d0640 1 Processor -- start 2024-01-25T15:05:52.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.696+0000 7f5f5e6d0640 1 -- start start 2024-01-25T15:05:52.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.696+0000 7f5f5e6d0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5f5806d560 0x7f5f5806b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:52.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.696+0000 7f5f5e6d0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5f580c4fe0 0x7f5f5806b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:52.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.696+0000 7f5f5e6d0640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f580afaa0 con 0x7f5f580af6c0 2024-01-25T15:05:52.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.696+0000 7f5f5e6d0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5806c480 con 0x7f5f580c4fe0 2024-01-25T15:05:52.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.696+0000 7f5f5e6d0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f58155290 con 0x7f5f5806d560 2024-01-25T15:05:52.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.696+0000 7f5f5cc6d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5f580c4fe0 0x7f5f5806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:52.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.696+0000 7f5f57fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5f580af6c0 0x7f5f580c5530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54562/0 (socket says 172.21.15.29:54562) 2024-01-25T15:05:52.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.696+0000 7f5f57fff640 1 -- 172.21.15.29:0/3992559655 learned_addr learned my addr 172.21.15.29:0/3992559655 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:52.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.697+0000 7f5f577fe640 1 --2- 172.21.15.29:0/3992559655 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5f5806d560 0x7f5f5806b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:52.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.697+0000 7f5f5cc6d640 1 -- 172.21.15.29:0/3992559655 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5f5806d560 msgr2=0x7f5f5806b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:52.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.697+0000 7f5f5cc6d640 1 --2- 172.21.15.29:0/3992559655 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5f5806d560 0x7f5f5806b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.697+0000 7f5f5cc6d640 1 -- 172.21.15.29:0/3992559655 >> v1:172.21.15.29:6789/0 conn(0x7f5f580af6c0 legacy=0x7f5f580c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:52.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.697+0000 7f5f56ffd640 1 -- 172.21.15.29:0/3992559655 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723366207 0 0) 0x7f5f580afaa0 con 0x7f5f580af6c0 2024-01-25T15:05:52.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.697+0000 7f5f5cc6d640 1 -- 172.21.15.29:0/3992559655 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f580c6060 con 0x7f5f580c4fe0 2024-01-25T15:05:52.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.697+0000 7f5f5cc6d640 1 --2- 172.21.15.29:0/3992559655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f580c4fe0 0x7f5f5806b760 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5f50009d90 tx=0x7f5f5002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94702f7850bac623 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:52.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.698+0000 7f5f56ffd640 1 -- 172.21.15.29:0/3992559655 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5002cc50 con 0x7f5f580c4fe0 2024-01-25T15:05:52.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.698+0000 7f5f56ffd640 1 -- 172.21.15.29:0/3992559655 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5002cdb0 con 0x7f5f580c4fe0 2024-01-25T15:05:52.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.698+0000 7f5f56ffd640 1 -- 172.21.15.29:0/3992559655 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50034660 con 0x7f5f580c4fe0 2024-01-25T15:05:52.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.698+0000 7f5f5e6d0640 1 -- 172.21.15.29:0/3992559655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f580c4fe0 msgr2=0x7f5f5806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:52.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.698+0000 7f5f5e6d0640 1 --2- 172.21.15.29:0/3992559655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f580c4fe0 0x7f5f5806b760 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5f50009d90 tx=0x7f5f5002bea0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.698+0000 7f5f5e6d0640 1 -- 172.21.15.29:0/3992559655 shutdown_connections 2024-01-25T15:05:52.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.698+0000 7f5f5e6d0640 1 --2- 172.21.15.29:0/3992559655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f580c4fe0 0x7f5f5806b760 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.698+0000 7f5f5e6d0640 1 --2- 172.21.15.29:0/3992559655 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5f5806d560 0x7f5f5806b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.698+0000 7f5f5e6d0640 1 -- 172.21.15.29:0/3992559655 >> 172.21.15.29:0/3992559655 conn(0x7f5f580c6ca0 msgr2=0x7f5f580c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:52.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.698+0000 7f5f5e6d0640 1 -- 172.21.15.29:0/3992559655 shutdown_connections 2024-01-25T15:05:52.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.698+0000 7f5f5e6d0640 1 -- 172.21.15.29:0/3992559655 wait complete. 2024-01-25T15:05:52.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.699+0000 7f5f5e6d0640 1 Processor -- start 2024-01-25T15:05:52.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.700+0000 7f5f5e6d0640 1 -- start start 2024-01-25T15:05:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.700+0000 7f5f5e6d0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f5806d560 0x7f5f580be890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.700+0000 7f5f5e6d0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f580af6c0 0x7f5f580ad580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.700+0000 7f5f5e6d0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5f580c4fe0 0x7f5f580c2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.700+0000 7f5f5e6d0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f580c05e0 con 0x7f5f5806d560 2024-01-25T15:05:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.700+0000 7f5f5e6d0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f581eaa20 con 0x7f5f580af6c0 2024-01-25T15:05:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.700+0000 7f5f5e6d0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f580b01c0 con 0x7f5f580c4fe0 2024-01-25T15:05:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.700+0000 7f5f57fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f5806d560 0x7f5f580be890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.700+0000 7f5f57fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f5806d560 0x7f5f580be890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55772/0 (socket says 172.21.15.29:55772) 2024-01-25T15:05:52.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.700+0000 7f5f57fff640 1 -- 172.21.15.29:0/927502141 learned_addr learned my addr 172.21.15.29:0/927502141 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:52.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.701+0000 7f5f577fe640 1 --2- 172.21.15.29:0/927502141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f580af6c0 0x7f5f580ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:52.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.701+0000 7f5f5cc6d640 1 --2- 172.21.15.29:0/927502141 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5f580c4fe0 0x7f5f580c2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:52.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.701+0000 7f5f57fff640 1 -- 172.21.15.29:0/927502141 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5f580c4fe0 msgr2=0x7f5f580c2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:52.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.701+0000 7f5f57fff640 1 --2- 172.21.15.29:0/927502141 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5f580c4fe0 0x7f5f580c2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.701+0000 7f5f57fff640 1 -- 172.21.15.29:0/927502141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f580af6c0 msgr2=0x7f5f580ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:52.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.701+0000 7f5f57fff640 1 --2- 172.21.15.29:0/927502141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f580af6c0 0x7f5f580ad580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.701+0000 7f5f57fff640 1 -- 172.21.15.29:0/927502141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f50009a70 con 0x7f5f5806d560 2024-01-25T15:05:52.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.701+0000 7f5f577fe640 1 --2- 172.21.15.29:0/927502141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f580af6c0 0x7f5f580ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:52.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.701+0000 7f5f57fff640 1 --2- 172.21.15.29:0/927502141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f5806d560 0x7f5f580be890 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800c500 tx=0x7f5f4800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:52.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.701+0000 7f5f54ff9640 1 -- 172.21.15.29:0/927502141 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48007560 con 0x7f5f5806d560 2024-01-25T15:05:52.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.701+0000 7f5f54ff9640 1 -- 172.21.15.29:0/927502141 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f480047e0 con 0x7f5f5806d560 2024-01-25T15:05:52.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.701+0000 7f5f5e6d0640 1 -- 172.21.15.29:0/927502141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f581eaf10 con 0x7f5f5806d560 2024-01-25T15:05:52.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.701+0000 7f5f54ff9640 1 -- 172.21.15.29:0/927502141 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48004b90 con 0x7f5f5806d560 2024-01-25T15:05:52.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.701+0000 7f5f5e6d0640 1 -- 172.21.15.29:0/927502141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f580c2350 con 0x7f5f5806d560 2024-01-25T15:05:52.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.702+0000 7f5f5e6d0640 1 -- 172.21.15.29:0/927502141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f58074010 con 0x7f5f5806d560 2024-01-25T15:05:52.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.702+0000 7f5f54ff9640 1 -- 172.21.15.29:0/927502141 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f5f48004cf0 con 0x7f5f5806d560 2024-01-25T15:05:52.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.703+0000 7f5f54ff9640 1 --2- 172.21.15.29:0/927502141 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5f4406aed0 0x7f5f4406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:52.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.703+0000 7f5f54ff9640 1 -- 172.21.15.29:0/927502141 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f5f48088f10 con 0x7f5f5806d560 2024-01-25T15:05:52.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.703+0000 7f5f577fe640 1 --2- 172.21.15.29:0/927502141 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5f4406aed0 0x7f5f4406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:52.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.704+0000 7f5f577fe640 1 --2- 172.21.15.29:0/927502141 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5f4406aed0 0x7f5f4406d390 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5f580c9170 tx=0x7f5f4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:52.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.707+0000 7f5f54ff9640 1 -- 172.21.15.29:0/927502141 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f5f480539d0 con 0x7f5f5806d560 2024-01-25T15:05:52.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.885+0000 7f5f5e6d0640 1 -- 172.21.15.29:0/927502141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5f580c45c0 con 0x7f5f5806d560 2024-01-25T15:05:52.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.886+0000 7f5f54ff9640 1 -- 172.21.15.29:0/927502141 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v42) v1 ==== 105+0+11 (secure 0 0 0) 0x7f5f48018020 con 0x7f5f5806d560 2024-01-25T15:05:52.887 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:52.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.888+0000 7f5f5e6d0640 1 -- 172.21.15.29:0/927502141 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5f4406aed0 msgr2=0x7f5f4406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:52.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.888+0000 7f5f5e6d0640 1 --2- 172.21.15.29:0/927502141 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5f4406aed0 0x7f5f4406d390 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5f580c9170 tx=0x7f5f4c008040 comp rx=0 tx=0).stop 2024-01-25T15:05:52.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.888+0000 7f5f5e6d0640 1 -- 172.21.15.29:0/927502141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f5806d560 msgr2=0x7f5f580be890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:52.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.888+0000 7f5f5e6d0640 1 --2- 172.21.15.29:0/927502141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f5806d560 0x7f5f580be890 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800c500 tx=0x7f5f4800c9c0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.888+0000 7f5f5e6d0640 1 -- 172.21.15.29:0/927502141 shutdown_connections 2024-01-25T15:05:52.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.888+0000 7f5f5e6d0640 1 --2- 172.21.15.29:0/927502141 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5f580c4fe0 0x7f5f580c2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.888+0000 7f5f5e6d0640 1 --2- 172.21.15.29:0/927502141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f580af6c0 0x7f5f580ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.888+0000 7f5f5e6d0640 1 --2- 172.21.15.29:0/927502141 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5f4406aed0 0x7f5f4406d390 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.888+0000 7f5f5e6d0640 1 --2- 172.21.15.29:0/927502141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f5806d560 0x7f5f580be890 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:52.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.888+0000 7f5f5e6d0640 1 -- 172.21.15.29:0/927502141 >> 172.21.15.29:0/927502141 conn(0x7f5f580c6ca0 msgr2=0x7f5f580ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:52.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.888+0000 7f5f5e6d0640 1 -- 172.21.15.29:0/927502141 shutdown_connections 2024-01-25T15:05:52.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:52.888+0000 7f5f5e6d0640 1 -- 172.21.15.29:0/927502141 wait complete. 2024-01-25T15:05:52.900 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-25T15:05:53.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.004+0000 7f1690497640 1 Processor -- start 2024-01-25T15:05:53.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.004+0000 7f1690497640 1 -- start start 2024-01-25T15:05:53.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.005+0000 7f1690497640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f168806b490 0x7f16880c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:53.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.005+0000 7f1690497640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1688158b80 0x7f16880c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:53.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.005+0000 7f1690497640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f16880c8450 0x7f1688151c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:53.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.005+0000 7f1690497640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16880c88e0 con 0x7f16880c8450 2024-01-25T15:05:53.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.005+0000 7f1690497640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16880c6770 con 0x7f1688158b80 2024-01-25T15:05:53.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.005+0000 7f1690497640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1688154f10 con 0x7f168806b490 2024-01-25T15:05:53.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.005+0000 7f168ea34640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f16880c8450 0x7f1688151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:53.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.005+0000 7f168ea34640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f16880c8450 0x7f1688151c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55782/0 (socket says 172.21.15.29:55782) 2024-01-25T15:05:53.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.005+0000 7f168ea34640 1 -- 172.21.15.29:0/595203330 learned_addr learned my addr 172.21.15.29:0/595203330 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:53.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.005+0000 7f168e233640 1 --2- 172.21.15.29:0/595203330 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f168806b490 0x7f16880c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:53.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.005+0000 7f168da32640 1 --2- 172.21.15.29:0/595203330 >> v2:172.21.15.52:3300/0 conn(0x7f1688158b80 0x7f16880c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:53.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.005+0000 7f168ea34640 1 -- 172.21.15.29:0/595203330 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f168806b490 msgr2=0x7f16880c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:53.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.005+0000 7f168ea34640 1 --2- 172.21.15.29:0/595203330 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f168806b490 0x7f16880c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.005+0000 7f168ea34640 1 -- 172.21.15.29:0/595203330 >> v2:172.21.15.52:3300/0 conn(0x7f1688158b80 msgr2=0x7f16880c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:53.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.005+0000 7f168ea34640 1 --2- 172.21.15.29:0/595203330 >> v2:172.21.15.52:3300/0 conn(0x7f1688158b80 0x7f16880c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.005+0000 7f168ea34640 1 -- 172.21.15.29:0/595203330 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16881551f0 con 0x7f16880c8450 2024-01-25T15:05:53.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.005+0000 7f168da32640 1 --2- 172.21.15.29:0/595203330 >> v2:172.21.15.52:3300/0 conn(0x7f1688158b80 0x7f16880c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:53.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.006+0000 7f168ea34640 1 --2- 172.21.15.29:0/595203330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16880c8450 0x7f1688151c30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f168808b8a0 tx=0x7f167802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6ecbc900511dab server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:53.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.006+0000 7f168d231640 1 -- 172.21.15.29:0/595203330 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167802c9e0 con 0x7f16880c8450 2024-01-25T15:05:53.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.006+0000 7f168d231640 1 -- 172.21.15.29:0/595203330 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167802cb40 con 0x7f16880c8450 2024-01-25T15:05:53.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.006+0000 7f168d231640 1 -- 172.21.15.29:0/595203330 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16780343f0 con 0x7f16880c8450 2024-01-25T15:05:53.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.007+0000 7f1690497640 1 -- 172.21.15.29:0/595203330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16880c8450 msgr2=0x7f1688151c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:53.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.007+0000 7f1690497640 1 --2- 172.21.15.29:0/595203330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16880c8450 0x7f1688151c30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f168808b8a0 tx=0x7f167802be40 comp rx=0 tx=0).stop 2024-01-25T15:05:53.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.007+0000 7f1690497640 1 -- 172.21.15.29:0/595203330 shutdown_connections 2024-01-25T15:05:53.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.007+0000 7f1690497640 1 --2- 172.21.15.29:0/595203330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16880c8450 0x7f1688151c30 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.007+0000 7f1690497640 1 --2- 172.21.15.29:0/595203330 >> v2:172.21.15.52:3300/0 conn(0x7f1688158b80 0x7f16880c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.007+0000 7f1690497640 1 --2- 172.21.15.29:0/595203330 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f168806b490 0x7f16880c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.007+0000 7f1690497640 1 -- 172.21.15.29:0/595203330 >> 172.21.15.29:0/595203330 conn(0x7f16880ca010 msgr2=0x7f16880ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:53.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.007+0000 7f1690497640 1 -- 172.21.15.29:0/595203330 shutdown_connections 2024-01-25T15:05:53.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.007+0000 7f1690497640 1 -- 172.21.15.29:0/595203330 wait complete. 2024-01-25T15:05:53.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.008+0000 7f1690497640 1 Processor -- start 2024-01-25T15:05:53.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.008+0000 7f1690497640 1 -- start start 2024-01-25T15:05:53.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.009+0000 7f1690497640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f168806b490 0x7f16881ede10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:53.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.009+0000 7f1690497640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16880c8450 0x7f16881e9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:53.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.009+0000 7f1690497640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1688158b80 0x7f1688155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:53.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.009+0000 7f1690497640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168814d230 con 0x7f1688158b80 2024-01-25T15:05:53.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.009+0000 7f1690497640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1688150860 con 0x7f16880c8450 2024-01-25T15:05:53.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.009+0000 7f1690497640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1688156470 con 0x7f168806b490 2024-01-25T15:05:53.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.009+0000 7f168ea34640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1688158b80 0x7f1688155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:53.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.009+0000 7f168ea34640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1688158b80 0x7f1688155f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55788/0 (socket says 172.21.15.29:55788) 2024-01-25T15:05:53.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.009+0000 7f168ea34640 1 -- 172.21.15.29:0/2487172775 learned_addr learned my addr 172.21.15.29:0/2487172775 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:53.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.009+0000 7f168e233640 1 --2- 172.21.15.29:0/2487172775 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f168806b490 0x7f16881ede10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:53.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.009+0000 7f168da32640 1 --2- 172.21.15.29:0/2487172775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16880c8450 0x7f16881e9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:53.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.009+0000 7f168ea34640 1 -- 172.21.15.29:0/2487172775 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f168806b490 msgr2=0x7f16881ede10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:53.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.009+0000 7f168ea34640 1 --2- 172.21.15.29:0/2487172775 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f168806b490 0x7f16881ede10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.009+0000 7f168ea34640 1 -- 172.21.15.29:0/2487172775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16880c8450 msgr2=0x7f16881e9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.009+0000 7f168ea34640 1 --2- 172.21.15.29:0/2487172775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16880c8450 0x7f16881e9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.009+0000 7f168ea34640 1 -- 172.21.15.29:0/2487172775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1678009b30 con 0x7f1688158b80 2024-01-25T15:05:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.009+0000 7f168ea34640 1 --2- 172.21.15.29:0/2487172775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1688158b80 0x7f1688155f30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1678036040 tx=0x7f1678004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.010+0000 7f1686ffd640 1 -- 172.21.15.29:0/2487172775 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1678009510 con 0x7f1688158b80 2024-01-25T15:05:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.010+0000 7f1686ffd640 1 -- 172.21.15.29:0/2487172775 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167803e450 con 0x7f1688158b80 2024-01-25T15:05:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.010+0000 7f1686ffd640 1 -- 172.21.15.29:0/2487172775 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167803e800 con 0x7f1688158b80 2024-01-25T15:05:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.010+0000 7f1690497640 1 -- 172.21.15.29:0/2487172775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16881ed3c0 con 0x7f1688158b80 2024-01-25T15:05:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.010+0000 7f1690497640 1 -- 172.21.15.29:0/2487172775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16881566a0 con 0x7f1688158b80 2024-01-25T15:05:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.011+0000 7f1690497640 1 -- 172.21.15.29:0/2487172775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16880acd80 con 0x7f1688158b80 2024-01-25T15:05:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.011+0000 7f1686ffd640 1 -- 172.21.15.29:0/2487172775 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f167803e960 con 0x7f1688158b80 2024-01-25T15:05:53.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.012+0000 7f1686ffd640 1 --2- 172.21.15.29:0/2487172775 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f167406aed0 0x7f167406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:53.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.012+0000 7f1686ffd640 1 -- 172.21.15.29:0/2487172775 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f16780ac790 con 0x7f1688158b80 2024-01-25T15:05:53.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.012+0000 7f168e233640 1 --2- 172.21.15.29:0/2487172775 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f167406aed0 0x7f167406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:53.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.012+0000 7f168e233640 1 --2- 172.21.15.29:0/2487172775 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f167406aed0 0x7f167406d390 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f16881e7c90 tx=0x7f1680008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:53.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.016+0000 7f1686ffd640 1 -- 172.21.15.29:0/2487172775 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f1678077370 con 0x7f1688158b80 2024-01-25T15:05:53.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.194+0000 7f1690497640 1 -- 172.21.15.29:0/2487172775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f1688067be0 con 0x7f1688158b80 2024-01-25T15:05:53.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.195+0000 7f1686ffd640 1 -- 172.21.15.29:0/2487172775 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v42) v1 ==== 101+0+11 (secure 0 0 0) 0x7f167807a990 con 0x7f1688158b80 2024-01-25T15:05:53.196 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-25T15:05:53.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.197+0000 7f1690497640 1 -- 172.21.15.29:0/2487172775 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f167406aed0 msgr2=0x7f167406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:53.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.197+0000 7f1690497640 1 --2- 172.21.15.29:0/2487172775 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f167406aed0 0x7f167406d390 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f16881e7c90 tx=0x7f1680008040 comp rx=0 tx=0).stop 2024-01-25T15:05:53.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.197+0000 7f1690497640 1 -- 172.21.15.29:0/2487172775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1688158b80 msgr2=0x7f1688155f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:53.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.197+0000 7f1690497640 1 --2- 172.21.15.29:0/2487172775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1688158b80 0x7f1688155f30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1678036040 tx=0x7f1678004a40 comp rx=0 tx=0).stop 2024-01-25T15:05:53.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.197+0000 7f1690497640 1 -- 172.21.15.29:0/2487172775 shutdown_connections 2024-01-25T15:05:53.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.197+0000 7f1690497640 1 --2- 172.21.15.29:0/2487172775 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f167406aed0 0x7f167406d390 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.197+0000 7f1690497640 1 --2- 172.21.15.29:0/2487172775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1688158b80 0x7f1688155f30 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.197+0000 7f1690497640 1 --2- 172.21.15.29:0/2487172775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16880c8450 0x7f16881e9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.197+0000 7f1690497640 1 --2- 172.21.15.29:0/2487172775 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f168806b490 0x7f16881ede10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.197+0000 7f1690497640 1 -- 172.21.15.29:0/2487172775 >> 172.21.15.29:0/2487172775 conn(0x7f16880ca010 msgr2=0x7f1688151dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:53.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.197+0000 7f1690497640 1 -- 172.21.15.29:0/2487172775 shutdown_connections 2024-01-25T15:05:53.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.197+0000 7f1690497640 1 -- 172.21.15.29:0/2487172775 wait complete. 2024-01-25T15:05:53.208 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-25T15:05:53.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.310+0000 7f7bf0361640 1 Processor -- start 2024-01-25T15:05:53.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.310+0000 7f7bf0361640 1 -- start start 2024-01-25T15:05:53.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.311+0000 7f7bf0361640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be8151f80 0x7f7be80c6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:53.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.311+0000 7f7bf0361640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7be8155190 0x7f7be80c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:53.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.311+0000 7f7bf0361640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be8158120 con 0x7f7be80c48d0 2024-01-25T15:05:53.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.311+0000 7f7bf0361640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be8155640 con 0x7f7be8155190 2024-01-25T15:05:53.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.311+0000 7f7bf0361640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be80c4db0 con 0x7f7be8151f80 2024-01-25T15:05:53.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.311+0000 7f7bed8fc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7be80c48d0 0x7f7be81585b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54570/0 (socket says 172.21.15.29:54570) 2024-01-25T15:05:53.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.311+0000 7f7bed8fc640 1 -- 172.21.15.29:0/1967502279 learned_addr learned my addr 172.21.15.29:0/1967502279 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:53.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.311+0000 7f7bee0fd640 1 --2- 172.21.15.29:0/1967502279 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be8151f80 0x7f7be80c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:53.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.311+0000 7f7bee8fe640 1 --2- 172.21.15.29:0/1967502279 >> v2:172.21.15.52:3300/0 conn(0x7f7be8155190 0x7f7be80c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:53.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.311+0000 7f7bed0fb640 1 -- 172.21.15.29:0/1967502279 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635244217 0 0) 0x7f7be8158120 con 0x7f7be80c48d0 2024-01-25T15:05:53.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.311+0000 7f7bed0fb640 1 -- 172.21.15.29:0/1967502279 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bd4003520 con 0x7f7be80c48d0 2024-01-25T15:05:53.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.311+0000 7f7bee0fd640 1 -- 172.21.15.29:0/1967502279 >> v2:172.21.15.52:3300/0 conn(0x7f7be8155190 msgr2=0x7f7be80c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:53.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.311+0000 7f7bee0fd640 1 --2- 172.21.15.29:0/1967502279 >> v2:172.21.15.52:3300/0 conn(0x7f7be8155190 0x7f7be80c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.311+0000 7f7bee0fd640 1 -- 172.21.15.29:0/1967502279 >> v1:172.21.15.29:6789/0 conn(0x7f7be80c48d0 legacy=0x7f7be81585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:53.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.311+0000 7f7bee0fd640 1 -- 172.21.15.29:0/1967502279 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be80c5090 con 0x7f7be8151f80 2024-01-25T15:05:53.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.312+0000 7f7bee0fd640 1 --2- 172.21.15.29:0/1967502279 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be8151f80 0x7f7be80c6030 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7be40097a0 tx=0x7f7be402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9825cf38d3fa7916 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:53.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.312+0000 7f7bed0fb640 1 -- 172.21.15.29:0/1967502279 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be4031830 con 0x7f7be8151f80 2024-01-25T15:05:53.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.312+0000 7f7bed0fb640 1 -- 172.21.15.29:0/1967502279 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be4031990 con 0x7f7be8151f80 2024-01-25T15:05:53.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.312+0000 7f7bed0fb640 1 -- 172.21.15.29:0/1967502279 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be4031d00 con 0x7f7be8151f80 2024-01-25T15:05:53.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.313+0000 7f7bf0361640 1 -- 172.21.15.29:0/1967502279 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be8151f80 msgr2=0x7f7be80c6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:53.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.313+0000 7f7bf0361640 1 --2- 172.21.15.29:0/1967502279 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be8151f80 0x7f7be80c6030 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7be40097a0 tx=0x7f7be402b8d0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.313+0000 7f7bf0361640 1 -- 172.21.15.29:0/1967502279 shutdown_connections 2024-01-25T15:05:53.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.313+0000 7f7bf0361640 1 --2- 172.21.15.29:0/1967502279 >> v2:172.21.15.52:3300/0 conn(0x7f7be8155190 0x7f7be80c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.313+0000 7f7bf0361640 1 --2- 172.21.15.29:0/1967502279 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be8151f80 0x7f7be80c6030 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.313+0000 7f7bf0361640 1 -- 172.21.15.29:0/1967502279 >> 172.21.15.29:0/1967502279 conn(0x7f7be80c7f10 msgr2=0x7f7be80c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:53.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.313+0000 7f7bf0361640 1 -- 172.21.15.29:0/1967502279 shutdown_connections 2024-01-25T15:05:53.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.313+0000 7f7bf0361640 1 -- 172.21.15.29:0/1967502279 wait complete. 2024-01-25T15:05:53.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.314+0000 7f7bf0361640 1 Processor -- start 2024-01-25T15:05:53.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.314+0000 7f7bf0361640 1 -- start start 2024-01-25T15:05:53.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.315+0000 7f7bf0361640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be80c48d0 0x7f7be80ac010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:53.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.315+0000 7f7bf0361640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7be8151f80 0x7f7be8145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:53.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.315+0000 7f7bf0361640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7be8155190 0x7f7be806f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:53.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.315+0000 7f7bf0361640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be80ac860 con 0x7f7be8155190 2024-01-25T15:05:53.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.315+0000 7f7bf0361640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be81e9e10 con 0x7f7be8151f80 2024-01-25T15:05:53.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.315+0000 7f7bf0361640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be81eade0 con 0x7f7be80c48d0 2024-01-25T15:05:53.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.315+0000 7f7bee8fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7be8155190 0x7f7be806f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:53.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.315+0000 7f7bee8fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7be8155190 0x7f7be806f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55798/0 (socket says 172.21.15.29:55798) 2024-01-25T15:05:53.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.315+0000 7f7bee8fe640 1 -- 172.21.15.29:0/4004590241 learned_addr learned my addr 172.21.15.29:0/4004590241 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:53.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.315+0000 7f7bee0fd640 1 --2- 172.21.15.29:0/4004590241 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be80c48d0 0x7f7be80ac010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:53.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.315+0000 7f7bed8fc640 1 --2- 172.21.15.29:0/4004590241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7be8151f80 0x7f7be8145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:53.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.315+0000 7f7bee8fe640 1 -- 172.21.15.29:0/4004590241 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be80c48d0 msgr2=0x7f7be80ac010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:53.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.315+0000 7f7bee8fe640 1 --2- 172.21.15.29:0/4004590241 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be80c48d0 0x7f7be80ac010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.315+0000 7f7bee8fe640 1 -- 172.21.15.29:0/4004590241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7be8151f80 msgr2=0x7f7be8145c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:53.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.315+0000 7f7bee8fe640 1 --2- 172.21.15.29:0/4004590241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7be8151f80 0x7f7be8145c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.315+0000 7f7bee8fe640 1 -- 172.21.15.29:0/4004590241 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be4009400 con 0x7f7be8155190 2024-01-25T15:05:53.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.315+0000 7f7bee8fe640 1 --2- 172.21.15.29:0/4004590241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7be8155190 0x7f7be806f720 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7be000efc0 tx=0x7f7be000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:53.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.315+0000 7f7bdeffd640 1 -- 172.21.15.29:0/4004590241 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be0014480 con 0x7f7be8155190 2024-01-25T15:05:53.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.315+0000 7f7bdeffd640 1 -- 172.21.15.29:0/4004590241 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be000f040 con 0x7f7be8155190 2024-01-25T15:05:53.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.315+0000 7f7bf0361640 1 -- 172.21.15.29:0/4004590241 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be81ea950 con 0x7f7be8155190 2024-01-25T15:05:53.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.315+0000 7f7bdeffd640 1 -- 172.21.15.29:0/4004590241 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be0014820 con 0x7f7be8155190 2024-01-25T15:05:53.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.315+0000 7f7bf0361640 1 -- 172.21.15.29:0/4004590241 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be81ea020 con 0x7f7be8155190 2024-01-25T15:05:53.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.316+0000 7f7bf0361640 1 -- 172.21.15.29:0/4004590241 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be804eb10 con 0x7f7be8155190 2024-01-25T15:05:53.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.317+0000 7f7bdeffd640 1 -- 172.21.15.29:0/4004590241 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7be0014980 con 0x7f7be8155190 2024-01-25T15:05:53.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.317+0000 7f7bdeffd640 1 --2- 172.21.15.29:0/4004590241 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7bcc06aed0 0x7f7bcc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:53.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.317+0000 7f7bdeffd640 1 -- 172.21.15.29:0/4004590241 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f7be008a4a0 con 0x7f7be8155190 2024-01-25T15:05:53.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.317+0000 7f7bee0fd640 1 --2- 172.21.15.29:0/4004590241 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7bcc06aed0 0x7f7bcc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:53.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.318+0000 7f7bee0fd640 1 --2- 172.21.15.29:0/4004590241 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7bcc06aed0 0x7f7bcc06d390 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7be4036000 tx=0x7f7be403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:53.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.322+0000 7f7bdeffd640 1 -- 172.21.15.29:0/4004590241 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7be0055010 con 0x7f7be8155190 2024-01-25T15:05:53.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.514+0000 7f7bf0361640 1 -- 172.21.15.29:0/4004590241 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7be81eaae0 con 0x7f7be8155190 2024-01-25T15:05:53.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.515+0000 7f7bdeffd640 1 -- 172.21.15.29:0/4004590241 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7be0058630 con 0x7f7be8155190 2024-01-25T15:05:53.515 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-25T15:05:53.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.517+0000 7f7bf0361640 1 -- 172.21.15.29:0/4004590241 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7bcc06aed0 msgr2=0x7f7bcc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:53.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.517+0000 7f7bf0361640 1 --2- 172.21.15.29:0/4004590241 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7bcc06aed0 0x7f7bcc06d390 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7be4036000 tx=0x7f7be403c040 comp rx=0 tx=0).stop 2024-01-25T15:05:53.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.517+0000 7f7bf0361640 1 -- 172.21.15.29:0/4004590241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7be8155190 msgr2=0x7f7be806f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:53.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.517+0000 7f7bf0361640 1 --2- 172.21.15.29:0/4004590241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7be8155190 0x7f7be806f720 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7be000efc0 tx=0x7f7be000c490 comp rx=0 tx=0).stop 2024-01-25T15:05:53.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.517+0000 7f7bf0361640 1 -- 172.21.15.29:0/4004590241 shutdown_connections 2024-01-25T15:05:53.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.517+0000 7f7bf0361640 1 --2- 172.21.15.29:0/4004590241 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7bcc06aed0 0x7f7bcc06d390 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.517+0000 7f7bf0361640 1 --2- 172.21.15.29:0/4004590241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7be8155190 0x7f7be806f720 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.517+0000 7f7bf0361640 1 --2- 172.21.15.29:0/4004590241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7be8151f80 0x7f7be8145c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.517+0000 7f7bf0361640 1 --2- 172.21.15.29:0/4004590241 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7be80c48d0 0x7f7be80ac010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.517+0000 7f7bf0361640 1 -- 172.21.15.29:0/4004590241 >> 172.21.15.29:0/4004590241 conn(0x7f7be80c7f10 msgr2=0x7f7be80c6030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:53.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.517+0000 7f7bf0361640 1 -- 172.21.15.29:0/4004590241 shutdown_connections 2024-01-25T15:05:53.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.517+0000 7f7bf0361640 1 -- 172.21.15.29:0/4004590241 wait complete. 2024-01-25T15:05:53.528 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-25T15:05:53.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:53.528 DEBUG:teuthology.orchestra.run.smithi029:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-25T15:05:53.558 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-01-25T15:05:53.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:53.558 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-25T15:05:53.613 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:05:53.613 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:05:53.668 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057150,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498940k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17629 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249468k,nr_inodes=812367,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498940k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-25T15:05:53.668 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-25T15:05:53.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.809+0000 7f4edc51d640 1 Processor -- start 2024-01-25T15:05:53.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.809+0000 7f4edc51d640 1 -- start start 2024-01-25T15:05:53.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.810+0000 7f4edc51d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ed4151d60 0x7f4ed4155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:53.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.810+0000 7f4edc51d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4ed4155010 0x7f4ed40ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:53.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.810+0000 7f4edc51d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed4152140 con 0x7f4ed40ad030 2024-01-25T15:05:53.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.810+0000 7f4edc51d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed40c9ae0 con 0x7f4ed4155010 2024-01-25T15:05:53.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.810+0000 7f4edc51d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed40c9520 con 0x7f4ed4151d60 2024-01-25T15:05:53.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.811+0000 7f4eda2b9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ed4151d60 0x7f4ed4155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:53.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.811+0000 7f4edaaba640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4ed4155010 0x7f4ed40ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:53.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.811+0000 7f4eda2b9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ed4151d60 0x7f4ed4155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:34516/0 (socket says 172.21.15.29:34516) 2024-01-25T15:05:53.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.811+0000 7f4eda2b9640 1 -- 172.21.15.29:0/3035974371 learned_addr learned my addr 172.21.15.29:0/3035974371 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:53.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.811+0000 7f4eda2b9640 1 -- 172.21.15.29:0/3035974371 >> v2:172.21.15.52:3300/0 conn(0x7f4ed4155010 msgr2=0x7f4ed40ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:53.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.811+0000 7f4eda2b9640 1 --2- 172.21.15.29:0/3035974371 >> v2:172.21.15.52:3300/0 conn(0x7f4ed4155010 0x7f4ed40ae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.811+0000 7f4eda2b9640 1 -- 172.21.15.29:0/3035974371 >> v1:172.21.15.52:6789/0 conn(0x7f4ed40ad030 legacy=0x7f4ed4158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:53.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.811+0000 7f4eda2b9640 1 -- 172.21.15.29:0/3035974371 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed40c9800 con 0x7f4ed4151d60 2024-01-25T15:05:53.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.812+0000 7f4eda2b9640 1 --2- 172.21.15.29:0/3035974371 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ed4151d60 0x7f4ed4155b80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0009870 tx=0x7f4ed002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ec88c5e05cd500c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:53.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.812+0000 7f4ed92b7640 1 -- 172.21.15.29:0/3035974371 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0030840 con 0x7f4ed4151d60 2024-01-25T15:05:53.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.812+0000 7f4ed92b7640 1 -- 172.21.15.29:0/3035974371 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed00309a0 con 0x7f4ed4151d60 2024-01-25T15:05:53.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.812+0000 7f4ed92b7640 1 -- 172.21.15.29:0/3035974371 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0030d30 con 0x7f4ed4151d60 2024-01-25T15:05:53.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.813+0000 7f4edc51d640 1 -- 172.21.15.29:0/3035974371 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ed4151d60 msgr2=0x7f4ed4155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:53.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.813+0000 7f4edc51d640 1 --2- 172.21.15.29:0/3035974371 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ed4151d60 0x7f4ed4155b80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0009870 tx=0x7f4ed002b980 comp rx=0 tx=0).stop 2024-01-25T15:05:53.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.813+0000 7f4edc51d640 1 -- 172.21.15.29:0/3035974371 shutdown_connections 2024-01-25T15:05:53.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.813+0000 7f4edc51d640 1 --2- 172.21.15.29:0/3035974371 >> v2:172.21.15.52:3300/0 conn(0x7f4ed4155010 0x7f4ed40ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.813+0000 7f4edc51d640 1 --2- 172.21.15.29:0/3035974371 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ed4151d60 0x7f4ed4155b80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.813+0000 7f4edc51d640 1 -- 172.21.15.29:0/3035974371 >> 172.21.15.29:0/3035974371 conn(0x7f4ed4072420 msgr2=0x7f4ed40abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:53.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.813+0000 7f4edc51d640 1 -- 172.21.15.29:0/3035974371 shutdown_connections 2024-01-25T15:05:53.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.813+0000 7f4edc51d640 1 -- 172.21.15.29:0/3035974371 wait complete. 2024-01-25T15:05:53.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.814+0000 7f4edc51d640 1 Processor -- start 2024-01-25T15:05:53.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.814+0000 7f4edc51d640 1 -- start start 2024-01-25T15:05:53.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.814+0000 7f4edc51d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ed40ad030 0x7f4ed40aab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:53.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.814+0000 7f4edc51d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ed4151d60 0x7f4ed414ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:53.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.814+0000 7f4edc51d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ed4155010 0x7f4ed41493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:53.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.814+0000 7f4edc51d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed40ab060 con 0x7f4ed4151d60 2024-01-25T15:05:53.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.814+0000 7f4edc51d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed4157530 con 0x7f4ed40ad030 2024-01-25T15:05:53.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.814+0000 7f4edc51d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed41577d0 con 0x7f4ed4155010 2024-01-25T15:05:53.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.815+0000 7f4ed9ab8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ed4151d60 0x7f4ed414ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:53.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.815+0000 7f4ed9ab8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ed4151d60 0x7f4ed414ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55814/0 (socket says 172.21.15.29:55814) 2024-01-25T15:05:53.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.815+0000 7f4ed9ab8640 1 -- 172.21.15.29:0/2666501271 learned_addr learned my addr 172.21.15.29:0/2666501271 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:53.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.815+0000 7f4edaaba640 1 --2- 172.21.15.29:0/2666501271 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ed4155010 0x7f4ed41493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:53.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.815+0000 7f4eda2b9640 1 --2- 172.21.15.29:0/2666501271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ed40ad030 0x7f4ed40aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:53.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.815+0000 7f4ed9ab8640 1 -- 172.21.15.29:0/2666501271 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ed4155010 msgr2=0x7f4ed41493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:53.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.815+0000 7f4ed9ab8640 1 --2- 172.21.15.29:0/2666501271 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ed4155010 0x7f4ed41493d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.815+0000 7f4ed9ab8640 1 -- 172.21.15.29:0/2666501271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ed40ad030 msgr2=0x7f4ed40aab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:53.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.815+0000 7f4ed9ab8640 1 --2- 172.21.15.29:0/2666501271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ed40ad030 0x7f4ed40aab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:53.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.815+0000 7f4ed9ab8640 1 -- 172.21.15.29:0/2666501271 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed00094d0 con 0x7f4ed4151d60 2024-01-25T15:05:53.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.815+0000 7f4ed9ab8640 1 --2- 172.21.15.29:0/2666501271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ed4151d60 0x7f4ed414ee30 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400c3c0 tx=0x7f4ec400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:53.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.815+0000 7f4ecaffd640 1 -- 172.21.15.29:0/2666501271 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec40052d0 con 0x7f4ed4151d60 2024-01-25T15:05:53.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.815+0000 7f4ecaffd640 1 -- 172.21.15.29:0/2666501271 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec4005450 con 0x7f4ed4151d60 2024-01-25T15:05:53.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.815+0000 7f4edc51d640 1 -- 172.21.15.29:0/2666501271 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed40a9ba0 con 0x7f4ed4151d60 2024-01-25T15:05:53.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.815+0000 7f4ecaffd640 1 -- 172.21.15.29:0/2666501271 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4007260 con 0x7f4ed4151d60 2024-01-25T15:05:53.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.815+0000 7f4edc51d640 1 -- 172.21.15.29:0/2666501271 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed414f370 con 0x7f4ed4151d60 2024-01-25T15:05:53.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.816+0000 7f4edc51d640 1 -- 172.21.15.29:0/2666501271 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed40c8e50 con 0x7f4ed4151d60 2024-01-25T15:05:53.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.817+0000 7f4ecaffd640 1 -- 172.21.15.29:0/2666501271 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4ec40073c0 con 0x7f4ed4151d60 2024-01-25T15:05:53.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.817+0000 7f4ecaffd640 1 --2- 172.21.15.29:0/2666501271 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4eb806aed0 0x7f4eb806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:53.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.817+0000 7f4ecaffd640 1 -- 172.21.15.29:0/2666501271 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f4ec4088d40 con 0x7f4ed4151d60 2024-01-25T15:05:53.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.817+0000 7f4eda2b9640 1 --2- 172.21.15.29:0/2666501271 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4eb806aed0 0x7f4eb806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:53.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.818+0000 7f4eda2b9640 1 --2- 172.21.15.29:0/2666501271 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4eb806aed0 0x7f4eb806d390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0036000 tx=0x7f4ed0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:53.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:53.822+0000 7f4ecaffd640 1 -- 172.21.15.29:0/2666501271 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4ec40538b0 con 0x7f4ed4151d60 2024-01-25T15:05:54.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:54.040+0000 7f4edc51d640 1 -- 172.21.15.29:0/2666501271 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4ed4074080 con 0x7f4ed4151d60 2024-01-25T15:05:54.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:54.040+0000 7f4ecaffd640 1 -- 172.21.15.29:0/2666501271 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) v1 ==== 53+0+149 (secure 0 0 0) 0x7f4ec4056ed0 con 0x7f4ed4151d60 2024-01-25T15:05:54.041 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-25T15:05:54.041 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-01-25T15:05:54.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:54.042+0000 7f4edc51d640 1 -- 172.21.15.29:0/2666501271 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4eb806aed0 msgr2=0x7f4eb806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:54.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:54.042+0000 7f4edc51d640 1 --2- 172.21.15.29:0/2666501271 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4eb806aed0 0x7f4eb806d390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0036000 tx=0x7f4ed0008030 comp rx=0 tx=0).stop 2024-01-25T15:05:54.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:54.042+0000 7f4edc51d640 1 -- 172.21.15.29:0/2666501271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ed4151d60 msgr2=0x7f4ed414ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:54.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:54.042+0000 7f4edc51d640 1 --2- 172.21.15.29:0/2666501271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ed4151d60 0x7f4ed414ee30 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400c3c0 tx=0x7f4ec400c880 comp rx=0 tx=0).stop 2024-01-25T15:05:54.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:54.042+0000 7f4edc51d640 1 -- 172.21.15.29:0/2666501271 shutdown_connections 2024-01-25T15:05:54.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:54.042+0000 7f4edc51d640 1 --2- 172.21.15.29:0/2666501271 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4ed4155010 0x7f4ed41493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:54.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:54.042+0000 7f4edc51d640 1 --2- 172.21.15.29:0/2666501271 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4eb806aed0 0x7f4eb806d390 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:54.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:54.042+0000 7f4edc51d640 1 --2- 172.21.15.29:0/2666501271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ed4151d60 0x7f4ed414ee30 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:54.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:54.042+0000 7f4edc51d640 1 --2- 172.21.15.29:0/2666501271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ed40ad030 0x7f4ed40aab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:54.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:54.042+0000 7f4edc51d640 1 -- 172.21.15.29:0/2666501271 >> 172.21.15.29:0/2666501271 conn(0x7f4ed4072420 msgr2=0x7f4ed40ca7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:54.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:54.042+0000 7f4edc51d640 1 -- 172.21.15.29:0/2666501271 shutdown_connections 2024-01-25T15:05:54.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:54.042+0000 7f4edc51d640 1 -- 172.21.15.29:0/2666501271 wait complete. 2024-01-25T15:05:54.053 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2024-01-25T15:05:54.053 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-25T15:05:54.053 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-01-25T15:05:54.053 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2024-01-25T15:05:54.053 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-25T15:05:54.053 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2024-01-25T15:05:54.053 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-25T15:05:54.053 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.AbkvMbv41K 2024-01-25T15:05:54.054 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-01-25T15:05:54.068 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.FbSo7aq6KL 2024-01-25T15:05:54.068 DEBUG:teuthology.orchestra.run.smithi029:> sudo cp /tmp/tmp.AbkvMbv41K /tmp/tmp.FbSo7aq6KL 2024-01-25T15:05:54.134 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.FbSo7aq6KL 2024-01-25T15:05:54.259 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.FbSo7aq6KL is 185B 2024-01-25T15:05:54.307 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.FbSo7aq6KL 2024-01-25T15:05:54.321 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQDPeLJlxLZuBxAA/8ujRSojtEUokTSb0g9dxQ== caps mds = "allow rw fsname=cephfs" caps mon = "allow r fsname=cephfs" caps osd = "allow rw tag cephfs data=cephfs" 2024-01-25T15:05:54.321 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-25T15:05:54.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:54.322 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-01-25T15:05:54.377 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-25T15:05:54.377 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-25T15:05:54.377 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-01-25T15:05:54.377 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:54.377 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-01-25T15:05:54.377 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:54.377 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:05:54.377 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-01-25T15:05:54.378 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2024-01-25T15:05:54.378 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:05:54.378 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-01-25T15:05:54.378 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2024-01-25T15:05:54.378 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-25T15:05:54.378 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-01-25T15:05:54.378 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2024-01-25T15:05:54.378 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-01-25T15:05:54.378 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42633sec preferred_lft 42633sec 2024-01-25T15:05:54.378 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link noprefixroute 2024-01-25T15:05:54.378 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:54.378 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:05:54.378 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-01-25T15:05:54.378 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2024-01-25T15:05:54.379 INFO:teuthology.orchestra.run.smithi029.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-25T15:05:54.379 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether f2:5a:78:7f:5a:d7 brd ff:ff:ff:ff:ff:ff 2024-01-25T15:05:54.379 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-25T15:05:54.379 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:54.379 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::24f2:8aff:fe6e:4acd/64 scope link 2024-01-25T15:05:54.379 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:54.379 INFO:teuthology.orchestra.run.smithi029.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-25T15:05:54.379 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether f2:5a:78:7f:5a:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-25T15:05:54.379 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::f05a:78ff:fe7f:5ad7/64 scope link 2024-01-25T15:05:54.379 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:05:54.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:54.380 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-25T15:05:54.442 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-01-25T15:05:54.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:54.444 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-01-25T15:05:54.499 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-01-25T15:05:54.500 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-25T15:05:54.500 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-01-25T15:05:54.500 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-01-25T15:05:54.500 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-25T15:05:54.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:54.500 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2024-01-25T15:05:54.500 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-01-25T15:05:54.500 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-25T15:05:54.501 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-25T15:05:54.501 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-25T15:05:54.501 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-01-25T15:05:54.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:54.596 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-01-25T15:05:54.610 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-25T15:05:54.610 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-25T15:05:54.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:54.611 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2024-01-25T15:05:54.677 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-25T15:05:54.677 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-25T15:05:54.732 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-25T15:05:54.732 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-25T15:05:54.732 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-25T15:05:54.787 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:05:54.802 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/tmp/tmp.AbkvMbv41K of=/dev/stdout 2024-01-25T15:05:54.842 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2024-01-25T15:05:54.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:54.843 DEBUG:teuthology.orchestra.run.smithi029:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQDPeLJlxLZuBxAA/8ujRSojtEUokTSb0g9dxQ==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-25T15:05:54.927 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,secret=AQDPeLJlxLZuBxAA/8ujRSojtEUokTSb0g9dxQ==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-25T15:05:54.927 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-25T15:05:54.927 INFO:teuthology.orchestra.run.smithi029.stdout:keyring.get_secret failed 2024-01-25T15:05:54.931 INFO:teuthology.orchestra.run.smithi029.stderr:mount.ceph: kernel BUG! 2024-01-25T15:05:54.931 INFO:teuthology.orchestra.run.smithi029.stderr:mount error: no mds (Metadata Server) is up. The cluster might be laggy, or you may not be authorized 2024-01-25T15:05:54.931 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,secret=AQDPeLJlxLZuBxAA/8ujRSojtEUokTSb0g9dxQ==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-25T15:05:54.931 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-25T15:05:54.931 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.52:3300,172.21.15.52:3301" 2024-01-25T15:05:54.932 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with new device syntax: testuser@3f65c5fb-9e8c-471f-b2c4-a9841e901c7a.cephfs2=/ 2024-01-25T15:05:54.932 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.29:3300/172.21.15.52:3300/172.21.15.52:3301" will pass to kernel 2024-01-25T15:05:54.937 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-25T15:05:54.937 INFO:tasks.cephfs.kernel_mount:mount command failed 2024-01-25T15:05:54.938 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-25T15:05:54.938 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-25T15:05:55.031 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-25T15:05:55.083 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-25T15:05:55.084 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:05:55.084 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:05:55.099 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057150,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498940k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17629 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249468k,nr_inodes=812367,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498940k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-25T15:05:55.099 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:05:55.099 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:05:55.116 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:05:55.117 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:05:55.176 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:55.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.277+0000 7f081b0a2640 1 Processor -- start 2024-01-25T15:05:55.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.277+0000 7f081b0a2640 1 -- start start 2024-01-25T15:05:55.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.277+0000 7f081b0a2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0814151d10 0x7f0814155370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:55.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.278+0000 7f081b0a2640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08140c7d10 con 0x7f08140c75a0 2024-01-25T15:05:55.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.278+0000 7f081b0a2640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0814158cb0 con 0x7f08140c5e10 2024-01-25T15:05:55.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.278+0000 7f081b0a2640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08140c6950 con 0x7f0814151d10 2024-01-25T15:05:55.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.278+0000 7f0818e3e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0814151d10 0x7f0814155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:55.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.278+0000 7f0813fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f08140c75a0 0x7f08140c48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54572/0 (socket says 172.21.15.29:54572) 2024-01-25T15:05:55.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.278+0000 7f0813fff640 1 -- 172.21.15.29:0/965545107 learned_addr learned my addr 172.21.15.29:0/965545107 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:55.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.278+0000 7f0818e3e640 1 -- 172.21.15.29:0/965545107 >> v1:172.21.15.52:6789/0 conn(0x7f08140c5e10 legacy=0x7f08140c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:55.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.278+0000 7f0818e3e640 1 -- 172.21.15.29:0/965545107 >> v1:172.21.15.29:6789/0 conn(0x7f08140c75a0 legacy=0x7f08140c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:55.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.278+0000 7f08137fe640 1 -- 172.21.15.29:0/965545107 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737779307 0 0) 0x7f08140c7d10 con 0x7f08140c75a0 2024-01-25T15:05:55.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.278+0000 7f0818e3e640 1 -- 172.21.15.29:0/965545107 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0814157ef0 con 0x7f0814151d10 2024-01-25T15:05:55.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.279+0000 7f0818e3e640 1 --2- 172.21.15.29:0/965545107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0814151d10 0x7f0814155370 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f08080097a0 tx=0x7f080802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1323835eb47debbf server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:55.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.279+0000 7f08137fe640 1 -- 172.21.15.29:0/965545107 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0808030610 con 0x7f0814151d10 2024-01-25T15:05:55.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.279+0000 7f08137fe640 1 -- 172.21.15.29:0/965545107 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0808030770 con 0x7f0814151d10 2024-01-25T15:05:55.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.279+0000 7f08137fe640 1 -- 172.21.15.29:0/965545107 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0808030b00 con 0x7f0814151d10 2024-01-25T15:05:55.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.279+0000 7f081b0a2640 1 -- 172.21.15.29:0/965545107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0814151d10 msgr2=0x7f0814155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:55.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.279+0000 7f081b0a2640 1 --2- 172.21.15.29:0/965545107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0814151d10 0x7f0814155370 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f08080097a0 tx=0x7f080802b960 comp rx=0 tx=0).stop 2024-01-25T15:05:55.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.280+0000 7f081b0a2640 1 -- 172.21.15.29:0/965545107 shutdown_connections 2024-01-25T15:05:55.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.280+0000 7f081b0a2640 1 --2- 172.21.15.29:0/965545107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0814151d10 0x7f0814155370 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.280+0000 7f081b0a2640 1 -- 172.21.15.29:0/965545107 >> 172.21.15.29:0/965545107 conn(0x7f08140c7f10 msgr2=0x7f08140c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:55.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.280+0000 7f081b0a2640 1 -- 172.21.15.29:0/965545107 shutdown_connections 2024-01-25T15:05:55.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.280+0000 7f081b0a2640 1 -- 172.21.15.29:0/965545107 wait complete. 2024-01-25T15:05:55.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.281+0000 7f081b0a2640 1 Processor -- start 2024-01-25T15:05:55.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.281+0000 7f081b0a2640 1 -- start start 2024-01-25T15:05:55.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.281+0000 7f081b0a2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08140c5e10 0x7f08140abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:55.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.281+0000 7f081b0a2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08140c75a0 0x7f0814155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:55.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.282+0000 7f081b0a2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0814151d10 0x7f08141ed740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:55.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.282+0000 7f081b0a2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0814152d00 con 0x7f0814151d10 2024-01-25T15:05:55.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.282+0000 7f081b0a2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0814154630 con 0x7f08140c75a0 2024-01-25T15:05:55.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.282+0000 7f081b0a2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08140ac430 con 0x7f08140c5e10 2024-01-25T15:05:55.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.282+0000 7f081963f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0814151d10 0x7f08141ed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:55.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.282+0000 7f081963f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0814151d10 0x7f08141ed740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55826/0 (socket says 172.21.15.29:55826) 2024-01-25T15:05:55.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.282+0000 7f081963f640 1 -- 172.21.15.29:0/562036796 learned_addr learned my addr 172.21.15.29:0/562036796 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:55.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.282+0000 7f0813fff640 1 --2- 172.21.15.29:0/562036796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08140c75a0 0x7f0814155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:55.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.282+0000 7f0818e3e640 1 --2- 172.21.15.29:0/562036796 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08140c5e10 0x7f08140abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:55.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.282+0000 7f081963f640 1 -- 172.21.15.29:0/562036796 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08140c5e10 msgr2=0x7f08140abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:55.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.282+0000 7f081963f640 1 --2- 172.21.15.29:0/562036796 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08140c5e10 0x7f08140abef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.282+0000 7f081963f640 1 -- 172.21.15.29:0/562036796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08140c75a0 msgr2=0x7f0814155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:55.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.282+0000 7f081963f640 1 --2- 172.21.15.29:0/562036796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08140c75a0 0x7f0814155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.282+0000 7f081963f640 1 -- 172.21.15.29:0/562036796 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0808009400 con 0x7f0814151d10 2024-01-25T15:05:55.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.282+0000 7f081963f640 1 --2- 172.21.15.29:0/562036796 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0814151d10 0x7f08141ed740 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f080c00c6b0 tx=0x7f080c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:55.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.282+0000 7f08117fa640 1 -- 172.21.15.29:0/562036796 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c003b70 con 0x7f0814151d10 2024-01-25T15:05:55.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.282+0000 7f08117fa640 1 -- 172.21.15.29:0/562036796 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080c003cf0 con 0x7f0814151d10 2024-01-25T15:05:55.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.282+0000 7f08117fa640 1 -- 172.21.15.29:0/562036796 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c003ea0 con 0x7f0814151d10 2024-01-25T15:05:55.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.282+0000 7f081b0a2640 1 -- 172.21.15.29:0/562036796 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0814156060 con 0x7f0814151d10 2024-01-25T15:05:55.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.282+0000 7f081b0a2640 1 -- 172.21.15.29:0/562036796 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08141ee250 con 0x7f0814151d10 2024-01-25T15:05:55.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.283+0000 7f081b0a2640 1 -- 172.21.15.29:0/562036796 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f081404eb10 con 0x7f0814151d10 2024-01-25T15:05:55.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.284+0000 7f08117fa640 1 -- 172.21.15.29:0/562036796 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f080c005310 con 0x7f0814151d10 2024-01-25T15:05:55.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.284+0000 7f08117fa640 1 --2- 172.21.15.29:0/562036796 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f07f806aed0 0x7f07f806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:55.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.284+0000 7f08117fa640 1 -- 172.21.15.29:0/562036796 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f080c089870 con 0x7f0814151d10 2024-01-25T15:05:55.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.284+0000 7f0818e3e640 1 --2- 172.21.15.29:0/562036796 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f07f806aed0 0x7f07f806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:55.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.285+0000 7f0818e3e640 1 --2- 172.21.15.29:0/562036796 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f07f806aed0 0x7f07f806d390 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0808036000 tx=0x7f0808008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:55.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.288+0000 7f08117fa640 1 -- 172.21.15.29:0/562036796 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f080c054290 con 0x7f0814151d10 2024-01-25T15:05:55.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.469+0000 7f081b0a2640 1 -- 172.21.15.29:0/562036796 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08140abc10 con 0x7f0814151d10 2024-01-25T15:05:55.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.471+0000 7f08117fa640 1 -- 172.21.15.29:0/562036796 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+20455 (secure 0 0 0) 0x7f08140abc10 con 0x7f0814151d10 2024-01-25T15:05:55.472 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:55.472 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":42,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:05:44.564655+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:05:25.099043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-25T15:05:25.537967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-25T15:05:40.935431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-25T15:05:41.895611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:55.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.473+0000 7f081b0a2640 1 -- 172.21.15.29:0/562036796 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f07f806aed0 msgr2=0x7f07f806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:55.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.473+0000 7f081b0a2640 1 --2- 172.21.15.29:0/562036796 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f07f806aed0 0x7f07f806d390 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0808036000 tx=0x7f0808008030 comp rx=0 tx=0).stop 2024-01-25T15:05:55.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.473+0000 7f081b0a2640 1 -- 172.21.15.29:0/562036796 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0814151d10 msgr2=0x7f08141ed740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:55.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.473+0000 7f081b0a2640 1 --2- 172.21.15.29:0/562036796 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0814151d10 0x7f08141ed740 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f080c00c6b0 tx=0x7f080c00cb70 comp rx=0 tx=0).stop 2024-01-25T15:05:55.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.473+0000 7f081b0a2640 1 -- 172.21.15.29:0/562036796 shutdown_connections 2024-01-25T15:05:55.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.473+0000 7f081b0a2640 1 --2- 172.21.15.29:0/562036796 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f07f806aed0 0x7f07f806d390 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.473+0000 7f081b0a2640 1 --2- 172.21.15.29:0/562036796 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0814151d10 0x7f08141ed740 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.473+0000 7f081b0a2640 1 --2- 172.21.15.29:0/562036796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08140c75a0 0x7f0814155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.473+0000 7f081b0a2640 1 --2- 172.21.15.29:0/562036796 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f08140c5e10 0x7f08140abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.473+0000 7f081b0a2640 1 -- 172.21.15.29:0/562036796 >> 172.21.15.29:0/562036796 conn(0x7f08140c7f10 msgr2=0x7f081406b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:55.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.473+0000 7f081b0a2640 1 -- 172.21.15.29:0/562036796 shutdown_connections 2024-01-25T15:05:55.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.473+0000 7f081b0a2640 1 -- 172.21.15.29:0/562036796 wait complete. 2024-01-25T15:05:55.485 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T15:04:14.955791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T15:05:25.099043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T15:05:25.537967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-25T15:05:40.935431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-25T15:05:41.895611+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-25T15:05:55.485 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:05:55.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.589+0000 7fd0012ee640 1 Processor -- start 2024-01-25T15:05:55.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.589+0000 7fd0012ee640 1 -- start start 2024-01-25T15:05:55.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.590+0000 7fd0012ee640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcffc14b2a0 0x7fcffc0a8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:55.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.590+0000 7fd0012ee640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcffc06d600 0x7fcffc06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:55.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.590+0000 7fd0012ee640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcffc06e780 0x7fcffc154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:55.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.590+0000 7fd0012ee640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcffc0c22c0 con 0x7fcffc14b2a0 2024-01-25T15:05:55.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.590+0000 7fd0012ee640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcffc155690 con 0x7fcffc06d600 2024-01-25T15:05:55.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.590+0000 7fd0012ee640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc0c24a0 con 0x7fcffc06e780 2024-01-25T15:05:55.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.590+0000 7fcffaffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcffc14b2a0 0x7fcffc0a8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:55.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.590+0000 7fcffaffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcffc14b2a0 0x7fcffc0a8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52124/0 (socket says 172.21.15.29:52124) 2024-01-25T15:05:55.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.590+0000 7fcffaffd640 1 -- 172.21.15.29:0/3335842000 learned_addr learned my addr 172.21.15.29:0/3335842000 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:55.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.590+0000 7fcffb7fe640 1 --2- 172.21.15.29:0/3335842000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcffc06e780 0x7fcffc154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:55.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.590+0000 7fcff27fc640 1 --2- 172.21.15.29:0/3335842000 >> v2:172.21.15.52:3300/0 conn(0x7fcffc06d600 0x7fcffc06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:55.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.590+0000 7fcffaffd640 1 -- 172.21.15.29:0/3335842000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcffc06e780 msgr2=0x7fcffc154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:55.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.590+0000 7fcffaffd640 1 --2- 172.21.15.29:0/3335842000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcffc06e780 0x7fcffc154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.590+0000 7fcffaffd640 1 -- 172.21.15.29:0/3335842000 >> v2:172.21.15.52:3300/0 conn(0x7fcffc06d600 msgr2=0x7fcffc06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:55.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.590+0000 7fcffaffd640 1 --2- 172.21.15.29:0/3335842000 >> v2:172.21.15.52:3300/0 conn(0x7fcffc06d600 0x7fcffc06e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.590+0000 7fcffaffd640 1 -- 172.21.15.29:0/3335842000 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc0c2780 con 0x7fcffc14b2a0 2024-01-25T15:05:55.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.591+0000 7fcffaffd640 1 --2- 172.21.15.29:0/3335842000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcffc14b2a0 0x7fcffc0a8490 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0c7e90 tx=0x7fcfec02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783195e91e0d53e2 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:55.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.591+0000 7fcffa7fc640 1 -- 172.21.15.29:0/3335842000 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec0317e0 con 0x7fcffc14b2a0 2024-01-25T15:05:55.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.591+0000 7fcffa7fc640 1 -- 172.21.15.29:0/3335842000 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfec031940 con 0x7fcffc14b2a0 2024-01-25T15:05:55.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.591+0000 7fcffa7fc640 1 -- 172.21.15.29:0/3335842000 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec031cd0 con 0x7fcffc14b2a0 2024-01-25T15:05:55.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.592+0000 7fd0012ee640 1 -- 172.21.15.29:0/3335842000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcffc14b2a0 msgr2=0x7fcffc0a8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:55.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.592+0000 7fd0012ee640 1 --2- 172.21.15.29:0/3335842000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcffc14b2a0 0x7fcffc0a8490 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0c7e90 tx=0x7fcfec02b880 comp rx=0 tx=0).stop 2024-01-25T15:05:55.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.592+0000 7fd0012ee640 1 -- 172.21.15.29:0/3335842000 shutdown_connections 2024-01-25T15:05:55.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.592+0000 7fd0012ee640 1 --2- 172.21.15.29:0/3335842000 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcffc06e780 0x7fcffc154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.592+0000 7fd0012ee640 1 --2- 172.21.15.29:0/3335842000 >> v2:172.21.15.52:3300/0 conn(0x7fcffc06d600 0x7fcffc06e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.592+0000 7fd0012ee640 1 --2- 172.21.15.29:0/3335842000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcffc14b2a0 0x7fcffc0a8490 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.592+0000 7fd0012ee640 1 -- 172.21.15.29:0/3335842000 >> 172.21.15.29:0/3335842000 conn(0x7fcffc0c39b0 msgr2=0x7fcffc0c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:55.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.592+0000 7fd0012ee640 1 -- 172.21.15.29:0/3335842000 shutdown_connections 2024-01-25T15:05:55.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.592+0000 7fd0012ee640 1 -- 172.21.15.29:0/3335842000 wait complete. 2024-01-25T15:05:55.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.593+0000 7fd0012ee640 1 Processor -- start 2024-01-25T15:05:55.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.593+0000 7fd0012ee640 1 -- start start 2024-01-25T15:05:55.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.594+0000 7fd0012ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcffc06d600 0x7fcffc151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:55.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.594+0000 7fd0012ee640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcffc06e780 0x7fcffc14e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:55.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.594+0000 7fd0012ee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcffc14b2a0 0x7fcffc0c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:55.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.594+0000 7fd0012ee640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc14d8c0 con 0x7fcffc14b2a0 2024-01-25T15:05:55.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.594+0000 7fd0012ee640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc14f5e0 con 0x7fcffc06d600 2024-01-25T15:05:55.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.594+0000 7fd0012ee640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc0c6a20 con 0x7fcffc06e780 2024-01-25T15:05:55.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.594+0000 7fcffb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcffc14b2a0 0x7fcffc0c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:55.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.594+0000 7fcffb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcffc14b2a0 0x7fcffc0c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52138/0 (socket says 172.21.15.29:52138) 2024-01-25T15:05:55.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.594+0000 7fcffb7fe640 1 -- 172.21.15.29:0/1386567504 learned_addr learned my addr 172.21.15.29:0/1386567504 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:55.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.594+0000 7fcff27fc640 1 --2- 172.21.15.29:0/1386567504 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcffc06e780 0x7fcffc14e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:55.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.594+0000 7fcffaffd640 1 --2- 172.21.15.29:0/1386567504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcffc06d600 0x7fcffc151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:55.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.594+0000 7fcffb7fe640 1 -- 172.21.15.29:0/1386567504 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcffc06e780 msgr2=0x7fcffc14e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:55.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.594+0000 7fcffb7fe640 1 --2- 172.21.15.29:0/1386567504 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcffc06e780 0x7fcffc14e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.594+0000 7fcffb7fe640 1 -- 172.21.15.29:0/1386567504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcffc06d600 msgr2=0x7fcffc151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:55.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.594+0000 7fcffb7fe640 1 --2- 172.21.15.29:0/1386567504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcffc06d600 0x7fcffc151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.594+0000 7fcffb7fe640 1 -- 172.21.15.29:0/1386567504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec0094d0 con 0x7fcffc14b2a0 2024-01-25T15:05:55.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.594+0000 7fcff27fc640 1 --2- 172.21.15.29:0/1386567504 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcffc06e780 0x7fcffc14e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:55.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.594+0000 7fcffaffd640 1 --2- 172.21.15.29:0/1386567504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcffc06d600 0x7fcffc151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:55.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.594+0000 7fcffb7fe640 1 --2- 172.21.15.29:0/1386567504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcffc14b2a0 0x7fcffc0c5e90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcff4007e70 tx=0x7fcff400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:55.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.595+0000 7fcff3fff640 1 -- 172.21.15.29:0/1386567504 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff4014620 con 0x7fcffc14b2a0 2024-01-25T15:05:55.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.595+0000 7fcff3fff640 1 -- 172.21.15.29:0/1386567504 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff40147a0 con 0x7fcffc14b2a0 2024-01-25T15:05:55.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.595+0000 7fd0012ee640 1 -- 172.21.15.29:0/1386567504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcffc14f7b0 con 0x7fcffc14b2a0 2024-01-25T15:05:55.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.595+0000 7fcff3fff640 1 -- 172.21.15.29:0/1386567504 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff4014b50 con 0x7fcffc14b2a0 2024-01-25T15:05:55.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.595+0000 7fd0012ee640 1 -- 172.21.15.29:0/1386567504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcffc14d5e0 con 0x7fcffc14b2a0 2024-01-25T15:05:55.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.596+0000 7fd0012ee640 1 -- 172.21.15.29:0/1386567504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcffc0c1620 con 0x7fcffc14b2a0 2024-01-25T15:05:55.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.596+0000 7fcff3fff640 1 -- 172.21.15.29:0/1386567504 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fcff4014cb0 con 0x7fcffc14b2a0 2024-01-25T15:05:55.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.597+0000 7fcff3fff640 1 --2- 172.21.15.29:0/1386567504 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcfdc06aed0 0x7fcfdc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:55.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.597+0000 7fcff3fff640 1 -- 172.21.15.29:0/1386567504 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fcff408a440 con 0x7fcffc14b2a0 2024-01-25T15:05:55.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.597+0000 7fcffaffd640 1 --2- 172.21.15.29:0/1386567504 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcfdc06aed0 0x7fcfdc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:55.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.597+0000 7fcffaffd640 1 --2- 172.21.15.29:0/1386567504 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcfdc06aed0 0x7fcfdc06d390 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcfec036000 tx=0x7fcfec03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:55.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.601+0000 7fcff3fff640 1 -- 172.21.15.29:0/1386567504 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fcff4054f00 con 0x7fcffc14b2a0 2024-01-25T15:05:55.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.785+0000 7fd0012ee640 1 -- 172.21.15.29:0/1386567504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcffc14e1b0 con 0x7fcffc14b2a0 2024-01-25T15:05:55.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.785+0000 7fcff3fff640 1 -- 172.21.15.29:0/1386567504 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcffc14e1b0 con 0x7fcffc14b2a0 2024-01-25T15:05:55.786 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-25T15:05:55.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.787+0000 7fd0012ee640 1 -- 172.21.15.29:0/1386567504 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcfdc06aed0 msgr2=0x7fcfdc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:55.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.787+0000 7fd0012ee640 1 --2- 172.21.15.29:0/1386567504 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcfdc06aed0 0x7fcfdc06d390 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcfec036000 tx=0x7fcfec03d040 comp rx=0 tx=0).stop 2024-01-25T15:05:55.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.787+0000 7fd0012ee640 1 -- 172.21.15.29:0/1386567504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcffc14b2a0 msgr2=0x7fcffc0c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:55.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.787+0000 7fd0012ee640 1 --2- 172.21.15.29:0/1386567504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcffc14b2a0 0x7fcffc0c5e90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcff4007e70 tx=0x7fcff400e4b0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.787+0000 7fd0012ee640 1 -- 172.21.15.29:0/1386567504 shutdown_connections 2024-01-25T15:05:55.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.787+0000 7fd0012ee640 1 --2- 172.21.15.29:0/1386567504 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcfdc06aed0 0x7fcfdc06d390 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.787+0000 7fd0012ee640 1 --2- 172.21.15.29:0/1386567504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcffc14b2a0 0x7fcffc0c5e90 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.787+0000 7fd0012ee640 1 --2- 172.21.15.29:0/1386567504 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcffc06e780 0x7fcffc14e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.787+0000 7fd0012ee640 1 --2- 172.21.15.29:0/1386567504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcffc06d600 0x7fcffc151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.787+0000 7fd0012ee640 1 -- 172.21.15.29:0/1386567504 >> 172.21.15.29:0/1386567504 conn(0x7fcffc0c39b0 msgr2=0x7fcffc147dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:55.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.787+0000 7fd0012ee640 1 -- 172.21.15.29:0/1386567504 shutdown_connections 2024-01-25T15:05:55.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.787+0000 7fd0012ee640 1 -- 172.21.15.29:0/1386567504 wait complete. 2024-01-25T15:05:55.799 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:05:55.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.902+0000 7fbb06c9b640 1 Processor -- start 2024-01-25T15:05:55.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.902+0000 7fbb06c9b640 1 -- start start 2024-01-25T15:05:55.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.903+0000 7fbb06c9b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb000c4a10 0x7fbb000c7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:55.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.903+0000 7fbb06c9b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb00070e20 con 0x7fbb000c4df0 2024-01-25T15:05:55.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.903+0000 7fbb06c9b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb000c5280 con 0x7fbb00158950 2024-01-25T15:05:55.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.903+0000 7fbb06c9b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb000c7e40 con 0x7fbb000c4a10 2024-01-25T15:05:55.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.903+0000 7fbb05238640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbb000c4df0 0x7fbb0015f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54232/0 (socket says 172.21.15.29:54232) 2024-01-25T15:05:55.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.903+0000 7fbb05238640 1 -- 172.21.15.29:0/2005332208 learned_addr learned my addr 172.21.15.29:0/2005332208 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:55.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.903+0000 7fbb04a37640 1 --2- 172.21.15.29:0/2005332208 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb000c4a10 0x7fbb000c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:55.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.903+0000 7fbaff7fe640 1 -- 172.21.15.29:0/2005332208 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903559971 0 0) 0x7fbb00070e20 con 0x7fbb000c4df0 2024-01-25T15:05:55.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.903+0000 7fbaff7fe640 1 -- 172.21.15.29:0/2005332208 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf0003520 con 0x7fbb000c4df0 2024-01-25T15:05:55.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.903+0000 7fbaff7fe640 1 -- 172.21.15.29:0/2005332208 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3858373299 0 0) 0x7fbaf0003520 con 0x7fbb000c4df0 2024-01-25T15:05:55.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.903+0000 7fbaff7fe640 1 -- 172.21.15.29:0/2005332208 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb000c4a10 msgr2=0x7fbb000c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:55.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.903+0000 7fbaff7fe640 1 --2- 172.21.15.29:0/2005332208 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb000c4a10 0x7fbb000c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.903+0000 7fbaff7fe640 1 -- 172.21.15.29:0/2005332208 >> v1:172.21.15.52:6789/0 conn(0x7fbb00158950 legacy=0x7fbb000c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:55.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.903+0000 7fbaff7fe640 1 -- 172.21.15.29:0/2005332208 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb000c7b60 con 0x7fbb000c4df0 2024-01-25T15:05:55.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.903+0000 7fbaff7fe640 1 -- 172.21.15.29:0/2005332208 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7fbaf80019f0 con 0x7fbb000c4df0 2024-01-25T15:05:55.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.903+0000 7fbaff7fe640 1 -- 172.21.15.29:0/2005332208 >> v1:172.21.15.29:6789/0 conn(0x7fbb000c4df0 legacy=0x7fbb0015f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:55.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.903+0000 7fbaff7fe640 1 --2- 172.21.15.29:0/2005332208 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb000c4a10 0x7fbaf0003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:55.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.904+0000 7fbaff7fe640 1 --2- 172.21.15.29:0/2005332208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbaf0003f90 0x7fbaf00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:55.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.904+0000 7fbaff7fe640 1 --2- 172.21.15.29:0/2005332208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf0004d00 0x7fbaf0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:55.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.904+0000 7fbaff7fe640 1 -- 172.21.15.29:0/2005332208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb000c7e40 con 0x7fbaf0004d00 2024-01-25T15:05:55.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.904+0000 7fbaff7fe640 1 -- 172.21.15.29:0/2005332208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf000bae0 con 0x7fbaf0003f90 2024-01-25T15:05:55.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.904+0000 7fbaff7fe640 1 -- 172.21.15.29:0/2005332208 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf000bca0 con 0x7fbb000c4a10 2024-01-25T15:05:55.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.904+0000 7fbb05238640 1 --2- 172.21.15.29:0/2005332208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf0004d00 0x7fbaf0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:55.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.904+0000 7fbb04a37640 1 --2- 172.21.15.29:0/2005332208 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb000c4a10 0x7fbaf0003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:55.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.904+0000 7fbafffff640 1 --2- 172.21.15.29:0/2005332208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbaf0003f90 0x7fbaf00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:55.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.904+0000 7fbb05238640 1 -- 172.21.15.29:0/2005332208 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb000c4a10 msgr2=0x7fbaf0003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:55.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.904+0000 7fbb05238640 1 --2- 172.21.15.29:0/2005332208 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb000c4a10 0x7fbaf0003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.904+0000 7fbb05238640 1 -- 172.21.15.29:0/2005332208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbaf0003f90 msgr2=0x7fbaf00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:55.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.904+0000 7fbb05238640 1 --2- 172.21.15.29:0/2005332208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbaf0003f90 0x7fbaf00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.904+0000 7fbb05238640 1 -- 172.21.15.29:0/2005332208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf0003520 con 0x7fbaf0004d00 2024-01-25T15:05:55.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.905+0000 7fbb05238640 1 --2- 172.21.15.29:0/2005332208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf0004d00 0x7fbaf0005180 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800a830 tx=0x7fbaf00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3f86a7d6484796 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:55.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.905+0000 7fbaff7fe640 1 -- 172.21.15.29:0/2005332208 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf80072d0 con 0x7fbaf0004d00 2024-01-25T15:05:55.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.905+0000 7fbaff7fe640 1 -- 172.21.15.29:0/2005332208 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf802f070 con 0x7fbaf0004d00 2024-01-25T15:05:55.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.905+0000 7fbaff7fe640 1 -- 172.21.15.29:0/2005332208 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf80076f0 con 0x7fbaf0004d00 2024-01-25T15:05:55.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.905+0000 7fbb06c9b640 1 -- 172.21.15.29:0/2005332208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf0004d00 msgr2=0x7fbaf0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:55.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.905+0000 7fbb06c9b640 1 --2- 172.21.15.29:0/2005332208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf0004d00 0x7fbaf0005180 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800a830 tx=0x7fbaf00057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.905+0000 7fbb05238640 1 -- 172.21.15.29:0/2005332208 reap_dead start 2024-01-25T15:05:55.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.905+0000 7fbb06c9b640 1 -- 172.21.15.29:0/2005332208 shutdown_connections 2024-01-25T15:05:55.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.905+0000 7fbb06c9b640 1 -- 172.21.15.29:0/2005332208 >> 172.21.15.29:0/2005332208 conn(0x7fbb000c7f80 msgr2=0x7fbb000c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:55.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.905+0000 7fbb06c9b640 1 -- 172.21.15.29:0/2005332208 shutdown_connections 2024-01-25T15:05:55.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.905+0000 7fbb06c9b640 1 -- 172.21.15.29:0/2005332208 wait complete. 2024-01-25T15:05:55.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.906+0000 7fbb06c9b640 1 Processor -- start 2024-01-25T15:05:55.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.907+0000 7fbb06c9b640 1 -- start start 2024-01-25T15:05:55.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.907+0000 7fbb06c9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf0004d00 0x7fbb001e8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:55.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.907+0000 7fbb06c9b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb0014c910 0x7fbb001eab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:55.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.907+0000 7fbb06c9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb001eb040 0x7fbb0006c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:55.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.907+0000 7fbb06c9b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb001ea6e0 con 0x7fbaf0004d00 2024-01-25T15:05:55.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.907+0000 7fbb06c9b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb000ad330 con 0x7fbb001eb040 2024-01-25T15:05:55.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.907+0000 7fbb06c9b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb001ee340 con 0x7fbb0014c910 2024-01-25T15:05:55.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.907+0000 7fbb04a37640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf0004d00 0x7fbb001e8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:55.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.907+0000 7fbb04a37640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf0004d00 0x7fbb001e8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52156/0 (socket says 172.21.15.29:52156) 2024-01-25T15:05:55.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.907+0000 7fbb04a37640 1 -- 172.21.15.29:0/1717638072 learned_addr learned my addr 172.21.15.29:0/1717638072 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:55.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.908+0000 7fbafffff640 1 --2- 172.21.15.29:0/1717638072 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb0014c910 0x7fbb001eab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:55.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.908+0000 7fbb05238640 1 --2- 172.21.15.29:0/1717638072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb001eb040 0x7fbb0006c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:55.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.908+0000 7fbb04a37640 1 -- 172.21.15.29:0/1717638072 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb0014c910 msgr2=0x7fbb001eab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:55.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.908+0000 7fbb04a37640 1 --2- 172.21.15.29:0/1717638072 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb0014c910 0x7fbb001eab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.908+0000 7fbb04a37640 1 -- 172.21.15.29:0/1717638072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb001eb040 msgr2=0x7fbb0006c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:55.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.908+0000 7fbb04a37640 1 --2- 172.21.15.29:0/1717638072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb001eb040 0x7fbb0006c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:55.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.908+0000 7fbb04a37640 1 -- 172.21.15.29:0/1717638072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb001ee5e0 con 0x7fbaf0004d00 2024-01-25T15:05:55.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.908+0000 7fbb05238640 1 --2- 172.21.15.29:0/1717638072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb001eb040 0x7fbb0006c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:55.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.908+0000 7fbafffff640 1 --2- 172.21.15.29:0/1717638072 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb0014c910 0x7fbb001eab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:55.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.908+0000 7fbb04a37640 1 --2- 172.21.15.29:0/1717638072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf0004d00 0x7fbb001e8300 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40119a0 tx=0x7fbaf4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:55.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.908+0000 7fbafd7fa640 1 -- 172.21.15.29:0/1717638072 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf400faf0 con 0x7fbaf0004d00 2024-01-25T15:05:55.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.908+0000 7fbafd7fa640 1 -- 172.21.15.29:0/1717638072 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf400fc50 con 0x7fbaf0004d00 2024-01-25T15:05:55.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.908+0000 7fbb06c9b640 1 -- 172.21.15.29:0/1717638072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb001ea2c0 con 0x7fbaf0004d00 2024-01-25T15:05:55.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.908+0000 7fbafd7fa640 1 -- 172.21.15.29:0/1717638072 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4014440 con 0x7fbaf0004d00 2024-01-25T15:05:55.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.908+0000 7fbb06c9b640 1 -- 172.21.15.29:0/1717638072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb001de090 con 0x7fbaf0004d00 2024-01-25T15:05:55.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.909+0000 7fbb06c9b640 1 -- 172.21.15.29:0/1717638072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb0004eb10 con 0x7fbaf0004d00 2024-01-25T15:05:55.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.909+0000 7fbafd7fa640 1 -- 172.21.15.29:0/1717638072 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fbaf40145a0 con 0x7fbaf0004d00 2024-01-25T15:05:55.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.910+0000 7fbafd7fa640 1 --2- 172.21.15.29:0/1717638072 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbae406aed0 0x7fbae406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:55.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.910+0000 7fbafd7fa640 1 -- 172.21.15.29:0/1717638072 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fbaf408a320 con 0x7fbaf0004d00 2024-01-25T15:05:55.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.910+0000 7fbafffff640 1 --2- 172.21.15.29:0/1717638072 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbae406aed0 0x7fbae406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:55.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.910+0000 7fbafffff640 1 --2- 172.21.15.29:0/1717638072 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbae406aed0 0x7fbae406d390 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0035f0 tx=0x7fbaec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:55.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:55.914+0000 7fbafd7fa640 1 -- 172.21.15.29:0/1717638072 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fbaf4054de0 con 0x7fbaf0004d00 2024-01-25T15:05:56.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.091+0000 7fbb06c9b640 1 -- 172.21.15.29:0/1717638072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbb00070d00 con 0x7fbaf0004d00 2024-01-25T15:05:56.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.092+0000 7fbafd7fa640 1 -- 172.21.15.29:0/1717638072 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbaf4058400 con 0x7fbaf0004d00 2024-01-25T15:05:56.093 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:56.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.094+0000 7fbb06c9b640 1 -- 172.21.15.29:0/1717638072 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbae406aed0 msgr2=0x7fbae406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:56.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.094+0000 7fbb06c9b640 1 --2- 172.21.15.29:0/1717638072 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbae406aed0 0x7fbae406d390 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0035f0 tx=0x7fbaec009040 comp rx=0 tx=0).stop 2024-01-25T15:05:56.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.094+0000 7fbb06c9b640 1 -- 172.21.15.29:0/1717638072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf0004d00 msgr2=0x7fbb001e8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:56.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.094+0000 7fbb06c9b640 1 --2- 172.21.15.29:0/1717638072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf0004d00 0x7fbb001e8300 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40119a0 tx=0x7fbaf4011e60 comp rx=0 tx=0).stop 2024-01-25T15:05:56.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.094+0000 7fbb06c9b640 1 -- 172.21.15.29:0/1717638072 shutdown_connections 2024-01-25T15:05:56.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.094+0000 7fbb06c9b640 1 --2- 172.21.15.29:0/1717638072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb001eb040 0x7fbb0006c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.094+0000 7fbb06c9b640 1 --2- 172.21.15.29:0/1717638072 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbb0014c910 0x7fbb001eab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.094+0000 7fbb06c9b640 1 --2- 172.21.15.29:0/1717638072 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbae406aed0 0x7fbae406d390 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.094+0000 7fbb06c9b640 1 --2- 172.21.15.29:0/1717638072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf0004d00 0x7fbb001e8300 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.094+0000 7fbb06c9b640 1 -- 172.21.15.29:0/1717638072 >> 172.21.15.29:0/1717638072 conn(0x7fbb000c7f80 msgr2=0x7fbb000c1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:56.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.094+0000 7fbb06c9b640 1 -- 172.21.15.29:0/1717638072 shutdown_connections 2024-01-25T15:05:56.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.094+0000 7fbb06c9b640 1 -- 172.21.15.29:0/1717638072 wait complete. 2024-01-25T15:05:56.105 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:05:56.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.208+0000 7f234c631640 1 Processor -- start 2024-01-25T15:05:56.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.208+0000 7f234c631640 1 -- start start 2024-01-25T15:05:56.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.209+0000 7f234c631640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f234414fbf0 0x7f23440c1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:56.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.209+0000 7f234c631640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23440abe10 0x7f23440a8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:56.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.209+0000 7f234c631640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23440a9ce0 con 0x7f23440c1e60 2024-01-25T15:05:56.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.209+0000 7f234c631640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2344153400 con 0x7f234414fbf0 2024-01-25T15:05:56.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.209+0000 7f234c631640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23440ab050 con 0x7f23440abe10 2024-01-25T15:05:56.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.209+0000 7f234abce640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f23440c1e60 0x7f2344155a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54234/0 (socket says 172.21.15.29:54234) 2024-01-25T15:05:56.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.209+0000 7f234abce640 1 -- 172.21.15.29:0/4280467592 learned_addr learned my addr 172.21.15.29:0/4280467592 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:56.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.209+0000 7f2349bcc640 1 --2- 172.21.15.29:0/4280467592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23440abe10 0x7f23440a8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:56.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.209+0000 7f234a3cd640 1 --2- 172.21.15.29:0/4280467592 >> v2:172.21.15.52:3300/0 conn(0x7f234414fbf0 0x7f23440c1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:56.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.209+0000 7f23493cb640 1 -- 172.21.15.29:0/4280467592 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639574827 0 0) 0x7f2334001490 con 0x7f23440c1e60 2024-01-25T15:05:56.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.209+0000 7f23493cb640 1 -- 172.21.15.29:0/4280467592 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f232c003520 con 0x7f23440c1e60 2024-01-25T15:05:56.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.210+0000 7f23493cb640 1 -- 172.21.15.29:0/4280467592 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 317592737 0 0) 0x7f232c003520 con 0x7f23440c1e60 2024-01-25T15:05:56.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.210+0000 7f23493cb640 1 -- 172.21.15.29:0/4280467592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23440abe10 msgr2=0x7f23440a8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:56.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.210+0000 7f23493cb640 1 --2- 172.21.15.29:0/4280467592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23440abe10 0x7f23440a8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.210+0000 7f23493cb640 1 -- 172.21.15.29:0/4280467592 >> v2:172.21.15.52:3300/0 conn(0x7f234414fbf0 msgr2=0x7f23440c1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:56.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.210+0000 7f23493cb640 1 --2- 172.21.15.29:0/4280467592 >> v2:172.21.15.52:3300/0 conn(0x7f234414fbf0 0x7f23440c1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.210+0000 7f23493cb640 1 -- 172.21.15.29:0/4280467592 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23440ab330 con 0x7f23440c1e60 2024-01-25T15:05:56.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.210+0000 7f23493cb640 1 -- 172.21.15.29:0/4280467592 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f2334001b80 con 0x7f23440c1e60 2024-01-25T15:05:56.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.210+0000 7f23493cb640 1 -- 172.21.15.29:0/4280467592 >> v1:172.21.15.29:6789/0 conn(0x7f23440c1e60 legacy=0x7f2344155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:56.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.210+0000 7f23493cb640 1 --2- 172.21.15.29:0/4280467592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23440abe10 0x7f232c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:56.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.210+0000 7f23493cb640 1 --2- 172.21.15.29:0/4280467592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f232c003f60 0x7f232c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:56.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.210+0000 7f23493cb640 1 --2- 172.21.15.29:0/4280467592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f232c004d00 0x7f232c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:56.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.210+0000 7f23493cb640 1 -- 172.21.15.29:0/4280467592 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2344153400 con 0x7f232c003f60 2024-01-25T15:05:56.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.210+0000 7f23493cb640 1 -- 172.21.15.29:0/4280467592 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23440ab050 con 0x7f232c004d00 2024-01-25T15:05:56.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.210+0000 7f23493cb640 1 -- 172.21.15.29:0/4280467592 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232c00b9b0 con 0x7f23440abe10 2024-01-25T15:05:56.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.210+0000 7f2349bcc640 1 --2- 172.21.15.29:0/4280467592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f232c003f60 0x7f232c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:56.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.210+0000 7f234a3cd640 1 --2- 172.21.15.29:0/4280467592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23440abe10 0x7f232c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:56.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.210+0000 7f234abce640 1 --2- 172.21.15.29:0/4280467592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f232c004d00 0x7f232c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:56.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.210+0000 7f2349bcc640 1 -- 172.21.15.29:0/4280467592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23440abe10 msgr2=0x7f232c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:56.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.210+0000 7f2349bcc640 1 --2- 172.21.15.29:0/4280467592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23440abe10 0x7f232c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.210+0000 7f2349bcc640 1 -- 172.21.15.29:0/4280467592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f232c004d00 msgr2=0x7f232c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:56.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.210+0000 7f2349bcc640 1 --2- 172.21.15.29:0/4280467592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f232c004d00 0x7f232c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.210+0000 7f2349bcc640 1 -- 172.21.15.29:0/4280467592 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c003520 con 0x7f232c003f60 2024-01-25T15:05:56.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.211+0000 7f2349bcc640 1 --2- 172.21.15.29:0/4280467592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f232c003f60 0x7f232c0047c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2338009ac0 tx=0x7f232c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e7d58e374c6149 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:56.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.211+0000 7f23493cb640 1 -- 172.21.15.29:0/4280467592 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233802c6b0 con 0x7f232c003f60 2024-01-25T15:05:56.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.211+0000 7f23493cb640 1 -- 172.21.15.29:0/4280467592 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233802c810 con 0x7f232c003f60 2024-01-25T15:05:56.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.211+0000 7f23493cb640 1 -- 172.21.15.29:0/4280467592 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233802cba0 con 0x7f232c003f60 2024-01-25T15:05:56.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.212+0000 7f234c631640 1 -- 172.21.15.29:0/4280467592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f232c003f60 msgr2=0x7f232c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:56.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.212+0000 7f234c631640 1 --2- 172.21.15.29:0/4280467592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f232c003f60 0x7f232c0047c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2338009ac0 tx=0x7f232c0057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.212+0000 7f234abce640 1 -- 172.21.15.29:0/4280467592 reap_dead start 2024-01-25T15:05:56.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.212+0000 7f234c631640 1 -- 172.21.15.29:0/4280467592 shutdown_connections 2024-01-25T15:05:56.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.212+0000 7f234c631640 1 -- 172.21.15.29:0/4280467592 >> 172.21.15.29:0/4280467592 conn(0x7f23440c2a10 msgr2=0x7f23440c2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:56.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.212+0000 7f234c631640 1 -- 172.21.15.29:0/4280467592 shutdown_connections 2024-01-25T15:05:56.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.212+0000 7f234c631640 1 -- 172.21.15.29:0/4280467592 wait complete. 2024-01-25T15:05:56.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.213+0000 7f234c631640 1 Processor -- start 2024-01-25T15:05:56.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.213+0000 7f234c631640 1 -- start start 2024-01-25T15:05:56.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.213+0000 7f234c631640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f232c003f60 0x7f23441eb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:56.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.213+0000 7f234c631640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23440bf180 0x7f23440bf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:56.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.213+0000 7f234c631640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2344154da0 0x7f2344155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:56.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.213+0000 7f234c631640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2344154630 con 0x7f2344154da0 2024-01-25T15:05:56.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.213+0000 7f234c631640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2344154910 con 0x7f232c003f60 2024-01-25T15:05:56.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.213+0000 7f234c631640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2344153800 con 0x7f23440bf180 2024-01-25T15:05:56.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.214+0000 7f234abce640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2344154da0 0x7f2344155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:56.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.214+0000 7f234abce640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2344154da0 0x7f2344155220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52170/0 (socket says 172.21.15.29:52170) 2024-01-25T15:05:56.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.214+0000 7f234abce640 1 -- 172.21.15.29:0/1475105429 learned_addr learned my addr 172.21.15.29:0/1475105429 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:56.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.214+0000 7f2349bcc640 1 --2- 172.21.15.29:0/1475105429 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23440bf180 0x7f23440bf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:56.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.214+0000 7f234a3cd640 1 --2- 172.21.15.29:0/1475105429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f232c003f60 0x7f23441eb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:56.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.214+0000 7f234abce640 1 -- 172.21.15.29:0/1475105429 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23440bf180 msgr2=0x7f23440bf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:56.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.214+0000 7f234abce640 1 --2- 172.21.15.29:0/1475105429 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23440bf180 0x7f23440bf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.214+0000 7f234abce640 1 -- 172.21.15.29:0/1475105429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f232c003f60 msgr2=0x7f23441eb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:56.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.214+0000 7f234abce640 1 --2- 172.21.15.29:0/1475105429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f232c003f60 0x7f23441eb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.214+0000 7f234abce640 1 -- 172.21.15.29:0/1475105429 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23441eba60 con 0x7f2344154da0 2024-01-25T15:05:56.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.214+0000 7f234abce640 1 --2- 172.21.15.29:0/1475105429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2344154da0 0x7f2344155220 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f234406e1c0 tx=0x7f233400ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:56.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.214+0000 7f2342ffd640 1 -- 172.21.15.29:0/1475105429 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334007780 con 0x7f2344154da0 2024-01-25T15:05:56.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.214+0000 7f2342ffd640 1 -- 172.21.15.29:0/1475105429 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23340078e0 con 0x7f2344154da0 2024-01-25T15:05:56.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.214+0000 7f2342ffd640 1 -- 172.21.15.29:0/1475105429 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23340133f0 con 0x7f2344154da0 2024-01-25T15:05:56.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.214+0000 7f234c631640 1 -- 172.21.15.29:0/1475105429 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23440c1920 con 0x7f2344154da0 2024-01-25T15:05:56.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.214+0000 7f234c631640 1 -- 172.21.15.29:0/1475105429 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23441eb760 con 0x7f2344154da0 2024-01-25T15:05:56.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.215+0000 7f234c631640 1 -- 172.21.15.29:0/1475105429 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2344074010 con 0x7f2344154da0 2024-01-25T15:05:56.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.216+0000 7f2342ffd640 1 -- 172.21.15.29:0/1475105429 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2334013550 con 0x7f2344154da0 2024-01-25T15:05:56.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.216+0000 7f2342ffd640 1 --2- 172.21.15.29:0/1475105429 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f233006af00 0x7f233006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:56.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.216+0000 7f2342ffd640 1 -- 172.21.15.29:0/1475105429 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f2334089f00 con 0x7f2344154da0 2024-01-25T15:05:56.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.216+0000 7f234a3cd640 1 --2- 172.21.15.29:0/1475105429 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f233006af00 0x7f233006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:56.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.217+0000 7f234a3cd640 1 --2- 172.21.15.29:0/1475105429 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f233006af00 0x7f233006d3c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f233c009c40 tx=0x7f233c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:56.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.220+0000 7f2342ffd640 1 -- 172.21.15.29:0/1475105429 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2334054930 con 0x7f2344154da0 2024-01-25T15:05:56.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.397+0000 7f234c631640 1 -- 172.21.15.29:0/1475105429 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f23440a9ce0 con 0x7f2344154da0 2024-01-25T15:05:56.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.398+0000 7f2342ffd640 1 -- 172.21.15.29:0/1475105429 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f23440a9ce0 con 0x7f2344154da0 2024-01-25T15:05:56.398 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-25T15:05:56.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.399+0000 7f234c631640 1 -- 172.21.15.29:0/1475105429 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f233006af00 msgr2=0x7f233006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:56.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.399+0000 7f234c631640 1 --2- 172.21.15.29:0/1475105429 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f233006af00 0x7f233006d3c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f233c009c40 tx=0x7f233c009190 comp rx=0 tx=0).stop 2024-01-25T15:05:56.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.399+0000 7f234c631640 1 -- 172.21.15.29:0/1475105429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2344154da0 msgr2=0x7f2344155220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:56.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.399+0000 7f234c631640 1 --2- 172.21.15.29:0/1475105429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2344154da0 0x7f2344155220 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f234406e1c0 tx=0x7f233400ae50 comp rx=0 tx=0).stop 2024-01-25T15:05:56.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.400+0000 7f234c631640 1 -- 172.21.15.29:0/1475105429 shutdown_connections 2024-01-25T15:05:56.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.400+0000 7f234c631640 1 --2- 172.21.15.29:0/1475105429 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f233006af00 0x7f233006d3c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.400+0000 7f234c631640 1 --2- 172.21.15.29:0/1475105429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2344154da0 0x7f2344155220 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.400+0000 7f234c631640 1 --2- 172.21.15.29:0/1475105429 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23440bf180 0x7f23440bf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.400+0000 7f234c631640 1 --2- 172.21.15.29:0/1475105429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f232c003f60 0x7f23441eb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.400+0000 7f234c631640 1 -- 172.21.15.29:0/1475105429 >> 172.21.15.29:0/1475105429 conn(0x7f23440c2a10 msgr2=0x7f23440c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:56.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.400+0000 7f234c631640 1 -- 172.21.15.29:0/1475105429 shutdown_connections 2024-01-25T15:05:56.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.400+0000 7f234c631640 1 -- 172.21.15.29:0/1475105429 wait complete. 2024-01-25T15:05:56.412 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-25T15:05:56.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.515+0000 7f9cf81d1640 1 Processor -- start 2024-01-25T15:05:56.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.515+0000 7f9cf81d1640 1 -- start start 2024-01-25T15:05:56.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.516+0000 7f9cf81d1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9cf006f290 0x7f9cf0158800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:56.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.516+0000 7f9cf81d1640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf0158d40 con 0x7f9cf006b380 2024-01-25T15:05:56.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.516+0000 7f9cf81d1640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf0072350 con 0x7f9cf013ddd0 2024-01-25T15:05:56.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.516+0000 7f9cf81d1640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf006dcd0 con 0x7f9cf006f290 2024-01-25T15:05:56.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.516+0000 7f9cf676e640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9cf006b380 0x7f9cf006a6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54236/0 (socket says 172.21.15.29:54236) 2024-01-25T15:05:56.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.516+0000 7f9cf676e640 1 -- 172.21.15.29:0/252280857 learned_addr learned my addr 172.21.15.29:0/252280857 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:56.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.516+0000 7f9cf576c640 1 --2- 172.21.15.29:0/252280857 >> v2:172.21.15.52:3300/0 conn(0x7f9cf006f290 0x7f9cf0158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:56.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.516+0000 7f9cf4f6b640 1 -- 172.21.15.29:0/252280857 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723636983 0 0) 0x7f9ce8001110 con 0x7f9cf006b380 2024-01-25T15:05:56.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.517+0000 7f9cf4f6b640 1 -- 172.21.15.29:0/252280857 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cd8003520 con 0x7f9cf006b380 2024-01-25T15:05:56.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.517+0000 7f9cf576c640 1 -- 172.21.15.29:0/252280857 >> v1:172.21.15.52:6789/0 conn(0x7f9cf013ddd0 legacy=0x7f9cf00c0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:56.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.517+0000 7f9cf576c640 1 -- 172.21.15.29:0/252280857 >> v1:172.21.15.29:6789/0 conn(0x7f9cf006b380 legacy=0x7f9cf006a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:56.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.517+0000 7f9cf576c640 1 -- 172.21.15.29:0/252280857 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf0157db0 con 0x7f9cf006f290 2024-01-25T15:05:56.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.518+0000 7f9cf576c640 1 --2- 172.21.15.29:0/252280857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9cf006f290 0x7f9cf0158800 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40097a0 tx=0x7f9ce402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a03d3375a32cda8 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:56.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.518+0000 7f9cf4f6b640 1 -- 172.21.15.29:0/252280857 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce402e070 con 0x7f9cf006f290 2024-01-25T15:05:56.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.518+0000 7f9cf4f6b640 1 -- 172.21.15.29:0/252280857 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce40315a0 con 0x7f9cf006f290 2024-01-25T15:05:56.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.518+0000 7f9cf4f6b640 1 -- 172.21.15.29:0/252280857 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4031910 con 0x7f9cf006f290 2024-01-25T15:05:56.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.518+0000 7f9cf81d1640 1 -- 172.21.15.29:0/252280857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9cf006f290 msgr2=0x7f9cf0158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:56.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.518+0000 7f9cf81d1640 1 --2- 172.21.15.29:0/252280857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9cf006f290 0x7f9cf0158800 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40097a0 tx=0x7f9ce402b840 comp rx=0 tx=0).stop 2024-01-25T15:05:56.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.518+0000 7f9cf81d1640 1 -- 172.21.15.29:0/252280857 shutdown_connections 2024-01-25T15:05:56.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.518+0000 7f9cf81d1640 1 --2- 172.21.15.29:0/252280857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9cf006f290 0x7f9cf0158800 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.518+0000 7f9cf81d1640 1 -- 172.21.15.29:0/252280857 >> 172.21.15.29:0/252280857 conn(0x7f9cf00c3b00 msgr2=0x7f9cf00c3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:56.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.518+0000 7f9cf81d1640 1 -- 172.21.15.29:0/252280857 shutdown_connections 2024-01-25T15:05:56.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.518+0000 7f9cf81d1640 1 -- 172.21.15.29:0/252280857 wait complete. 2024-01-25T15:05:56.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.519+0000 7f9cf81d1640 1 Processor -- start 2024-01-25T15:05:56.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.520+0000 7f9cf81d1640 1 -- start start 2024-01-25T15:05:56.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.520+0000 7f9cf81d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cf006b380 0x7f9cf01ed5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:56.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.520+0000 7f9cf81d1640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cf013ddd0 0x7f9cf01512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:56.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.520+0000 7f9cf81d1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9cf0138f30 0x7f9cf01ec3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:56.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.520+0000 7f9cf81d1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf0138da0 con 0x7f9cf006b380 2024-01-25T15:05:56.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.520+0000 7f9cf81d1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf01ee070 con 0x7f9cf0138f30 2024-01-25T15:05:56.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.520+0000 7f9cf81d1640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf01ebc60 con 0x7f9cf013ddd0 2024-01-25T15:05:56.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.520+0000 7f9cf5f6d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cf006b380 0x7f9cf01ed5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:56.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.520+0000 7f9cf5f6d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cf006b380 0x7f9cf01ed5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52186/0 (socket says 172.21.15.29:52186) 2024-01-25T15:05:56.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.520+0000 7f9cf5f6d640 1 -- 172.21.15.29:0/1462588594 learned_addr learned my addr 172.21.15.29:0/1462588594 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:56.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.520+0000 7f9cf676e640 1 --2- 172.21.15.29:0/1462588594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9cf0138f30 0x7f9cf01ec3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:56.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.521+0000 7f9cf576c640 1 --2- 172.21.15.29:0/1462588594 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cf013ddd0 0x7f9cf01512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:56.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.521+0000 7f9cf5f6d640 1 -- 172.21.15.29:0/1462588594 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cf013ddd0 msgr2=0x7f9cf01512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:56.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.521+0000 7f9cf5f6d640 1 --2- 172.21.15.29:0/1462588594 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cf013ddd0 0x7f9cf01512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.521+0000 7f9cf5f6d640 1 -- 172.21.15.29:0/1462588594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9cf0138f30 msgr2=0x7f9cf01ec3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:56.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.521+0000 7f9cf5f6d640 1 --2- 172.21.15.29:0/1462588594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9cf0138f30 0x7f9cf01ec3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.521+0000 7f9cf5f6d640 1 -- 172.21.15.29:0/1462588594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce4009400 con 0x7f9cf006b380 2024-01-25T15:05:56.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.521+0000 7f9cf676e640 1 --2- 172.21.15.29:0/1462588594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9cf0138f30 0x7f9cf01ec3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:56.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.521+0000 7f9cf5f6d640 1 --2- 172.21.15.29:0/1462588594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cf006b380 0x7f9cf01ed5c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000c760 tx=0x7f9ce000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:56.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.521+0000 7f9cee7fc640 1 -- 172.21.15.29:0/1462588594 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0006d50 con 0x7f9cf006b380 2024-01-25T15:05:56.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.521+0000 7f9cee7fc640 1 -- 172.21.15.29:0/1462588594 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce000ce70 con 0x7f9cf006b380 2024-01-25T15:05:56.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.521+0000 7f9cf81d1640 1 -- 172.21.15.29:0/1462588594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf01ebf40 con 0x7f9cf006b380 2024-01-25T15:05:56.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.521+0000 7f9cee7fc640 1 -- 172.21.15.29:0/1462588594 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0003b90 con 0x7f9cf006b380 2024-01-25T15:05:56.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.521+0000 7f9cf81d1640 1 -- 172.21.15.29:0/1462588594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf00ac400 con 0x7f9cf006b380 2024-01-25T15:05:56.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.522+0000 7f9cf81d1640 1 -- 172.21.15.29:0/1462588594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf0074010 con 0x7f9cf006b380 2024-01-25T15:05:56.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.522+0000 7f9cee7fc640 1 -- 172.21.15.29:0/1462588594 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9ce0003cf0 con 0x7f9cf006b380 2024-01-25T15:05:56.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.523+0000 7f9cee7fc640 1 --2- 172.21.15.29:0/1462588594 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9cdc06aed0 0x7f9cdc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:56.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.523+0000 7f9cee7fc640 1 -- 172.21.15.29:0/1462588594 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f9ce0089620 con 0x7f9cf006b380 2024-01-25T15:05:56.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.523+0000 7f9cf576c640 1 --2- 172.21.15.29:0/1462588594 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9cdc06aed0 0x7f9cdc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:56.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.523+0000 7f9cf576c640 1 --2- 172.21.15.29:0/1462588594 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9cdc06aed0 0x7f9cdc06d390 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4036000 tx=0x7f9ce4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:56.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.527+0000 7f9cee7fc640 1 -- 172.21.15.29:0/1462588594 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f9ce0057b70 con 0x7f9cf006b380 2024-01-25T15:05:56.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.707+0000 7f9cf81d1640 1 -- 172.21.15.29:0/1462588594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9cf006b0d0 con 0x7f9cf006b380 2024-01-25T15:05:56.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.708+0000 7f9cee7fc640 1 -- 172.21.15.29:0/1462588594 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v42) v1 ==== 105+0+11 (secure 0 0 0) 0x7f9ce0057700 con 0x7f9cf006b380 2024-01-25T15:05:56.709 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:56.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.709+0000 7f9cf81d1640 1 -- 172.21.15.29:0/1462588594 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9cdc06aed0 msgr2=0x7f9cdc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:56.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.709+0000 7f9cf81d1640 1 --2- 172.21.15.29:0/1462588594 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9cdc06aed0 0x7f9cdc06d390 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4036000 tx=0x7f9ce4008030 comp rx=0 tx=0).stop 2024-01-25T15:05:56.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.709+0000 7f9cf81d1640 1 -- 172.21.15.29:0/1462588594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cf006b380 msgr2=0x7f9cf01ed5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:56.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.709+0000 7f9cf81d1640 1 --2- 172.21.15.29:0/1462588594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cf006b380 0x7f9cf01ed5c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000c760 tx=0x7f9ce000cc20 comp rx=0 tx=0).stop 2024-01-25T15:05:56.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.709+0000 7f9cf81d1640 1 -- 172.21.15.29:0/1462588594 shutdown_connections 2024-01-25T15:05:56.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.709+0000 7f9cf81d1640 1 --2- 172.21.15.29:0/1462588594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9cf0138f30 0x7f9cf01ec3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.709+0000 7f9cf81d1640 1 --2- 172.21.15.29:0/1462588594 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9cf013ddd0 0x7f9cf01512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.709+0000 7f9cf81d1640 1 --2- 172.21.15.29:0/1462588594 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9cdc06aed0 0x7f9cdc06d390 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.709+0000 7f9cf81d1640 1 --2- 172.21.15.29:0/1462588594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cf006b380 0x7f9cf01ed5c0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.710+0000 7f9cf81d1640 1 -- 172.21.15.29:0/1462588594 >> 172.21.15.29:0/1462588594 conn(0x7f9cf00c3b00 msgr2=0x7f9cf00c3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:56.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.710+0000 7f9cf81d1640 1 -- 172.21.15.29:0/1462588594 shutdown_connections 2024-01-25T15:05:56.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.710+0000 7f9cf81d1640 1 -- 172.21.15.29:0/1462588594 wait complete. 2024-01-25T15:05:56.721 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-25T15:05:56.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.825+0000 7f749abf5640 1 Processor -- start 2024-01-25T15:05:56.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.825+0000 7f749abf5640 1 -- start start 2024-01-25T15:05:56.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.826+0000 7f749abf5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f74940c4a10 0x7f74940c7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.826+0000 7f749abf5640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7494070e20 con 0x7f74940c4df0 2024-01-25T15:05:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.826+0000 7f749abf5640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74940c5280 con 0x7f7494158950 2024-01-25T15:05:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.826+0000 7f749abf5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74940c7e40 con 0x7f74940c4a10 2024-01-25T15:05:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.826+0000 7f7499192640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f74940c4df0 0x7f749415f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54250/0 (socket says 172.21.15.29:54250) 2024-01-25T15:05:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.826+0000 7f7499192640 1 -- 172.21.15.29:0/1072202051 learned_addr learned my addr 172.21.15.29:0/1072202051 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.826+0000 7f7498991640 1 --2- 172.21.15.29:0/1072202051 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f74940c4a10 0x7f74940c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.826+0000 7f74937fe640 1 -- 172.21.15.29:0/1072202051 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840977991 0 0) 0x7f7494070e20 con 0x7f74940c4df0 2024-01-25T15:05:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.826+0000 7f74937fe640 1 -- 172.21.15.29:0/1072202051 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f747c003520 con 0x7f74940c4df0 2024-01-25T15:05:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.826+0000 7f74937fe640 1 -- 172.21.15.29:0/1072202051 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2816576871 0 0) 0x7f747c003520 con 0x7f74940c4df0 2024-01-25T15:05:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.826+0000 7f74937fe640 1 -- 172.21.15.29:0/1072202051 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f74940c4a10 msgr2=0x7f74940c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.826+0000 7f74937fe640 1 --2- 172.21.15.29:0/1072202051 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f74940c4a10 0x7f74940c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.826+0000 7f74937fe640 1 -- 172.21.15.29:0/1072202051 >> v1:172.21.15.52:6789/0 conn(0x7f7494158950 legacy=0x7f74940c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.826+0000 7f74937fe640 1 -- 172.21.15.29:0/1072202051 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74940c7b60 con 0x7f74940c4df0 2024-01-25T15:05:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.827+0000 7f74937fe640 1 -- 172.21.15.29:0/1072202051 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f7484001670 con 0x7f74940c4df0 2024-01-25T15:05:56.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.827+0000 7f74937fe640 1 -- 172.21.15.29:0/1072202051 >> v1:172.21.15.29:6789/0 conn(0x7f74940c4df0 legacy=0x7f749415f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:56.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.827+0000 7f74937fe640 1 --2- 172.21.15.29:0/1072202051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f747c003a10 0x7f747c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:56.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.827+0000 7f74937fe640 1 --2- 172.21.15.29:0/1072202051 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f747c0047c0 0x7f747c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:56.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.827+0000 7f74937fe640 1 --2- 172.21.15.29:0/1072202051 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f74940c4a10 0x7f747c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:56.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.827+0000 7f74937fe640 1 -- 172.21.15.29:0/1072202051 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74940c7e40 con 0x7f747c0047c0 2024-01-25T15:05:56.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.827+0000 7f74937fe640 1 -- 172.21.15.29:0/1072202051 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c00ba30 con 0x7f747c003a10 2024-01-25T15:05:56.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.827+0000 7f74937fe640 1 -- 172.21.15.29:0/1072202051 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c00bbc0 con 0x7f74940c4a10 2024-01-25T15:05:56.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.827+0000 7f7493fff640 1 --2- 172.21.15.29:0/1072202051 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f747c0047c0 0x7f747c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.827+0000 7f7499192640 1 --2- 172.21.15.29:0/1072202051 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f74940c4a10 0x7f747c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.827+0000 7f7498991640 1 --2- 172.21.15.29:0/1072202051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f747c003a10 0x7f747c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.827+0000 7f7493fff640 1 -- 172.21.15.29:0/1072202051 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f74940c4a10 msgr2=0x7f747c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.827+0000 7f7493fff640 1 --2- 172.21.15.29:0/1072202051 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f74940c4a10 0x7f747c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.827+0000 7f7493fff640 1 -- 172.21.15.29:0/1072202051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f747c003a10 msgr2=0x7f747c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.827+0000 7f7493fff640 1 --2- 172.21.15.29:0/1072202051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f747c003a10 0x7f747c003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.827+0000 7f7493fff640 1 -- 172.21.15.29:0/1072202051 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c003520 con 0x7f747c0047c0 2024-01-25T15:05:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.828+0000 7f7493fff640 1 --2- 172.21.15.29:0/1072202051 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f747c0047c0 0x7f747c004c40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f7488001850 tx=0x7f747c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c2a7850dfede1d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.828+0000 7f74937fe640 1 -- 172.21.15.29:0/1072202051 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7488032600 con 0x7f747c0047c0 2024-01-25T15:05:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.828+0000 7f74937fe640 1 -- 172.21.15.29:0/1072202051 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748802e050 con 0x7f747c0047c0 2024-01-25T15:05:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.828+0000 7f74937fe640 1 -- 172.21.15.29:0/1072202051 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74880329c0 con 0x7f747c0047c0 2024-01-25T15:05:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.828+0000 7f749abf5640 1 -- 172.21.15.29:0/1072202051 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f747c0047c0 msgr2=0x7f747c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.828+0000 7f749abf5640 1 --2- 172.21.15.29:0/1072202051 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f747c0047c0 0x7f747c004c40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f7488001850 tx=0x7f747c0057f0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.828+0000 7f7499192640 1 -- 172.21.15.29:0/1072202051 reap_dead start 2024-01-25T15:05:56.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.829+0000 7f749abf5640 1 -- 172.21.15.29:0/1072202051 shutdown_connections 2024-01-25T15:05:56.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.829+0000 7f749abf5640 1 -- 172.21.15.29:0/1072202051 >> 172.21.15.29:0/1072202051 conn(0x7f74940c7f80 msgr2=0x7f74940c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:56.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.829+0000 7f749abf5640 1 -- 172.21.15.29:0/1072202051 shutdown_connections 2024-01-25T15:05:56.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.829+0000 7f749abf5640 1 -- 172.21.15.29:0/1072202051 wait complete. 2024-01-25T15:05:56.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.830+0000 7f749abf5640 1 Processor -- start 2024-01-25T15:05:56.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.830+0000 7f749abf5640 1 -- start start 2024-01-25T15:05:56.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.830+0000 7f749abf5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f747c0047c0 0x7f74941ee090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:56.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.830+0000 7f749abf5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f74941e1390 0x7f74941de750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:56.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.830+0000 7f749abf5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f749414cb70 0x7f74941dffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:56.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.830+0000 7f749abf5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749414b310 con 0x7f747c0047c0 2024-01-25T15:05:56.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.830+0000 7f749abf5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749414b030 con 0x7f749414cb70 2024-01-25T15:05:56.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.830+0000 7f749abf5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74941ed5b0 con 0x7f74941e1390 2024-01-25T15:05:56.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.831+0000 7f7498991640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f747c0047c0 0x7f74941ee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:56.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.831+0000 7f7498991640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f747c0047c0 0x7f74941ee090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52192/0 (socket says 172.21.15.29:52192) 2024-01-25T15:05:56.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.831+0000 7f7498991640 1 -- 172.21.15.29:0/4063837722 learned_addr learned my addr 172.21.15.29:0/4063837722 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:56.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.831+0000 7f7498991640 1 -- 172.21.15.29:0/4063837722 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f74941e1390 msgr2=0x7f74941de750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:56.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.831+0000 7f7499192640 1 --2- 172.21.15.29:0/4063837722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f749414cb70 0x7f74941dffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:56.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.831+0000 7f7493fff640 1 --2- 172.21.15.29:0/4063837722 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f74941e1390 0x7f74941de750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:56.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.831+0000 7f7498991640 1 --2- 172.21.15.29:0/4063837722 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f74941e1390 0x7f74941de750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.831+0000 7f7498991640 1 -- 172.21.15.29:0/4063837722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f749414cb70 msgr2=0x7f74941dffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:56.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.831+0000 7f7498991640 1 --2- 172.21.15.29:0/4063837722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f749414cb70 0x7f74941dffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:56.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.831+0000 7f7498991640 1 -- 172.21.15.29:0/4063837722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74941ed890 con 0x7f747c0047c0 2024-01-25T15:05:56.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.831+0000 7f7499192640 1 --2- 172.21.15.29:0/4063837722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f749414cb70 0x7f74941dffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:56.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.831+0000 7f7493fff640 1 --2- 172.21.15.29:0/4063837722 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f74941e1390 0x7f74941de750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:56.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.831+0000 7f7498991640 1 --2- 172.21.15.29:0/4063837722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f747c0047c0 0x7f74941ee090 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f748c009f90 tx=0x7f748c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:56.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.831+0000 7f74917fa640 1 -- 172.21.15.29:0/4063837722 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c00e040 con 0x7f747c0047c0 2024-01-25T15:05:56.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.831+0000 7f74917fa640 1 -- 172.21.15.29:0/4063837722 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c00f040 con 0x7f747c0047c0 2024-01-25T15:05:56.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.831+0000 7f749abf5640 1 -- 172.21.15.29:0/4063837722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74941edb70 con 0x7f747c0047c0 2024-01-25T15:05:56.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.831+0000 7f74917fa640 1 -- 172.21.15.29:0/4063837722 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c015870 con 0x7f747c0047c0 2024-01-25T15:05:56.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.831+0000 7f749abf5640 1 -- 172.21.15.29:0/4063837722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f749414cff0 con 0x7f747c0047c0 2024-01-25T15:05:56.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.832+0000 7f749abf5640 1 -- 172.21.15.29:0/4063837722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f749404eb10 con 0x7f747c0047c0 2024-01-25T15:05:56.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.833+0000 7f74917fa640 1 -- 172.21.15.29:0/4063837722 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f748c0159d0 con 0x7f747c0047c0 2024-01-25T15:05:56.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.833+0000 7f74917fa640 1 --2- 172.21.15.29:0/4063837722 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f748006aed0 0x7f748006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:56.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.833+0000 7f74917fa640 1 -- 172.21.15.29:0/4063837722 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f748c08a810 con 0x7f747c0047c0 2024-01-25T15:05:56.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.833+0000 7f7493fff640 1 --2- 172.21.15.29:0/4063837722 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f748006aed0 0x7f748006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:56.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.834+0000 7f7493fff640 1 --2- 172.21.15.29:0/4063837722 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f748006aed0 0x7f748006d390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7488001820 tx=0x7f7488030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:56.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:56.837+0000 7f74917fa640 1 -- 172.21.15.29:0/4063837722 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f748c0552d0 con 0x7f747c0047c0 2024-01-25T15:05:57.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.018+0000 7f749abf5640 1 -- 172.21.15.29:0/4063837722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f74941edd00 con 0x7f747c0047c0 2024-01-25T15:05:57.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.018+0000 7f74917fa640 1 -- 172.21.15.29:0/4063837722 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v42) v1 ==== 101+0+11 (secure 0 0 0) 0x7f748c00fea0 con 0x7f747c0047c0 2024-01-25T15:05:57.020 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-25T15:05:57.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.020+0000 7f749abf5640 1 -- 172.21.15.29:0/4063837722 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f748006aed0 msgr2=0x7f748006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:57.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.020+0000 7f749abf5640 1 --2- 172.21.15.29:0/4063837722 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f748006aed0 0x7f748006d390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7488001820 tx=0x7f7488030000 comp rx=0 tx=0).stop 2024-01-25T15:05:57.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.020+0000 7f749abf5640 1 -- 172.21.15.29:0/4063837722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f747c0047c0 msgr2=0x7f74941ee090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:57.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.020+0000 7f749abf5640 1 --2- 172.21.15.29:0/4063837722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f747c0047c0 0x7f74941ee090 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f748c009f90 tx=0x7f748c00f580 comp rx=0 tx=0).stop 2024-01-25T15:05:57.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.020+0000 7f749abf5640 1 -- 172.21.15.29:0/4063837722 shutdown_connections 2024-01-25T15:05:57.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.020+0000 7f749abf5640 1 --2- 172.21.15.29:0/4063837722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f749414cb70 0x7f74941dffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.020+0000 7f749abf5640 1 --2- 172.21.15.29:0/4063837722 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f74941e1390 0x7f74941de750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.020+0000 7f749abf5640 1 --2- 172.21.15.29:0/4063837722 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f748006aed0 0x7f748006d390 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.020+0000 7f749abf5640 1 --2- 172.21.15.29:0/4063837722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f747c0047c0 0x7f74941ee090 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.020+0000 7f749abf5640 1 -- 172.21.15.29:0/4063837722 >> 172.21.15.29:0/4063837722 conn(0x7f74940c7f80 msgr2=0x7f74940c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:57.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.020+0000 7f749abf5640 1 -- 172.21.15.29:0/4063837722 shutdown_connections 2024-01-25T15:05:57.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.020+0000 7f749abf5640 1 -- 172.21.15.29:0/4063837722 wait complete. 2024-01-25T15:05:57.032 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-25T15:05:57.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.134+0000 7f719469e640 1 Processor -- start 2024-01-25T15:05:57.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.134+0000 7f719469e640 1 -- start start 2024-01-25T15:05:57.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.135+0000 7f719469e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f718c06b490 0x7f718c0c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:57.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.135+0000 7f719469e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f718c158b80 0x7f718c0c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:57.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.135+0000 7f719469e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f718c0c8450 0x7f718c151c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:57.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.135+0000 7f719469e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f718c0c88e0 con 0x7f718c0c8450 2024-01-25T15:05:57.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.135+0000 7f719469e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f718c0c6770 con 0x7f718c06b490 2024-01-25T15:05:57.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.135+0000 7f719469e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718c154f10 con 0x7f718c158b80 2024-01-25T15:05:57.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.135+0000 7f7192c3b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f718c0c8450 0x7f718c151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:57.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.135+0000 7f7192c3b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f718c0c8450 0x7f718c151c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52198/0 (socket says 172.21.15.29:52198) 2024-01-25T15:05:57.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.135+0000 7f7192c3b640 1 -- 172.21.15.29:0/3782137363 learned_addr learned my addr 172.21.15.29:0/3782137363 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:57.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.135+0000 7f7191c39640 1 --2- 172.21.15.29:0/3782137363 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f718c158b80 0x7f718c0c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:57.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.135+0000 7f719243a640 1 --2- 172.21.15.29:0/3782137363 >> v2:172.21.15.52:3300/0 conn(0x7f718c06b490 0x7f718c0c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:57.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.135+0000 7f7192c3b640 1 -- 172.21.15.29:0/3782137363 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f718c158b80 msgr2=0x7f718c0c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:57.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.135+0000 7f7192c3b640 1 --2- 172.21.15.29:0/3782137363 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f718c158b80 0x7f718c0c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.135+0000 7f7192c3b640 1 -- 172.21.15.29:0/3782137363 >> v2:172.21.15.52:3300/0 conn(0x7f718c06b490 msgr2=0x7f718c0c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:57.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.135+0000 7f7192c3b640 1 --2- 172.21.15.29:0/3782137363 >> v2:172.21.15.52:3300/0 conn(0x7f718c06b490 0x7f718c0c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.135+0000 7f7192c3b640 1 -- 172.21.15.29:0/3782137363 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718c1551f0 con 0x7f718c0c8450 2024-01-25T15:05:57.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.135+0000 7f7191c39640 1 --2- 172.21.15.29:0/3782137363 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f718c158b80 0x7f718c0c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:57.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.136+0000 7f7192c3b640 1 --2- 172.21.15.29:0/3782137363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f718c0c8450 0x7f718c151c30 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f718c0c7b60 tx=0x7f718402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3dba829648e9e2d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:57.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.136+0000 7f7191438640 1 -- 172.21.15.29:0/3782137363 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718402c9e0 con 0x7f718c0c8450 2024-01-25T15:05:57.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.136+0000 7f7191438640 1 -- 172.21.15.29:0/3782137363 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718402cb40 con 0x7f718c0c8450 2024-01-25T15:05:57.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.136+0000 7f7191438640 1 -- 172.21.15.29:0/3782137363 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71840343f0 con 0x7f718c0c8450 2024-01-25T15:05:57.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.136+0000 7f719469e640 1 -- 172.21.15.29:0/3782137363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f718c0c8450 msgr2=0x7f718c151c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:57.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.136+0000 7f719469e640 1 --2- 172.21.15.29:0/3782137363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f718c0c8450 0x7f718c151c30 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f718c0c7b60 tx=0x7f718402be40 comp rx=0 tx=0).stop 2024-01-25T15:05:57.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.137+0000 7f719469e640 1 -- 172.21.15.29:0/3782137363 shutdown_connections 2024-01-25T15:05:57.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.137+0000 7f719469e640 1 --2- 172.21.15.29:0/3782137363 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f718c158b80 0x7f718c0c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.137+0000 7f719469e640 1 --2- 172.21.15.29:0/3782137363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f718c0c8450 0x7f718c151c30 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.137+0000 7f719469e640 1 --2- 172.21.15.29:0/3782137363 >> v2:172.21.15.52:3300/0 conn(0x7f718c06b490 0x7f718c0c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.137+0000 7f719469e640 1 -- 172.21.15.29:0/3782137363 >> 172.21.15.29:0/3782137363 conn(0x7f718c0ca010 msgr2=0x7f718c0ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:57.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.137+0000 7f719469e640 1 -- 172.21.15.29:0/3782137363 shutdown_connections 2024-01-25T15:05:57.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.137+0000 7f719469e640 1 -- 172.21.15.29:0/3782137363 wait complete. 2024-01-25T15:05:57.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.138+0000 7f719469e640 1 Processor -- start 2024-01-25T15:05:57.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.138+0000 7f719469e640 1 -- start start 2024-01-25T15:05:57.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.138+0000 7f719469e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f718c06b490 0x7f718c156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:57.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.138+0000 7f719469e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f718c0c8450 0x7f718c1565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:57.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.138+0000 7f719469e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f718c158b80 0x7f718c1490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:57.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.138+0000 7f719469e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c1edd60 con 0x7f718c0c8450 2024-01-25T15:05:57.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.138+0000 7f719469e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c144d50 con 0x7f718c06b490 2024-01-25T15:05:57.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.138+0000 7f719469e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718c0bd5e0 con 0x7f718c158b80 2024-01-25T15:05:57.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.139+0000 7f7191c39640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f718c0c8450 0x7f718c1565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:57.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.139+0000 7f7191c39640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f718c0c8450 0x7f718c1565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52212/0 (socket says 172.21.15.29:52212) 2024-01-25T15:05:57.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.139+0000 7f7191c39640 1 -- 172.21.15.29:0/1001266585 learned_addr learned my addr 172.21.15.29:0/1001266585 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:57.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.139+0000 7f719243a640 1 --2- 172.21.15.29:0/1001266585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f718c06b490 0x7f718c156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:57.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.139+0000 7f7192c3b640 1 --2- 172.21.15.29:0/1001266585 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f718c158b80 0x7f718c1490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:57.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.139+0000 7f7191c39640 1 -- 172.21.15.29:0/1001266585 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f718c158b80 msgr2=0x7f718c1490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:57.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.139+0000 7f7191c39640 1 --2- 172.21.15.29:0/1001266585 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f718c158b80 0x7f718c1490d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.139+0000 7f7191c39640 1 -- 172.21.15.29:0/1001266585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f718c06b490 msgr2=0x7f718c156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:57.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.139+0000 7f7191c39640 1 --2- 172.21.15.29:0/1001266585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f718c06b490 0x7f718c156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.139+0000 7f7191c39640 1 -- 172.21.15.29:0/1001266585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7184009b30 con 0x7f718c0c8450 2024-01-25T15:05:57.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.139+0000 7f7191c39640 1 --2- 172.21.15.29:0/1001266585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f718c0c8450 0x7f718c1565a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f717c00c850 tx=0x7f717c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:57.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.139+0000 7f7182ffd640 1 -- 172.21.15.29:0/1001266585 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c007a30 con 0x7f718c0c8450 2024-01-25T15:05:57.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.139+0000 7f7182ffd640 1 -- 172.21.15.29:0/1001266585 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717c007b90 con 0x7f718c0c8450 2024-01-25T15:05:57.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.139+0000 7f719469e640 1 -- 172.21.15.29:0/1001266585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f718c157240 con 0x7f718c0c8450 2024-01-25T15:05:57.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.139+0000 7f7182ffd640 1 -- 172.21.15.29:0/1001266585 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c00cea0 con 0x7f718c0c8450 2024-01-25T15:05:57.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.139+0000 7f719469e640 1 -- 172.21.15.29:0/1001266585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f718c144790 con 0x7f718c0c8450 2024-01-25T15:05:57.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.140+0000 7f719469e640 1 -- 172.21.15.29:0/1001266585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718c0a97d0 con 0x7f718c0c8450 2024-01-25T15:05:57.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.141+0000 7f7182ffd640 1 -- 172.21.15.29:0/1001266585 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f717c0113f0 con 0x7f718c0c8450 2024-01-25T15:05:57.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.141+0000 7f7182ffd640 1 --2- 172.21.15.29:0/1001266585 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f717006af00 0x7f717006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:57.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.141+0000 7f7182ffd640 1 -- 172.21.15.29:0/1001266585 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f717c089a10 con 0x7f718c0c8450 2024-01-25T15:05:57.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.141+0000 7f719243a640 1 --2- 172.21.15.29:0/1001266585 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f717006af00 0x7f717006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:57.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.142+0000 7f719243a640 1 --2- 172.21.15.29:0/1001266585 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f717006af00 0x7f717006d3c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f718800aa20 tx=0x7f7188008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:57.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.145+0000 7f7182ffd640 1 -- 172.21.15.29:0/1001266585 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f717c054580 con 0x7f718c0c8450 2024-01-25T15:05:57.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.338+0000 7f719469e640 1 -- 172.21.15.29:0/1001266585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f718c074010 con 0x7f718c0c8450 2024-01-25T15:05:57.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.338+0000 7f7182ffd640 1 -- 172.21.15.29:0/1001266585 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7f717c057ba0 con 0x7f718c0c8450 2024-01-25T15:05:57.339 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-01-25T15:05:57.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.340+0000 7f719469e640 1 -- 172.21.15.29:0/1001266585 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f717006af00 msgr2=0x7f717006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:57.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.340+0000 7f719469e640 1 --2- 172.21.15.29:0/1001266585 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f717006af00 0x7f717006d3c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f718800aa20 tx=0x7f7188008040 comp rx=0 tx=0).stop 2024-01-25T15:05:57.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.340+0000 7f719469e640 1 -- 172.21.15.29:0/1001266585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f718c0c8450 msgr2=0x7f718c1565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:57.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.340+0000 7f719469e640 1 --2- 172.21.15.29:0/1001266585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f718c0c8450 0x7f718c1565a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f717c00c850 tx=0x7f717c00cc50 comp rx=0 tx=0).stop 2024-01-25T15:05:57.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.340+0000 7f719469e640 1 -- 172.21.15.29:0/1001266585 shutdown_connections 2024-01-25T15:05:57.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.340+0000 7f719469e640 1 --2- 172.21.15.29:0/1001266585 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f718c158b80 0x7f718c1490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.340+0000 7f719469e640 1 --2- 172.21.15.29:0/1001266585 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f717006af00 0x7f717006d3c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.340+0000 7f719469e640 1 --2- 172.21.15.29:0/1001266585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f718c0c8450 0x7f718c1565a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.340+0000 7f719469e640 1 --2- 172.21.15.29:0/1001266585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f718c06b490 0x7f718c156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.340+0000 7f719469e640 1 -- 172.21.15.29:0/1001266585 >> 172.21.15.29:0/1001266585 conn(0x7f718c0ca010 msgr2=0x7f718c14b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:57.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.340+0000 7f719469e640 1 -- 172.21.15.29:0/1001266585 shutdown_connections 2024-01-25T15:05:57.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.340+0000 7f719469e640 1 -- 172.21.15.29:0/1001266585 wait complete. 2024-01-25T15:05:57.351 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-25T15:05:57.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:57.351 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-01-25T15:05:57.387 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-01-25T15:05:57.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:57.387 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-25T15:05:57.446 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:05:57.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.548+0000 7f9f94a1e640 1 Processor -- start 2024-01-25T15:05:57.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.548+0000 7f9f94a1e640 1 -- start start 2024-01-25T15:05:57.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.548+0000 7f9f94a1e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f90151f60 0x7f9f90158800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:57.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.549+0000 7f9f94a1e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9f900c1360 0x7f9f900bf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:57.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.549+0000 7f9f94a1e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f900c04d0 con 0x7f9f9006d540 2024-01-25T15:05:57.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.549+0000 7f9f94a1e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f900c2890 con 0x7f9f900c1360 2024-01-25T15:05:57.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.549+0000 7f9f94a1e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900bff00 con 0x7f9f90151f60 2024-01-25T15:05:57.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.549+0000 7f9f8e59c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f90151f60 0x7f9f90158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:57.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.549+0000 7f9f87fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9f900c1360 0x7f9f900bf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:57.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.549+0000 7f9f87fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9f900c1360 0x7f9f900bf9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:47666/0 (socket says 172.21.15.29:47666) 2024-01-25T15:05:57.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.549+0000 7f9f87fff640 1 -- 172.21.15.29:0/3837099054 learned_addr learned my addr 172.21.15.29:0/3837099054 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:57.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.549+0000 7f9f8e59c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f90151f60 0x7f9f90158800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:46096/0 (socket says 172.21.15.29:46096) 2024-01-25T15:05:57.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.549+0000 7f9f87fff640 1 -- 172.21.15.29:0/3837099054 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f90151f60 msgr2=0x7f9f90158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:57.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.549+0000 7f9f87fff640 1 --2- 172.21.15.29:0/3837099054 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f90151f60 0x7f9f90158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.549+0000 7f9f87fff640 1 -- 172.21.15.29:0/3837099054 >> v1:172.21.15.52:6789/0 conn(0x7f9f9006d540 legacy=0x7f9f9006a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:57.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.549+0000 7f9f87fff640 1 -- 172.21.15.29:0/3837099054 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f900c0720 con 0x7f9f900c1360 2024-01-25T15:05:57.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.549+0000 7f9f8e59c640 1 --2- 172.21.15.29:0/3837099054 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f90151f60 0x7f9f90158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:05:57.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.550+0000 7f9f87fff640 1 --2- 172.21.15.29:0/3837099054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f900c1360 0x7f9f900bf9c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9f78009870 tx=0x7f9f7802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80230c6af97e6543 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:57.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.550+0000 7f9f8dd9b640 1 -- 172.21.15.29:0/3837099054 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f78031640 con 0x7f9f900c1360 2024-01-25T15:05:57.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.550+0000 7f9f8dd9b640 1 -- 172.21.15.29:0/3837099054 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f780317a0 con 0x7f9f900c1360 2024-01-25T15:05:57.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.550+0000 7f9f8dd9b640 1 -- 172.21.15.29:0/3837099054 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f78031b30 con 0x7f9f900c1360 2024-01-25T15:05:57.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.551+0000 7f9f94a1e640 1 -- 172.21.15.29:0/3837099054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f900c1360 msgr2=0x7f9f900bf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:57.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.551+0000 7f9f94a1e640 1 --2- 172.21.15.29:0/3837099054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f900c1360 0x7f9f900bf9c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9f78009870 tx=0x7f9f7802b8f0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.551+0000 7f9f94a1e640 1 -- 172.21.15.29:0/3837099054 shutdown_connections 2024-01-25T15:05:57.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.551+0000 7f9f94a1e640 1 --2- 172.21.15.29:0/3837099054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f900c1360 0x7f9f900bf9c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.551+0000 7f9f94a1e640 1 --2- 172.21.15.29:0/3837099054 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f90151f60 0x7f9f90158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.551+0000 7f9f94a1e640 1 -- 172.21.15.29:0/3837099054 >> 172.21.15.29:0/3837099054 conn(0x7f9f900a8ac0 msgr2=0x7f9f900c6370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:57.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.551+0000 7f9f94a1e640 1 -- 172.21.15.29:0/3837099054 shutdown_connections 2024-01-25T15:05:57.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.551+0000 7f9f94a1e640 1 -- 172.21.15.29:0/3837099054 wait complete. 2024-01-25T15:05:57.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.552+0000 7f9f94a1e640 1 Processor -- start 2024-01-25T15:05:57.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.552+0000 7f9f94a1e640 1 -- start start 2024-01-25T15:05:57.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.553+0000 7f9f94a1e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f9006d540 0x7f9f901ed940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:57.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.553+0000 7f9f94a1e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f900c1360 0x7f9f9014bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:57.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.553+0000 7f9f94a1e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f90151f60 0x7f9f9014c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:57.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.553+0000 7f9f94a1e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f901552e0 con 0x7f9f9006d540 2024-01-25T15:05:57.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.553+0000 7f9f94a1e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900abee0 con 0x7f9f90151f60 2024-01-25T15:05:57.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.553+0000 7f9f94a1e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9014ce80 con 0x7f9f900c1360 2024-01-25T15:05:57.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.553+0000 7f9f8e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f9006d540 0x7f9f901ed940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:57.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.553+0000 7f9f8e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f9006d540 0x7f9f901ed940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52214/0 (socket says 172.21.15.29:52214) 2024-01-25T15:05:57.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.553+0000 7f9f8e59c640 1 -- 172.21.15.29:0/3037164704 learned_addr learned my addr 172.21.15.29:0/3037164704 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:57.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.553+0000 7f9f87fff640 1 --2- 172.21.15.29:0/3037164704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f900c1360 0x7f9f9014bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:57.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.553+0000 7f9f8ed9d640 1 --2- 172.21.15.29:0/3037164704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f90151f60 0x7f9f9014c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:57.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.553+0000 7f9f8e59c640 1 -- 172.21.15.29:0/3037164704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f900c1360 msgr2=0x7f9f9014bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:57.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.553+0000 7f9f8e59c640 1 --2- 172.21.15.29:0/3037164704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f900c1360 0x7f9f9014bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.553+0000 7f9f8e59c640 1 -- 172.21.15.29:0/3037164704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f90151f60 msgr2=0x7f9f9014c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:57.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.553+0000 7f9f8e59c640 1 --2- 172.21.15.29:0/3037164704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f90151f60 0x7f9f9014c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.553+0000 7f9f8e59c640 1 -- 172.21.15.29:0/3037164704 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f80009400 con 0x7f9f9006d540 2024-01-25T15:05:57.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.553+0000 7f9f8e59c640 1 --2- 172.21.15.29:0/3037164704 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f9006d540 0x7f9f901ed940 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000e960 tx=0x7f9f8000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:57.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.554+0000 7f9f86ffd640 1 -- 172.21.15.29:0/3037164704 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8000ca00 con 0x7f9f9006d540 2024-01-25T15:05:57.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.554+0000 7f9f86ffd640 1 -- 172.21.15.29:0/3037164704 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8000cb60 con 0x7f9f9006d540 2024-01-25T15:05:57.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.554+0000 7f9f94a1e640 1 -- 172.21.15.29:0/3037164704 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f780094d0 con 0x7f9f9006d540 2024-01-25T15:05:57.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.554+0000 7f9f86ffd640 1 -- 172.21.15.29:0/3037164704 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f80013470 con 0x7f9f9006d540 2024-01-25T15:05:57.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.554+0000 7f9f94a1e640 1 -- 172.21.15.29:0/3037164704 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9014c970 con 0x7f9f9006d540 2024-01-25T15:05:57.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.555+0000 7f9f94a1e640 1 -- 172.21.15.29:0/3037164704 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f90074080 con 0x7f9f9006d540 2024-01-25T15:05:57.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.555+0000 7f9f86ffd640 1 -- 172.21.15.29:0/3037164704 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9f800135d0 con 0x7f9f9006d540 2024-01-25T15:05:57.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.555+0000 7f9f86ffd640 1 --2- 172.21.15.29:0/3037164704 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9f7006aed0 0x7f9f7006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:57.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.555+0000 7f9f86ffd640 1 -- 172.21.15.29:0/3037164704 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f9f80089a80 con 0x7f9f9006d540 2024-01-25T15:05:57.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.556+0000 7f9f87fff640 1 --2- 172.21.15.29:0/3037164704 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9f7006aed0 0x7f9f7006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:57.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.556+0000 7f9f87fff640 1 --2- 172.21.15.29:0/3037164704 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9f7006aed0 0x7f9f7006d390 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9f78036000 tx=0x7f9f7803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:57.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.560+0000 7f9f86ffd640 1 -- 172.21.15.29:0/3037164704 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f9f800545f0 con 0x7f9f9006d540 2024-01-25T15:05:57.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.778+0000 7f9f94a1e640 1 -- 172.21.15.29:0/3037164704 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f9014c970 con 0x7f9f9006d540 2024-01-25T15:05:57.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.779+0000 7f9f86ffd640 1 -- 172.21.15.29:0/3037164704 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6180 (secure 0 0 0) 0x7f9f9014c970 con 0x7f9f9006d540 2024-01-25T15:05:57.780 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:57.780 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/3901576943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6835","nonce":3901576943},{"type":"v1","addr":"172.21.15.52:6837","nonce":3901576943}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6836/1878395580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1878395580},{"type":"v1","addr":"172.21.15.52:6836","nonce":1878395580}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:05:26.577307+0000","modified":"2024-01-25T15:05:28.881837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3222226893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3222226893},{"type":"v1","addr":"172.21.15.29:6835","nonce":3222226893}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:05:42.928937+0000","modified":"2024-01-25T15:05:44.918053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.29:6834/1607449141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1607449141},{"type":"v1","addr":"172.21.15.29:6834","nonce":1607449141}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-25T15:05:57.780 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 20 2024-01-25T15:05:57.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.781+0000 7f9f94a1e640 1 -- 172.21.15.29:0/3037164704 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9f7006aed0 msgr2=0x7f9f7006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:57.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.781+0000 7f9f94a1e640 1 --2- 172.21.15.29:0/3037164704 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9f7006aed0 0x7f9f7006d390 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9f78036000 tx=0x7f9f7803c040 comp rx=0 tx=0).stop 2024-01-25T15:05:57.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.781+0000 7f9f94a1e640 1 -- 172.21.15.29:0/3037164704 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f9006d540 msgr2=0x7f9f901ed940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:57.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.781+0000 7f9f94a1e640 1 --2- 172.21.15.29:0/3037164704 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f9006d540 0x7f9f901ed940 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000e960 tx=0x7f9f8000ee20 comp rx=0 tx=0).stop 2024-01-25T15:05:57.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.781+0000 7f9f94a1e640 1 -- 172.21.15.29:0/3037164704 shutdown_connections 2024-01-25T15:05:57.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.781+0000 7f9f94a1e640 1 --2- 172.21.15.29:0/3037164704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f90151f60 0x7f9f9014c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.781+0000 7f9f94a1e640 1 --2- 172.21.15.29:0/3037164704 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9f900c1360 0x7f9f9014bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.781+0000 7f9f94a1e640 1 --2- 172.21.15.29:0/3037164704 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9f7006aed0 0x7f9f7006d390 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.781+0000 7f9f94a1e640 1 --2- 172.21.15.29:0/3037164704 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f9006d540 0x7f9f901ed940 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.781+0000 7f9f94a1e640 1 -- 172.21.15.29:0/3037164704 >> 172.21.15.29:0/3037164704 conn(0x7f9f900a8ac0 msgr2=0x7f9f90158650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:57.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.781+0000 7f9f94a1e640 1 -- 172.21.15.29:0/3037164704 shutdown_connections 2024-01-25T15:05:57.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.781+0000 7f9f94a1e640 1 -- 172.21.15.29:0/3037164704 wait complete. 2024-01-25T15:05:57.792 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:57.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.893+0000 7efd60cc2640 1 Processor -- start 2024-01-25T15:05:57.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.893+0000 7efd60cc2640 1 -- start start 2024-01-25T15:05:57.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.893+0000 7efd60cc2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efd5c14c5a0 0x7efd5c0c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:57.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.893+0000 7efd60cc2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efd5c0c5e10 0x7efd5c0c6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:57.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.893+0000 7efd60cc2640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5c152770 con 0x7efd5c0ad1a0 2024-01-25T15:05:57.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.893+0000 7efd60cc2640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd5c152560 con 0x7efd5c0c5e10 2024-01-25T15:05:57.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.893+0000 7efd60cc2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c153530 con 0x7efd5c14c5a0 2024-01-25T15:05:57.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.894+0000 7efd5ad9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efd5c0c5e10 0x7efd5c0c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:57.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.894+0000 7efd53fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7efd5c0ad1a0 0x7efd5c070510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54254/0 (socket says 172.21.15.29:54254) 2024-01-25T15:05:57.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.894+0000 7efd53fff640 1 -- 172.21.15.29:0/1344801156 learned_addr learned my addr 172.21.15.29:0/1344801156 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:57.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.894+0000 7efd5a59c640 1 --2- 172.21.15.29:0/1344801156 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efd5c14c5a0 0x7efd5c0c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:57.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.894+0000 7efd5ad9d640 1 -- 172.21.15.29:0/1344801156 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efd5c14c5a0 msgr2=0x7efd5c0c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:57.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.894+0000 7efd5ad9d640 1 --2- 172.21.15.29:0/1344801156 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efd5c14c5a0 0x7efd5c0c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.894+0000 7efd5ad9d640 1 -- 172.21.15.29:0/1344801156 >> v1:172.21.15.29:6789/0 conn(0x7efd5c0ad1a0 legacy=0x7efd5c070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:57.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.894+0000 7efd59d9b640 1 -- 172.21.15.29:0/1344801156 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993751600 0 0) 0x7efd5c152770 con 0x7efd5c0ad1a0 2024-01-25T15:05:57.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.894+0000 7efd5ad9d640 1 -- 172.21.15.29:0/1344801156 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c152a50 con 0x7efd5c0c5e10 2024-01-25T15:05:57.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.895+0000 7efd5ad9d640 1 --2- 172.21.15.29:0/1344801156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd5c0c5e10 0x7efd5c0c6260 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7efd54009d90 tx=0x7efd5402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d749f1f915f6ed server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:57.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.895+0000 7efd59d9b640 1 -- 172.21.15.29:0/1344801156 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5402cbc0 con 0x7efd5c0c5e10 2024-01-25T15:05:57.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.895+0000 7efd59d9b640 1 -- 172.21.15.29:0/1344801156 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5402cd20 con 0x7efd5c0c5e10 2024-01-25T15:05:57.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.895+0000 7efd59d9b640 1 -- 172.21.15.29:0/1344801156 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54034660 con 0x7efd5c0c5e10 2024-01-25T15:05:57.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.895+0000 7efd60cc2640 1 -- 172.21.15.29:0/1344801156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd5c0c5e10 msgr2=0x7efd5c0c6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:57.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.895+0000 7efd60cc2640 1 --2- 172.21.15.29:0/1344801156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd5c0c5e10 0x7efd5c0c6260 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7efd54009d90 tx=0x7efd5402be10 comp rx=0 tx=0).stop 2024-01-25T15:05:57.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.895+0000 7efd60cc2640 1 -- 172.21.15.29:0/1344801156 shutdown_connections 2024-01-25T15:05:57.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.895+0000 7efd60cc2640 1 --2- 172.21.15.29:0/1344801156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd5c0c5e10 0x7efd5c0c6260 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.895+0000 7efd60cc2640 1 --2- 172.21.15.29:0/1344801156 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efd5c14c5a0 0x7efd5c0c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.895+0000 7efd60cc2640 1 -- 172.21.15.29:0/1344801156 >> 172.21.15.29:0/1344801156 conn(0x7efd5c0c7f10 msgr2=0x7efd5c0c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:57.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.895+0000 7efd60cc2640 1 -- 172.21.15.29:0/1344801156 shutdown_connections 2024-01-25T15:05:57.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.895+0000 7efd60cc2640 1 -- 172.21.15.29:0/1344801156 wait complete. 2024-01-25T15:05:57.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.897+0000 7efd60cc2640 1 Processor -- start 2024-01-25T15:05:57.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.897+0000 7efd60cc2640 1 -- start start 2024-01-25T15:05:57.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.897+0000 7efd60cc2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efd5c0ad1a0 0x7efd5c0c4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:57.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.897+0000 7efd60cc2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd5c0c5e10 0x7efd5c14ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:57.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.897+0000 7efd60cc2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd5c14c5a0 0x7efd5c14f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:57.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.897+0000 7efd60cc2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c06d690 con 0x7efd5c0c5e10 2024-01-25T15:05:57.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.897+0000 7efd60cc2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c148fd0 con 0x7efd5c14c5a0 2024-01-25T15:05:57.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.897+0000 7efd60cc2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c1e9ef0 con 0x7efd5c0ad1a0 2024-01-25T15:05:57.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.897+0000 7efd53fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd5c0c5e10 0x7efd5c14ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:57.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.897+0000 7efd53fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd5c0c5e10 0x7efd5c14ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52236/0 (socket says 172.21.15.29:52236) 2024-01-25T15:05:57.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.897+0000 7efd53fff640 1 -- 172.21.15.29:0/2553698716 learned_addr learned my addr 172.21.15.29:0/2553698716 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:57.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.898+0000 7efd5a59c640 1 --2- 172.21.15.29:0/2553698716 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efd5c0ad1a0 0x7efd5c0c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:57.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.898+0000 7efd5ad9d640 1 --2- 172.21.15.29:0/2553698716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd5c14c5a0 0x7efd5c14f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:57.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.898+0000 7efd53fff640 1 -- 172.21.15.29:0/2553698716 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efd5c0ad1a0 msgr2=0x7efd5c0c4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:57.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.898+0000 7efd53fff640 1 --2- 172.21.15.29:0/2553698716 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efd5c0ad1a0 0x7efd5c0c4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.898+0000 7efd53fff640 1 -- 172.21.15.29:0/2553698716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd5c14c5a0 msgr2=0x7efd5c14f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:57.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.898+0000 7efd53fff640 1 --2- 172.21.15.29:0/2553698716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd5c14c5a0 0x7efd5c14f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:57.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.898+0000 7efd53fff640 1 -- 172.21.15.29:0/2553698716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd54009a70 con 0x7efd5c0c5e10 2024-01-25T15:05:57.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.898+0000 7efd5ad9d640 1 --2- 172.21.15.29:0/2553698716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd5c14c5a0 0x7efd5c14f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:57.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.898+0000 7efd53fff640 1 --2- 172.21.15.29:0/2553698716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd5c0c5e10 0x7efd5c14ed50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7efd4400c4d0 tx=0x7efd4400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:57.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.898+0000 7efd52ffd640 1 -- 172.21.15.29:0/2553698716 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd440074e0 con 0x7efd5c0c5e10 2024-01-25T15:05:57.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.898+0000 7efd52ffd640 1 -- 172.21.15.29:0/2553698716 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd44007660 con 0x7efd5c0c5e10 2024-01-25T15:05:57.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.898+0000 7efd60cc2640 1 -- 172.21.15.29:0/2553698716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5c1eaa30 con 0x7efd5c0c5e10 2024-01-25T15:05:57.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.898+0000 7efd52ffd640 1 -- 172.21.15.29:0/2553698716 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd44004a20 con 0x7efd5c0c5e10 2024-01-25T15:05:57.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.898+0000 7efd60cc2640 1 -- 172.21.15.29:0/2553698716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5c1ea3e0 con 0x7efd5c0c5e10 2024-01-25T15:05:57.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.899+0000 7efd60cc2640 1 -- 172.21.15.29:0/2553698716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5c04eb10 con 0x7efd5c0c5e10 2024-01-25T15:05:57.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.899+0000 7efd52ffd640 1 -- 172.21.15.29:0/2553698716 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7efd44004b80 con 0x7efd5c0c5e10 2024-01-25T15:05:57.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.900+0000 7efd52ffd640 1 --2- 172.21.15.29:0/2553698716 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efd3c06aed0 0x7efd3c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:57.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.900+0000 7efd52ffd640 1 -- 172.21.15.29:0/2553698716 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7efd44088fb0 con 0x7efd5c0c5e10 2024-01-25T15:05:57.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.900+0000 7efd5a59c640 1 --2- 172.21.15.29:0/2553698716 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efd3c06aed0 0x7efd3c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:57.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.900+0000 7efd5a59c640 1 --2- 172.21.15.29:0/2553698716 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efd3c06aed0 0x7efd3c06d390 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efd4c006fd0 tx=0x7efd4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:57.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:57.904+0000 7efd52ffd640 1 -- 172.21.15.29:0/2553698716 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7efd440bc190 con 0x7efd5c0c5e10 2024-01-25T15:05:58.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.084+0000 7efd60cc2640 1 -- 172.21.15.29:0/2553698716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd5c1eabc0 con 0x7efd5c0c5e10 2024-01-25T15:05:58.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.085+0000 7efd52ffd640 1 -- 172.21.15.29:0/2553698716 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+20455 (secure 0 0 0) 0x7efd44018020 con 0x7efd5c0c5e10 2024-01-25T15:05:58.086 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:58.087 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":42,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:05:44.564655+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:05:25.099043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-25T15:05:25.537967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-25T15:05:40.935431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-25T15:05:41.895611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:58.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.087+0000 7efd60cc2640 1 -- 172.21.15.29:0/2553698716 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efd3c06aed0 msgr2=0x7efd3c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:58.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.087+0000 7efd60cc2640 1 --2- 172.21.15.29:0/2553698716 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efd3c06aed0 0x7efd3c06d390 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efd4c006fd0 tx=0x7efd4c008040 comp rx=0 tx=0).stop 2024-01-25T15:05:58.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.087+0000 7efd60cc2640 1 -- 172.21.15.29:0/2553698716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd5c0c5e10 msgr2=0x7efd5c14ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:58.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.087+0000 7efd60cc2640 1 --2- 172.21.15.29:0/2553698716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd5c0c5e10 0x7efd5c14ed50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7efd4400c4d0 tx=0x7efd4400c990 comp rx=0 tx=0).stop 2024-01-25T15:05:58.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.087+0000 7efd60cc2640 1 -- 172.21.15.29:0/2553698716 shutdown_connections 2024-01-25T15:05:58.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.087+0000 7efd60cc2640 1 --2- 172.21.15.29:0/2553698716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd5c14c5a0 0x7efd5c14f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:58.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.087+0000 7efd60cc2640 1 --2- 172.21.15.29:0/2553698716 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7efd3c06aed0 0x7efd3c06d390 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:58.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.087+0000 7efd60cc2640 1 --2- 172.21.15.29:0/2553698716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd5c0c5e10 0x7efd5c14ed50 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:58.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.087+0000 7efd60cc2640 1 --2- 172.21.15.29:0/2553698716 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7efd5c0ad1a0 0x7efd5c0c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:58.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.087+0000 7efd60cc2640 1 -- 172.21.15.29:0/2553698716 >> 172.21.15.29:0/2553698716 conn(0x7efd5c0c7f10 msgr2=0x7efd5c0a8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:58.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.087+0000 7efd60cc2640 1 -- 172.21.15.29:0/2553698716 shutdown_connections 2024-01-25T15:05:58.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.087+0000 7efd60cc2640 1 -- 172.21.15.29:0/2553698716 wait complete. 2024-01-25T15:05:58.099 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T15:04:14.955791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T15:05:25.099043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T15:05:25.537967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-25T15:05:40.935431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-25T15:05:41.895611+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-25T15:05:58.099 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:05:58.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.203+0000 7f2692a97640 1 Processor -- start 2024-01-25T15:05:58.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.203+0000 7f2692a97640 1 -- start start 2024-01-25T15:05:58.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.203+0000 7f2692a97640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f268c0c4fe0 0x7f268c06b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:58.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.203+0000 7f2692a97640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f268c0afaa0 con 0x7f268c06d560 2024-01-25T15:05:58.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.203+0000 7f2692a97640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f268c0c6060 con 0x7f268c0af6c0 2024-01-25T15:05:58.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.203+0000 7f2692a97640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f268c06c480 con 0x7f268c0c4fe0 2024-01-25T15:05:58.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.203+0000 7f2691034640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f268c0c4fe0 0x7f268c06b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:58.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.204+0000 7f2691034640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f268c0c4fe0 0x7f268c06b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52238/0 (socket says 172.21.15.29:52238) 2024-01-25T15:05:58.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.204+0000 7f268bfff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f268c06d560 0x7f268c06b220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54270/0 (socket says 172.21.15.29:54270) 2024-01-25T15:05:58.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.204+0000 7f2691034640 1 -- 172.21.15.29:0/1262607521 learned_addr learned my addr 172.21.15.29:0/1262607521 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:58.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.204+0000 7f2691034640 1 -- 172.21.15.29:0/1262607521 >> v1:172.21.15.52:6789/0 conn(0x7f268c0af6c0 legacy=0x7f268c0c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:58.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.204+0000 7f2691034640 1 -- 172.21.15.29:0/1262607521 >> v1:172.21.15.29:6789/0 conn(0x7f268c06d560 legacy=0x7f268c06b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:58.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.204+0000 7f2691034640 1 -- 172.21.15.29:0/1262607521 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268c155480 con 0x7f268c0c4fe0 2024-01-25T15:05:58.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.204+0000 7f268b7fe640 1 -- 172.21.15.29:0/1262607521 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002717844 0 0) 0x7f268c0afaa0 con 0x7f268c06d560 2024-01-25T15:05:58.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.205+0000 7f2691034640 1 --2- 172.21.15.29:0/1262607521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f268c0c4fe0 0x7f268c06b930 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2674009870 tx=0x7f267402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f703b7b54e18ca7a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:58.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.205+0000 7f268b7fe640 1 -- 172.21.15.29:0/1262607521 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674030860 con 0x7f268c0c4fe0 2024-01-25T15:05:58.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.205+0000 7f268b7fe640 1 -- 172.21.15.29:0/1262607521 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26740309c0 con 0x7f268c0c4fe0 2024-01-25T15:05:58.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.205+0000 7f268b7fe640 1 -- 172.21.15.29:0/1262607521 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674030d50 con 0x7f268c0c4fe0 2024-01-25T15:05:58.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.205+0000 7f2692a97640 1 -- 172.21.15.29:0/1262607521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f268c0c4fe0 msgr2=0x7f268c06b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:58.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.205+0000 7f2692a97640 1 --2- 172.21.15.29:0/1262607521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f268c0c4fe0 0x7f268c06b930 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2674009870 tx=0x7f267402b9a0 comp rx=0 tx=0).stop 2024-01-25T15:05:58.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.205+0000 7f2692a97640 1 -- 172.21.15.29:0/1262607521 shutdown_connections 2024-01-25T15:05:58.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.205+0000 7f2692a97640 1 --2- 172.21.15.29:0/1262607521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f268c0c4fe0 0x7f268c06b930 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:58.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.205+0000 7f2692a97640 1 -- 172.21.15.29:0/1262607521 >> 172.21.15.29:0/1262607521 conn(0x7f268c0c6ca0 msgr2=0x7f268c0c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:58.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.205+0000 7f2692a97640 1 -- 172.21.15.29:0/1262607521 shutdown_connections 2024-01-25T15:05:58.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.205+0000 7f2692a97640 1 -- 172.21.15.29:0/1262607521 wait complete. 2024-01-25T15:05:58.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.206+0000 7f2692a97640 1 Processor -- start 2024-01-25T15:05:58.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.206+0000 7f2692a97640 1 -- start start 2024-01-25T15:05:58.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.207+0000 7f2692a97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f268c06d560 0x7f268c1ea990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:58.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.207+0000 7f2692a97640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f268c0af6c0 0x7f268c1ede30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:58.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.207+0000 7f2692a97640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f268c0c4fe0 0x7f268c0c1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:58.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.207+0000 7f2692a97640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c1eaed0 con 0x7f268c06d560 2024-01-25T15:05:58.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.207+0000 7f2692a97640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c157150 con 0x7f268c0af6c0 2024-01-25T15:05:58.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.207+0000 7f2692a97640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268c1585f0 con 0x7f268c0c4fe0 2024-01-25T15:05:58.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.207+0000 7f2690833640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f268c06d560 0x7f268c1ea990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:58.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.207+0000 7f2690833640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f268c06d560 0x7f268c1ea990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52250/0 (socket says 172.21.15.29:52250) 2024-01-25T15:05:58.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.207+0000 7f2690833640 1 -- 172.21.15.29:0/3655863314 learned_addr learned my addr 172.21.15.29:0/3655863314 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:58.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.208+0000 7f2691034640 1 --2- 172.21.15.29:0/3655863314 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f268c0c4fe0 0x7f268c0c1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:58.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.208+0000 7f268bfff640 1 --2- 172.21.15.29:0/3655863314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f268c0af6c0 0x7f268c1ede30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:58.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.208+0000 7f2690833640 1 -- 172.21.15.29:0/3655863314 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f268c0c4fe0 msgr2=0x7f268c0c1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:58.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.208+0000 7f2690833640 1 --2- 172.21.15.29:0/3655863314 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f268c0c4fe0 0x7f268c0c1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:58.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.208+0000 7f2690833640 1 -- 172.21.15.29:0/3655863314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f268c0af6c0 msgr2=0x7f268c1ede30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:58.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.208+0000 7f2690833640 1 --2- 172.21.15.29:0/3655863314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f268c0af6c0 0x7f268c1ede30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:58.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.208+0000 7f2690833640 1 -- 172.21.15.29:0/3655863314 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26740094d0 con 0x7f268c06d560 2024-01-25T15:05:58.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.208+0000 7f268bfff640 1 --2- 172.21.15.29:0/3655863314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f268c0af6c0 0x7f268c1ede30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:58.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.208+0000 7f2690833640 1 --2- 172.21.15.29:0/3655863314 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f268c06d560 0x7f268c1ea990 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f268400c7c0 tx=0x7f268400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:58.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.208+0000 7f26897fa640 1 -- 172.21.15.29:0/3655863314 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268400aa50 con 0x7f268c06d560 2024-01-25T15:05:58.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.208+0000 7f26897fa640 1 -- 172.21.15.29:0/3655863314 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268400abb0 con 0x7f268c06d560 2024-01-25T15:05:58.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.208+0000 7f2692a97640 1 -- 172.21.15.29:0/3655863314 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f268c1ee370 con 0x7f268c06d560 2024-01-25T15:05:58.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.208+0000 7f26897fa640 1 -- 172.21.15.29:0/3655863314 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2684012420 con 0x7f268c06d560 2024-01-25T15:05:58.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.208+0000 7f2692a97640 1 -- 172.21.15.29:0/3655863314 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268c158310 con 0x7f268c06d560 2024-01-25T15:05:58.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.209+0000 7f2692a97640 1 -- 172.21.15.29:0/3655863314 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268c1521d0 con 0x7f268c06d560 2024-01-25T15:05:58.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.210+0000 7f26897fa640 1 -- 172.21.15.29:0/3655863314 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2684012580 con 0x7f268c06d560 2024-01-25T15:05:58.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.210+0000 7f26897fa640 1 --2- 172.21.15.29:0/3655863314 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f266c06aed0 0x7f266c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:58.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.210+0000 7f26897fa640 1 -- 172.21.15.29:0/3655863314 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f26840899c0 con 0x7f268c06d560 2024-01-25T15:05:58.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.210+0000 7f268bfff640 1 --2- 172.21.15.29:0/3655863314 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f266c06aed0 0x7f266c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:58.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.211+0000 7f268bfff640 1 --2- 172.21.15.29:0/3655863314 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f266c06aed0 0x7f266c06d390 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f268c0c4740 tx=0x7f267c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:58.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.214+0000 7f26897fa640 1 -- 172.21.15.29:0/3655863314 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2684054480 con 0x7f268c06d560 2024-01-25T15:05:58.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.394+0000 7f2692a97640 1 -- 172.21.15.29:0/3655863314 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f268c0c54b0 con 0x7f268c06d560 2024-01-25T15:05:58.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.394+0000 7f26897fa640 1 -- 172.21.15.29:0/3655863314 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2684057aa0 con 0x7f268c06d560 2024-01-25T15:05:58.395 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-25T15:05:58.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.396+0000 7f2692a97640 1 -- 172.21.15.29:0/3655863314 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f266c06aed0 msgr2=0x7f266c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:58.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.396+0000 7f2692a97640 1 --2- 172.21.15.29:0/3655863314 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f266c06aed0 0x7f266c06d390 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f268c0c4740 tx=0x7f267c009040 comp rx=0 tx=0).stop 2024-01-25T15:05:58.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.396+0000 7f2692a97640 1 -- 172.21.15.29:0/3655863314 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f268c06d560 msgr2=0x7f268c1ea990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:58.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.396+0000 7f2692a97640 1 --2- 172.21.15.29:0/3655863314 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f268c06d560 0x7f268c1ea990 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f268400c7c0 tx=0x7f268400cc80 comp rx=0 tx=0).stop 2024-01-25T15:05:58.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.396+0000 7f2692a97640 1 -- 172.21.15.29:0/3655863314 shutdown_connections 2024-01-25T15:05:58.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.396+0000 7f2692a97640 1 --2- 172.21.15.29:0/3655863314 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f268c0c4fe0 0x7f268c0c1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:58.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.396+0000 7f2692a97640 1 --2- 172.21.15.29:0/3655863314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f268c0af6c0 0x7f268c1ede30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:58.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.396+0000 7f2692a97640 1 --2- 172.21.15.29:0/3655863314 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f266c06aed0 0x7f266c06d390 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:58.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.396+0000 7f2692a97640 1 --2- 172.21.15.29:0/3655863314 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f268c06d560 0x7f268c1ea990 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:58.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.396+0000 7f2692a97640 1 -- 172.21.15.29:0/3655863314 >> 172.21.15.29:0/3655863314 conn(0x7f268c0c6ca0 msgr2=0x7f268c0c7080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:58.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.396+0000 7f2692a97640 1 -- 172.21.15.29:0/3655863314 shutdown_connections 2024-01-25T15:05:58.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.396+0000 7f2692a97640 1 -- 172.21.15.29:0/3655863314 wait complete. 2024-01-25T15:05:58.407 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:05:58.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.511+0000 7f0c07d73640 1 Processor -- start 2024-01-25T15:05:58.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.511+0000 7f0c07d73640 1 -- start start 2024-01-25T15:05:58.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.511+0000 7f0c07d73640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0c0006f290 0x7f0c00158800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:58.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.511+0000 7f0c07d73640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c00158d40 con 0x7f0c0006b380 2024-01-25T15:05:58.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.511+0000 7f0c07d73640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c00072350 con 0x7f0c0013ddd0 2024-01-25T15:05:58.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.511+0000 7f0c07d73640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c0006dcd0 con 0x7f0c0006f290 2024-01-25T15:05:58.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.512+0000 7f0c0530e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0c0006f290 0x7f0c00158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:58.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.512+0000 7f0c06310640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0c0006b380 0x7f0c0006a6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54282/0 (socket says 172.21.15.29:54282) 2024-01-25T15:05:58.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.512+0000 7f0c06310640 1 -- 172.21.15.29:0/611848975 learned_addr learned my addr 172.21.15.29:0/611848975 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:58.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.512+0000 7f0c0530e640 1 -- 172.21.15.29:0/611848975 >> v1:172.21.15.52:6789/0 conn(0x7f0c0013ddd0 legacy=0x7f0c000c0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:58.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.512+0000 7f0c0530e640 1 -- 172.21.15.29:0/611848975 >> v1:172.21.15.29:6789/0 conn(0x7f0c0006b380 legacy=0x7f0c0006a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:58.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.512+0000 7f0c0530e640 1 -- 172.21.15.29:0/611848975 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c00157db0 con 0x7f0c0006f290 2024-01-25T15:05:58.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.513+0000 7f0c0530e640 1 --2- 172.21.15.29:0/611848975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c0006f290 0x7f0c00158800 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0bf00097a0 tx=0x7f0bf002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a6862750ca5845 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:58.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.513+0000 7f0c04b0d640 1 -- 172.21.15.29:0/611848975 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf002e070 con 0x7f0c0006f290 2024-01-25T15:05:58.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.513+0000 7f0c04b0d640 1 -- 172.21.15.29:0/611848975 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf00315a0 con 0x7f0c0006f290 2024-01-25T15:05:58.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.513+0000 7f0c04b0d640 1 -- 172.21.15.29:0/611848975 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0031930 con 0x7f0c0006f290 2024-01-25T15:05:58.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.513+0000 7f0c07d73640 1 -- 172.21.15.29:0/611848975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c0006f290 msgr2=0x7f0c00158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:58.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.513+0000 7f0c07d73640 1 --2- 172.21.15.29:0/611848975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c0006f290 0x7f0c00158800 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0bf00097a0 tx=0x7f0bf002b840 comp rx=0 tx=0).stop 2024-01-25T15:05:58.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.513+0000 7f0c07d73640 1 -- 172.21.15.29:0/611848975 shutdown_connections 2024-01-25T15:05:58.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.513+0000 7f0c07d73640 1 --2- 172.21.15.29:0/611848975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c0006f290 0x7f0c00158800 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:58.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.513+0000 7f0c07d73640 1 -- 172.21.15.29:0/611848975 >> 172.21.15.29:0/611848975 conn(0x7f0c000c3b00 msgr2=0x7f0c000c3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:58.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.514+0000 7f0c07d73640 1 -- 172.21.15.29:0/611848975 shutdown_connections 2024-01-25T15:05:58.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.514+0000 7f0c07d73640 1 -- 172.21.15.29:0/611848975 wait complete. 2024-01-25T15:05:58.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.515+0000 7f0c07d73640 1 Processor -- start 2024-01-25T15:05:58.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.515+0000 7f0c07d73640 1 -- start start 2024-01-25T15:05:58.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.515+0000 7f0c07d73640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c0006b380 0x7f0c001eb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:58.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.515+0000 7f0c07d73640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c0013ddd0 0x7f0c00139650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:58.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.515+0000 7f0c07d73640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c000a86a0 0x7f0c001edb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:58.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.515+0000 7f0c07d73640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c001ee6d0 con 0x7f0c000a86a0 2024-01-25T15:05:58.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.515+0000 7f0c07d73640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0013a430 con 0x7f0c0006b380 2024-01-25T15:05:58.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.515+0000 7f0c07d73640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c000a8c90 con 0x7f0c0013ddd0 2024-01-25T15:05:58.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.515+0000 7f0c06310640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c000a86a0 0x7f0c001edb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:58.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.515+0000 7f0c06310640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c000a86a0 0x7f0c001edb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52264/0 (socket says 172.21.15.29:52264) 2024-01-25T15:05:58.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.515+0000 7f0c06310640 1 -- 172.21.15.29:0/812533055 learned_addr learned my addr 172.21.15.29:0/812533055 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:58.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.516+0000 7f0c0530e640 1 --2- 172.21.15.29:0/812533055 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c0013ddd0 0x7f0c00139650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:58.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.516+0000 7f0c05b0f640 1 --2- 172.21.15.29:0/812533055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c0006b380 0x7f0c001eb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:58.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.516+0000 7f0c06310640 1 -- 172.21.15.29:0/812533055 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c0013ddd0 msgr2=0x7f0c00139650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:58.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.516+0000 7f0c06310640 1 --2- 172.21.15.29:0/812533055 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c0013ddd0 0x7f0c00139650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:58.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.516+0000 7f0c06310640 1 -- 172.21.15.29:0/812533055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c0006b380 msgr2=0x7f0c001eb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:58.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.516+0000 7f0c06310640 1 --2- 172.21.15.29:0/812533055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c0006b380 0x7f0c001eb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:58.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.516+0000 7f0c06310640 1 -- 172.21.15.29:0/812533055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf0009400 con 0x7f0c000a86a0 2024-01-25T15:05:58.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.516+0000 7f0c06310640 1 --2- 172.21.15.29:0/812533055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c000a86a0 0x7f0c001edb70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800cbc0 tx=0x7f0bf800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:58.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.516+0000 7f0bf67fc640 1 -- 172.21.15.29:0/812533055 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf800ad40 con 0x7f0c000a86a0 2024-01-25T15:05:58.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.516+0000 7f0bf67fc640 1 -- 172.21.15.29:0/812533055 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf8012400 con 0x7f0c000a86a0 2024-01-25T15:05:58.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.516+0000 7f0c07d73640 1 -- 172.21.15.29:0/812533055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c000a8f70 con 0x7f0c000a86a0 2024-01-25T15:05:58.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.516+0000 7f0bf67fc640 1 -- 172.21.15.29:0/812533055 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf800aea0 con 0x7f0c000a86a0 2024-01-25T15:05:58.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.516+0000 7f0c07d73640 1 -- 172.21.15.29:0/812533055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c00138e10 con 0x7f0c000a86a0 2024-01-25T15:05:58.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.517+0000 7f0c07d73640 1 -- 172.21.15.29:0/812533055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c00139370 con 0x7f0c000a86a0 2024-01-25T15:05:58.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.517+0000 7f0bf67fc640 1 -- 172.21.15.29:0/812533055 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0bf8007070 con 0x7f0c000a86a0 2024-01-25T15:05:58.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.518+0000 7f0bf67fc640 1 --2- 172.21.15.29:0/812533055 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0be406aed0 0x7f0be406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:58.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.518+0000 7f0bf67fc640 1 -- 172.21.15.29:0/812533055 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f0bf8089790 con 0x7f0c000a86a0 2024-01-25T15:05:58.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.518+0000 7f0c05b0f640 1 --2- 172.21.15.29:0/812533055 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0be406aed0 0x7f0be406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:58.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.518+0000 7f0c05b0f640 1 --2- 172.21.15.29:0/812533055 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0be406aed0 0x7f0be406d390 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc007fd0 tx=0x7f0bfc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:58.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.522+0000 7f0bf67fc640 1 -- 172.21.15.29:0/812533055 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f0c00139370 con 0x7f0c000a86a0 2024-01-25T15:05:58.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.705+0000 7f0c07d73640 1 -- 172.21.15.29:0/812533055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0c00158d40 con 0x7f0c000a86a0 2024-01-25T15:05:58.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.706+0000 7f0bf67fc640 1 -- 172.21.15.29:0/812533055 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0c00158d40 con 0x7f0c000a86a0 2024-01-25T15:05:58.707 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:58.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.708+0000 7f0c07d73640 1 -- 172.21.15.29:0/812533055 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0be406aed0 msgr2=0x7f0be406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:58.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.708+0000 7f0c07d73640 1 --2- 172.21.15.29:0/812533055 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0be406aed0 0x7f0be406d390 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc007fd0 tx=0x7f0bfc009040 comp rx=0 tx=0).stop 2024-01-25T15:05:58.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.708+0000 7f0c07d73640 1 -- 172.21.15.29:0/812533055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c000a86a0 msgr2=0x7f0c001edb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:58.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.708+0000 7f0c07d73640 1 --2- 172.21.15.29:0/812533055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c000a86a0 0x7f0c001edb70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800cbc0 tx=0x7f0bf800a430 comp rx=0 tx=0).stop 2024-01-25T15:05:58.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.708+0000 7f0c07d73640 1 -- 172.21.15.29:0/812533055 shutdown_connections 2024-01-25T15:05:58.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.708+0000 7f0c07d73640 1 --2- 172.21.15.29:0/812533055 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0be406aed0 0x7f0be406d390 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:58.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.708+0000 7f0c07d73640 1 --2- 172.21.15.29:0/812533055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c000a86a0 0x7f0c001edb70 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:58.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.708+0000 7f0c07d73640 1 --2- 172.21.15.29:0/812533055 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c0013ddd0 0x7f0c00139650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:58.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.708+0000 7f0c07d73640 1 --2- 172.21.15.29:0/812533055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c0006b380 0x7f0c001eb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:58.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.708+0000 7f0c07d73640 1 -- 172.21.15.29:0/812533055 >> 172.21.15.29:0/812533055 conn(0x7f0c000c3b00 msgr2=0x7f0c0013d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:58.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.708+0000 7f0c07d73640 1 -- 172.21.15.29:0/812533055 shutdown_connections 2024-01-25T15:05:58.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.708+0000 7f0c07d73640 1 -- 172.21.15.29:0/812533055 wait complete. 2024-01-25T15:05:58.719 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:05:58.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.823+0000 7fada2eda640 1 Processor -- start 2024-01-25T15:05:58.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.823+0000 7fada2eda640 1 -- start start 2024-01-25T15:05:58.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.823+0000 7fada2eda640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fad9c0abe10 0x7fad9c0a8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:58.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.823+0000 7fada2eda640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9c0a9ce0 con 0x7fad9c152e90 2024-01-25T15:05:58.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.824+0000 7fada2eda640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9c153400 con 0x7fad9c14fbf0 2024-01-25T15:05:58.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.824+0000 7fada2eda640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad9c0ab050 con 0x7fad9c0abe10 2024-01-25T15:05:58.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.824+0000 7fad9bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fad9c0abe10 0x7fad9c0a8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:58.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.824+0000 7fada1477640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fad9c152e90 0x7fad9c15cd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54284/0 (socket says 172.21.15.29:54284) 2024-01-25T15:05:58.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.824+0000 7fada1477640 1 -- 172.21.15.29:0/609625838 learned_addr learned my addr 172.21.15.29:0/609625838 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:58.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.824+0000 7fad9bfff640 1 -- 172.21.15.29:0/609625838 >> v1:172.21.15.52:6789/0 conn(0x7fad9c14fbf0 legacy=0x7fad9c0c1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:58.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.824+0000 7fad9bfff640 1 -- 172.21.15.29:0/609625838 >> v1:172.21.15.29:6789/0 conn(0x7fad9c152e90 legacy=0x7fad9c15cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:58.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.824+0000 7fad9bfff640 1 -- 172.21.15.29:0/609625838 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c0ab330 con 0x7fad9c0abe10 2024-01-25T15:05:58.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.825+0000 7fad9bfff640 1 --2- 172.21.15.29:0/609625838 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad9c0abe10 0x7fad9c0a8490 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fad880097a0 tx=0x7fad8802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d57d5a28db69a48 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:58.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.825+0000 7fad9b7fe640 1 -- 172.21.15.29:0/609625838 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88030610 con 0x7fad9c0abe10 2024-01-25T15:05:58.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.825+0000 7fad9b7fe640 1 -- 172.21.15.29:0/609625838 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad88030770 con 0x7fad9c0abe10 2024-01-25T15:05:58.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.825+0000 7fad9b7fe640 1 -- 172.21.15.29:0/609625838 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88030b00 con 0x7fad9c0abe10 2024-01-25T15:05:58.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.825+0000 7fada2eda640 1 -- 172.21.15.29:0/609625838 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad9c0abe10 msgr2=0x7fad9c0a8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:58.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.825+0000 7fada2eda640 1 --2- 172.21.15.29:0/609625838 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad9c0abe10 0x7fad9c0a8490 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fad880097a0 tx=0x7fad8802b960 comp rx=0 tx=0).stop 2024-01-25T15:05:58.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.825+0000 7fada2eda640 1 -- 172.21.15.29:0/609625838 shutdown_connections 2024-01-25T15:05:58.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.825+0000 7fada2eda640 1 --2- 172.21.15.29:0/609625838 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad9c0abe10 0x7fad9c0a8490 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:58.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.825+0000 7fada2eda640 1 -- 172.21.15.29:0/609625838 >> 172.21.15.29:0/609625838 conn(0x7fad9c0c2a10 msgr2=0x7fad9c0c2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:58.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.825+0000 7fada2eda640 1 -- 172.21.15.29:0/609625838 shutdown_connections 2024-01-25T15:05:58.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.825+0000 7fada2eda640 1 -- 172.21.15.29:0/609625838 wait complete. 2024-01-25T15:05:58.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.827+0000 7fada2eda640 1 Processor -- start 2024-01-25T15:05:58.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.827+0000 7fada2eda640 1 -- start start 2024-01-25T15:05:58.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.827+0000 7fada2eda640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad9c0abe10 0x7fad9c156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:58.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.827+0000 7fada2eda640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad9c14fbf0 0x7fad9c1545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:58.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.827+0000 7fada2eda640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad9c152e90 0x7fad9c1eb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:58.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.827+0000 7fada2eda640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c1535b0 con 0x7fad9c14fbf0 2024-01-25T15:05:58.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.827+0000 7fada2eda640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c153800 con 0x7fad9c0abe10 2024-01-25T15:05:58.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.827+0000 7fada2eda640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c153ae0 con 0x7fad9c152e90 2024-01-25T15:05:58.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.828+0000 7fad9bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad9c14fbf0 0x7fad9c1545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:58.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.828+0000 7fad9bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad9c14fbf0 0x7fad9c1545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52278/0 (socket says 172.21.15.29:52278) 2024-01-25T15:05:58.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.828+0000 7fad9bfff640 1 -- 172.21.15.29:0/2591530018 learned_addr learned my addr 172.21.15.29:0/2591530018 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:58.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.828+0000 7fada0c76640 1 --2- 172.21.15.29:0/2591530018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad9c0abe10 0x7fad9c156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:58.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.828+0000 7fada1477640 1 --2- 172.21.15.29:0/2591530018 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad9c152e90 0x7fad9c1eb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:58.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.828+0000 7fad9bfff640 1 -- 172.21.15.29:0/2591530018 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad9c152e90 msgr2=0x7fad9c1eb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:58.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.828+0000 7fad9bfff640 1 --2- 172.21.15.29:0/2591530018 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad9c152e90 0x7fad9c1eb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:58.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.828+0000 7fad9bfff640 1 -- 172.21.15.29:0/2591530018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad9c0abe10 msgr2=0x7fad9c156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:58.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.828+0000 7fad9bfff640 1 --2- 172.21.15.29:0/2591530018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad9c0abe10 0x7fad9c156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:58.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.828+0000 7fad9bfff640 1 -- 172.21.15.29:0/2591530018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad88009400 con 0x7fad9c14fbf0 2024-01-25T15:05:58.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.828+0000 7fad9bfff640 1 --2- 172.21.15.29:0/2591530018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad9c14fbf0 0x7fad9c1545c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fad8802bf70 tx=0x7fad880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:58.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.828+0000 7fad997fa640 1 -- 172.21.15.29:0/2591530018 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8803e070 con 0x7fad9c14fbf0 2024-01-25T15:05:58.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.828+0000 7fad997fa640 1 -- 172.21.15.29:0/2591530018 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad88039a10 con 0x7fad9c14fbf0 2024-01-25T15:05:58.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.828+0000 7fada2eda640 1 -- 172.21.15.29:0/2591530018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9c153dc0 con 0x7fad9c14fbf0 2024-01-25T15:05:58.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.828+0000 7fad997fa640 1 -- 172.21.15.29:0/2591530018 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88039da0 con 0x7fad9c14fbf0 2024-01-25T15:05:58.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.828+0000 7fada2eda640 1 -- 172.21.15.29:0/2591530018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9c156650 con 0x7fad9c14fbf0 2024-01-25T15:05:58.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.829+0000 7fada2eda640 1 -- 172.21.15.29:0/2591530018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9c1542e0 con 0x7fad9c14fbf0 2024-01-25T15:05:58.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.830+0000 7fad997fa640 1 -- 172.21.15.29:0/2591530018 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fad8804b400 con 0x7fad9c14fbf0 2024-01-25T15:05:58.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.830+0000 7fad997fa640 1 --2- 172.21.15.29:0/2591530018 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fad8006aed0 0x7fad8006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:58.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.830+0000 7fad997fa640 1 -- 172.21.15.29:0/2591530018 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fad880abe80 con 0x7fad9c14fbf0 2024-01-25T15:05:58.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.830+0000 7fada0c76640 1 --2- 172.21.15.29:0/2591530018 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fad8006aed0 0x7fad8006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:58.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.831+0000 7fada0c76640 1 --2- 172.21.15.29:0/2591530018 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fad8006aed0 0x7fad8006d390 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fad90001780 tx=0x7fad90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:58.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:58.835+0000 7fad997fa640 1 -- 172.21.15.29:0/2591530018 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fad9c1542e0 con 0x7fad9c14fbf0 2024-01-25T15:05:59.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.013+0000 7fada2eda640 1 -- 172.21.15.29:0/2591530018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fad9c1542e0 con 0x7fad9c14fbf0 2024-01-25T15:05:59.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.014+0000 7fad997fa640 1 -- 172.21.15.29:0/2591530018 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7fad9c1542e0 con 0x7fad9c14fbf0 2024-01-25T15:05:59.015 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-25T15:05:59.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.016+0000 7fada2eda640 1 -- 172.21.15.29:0/2591530018 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fad8006aed0 msgr2=0x7fad8006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:59.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.016+0000 7fada2eda640 1 --2- 172.21.15.29:0/2591530018 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fad8006aed0 0x7fad8006d390 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fad90001780 tx=0x7fad90009040 comp rx=0 tx=0).stop 2024-01-25T15:05:59.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.016+0000 7fada2eda640 1 -- 172.21.15.29:0/2591530018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad9c14fbf0 msgr2=0x7fad9c1545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:59.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.016+0000 7fada2eda640 1 --2- 172.21.15.29:0/2591530018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad9c14fbf0 0x7fad9c1545c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fad8802bf70 tx=0x7fad880046c0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.016+0000 7fada2eda640 1 -- 172.21.15.29:0/2591530018 shutdown_connections 2024-01-25T15:05:59.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.016+0000 7fada2eda640 1 --2- 172.21.15.29:0/2591530018 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad9c152e90 0x7fad9c1eb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.016+0000 7fada2eda640 1 --2- 172.21.15.29:0/2591530018 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fad8006aed0 0x7fad8006d390 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.016+0000 7fada2eda640 1 --2- 172.21.15.29:0/2591530018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad9c14fbf0 0x7fad9c1545c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.016+0000 7fada2eda640 1 --2- 172.21.15.29:0/2591530018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad9c0abe10 0x7fad9c156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.016+0000 7fada2eda640 1 -- 172.21.15.29:0/2591530018 >> 172.21.15.29:0/2591530018 conn(0x7fad9c0c2a10 msgr2=0x7fad9c0c1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:59.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.016+0000 7fada2eda640 1 -- 172.21.15.29:0/2591530018 shutdown_connections 2024-01-25T15:05:59.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.016+0000 7fada2eda640 1 -- 172.21.15.29:0/2591530018 wait complete. 2024-01-25T15:05:59.027 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-25T15:05:59.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.130+0000 7fa8b622b640 1 Processor -- start 2024-01-25T15:05:59.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.131+0000 7fa8b622b640 1 -- start start 2024-01-25T15:05:59.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.131+0000 7fa8b622b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa8b013ddd0 0x7fa8b0158800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:59.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.131+0000 7fa8b622b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b0158d40 con 0x7fa8b006f290 2024-01-25T15:05:59.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.131+0000 7fa8b622b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b0072350 con 0x7fa8b006b380 2024-01-25T15:05:59.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.131+0000 7fa8b622b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b006dcd0 con 0x7fa8b013ddd0 2024-01-25T15:05:59.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.131+0000 7fa8aeffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa8b006f290 0x7fa8b00c0430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54290/0 (socket says 172.21.15.29:54290) 2024-01-25T15:05:59.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.131+0000 7fa8aeffd640 1 -- 172.21.15.29:0/693814507 learned_addr learned my addr 172.21.15.29:0/693814507 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:59.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.132+0000 7fa8af7fe640 1 --2- 172.21.15.29:0/693814507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa8b013ddd0 0x7fa8b0158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:59.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.132+0000 7fa8ae7fc640 1 -- 172.21.15.29:0/693814507 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3566037880 0 0) 0x7fa8a4001110 con 0x7fa8b006f290 2024-01-25T15:05:59.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.132+0000 7fa8ae7fc640 1 -- 172.21.15.29:0/693814507 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa898003520 con 0x7fa8b006f290 2024-01-25T15:05:59.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.132+0000 7fa8ae7fc640 1 -- 172.21.15.29:0/693814507 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418181049 0 0) 0x7fa8b0072350 con 0x7fa8b006b380 2024-01-25T15:05:59.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.132+0000 7fa8af7fe640 1 -- 172.21.15.29:0/693814507 >> v1:172.21.15.52:6789/0 conn(0x7fa8b006b380 legacy=0x7fa8b006a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:59.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.132+0000 7fa8af7fe640 1 -- 172.21.15.29:0/693814507 >> v1:172.21.15.29:6789/0 conn(0x7fa8b006f290 legacy=0x7fa8b00c0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:59.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.132+0000 7fa8af7fe640 1 -- 172.21.15.29:0/693814507 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b0157db0 con 0x7fa8b013ddd0 2024-01-25T15:05:59.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.133+0000 7fa8af7fe640 1 --2- 172.21.15.29:0/693814507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa8b013ddd0 0x7fa8b0158800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00097d0 tx=0x7fa8a002b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52271a76c1d9e644 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:59.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.133+0000 7fa8ae7fc640 1 -- 172.21.15.29:0/693814507 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0031770 con 0x7fa8b013ddd0 2024-01-25T15:05:59.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.133+0000 7fa8ae7fc640 1 -- 172.21.15.29:0/693814507 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a00318d0 con 0x7fa8b013ddd0 2024-01-25T15:05:59.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.133+0000 7fa8ae7fc640 1 -- 172.21.15.29:0/693814507 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0031c40 con 0x7fa8b013ddd0 2024-01-25T15:05:59.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.133+0000 7fa8b622b640 1 -- 172.21.15.29:0/693814507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa8b013ddd0 msgr2=0x7fa8b0158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:59.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.133+0000 7fa8b622b640 1 --2- 172.21.15.29:0/693814507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa8b013ddd0 0x7fa8b0158800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00097d0 tx=0x7fa8a002b810 comp rx=0 tx=0).stop 2024-01-25T15:05:59.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.133+0000 7fa8b622b640 1 -- 172.21.15.29:0/693814507 shutdown_connections 2024-01-25T15:05:59.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.133+0000 7fa8b622b640 1 --2- 172.21.15.29:0/693814507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa8b013ddd0 0x7fa8b0158800 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.133+0000 7fa8b622b640 1 -- 172.21.15.29:0/693814507 >> 172.21.15.29:0/693814507 conn(0x7fa8b00c3b00 msgr2=0x7fa8b00c3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:59.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.134+0000 7fa8b622b640 1 -- 172.21.15.29:0/693814507 shutdown_connections 2024-01-25T15:05:59.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.134+0000 7fa8b622b640 1 -- 172.21.15.29:0/693814507 wait complete. 2024-01-25T15:05:59.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.135+0000 7fa8b622b640 1 Processor -- start 2024-01-25T15:05:59.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.135+0000 7fa8b622b640 1 -- start start 2024-01-25T15:05:59.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.135+0000 7fa8b622b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8b006b380 0x7fa8b0135b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:59.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.135+0000 7fa8b622b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8b013ddd0 0x7fa8b01ea9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:59.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.135+0000 7fa8b622b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa8b01ee410 0x7fa8b01eaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:59.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.135+0000 7fa8b622b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b01eb460 con 0x7fa8b006b380 2024-01-25T15:05:59.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.135+0000 7fa8b622b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b01ee8a0 con 0x7fa8b013ddd0 2024-01-25T15:05:59.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.135+0000 7fa8b622b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00a8c40 con 0x7fa8b01ee410 2024-01-25T15:05:59.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.136+0000 7fa8af7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8b006b380 0x7fa8b0135b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:59.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.136+0000 7fa8af7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8b006b380 0x7fa8b0135b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52292/0 (socket says 172.21.15.29:52292) 2024-01-25T15:05:59.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.136+0000 7fa8af7fe640 1 -- 172.21.15.29:0/3327031812 learned_addr learned my addr 172.21.15.29:0/3327031812 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:59.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.136+0000 7fa8affff640 1 --2- 172.21.15.29:0/3327031812 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa8b01ee410 0x7fa8b01eaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:59.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.136+0000 7fa8aeffd640 1 --2- 172.21.15.29:0/3327031812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8b013ddd0 0x7fa8b01ea9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:59.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.136+0000 7fa8af7fe640 1 -- 172.21.15.29:0/3327031812 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa8b01ee410 msgr2=0x7fa8b01eaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:59.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.136+0000 7fa8af7fe640 1 --2- 172.21.15.29:0/3327031812 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa8b01ee410 0x7fa8b01eaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.136+0000 7fa8af7fe640 1 -- 172.21.15.29:0/3327031812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8b013ddd0 msgr2=0x7fa8b01ea9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:59.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.136+0000 7fa8af7fe640 1 --2- 172.21.15.29:0/3327031812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8b013ddd0 0x7fa8b01ea9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.136+0000 7fa8af7fe640 1 -- 172.21.15.29:0/3327031812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a0009400 con 0x7fa8b006b380 2024-01-25T15:05:59.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.136+0000 7fa8af7fe640 1 --2- 172.21.15.29:0/3327031812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8b006b380 0x7fa8b0135b70 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0000c00 tx=0x7fa8a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:59.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.136+0000 7fa897fff640 1 -- 172.21.15.29:0/3327031812 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0032810 con 0x7fa8b006b380 2024-01-25T15:05:59.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.136+0000 7fa897fff640 1 -- 172.21.15.29:0/3327031812 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a0032970 con 0x7fa8b006b380 2024-01-25T15:05:59.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.136+0000 7fa8b622b640 1 -- 172.21.15.29:0/3327031812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b00a8f20 con 0x7fa8b006b380 2024-01-25T15:05:59.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.136+0000 7fa897fff640 1 -- 172.21.15.29:0/3327031812 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0032d20 con 0x7fa8b006b380 2024-01-25T15:05:59.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.136+0000 7fa8b622b640 1 -- 172.21.15.29:0/3327031812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b01360b0 con 0x7fa8b006b380 2024-01-25T15:05:59.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.137+0000 7fa8b622b640 1 -- 172.21.15.29:0/3327031812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b0074010 con 0x7fa8b006b380 2024-01-25T15:05:59.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.138+0000 7fa897fff640 1 -- 172.21.15.29:0/3327031812 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fa8a004e450 con 0x7fa8b006b380 2024-01-25T15:05:59.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.138+0000 7fa897fff640 1 --2- 172.21.15.29:0/3327031812 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa89c06aed0 0x7fa89c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:59.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.138+0000 7fa897fff640 1 -- 172.21.15.29:0/3327031812 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fa8a00ab930 con 0x7fa8b006b380 2024-01-25T15:05:59.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.138+0000 7fa8aeffd640 1 --2- 172.21.15.29:0/3327031812 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa89c06aed0 0x7fa89c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:59.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.139+0000 7fa8aeffd640 1 --2- 172.21.15.29:0/3327031812 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa89c06aed0 0x7fa89c06d390 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00a88e0 tx=0x7fa8a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:59.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.143+0000 7fa897fff640 1 -- 172.21.15.29:0/3327031812 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fa8a0076410 con 0x7fa8b006b380 2024-01-25T15:05:59.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.329+0000 7fa8b622b640 1 -- 172.21.15.29:0/3327031812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8b006b0d0 con 0x7fa8b006b380 2024-01-25T15:05:59.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.329+0000 7fa897fff640 1 -- 172.21.15.29:0/3327031812 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v42) v1 ==== 105+0+11 (secure 0 0 0) 0x7fa8a0079a30 con 0x7fa8b006b380 2024-01-25T15:05:59.330 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:05:59.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.331+0000 7fa8b622b640 1 -- 172.21.15.29:0/3327031812 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa89c06aed0 msgr2=0x7fa89c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:59.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.331+0000 7fa8b622b640 1 --2- 172.21.15.29:0/3327031812 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa89c06aed0 0x7fa89c06d390 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00a88e0 tx=0x7fa8a4009040 comp rx=0 tx=0).stop 2024-01-25T15:05:59.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.331+0000 7fa8b622b640 1 -- 172.21.15.29:0/3327031812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8b006b380 msgr2=0x7fa8b0135b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:59.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.331+0000 7fa8b622b640 1 --2- 172.21.15.29:0/3327031812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8b006b380 0x7fa8b0135b70 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0000c00 tx=0x7fa8a00046c0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.331+0000 7fa8b622b640 1 -- 172.21.15.29:0/3327031812 shutdown_connections 2024-01-25T15:05:59.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.331+0000 7fa8b622b640 1 --2- 172.21.15.29:0/3327031812 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa8b01ee410 0x7fa8b01eaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.331+0000 7fa8b622b640 1 --2- 172.21.15.29:0/3327031812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8b013ddd0 0x7fa8b01ea9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.331+0000 7fa8b622b640 1 --2- 172.21.15.29:0/3327031812 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa89c06aed0 0x7fa89c06d390 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.331+0000 7fa8b622b640 1 --2- 172.21.15.29:0/3327031812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8b006b380 0x7fa8b0135b70 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.331+0000 7fa8b622b640 1 -- 172.21.15.29:0/3327031812 >> 172.21.15.29:0/3327031812 conn(0x7fa8b00c3b00 msgr2=0x7fa8b006a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:59.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.331+0000 7fa8b622b640 1 -- 172.21.15.29:0/3327031812 shutdown_connections 2024-01-25T15:05:59.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.331+0000 7fa8b622b640 1 -- 172.21.15.29:0/3327031812 wait complete. 2024-01-25T15:05:59.342 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-25T15:05:59.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.446+0000 7f1f2fc90640 1 Processor -- start 2024-01-25T15:05:59.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.447+0000 7f1f2fc90640 1 -- start start 2024-01-25T15:05:59.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.447+0000 7f1f2fc90640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1f2806b490 0x7f1f280c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:59.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.447+0000 7f1f2fc90640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f280c6770 con 0x7f1f280c8620 2024-01-25T15:05:59.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.447+0000 7f1f2fc90640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f28154f10 con 0x7f1f28158b80 2024-01-25T15:05:59.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.447+0000 7f1f2fc90640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f281551f0 con 0x7f1f2806b490 2024-01-25T15:05:59.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.447+0000 7f1f2da2c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1f2806b490 0x7f1f280c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:59.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.447+0000 7f1f2e22d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1f280c8620 0x7f1f28151c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54302/0 (socket says 172.21.15.29:54302) 2024-01-25T15:05:59.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.447+0000 7f1f2da2c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1f2806b490 0x7f1f280c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52302/0 (socket says 172.21.15.29:52302) 2024-01-25T15:05:59.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.447+0000 7f1f2e22d640 1 -- 172.21.15.29:0/2756219588 learned_addr learned my addr 172.21.15.29:0/2756219588 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:05:59.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.448+0000 7f1f2da2c640 1 -- 172.21.15.29:0/2756219588 >> v1:172.21.15.52:6789/0 conn(0x7f1f28158b80 legacy=0x7f1f280c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:59.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.448+0000 7f1f2da2c640 1 -- 172.21.15.29:0/2756219588 >> v1:172.21.15.29:6789/0 conn(0x7f1f280c8620 legacy=0x7f1f28151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:59.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.448+0000 7f1f2da2c640 1 -- 172.21.15.29:0/2756219588 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f281554d0 con 0x7f1f2806b490 2024-01-25T15:05:59.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.448+0000 7f1f2ca2a640 1 -- 172.21.15.29:0/2756219588 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907923476 0 0) 0x7f1f280c6770 con 0x7f1f280c8620 2024-01-25T15:05:59.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.448+0000 7f1f2da2c640 1 --2- 172.21.15.29:0/2756219588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2806b490 0x7f1f280c6120 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1f240097a0 tx=0x7f1f2402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7396382348608e4 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:59.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.449+0000 7f1f2ca2a640 1 -- 172.21.15.29:0/2756219588 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2402e070 con 0x7f1f2806b490 2024-01-25T15:05:59.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.449+0000 7f1f2ca2a640 1 -- 172.21.15.29:0/2756219588 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f240315a0 con 0x7f1f2806b490 2024-01-25T15:05:59.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.449+0000 7f1f2ca2a640 1 -- 172.21.15.29:0/2756219588 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f24031930 con 0x7f1f2806b490 2024-01-25T15:05:59.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.449+0000 7f1f2fc90640 1 -- 172.21.15.29:0/2756219588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2806b490 msgr2=0x7f1f280c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:59.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.449+0000 7f1f2fc90640 1 --2- 172.21.15.29:0/2756219588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2806b490 0x7f1f280c6120 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1f240097a0 tx=0x7f1f2402b840 comp rx=0 tx=0).stop 2024-01-25T15:05:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.449+0000 7f1f2fc90640 1 -- 172.21.15.29:0/2756219588 shutdown_connections 2024-01-25T15:05:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.449+0000 7f1f2fc90640 1 --2- 172.21.15.29:0/2756219588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2806b490 0x7f1f280c6120 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.449+0000 7f1f2fc90640 1 -- 172.21.15.29:0/2756219588 >> 172.21.15.29:0/2756219588 conn(0x7f1f280ca010 msgr2=0x7f1f280ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.449+0000 7f1f2fc90640 1 -- 172.21.15.29:0/2756219588 shutdown_connections 2024-01-25T15:05:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.449+0000 7f1f2fc90640 1 -- 172.21.15.29:0/2756219588 wait complete. 2024-01-25T15:05:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.450+0000 7f1f2fc90640 1 Processor -- start 2024-01-25T15:05:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.450+0000 7f1f2fc90640 1 -- start start 2024-01-25T15:05:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.451+0000 7f1f2fc90640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2806b490 0x7f1f28157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.451+0000 7f1f2fc90640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1f280c8620 0x7f1f281448f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.451+0000 7f1f2fc90640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f28158b80 0x7f1f2814ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.451+0000 7f1f2fc90640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f28156d90 con 0x7f1f2806b490 2024-01-25T15:05:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.451+0000 7f1f2fc90640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2814fdd0 con 0x7f1f28158b80 2024-01-25T15:05:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.451+0000 7f1f2fc90640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2814faf0 con 0x7f1f280c8620 2024-01-25T15:05:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.451+0000 7f1f2da2c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2806b490 0x7f1f28157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.451+0000 7f1f2da2c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2806b490 0x7f1f28157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52318/0 (socket says 172.21.15.29:52318) 2024-01-25T15:05:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.451+0000 7f1f2da2c640 1 -- 172.21.15.29:0/2786080441 learned_addr learned my addr 172.21.15.29:0/2786080441 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.451+0000 7f1f2e22d640 1 --2- 172.21.15.29:0/2786080441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f28158b80 0x7f1f2814ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.451+0000 7f1f2d22b640 1 --2- 172.21.15.29:0/2786080441 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1f280c8620 0x7f1f281448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.451+0000 7f1f2da2c640 1 -- 172.21.15.29:0/2786080441 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1f280c8620 msgr2=0x7f1f281448f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.451+0000 7f1f2da2c640 1 --2- 172.21.15.29:0/2786080441 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1f280c8620 0x7f1f281448f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.451+0000 7f1f2da2c640 1 -- 172.21.15.29:0/2786080441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f28158b80 msgr2=0x7f1f2814ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.451+0000 7f1f2da2c640 1 --2- 172.21.15.29:0/2786080441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f28158b80 0x7f1f2814ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.451+0000 7f1f2da2c640 1 -- 172.21.15.29:0/2786080441 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f24009400 con 0x7f1f2806b490 2024-01-25T15:05:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.451+0000 7f1f2d22b640 1 --2- 172.21.15.29:0/2786080441 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1f280c8620 0x7f1f281448f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.451+0000 7f1f2da2c640 1 --2- 172.21.15.29:0/2786080441 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2806b490 0x7f1f28157bd0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1f240097a0 tx=0x7f1f240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.452+0000 7f1f1e7fc640 1 -- 172.21.15.29:0/2786080441 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f24004230 con 0x7f1f2806b490 2024-01-25T15:05:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.452+0000 7f1f1e7fc640 1 -- 172.21.15.29:0/2786080441 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f240043b0 con 0x7f1f2806b490 2024-01-25T15:05:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.452+0000 7f1f2fc90640 1 -- 172.21.15.29:0/2786080441 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f28155b70 con 0x7f1f2806b490 2024-01-25T15:05:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.452+0000 7f1f1e7fc640 1 -- 172.21.15.29:0/2786080441 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f24004520 con 0x7f1f2806b490 2024-01-25T15:05:59.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.452+0000 7f1f2fc90640 1 -- 172.21.15.29:0/2786080441 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f281452f0 con 0x7f1f2806b490 2024-01-25T15:05:59.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.453+0000 7f1f2fc90640 1 -- 172.21.15.29:0/2786080441 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f28074010 con 0x7f1f2806b490 2024-01-25T15:05:59.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.453+0000 7f1f1e7fc640 1 -- 172.21.15.29:0/2786080441 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f1f24032880 con 0x7f1f2806b490 2024-01-25T15:05:59.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.453+0000 7f1f1e7fc640 1 --2- 172.21.15.29:0/2786080441 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1f0c06aed0 0x7f1f0c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:59.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.454+0000 7f1f1e7fc640 1 -- 172.21.15.29:0/2786080441 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f1f240abc30 con 0x7f1f2806b490 2024-01-25T15:05:59.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.454+0000 7f1f2d22b640 1 --2- 172.21.15.29:0/2786080441 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1f0c06aed0 0x7f1f0c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:59.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.454+0000 7f1f2d22b640 1 --2- 172.21.15.29:0/2786080441 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1f0c06aed0 0x7f1f0c06d390 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1f280c4320 tx=0x7f1f18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:59.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.458+0000 7f1f1e7fc640 1 -- 172.21.15.29:0/2786080441 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f1f240766f0 con 0x7f1f2806b490 2024-01-25T15:05:59.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.641+0000 7f1f2fc90640 1 -- 172.21.15.29:0/2786080441 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f1f28074010 con 0x7f1f2806b490 2024-01-25T15:05:59.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.641+0000 7f1f1e7fc640 1 -- 172.21.15.29:0/2786080441 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v42) v1 ==== 101+0+11 (secure 0 0 0) 0x7f1f24079d10 con 0x7f1f2806b490 2024-01-25T15:05:59.642 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-25T15:05:59.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.643+0000 7f1f2fc90640 1 -- 172.21.15.29:0/2786080441 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1f0c06aed0 msgr2=0x7f1f0c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:59.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.643+0000 7f1f2fc90640 1 --2- 172.21.15.29:0/2786080441 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1f0c06aed0 0x7f1f0c06d390 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1f280c4320 tx=0x7f1f18008040 comp rx=0 tx=0).stop 2024-01-25T15:05:59.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.643+0000 7f1f2fc90640 1 -- 172.21.15.29:0/2786080441 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2806b490 msgr2=0x7f1f28157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:59.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.643+0000 7f1f2fc90640 1 --2- 172.21.15.29:0/2786080441 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2806b490 0x7f1f28157bd0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1f240097a0 tx=0x7f1f240046c0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.643+0000 7f1f2fc90640 1 -- 172.21.15.29:0/2786080441 shutdown_connections 2024-01-25T15:05:59.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.643+0000 7f1f2fc90640 1 --2- 172.21.15.29:0/2786080441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f28158b80 0x7f1f2814ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.643+0000 7f1f2fc90640 1 --2- 172.21.15.29:0/2786080441 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1f280c8620 0x7f1f281448f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.643+0000 7f1f2fc90640 1 --2- 172.21.15.29:0/2786080441 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f1f0c06aed0 0x7f1f0c06d390 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.643+0000 7f1f2fc90640 1 --2- 172.21.15.29:0/2786080441 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2806b490 0x7f1f28157bd0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.643+0000 7f1f2fc90640 1 -- 172.21.15.29:0/2786080441 >> 172.21.15.29:0/2786080441 conn(0x7f1f280ca010 msgr2=0x7f1f280c5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:59.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.644+0000 7f1f2fc90640 1 -- 172.21.15.29:0/2786080441 shutdown_connections 2024-01-25T15:05:59.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.644+0000 7f1f2fc90640 1 -- 172.21.15.29:0/2786080441 wait complete. 2024-01-25T15:05:59.655 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:05:59.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.756+0000 7fb76c551640 1 Processor -- start 2024-01-25T15:05:59.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.756+0000 7fb76c551640 1 -- start start 2024-01-25T15:05:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.756+0000 7fb76c551640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb764152160 0x7fb76406bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.756+0000 7fb76c551640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb7640c7f10 0x7fb7640c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.756+0000 7fb76c551640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb764155430 con 0x7fb7640c4990 2024-01-25T15:05:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.756+0000 7fb76c551640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb764154b40 con 0x7fb764152160 2024-01-25T15:05:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.756+0000 7fb76c551640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb764152540 con 0x7fb7640c7f10 2024-01-25T15:05:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.757+0000 7fb76a2ed640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb764152160 0x7fb76406bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.757+0000 7fb76a2ed640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb764152160 0x7fb76406bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52332/0 (socket says 172.21.15.29:52332) 2024-01-25T15:05:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.757+0000 7fb76a2ed640 1 -- 172.21.15.29:0/450309864 learned_addr learned my addr 172.21.15.29:0/450309864 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.757+0000 7fb76aaee640 1 --2- 172.21.15.29:0/450309864 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb7640c7f10 0x7fb7640c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.757+0000 7fb76a2ed640 1 -- 172.21.15.29:0/450309864 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb7640c7f10 msgr2=0x7fb7640c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.757+0000 7fb76a2ed640 1 --2- 172.21.15.29:0/450309864 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb7640c7f10 0x7fb7640c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.757+0000 7fb76a2ed640 1 -- 172.21.15.29:0/450309864 >> v1:172.21.15.52:6789/0 conn(0x7fb7640c4990 legacy=0x7fb7640c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:05:59.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.757+0000 7fb76a2ed640 1 -- 172.21.15.29:0/450309864 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7640c64b0 con 0x7fb764152160 2024-01-25T15:05:59.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.757+0000 7fb76aaee640 1 --2- 172.21.15.29:0/450309864 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb7640c7f10 0x7fb7640c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:59.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.758+0000 7fb76a2ed640 1 --2- 172.21.15.29:0/450309864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb764152160 0x7fb76406bc00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb760009870 tx=0x7fb76002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9af41521b198921 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:59.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.758+0000 7fb7692eb640 1 -- 172.21.15.29:0/450309864 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7600317c0 con 0x7fb764152160 2024-01-25T15:05:59.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.758+0000 7fb7692eb640 1 -- 172.21.15.29:0/450309864 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb760031920 con 0x7fb764152160 2024-01-25T15:05:59.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.758+0000 7fb7692eb640 1 -- 172.21.15.29:0/450309864 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760031cb0 con 0x7fb764152160 2024-01-25T15:05:59.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.758+0000 7fb76c551640 1 -- 172.21.15.29:0/450309864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb764152160 msgr2=0x7fb76406bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:59.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.758+0000 7fb76c551640 1 --2- 172.21.15.29:0/450309864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb764152160 0x7fb76406bc00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb760009870 tx=0x7fb76002b860 comp rx=0 tx=0).stop 2024-01-25T15:05:59.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.759+0000 7fb76c551640 1 -- 172.21.15.29:0/450309864 shutdown_connections 2024-01-25T15:05:59.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.759+0000 7fb76c551640 1 --2- 172.21.15.29:0/450309864 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb7640c7f10 0x7fb7640c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.759+0000 7fb76c551640 1 --2- 172.21.15.29:0/450309864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb764152160 0x7fb76406bc00 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.759+0000 7fb76c551640 1 -- 172.21.15.29:0/450309864 >> 172.21.15.29:0/450309864 conn(0x7fb7640ca1f0 msgr2=0x7fb7640ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:59.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.759+0000 7fb76c551640 1 -- 172.21.15.29:0/450309864 shutdown_connections 2024-01-25T15:05:59.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.759+0000 7fb76c551640 1 -- 172.21.15.29:0/450309864 wait complete. 2024-01-25T15:05:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.760+0000 7fb76c551640 1 Processor -- start 2024-01-25T15:05:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.760+0000 7fb76c551640 1 -- start start 2024-01-25T15:05:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.760+0000 7fb76c551640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7640c4990 0x7fb7641587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.760+0000 7fb76c551640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7640c7f10 0x7fb7640bf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.760+0000 7fb76c551640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb764152160 0x7fb7640bfc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.760+0000 7fb76c551640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb764145140 con 0x7fb7640c4990 2024-01-25T15:05:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.760+0000 7fb76c551640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb764155e90 con 0x7fb7640c7f10 2024-01-25T15:05:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.760+0000 7fb76c551640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7640be4c0 con 0x7fb764152160 2024-01-25T15:05:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.760+0000 7fb76a2ed640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7640c4990 0x7fb7641587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.761+0000 7fb76a2ed640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7640c4990 0x7fb7641587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52344/0 (socket says 172.21.15.29:52344) 2024-01-25T15:05:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.761+0000 7fb76a2ed640 1 -- 172.21.15.29:0/2929405964 learned_addr learned my addr 172.21.15.29:0/2929405964 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:05:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.761+0000 7fb769aec640 1 --2- 172.21.15.29:0/2929405964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7640c7f10 0x7fb7640bf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.761+0000 7fb76aaee640 1 --2- 172.21.15.29:0/2929405964 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb764152160 0x7fb7640bfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.761+0000 7fb76a2ed640 1 -- 172.21.15.29:0/2929405964 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb764152160 msgr2=0x7fb7640bfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.761+0000 7fb76a2ed640 1 --2- 172.21.15.29:0/2929405964 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb764152160 0x7fb7640bfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.761+0000 7fb76a2ed640 1 -- 172.21.15.29:0/2929405964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7640c7f10 msgr2=0x7fb7640bf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.761+0000 7fb76a2ed640 1 --2- 172.21.15.29:0/2929405964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7640c7f10 0x7fb7640bf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.761+0000 7fb76a2ed640 1 -- 172.21.15.29:0/2929405964 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7600094d0 con 0x7fb7640c4990 2024-01-25T15:05:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.761+0000 7fb76a2ed640 1 --2- 172.21.15.29:0/2929405964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7640c4990 0x7fb7641587d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb760000c00 tx=0x7fb7600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.761+0000 7fb75affd640 1 -- 172.21.15.29:0/2929405964 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7600329a0 con 0x7fb7640c4990 2024-01-25T15:05:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.761+0000 7fb75affd640 1 -- 172.21.15.29:0/2929405964 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb760032b40 con 0x7fb7640c4990 2024-01-25T15:05:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.761+0000 7fb75affd640 1 -- 172.21.15.29:0/2929405964 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7600453f0 con 0x7fb7640c4990 2024-01-25T15:05:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.761+0000 7fb76c551640 1 -- 172.21.15.29:0/2929405964 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7640c0170 con 0x7fb7640c4990 2024-01-25T15:05:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.761+0000 7fb76c551640 1 -- 172.21.15.29:0/2929405964 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7641560a0 con 0x7fb7640c4990 2024-01-25T15:05:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.762+0000 7fb76c551640 1 -- 172.21.15.29:0/2929405964 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb76406c6d0 con 0x7fb7640c4990 2024-01-25T15:05:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.763+0000 7fb75affd640 1 -- 172.21.15.29:0/2929405964 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fb76004e450 con 0x7fb7640c4990 2024-01-25T15:05:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.763+0000 7fb75affd640 1 --2- 172.21.15.29:0/2929405964 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb74806aed0 0x7fb74806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.763+0000 7fb75affd640 1 -- 172.21.15.29:0/2929405964 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fb7600abe70 con 0x7fb7640c4990 2024-01-25T15:05:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.763+0000 7fb769aec640 1 --2- 172.21.15.29:0/2929405964 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb74806aed0 0x7fb74806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.764+0000 7fb769aec640 1 --2- 172.21.15.29:0/2929405964 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb74806aed0 0x7fb74806d390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb764151b70 tx=0x7fb754009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:59.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.767+0000 7fb75affd640 1 -- 172.21.15.29:0/2929405964 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fb760076a50 con 0x7fb7640c4990 2024-01-25T15:05:59.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.986+0000 7fb76c551640 1 -- 172.21.15.29:0/2929405964 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7640676c0 con 0x7fb7640c4990 2024-01-25T15:05:59.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.987+0000 7fb75affd640 1 -- 172.21.15.29:0/2929405964 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6180 (secure 0 0 0) 0x7fb76007a070 con 0x7fb7640c4990 2024-01-25T15:05:59.987 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:05:59.987 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/3901576943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6835","nonce":3901576943},{"type":"v1","addr":"172.21.15.52:6837","nonce":3901576943}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6836/1878395580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1878395580},{"type":"v1","addr":"172.21.15.52:6836","nonce":1878395580}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:05:26.577307+0000","modified":"2024-01-25T15:05:28.881837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3222226893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3222226893},{"type":"v1","addr":"172.21.15.29:6835","nonce":3222226893}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:05:42.928937+0000","modified":"2024-01-25T15:05:44.918053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.29:6834/1607449141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1607449141},{"type":"v1","addr":"172.21.15.29:6834","nonce":1607449141}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-25T15:05:59.988 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 20 2024-01-25T15:05:59.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.989+0000 7fb76c551640 1 -- 172.21.15.29:0/2929405964 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb74806aed0 msgr2=0x7fb74806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:59.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.989+0000 7fb76c551640 1 --2- 172.21.15.29:0/2929405964 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb74806aed0 0x7fb74806d390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb764151b70 tx=0x7fb754009040 comp rx=0 tx=0).stop 2024-01-25T15:05:59.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.989+0000 7fb76c551640 1 -- 172.21.15.29:0/2929405964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7640c4990 msgr2=0x7fb7641587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:59.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.989+0000 7fb76c551640 1 --2- 172.21.15.29:0/2929405964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7640c4990 0x7fb7641587d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb760000c00 tx=0x7fb7600046c0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.989+0000 7fb76c551640 1 -- 172.21.15.29:0/2929405964 shutdown_connections 2024-01-25T15:05:59.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.989+0000 7fb76c551640 1 --2- 172.21.15.29:0/2929405964 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb764152160 0x7fb7640bfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.989+0000 7fb76c551640 1 --2- 172.21.15.29:0/2929405964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7640c7f10 0x7fb7640bf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.989+0000 7fb76c551640 1 --2- 172.21.15.29:0/2929405964 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb74806aed0 0x7fb74806d390 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.989+0000 7fb76c551640 1 --2- 172.21.15.29:0/2929405964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7640c4990 0x7fb7641587d0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:59.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.989+0000 7fb76c551640 1 -- 172.21.15.29:0/2929405964 >> 172.21.15.29:0/2929405964 conn(0x7fb7640ca1f0 msgr2=0x7fb7640ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:59.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.989+0000 7fb76c551640 1 -- 172.21.15.29:0/2929405964 shutdown_connections 2024-01-25T15:05:59.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:05:59.989+0000 7fb76c551640 1 -- 172.21.15.29:0/2929405964 wait complete. 2024-01-25T15:06:00.000 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:06:00.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.101+0000 7fada3a61640 1 Processor -- start 2024-01-25T15:06:00.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.101+0000 7fada3a61640 1 -- start start 2024-01-25T15:06:00.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.102+0000 7fada3a61640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad9c154d50 0x7fad9c15ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:00.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.102+0000 7fada3a61640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9c06ac10 con 0x7fad9c14e840 2024-01-25T15:06:00.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.102+0000 7fada3a61640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9c0c3260 con 0x7fad9c06b0a0 2024-01-25T15:06:00.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.102+0000 7fada3a61640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c06a6c0 con 0x7fad9c154d50 2024-01-25T15:06:00.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.102+0000 7fada17fd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fad9c14e840 0x7fad9c06dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54314/0 (socket says 172.21.15.29:54314) 2024-01-25T15:06:00.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.102+0000 7fada17fd640 1 -- 172.21.15.29:0/386558696 learned_addr learned my addr 172.21.15.29:0/386558696 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:00.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fada1ffe640 1 --2- 172.21.15.29:0/386558696 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad9c154d50 0x7fad9c15ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:00.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fad9bfff640 1 -- 172.21.15.29:0/386558696 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2522342642 0 0) 0x7fad9c06ac10 con 0x7fad9c14e840 2024-01-25T15:06:00.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fad9bfff640 1 -- 172.21.15.29:0/386558696 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad84003520 con 0x7fad9c14e840 2024-01-25T15:06:00.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fad9bfff640 1 -- 172.21.15.29:0/386558696 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3076787939 0 0) 0x7fad84003520 con 0x7fad9c14e840 2024-01-25T15:06:00.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fad9bfff640 1 -- 172.21.15.29:0/386558696 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad9c154d50 msgr2=0x7fad9c15ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:00.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fad9bfff640 1 --2- 172.21.15.29:0/386558696 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad9c154d50 0x7fad9c15ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fad9bfff640 1 -- 172.21.15.29:0/386558696 >> v1:172.21.15.52:6789/0 conn(0x7fad9c06b0a0 legacy=0x7fad9c154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:00.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fad9bfff640 1 -- 172.21.15.29:0/386558696 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c0c3540 con 0x7fad9c14e840 2024-01-25T15:06:00.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fad9bfff640 1 -- 172.21.15.29:0/386558696 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7fad94001670 con 0x7fad9c14e840 2024-01-25T15:06:00.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fad9bfff640 1 -- 172.21.15.29:0/386558696 >> v1:172.21.15.29:6789/0 conn(0x7fad9c14e840 legacy=0x7fad9c06dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:00.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fad9bfff640 1 --2- 172.21.15.29:0/386558696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad840039a0 0x7fad84003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:00.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fad9bfff640 1 --2- 172.21.15.29:0/386558696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad840047c0 0x7fad84004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:00.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fad9bfff640 1 --2- 172.21.15.29:0/386558696 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad9c154d50 0x7fad840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:00.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fad9bfff640 1 -- 172.21.15.29:0/386558696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c06a6c0 con 0x7fad840039a0 2024-01-25T15:06:00.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fad9bfff640 1 -- 172.21.15.29:0/386558696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8400bab0 con 0x7fad840047c0 2024-01-25T15:06:00.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fad9bfff640 1 -- 172.21.15.29:0/386558696 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8400bc70 con 0x7fad9c154d50 2024-01-25T15:06:00.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fada17fd640 1 --2- 172.21.15.29:0/386558696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad840039a0 0x7fad84003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:00.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fada1ffe640 1 --2- 172.21.15.29:0/386558696 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad9c154d50 0x7fad840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:00.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fada0ffc640 1 --2- 172.21.15.29:0/386558696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad840047c0 0x7fad84004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:00.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fada17fd640 1 -- 172.21.15.29:0/386558696 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad9c154d50 msgr2=0x7fad840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:00.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fada17fd640 1 --2- 172.21.15.29:0/386558696 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad9c154d50 0x7fad840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fada17fd640 1 -- 172.21.15.29:0/386558696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad840047c0 msgr2=0x7fad84004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:00.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fada17fd640 1 --2- 172.21.15.29:0/386558696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad840047c0 0x7fad84004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fada17fd640 1 -- 172.21.15.29:0/386558696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad84003520 con 0x7fad840039a0 2024-01-25T15:06:00.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.103+0000 7fada0ffc640 1 --2- 172.21.15.29:0/386558696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad840047c0 0x7fad84004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:00.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.104+0000 7fada17fd640 1 --2- 172.21.15.29:0/386558696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad840039a0 0x7fad84003dc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fad9400c240 tx=0x7fad840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61456810a252324a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:00.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.104+0000 7fad9bfff640 1 -- 172.21.15.29:0/386558696 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad94005ad0 con 0x7fad840039a0 2024-01-25T15:06:00.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.104+0000 7fad9bfff640 1 -- 172.21.15.29:0/386558696 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad94005c30 con 0x7fad840039a0 2024-01-25T15:06:00.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.104+0000 7fad9bfff640 1 -- 172.21.15.29:0/386558696 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9402c8b0 con 0x7fad840039a0 2024-01-25T15:06:00.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.105+0000 7fada3a61640 1 -- 172.21.15.29:0/386558696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad840039a0 msgr2=0x7fad84003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:00.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.105+0000 7fada3a61640 1 --2- 172.21.15.29:0/386558696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad840039a0 0x7fad84003dc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fad9400c240 tx=0x7fad840057f0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.105+0000 7fada1ffe640 1 -- 172.21.15.29:0/386558696 reap_dead start 2024-01-25T15:06:00.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.105+0000 7fada3a61640 1 -- 172.21.15.29:0/386558696 shutdown_connections 2024-01-25T15:06:00.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.105+0000 7fada3a61640 1 -- 172.21.15.29:0/386558696 >> 172.21.15.29:0/386558696 conn(0x7fad9c0c3920 msgr2=0x7fad9c0c3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:00.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.105+0000 7fada3a61640 1 -- 172.21.15.29:0/386558696 shutdown_connections 2024-01-25T15:06:00.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.105+0000 7fada3a61640 1 -- 172.21.15.29:0/386558696 wait complete. 2024-01-25T15:06:00.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.106+0000 7fada3a61640 1 Processor -- start 2024-01-25T15:06:00.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.106+0000 7fada3a61640 1 -- start start 2024-01-25T15:06:00.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.107+0000 7fada3a61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad840039a0 0x7fad9c1de200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:00.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.107+0000 7fada3a61640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad9c1dfac0 0x7fad9c1dd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:00.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.107+0000 7fada3a61640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad9c1e0570 0x7fad9c1e09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.107+0000 7fada3a61640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c1e0f30 con 0x7fad840039a0 2024-01-25T15:06:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.107+0000 7fada3a61640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c1db0c0 con 0x7fad9c1e0570 2024-01-25T15:06:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.107+0000 7fada3a61640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c1db680 con 0x7fad9c1dfac0 2024-01-25T15:06:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.107+0000 7fada17fd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad840039a0 0x7fad9c1de200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.107+0000 7fada17fd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad840039a0 0x7fad9c1de200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52360/0 (socket says 172.21.15.29:52360) 2024-01-25T15:06:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.107+0000 7fada17fd640 1 -- 172.21.15.29:0/1132070193 learned_addr learned my addr 172.21.15.29:0/1132070193 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.107+0000 7fada0ffc640 1 --2- 172.21.15.29:0/1132070193 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad9c1dfac0 0x7fad9c1dd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.107+0000 7fada1ffe640 1 --2- 172.21.15.29:0/1132070193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad9c1e0570 0x7fad9c1e09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.107+0000 7fada17fd640 1 -- 172.21.15.29:0/1132070193 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad9c1dfac0 msgr2=0x7fad9c1dd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.107+0000 7fada17fd640 1 --2- 172.21.15.29:0/1132070193 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad9c1dfac0 0x7fad9c1dd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.107+0000 7fada17fd640 1 -- 172.21.15.29:0/1132070193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad9c1e0570 msgr2=0x7fad9c1e09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.107+0000 7fada17fd640 1 --2- 172.21.15.29:0/1132070193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad9c1e0570 0x7fad9c1e09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.107+0000 7fada17fd640 1 -- 172.21.15.29:0/1132070193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c1dff40 con 0x7fad840039a0 2024-01-25T15:06:00.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.107+0000 7fada1ffe640 1 --2- 172.21.15.29:0/1132070193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad9c1e0570 0x7fad9c1e09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:00.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.107+0000 7fada17fd640 1 --2- 172.21.15.29:0/1132070193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad840039a0 0x7fad9c1de200 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fad9400c240 tx=0x7fad94001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:00.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.107+0000 7fad99ffb640 1 -- 172.21.15.29:0/1132070193 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9402ccc0 con 0x7fad840039a0 2024-01-25T15:06:00.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.107+0000 7fad99ffb640 1 -- 172.21.15.29:0/1132070193 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9402ce20 con 0x7fad840039a0 2024-01-25T15:06:00.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.107+0000 7fada3a61640 1 -- 172.21.15.29:0/1132070193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9c1e1440 con 0x7fad840039a0 2024-01-25T15:06:00.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.107+0000 7fad99ffb640 1 -- 172.21.15.29:0/1132070193 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad940072b0 con 0x7fad840039a0 2024-01-25T15:06:00.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.108+0000 7fada3a61640 1 -- 172.21.15.29:0/1132070193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9c1db310 con 0x7fad840039a0 2024-01-25T15:06:00.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.109+0000 7fada3a61640 1 -- 172.21.15.29:0/1132070193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9c074080 con 0x7fad840039a0 2024-01-25T15:06:00.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.109+0000 7fad99ffb640 1 -- 172.21.15.29:0/1132070193 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fad94032070 con 0x7fad840039a0 2024-01-25T15:06:00.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.109+0000 7fad99ffb640 1 --2- 172.21.15.29:0/1132070193 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fad8806af00 0x7fad8806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:00.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.109+0000 7fad99ffb640 1 -- 172.21.15.29:0/1132070193 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fad9403c040 con 0x7fad840039a0 2024-01-25T15:06:00.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.110+0000 7fada0ffc640 1 --2- 172.21.15.29:0/1132070193 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fad8806af00 0x7fad8806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:00.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.110+0000 7fada0ffc640 1 --2- 172.21.15.29:0/1132070193 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fad8806af00 0x7fad8806d3c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fad90007fd0 tx=0x7fad90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:00.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.114+0000 7fad99ffb640 1 -- 172.21.15.29:0/1132070193 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fad94075990 con 0x7fad840039a0 2024-01-25T15:06:00.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.295+0000 7fada3a61640 1 -- 172.21.15.29:0/1132070193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad9c072750 con 0x7fad840039a0 2024-01-25T15:06:00.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.296+0000 7fad99ffb640 1 -- 172.21.15.29:0/1132070193 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+20455 (secure 0 0 0) 0x7fad94045090 con 0x7fad840039a0 2024-01-25T15:06:00.297 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:06:00.297 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":42,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:05:44.564655+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:05:25.099043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-25T15:05:25.537967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-25T15:05:40.935431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-25T15:05:41.895611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:06:00.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.298+0000 7fada3a61640 1 -- 172.21.15.29:0/1132070193 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fad8806af00 msgr2=0x7fad8806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:00.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.298+0000 7fada3a61640 1 --2- 172.21.15.29:0/1132070193 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fad8806af00 0x7fad8806d3c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fad90007fd0 tx=0x7fad90009040 comp rx=0 tx=0).stop 2024-01-25T15:06:00.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.298+0000 7fada3a61640 1 -- 172.21.15.29:0/1132070193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad840039a0 msgr2=0x7fad9c1de200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:00.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.298+0000 7fada3a61640 1 --2- 172.21.15.29:0/1132070193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad840039a0 0x7fad9c1de200 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fad9400c240 tx=0x7fad94001a00 comp rx=0 tx=0).stop 2024-01-25T15:06:00.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.298+0000 7fada3a61640 1 -- 172.21.15.29:0/1132070193 shutdown_connections 2024-01-25T15:06:00.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.298+0000 7fada3a61640 1 --2- 172.21.15.29:0/1132070193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad9c1e0570 0x7fad9c1e09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.298+0000 7fada3a61640 1 --2- 172.21.15.29:0/1132070193 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad9c1dfac0 0x7fad9c1dd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.299+0000 7fada3a61640 1 --2- 172.21.15.29:0/1132070193 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fad8806af00 0x7fad8806d3c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.299+0000 7fada3a61640 1 --2- 172.21.15.29:0/1132070193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad840039a0 0x7fad9c1de200 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.299+0000 7fada3a61640 1 -- 172.21.15.29:0/1132070193 >> 172.21.15.29:0/1132070193 conn(0x7fad9c0c3920 msgr2=0x7fad9c06d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:00.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.299+0000 7fada3a61640 1 -- 172.21.15.29:0/1132070193 shutdown_connections 2024-01-25T15:06:00.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.299+0000 7fada3a61640 1 -- 172.21.15.29:0/1132070193 wait complete. 2024-01-25T15:06:00.310 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-25T15:06:00.310 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:06:00.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.411+0000 7f666b83a640 1 Processor -- start 2024-01-25T15:06:00.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.411+0000 7f666b83a640 1 -- start start 2024-01-25T15:06:00.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.412+0000 7f666b83a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f66641520b0 0x7f6664155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:00.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.412+0000 7f666b83a640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66640c66c0 con 0x7f66640c4f00 2024-01-25T15:06:00.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.412+0000 7f666b83a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f666406cfc0 con 0x7f66640c55e0 2024-01-25T15:06:00.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.412+0000 7f666b83a640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6664152490 con 0x7f66641520b0 2024-01-25T15:06:00.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.412+0000 7f6669dd7640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f66640c4f00 0x7f66640c5b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54322/0 (socket says 172.21.15.29:54322) 2024-01-25T15:06:00.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.412+0000 7f6669dd7640 1 -- 172.21.15.29:0/1917642037 learned_addr learned my addr 172.21.15.29:0/1917642037 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:00.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.412+0000 7f66695d6640 1 --2- 172.21.15.29:0/1917642037 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f66641520b0 0x7f6664155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:00.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.413+0000 7f665bfff640 1 -- 172.21.15.29:0/1917642037 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800987492 0 0) 0x7f66640c66c0 con 0x7f66640c4f00 2024-01-25T15:06:00.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.413+0000 7f665bfff640 1 -- 172.21.15.29:0/1917642037 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6650003520 con 0x7f66640c4f00 2024-01-25T15:06:00.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.413+0000 7f665bfff640 1 -- 172.21.15.29:0/1917642037 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3473674695 0 0) 0x7f666406cfc0 con 0x7f66640c55e0 2024-01-25T15:06:00.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.413+0000 7f66695d6640 1 -- 172.21.15.29:0/1917642037 >> v1:172.21.15.52:6789/0 conn(0x7f66640c55e0 legacy=0x7f66640c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:00.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.413+0000 7f66695d6640 1 -- 172.21.15.29:0/1917642037 >> v1:172.21.15.29:6789/0 conn(0x7f66640c4f00 legacy=0x7f66640c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:00.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.413+0000 7f66695d6640 1 -- 172.21.15.29:0/1917642037 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66640c8830 con 0x7f66641520b0 2024-01-25T15:06:00.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.414+0000 7f66695d6640 1 --2- 172.21.15.29:0/1917642037 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f66641520b0 0x7f6664155570 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f66600097d0 tx=0x7f666002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=432896c1aee1e3eb server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:00.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.414+0000 7f665bfff640 1 -- 172.21.15.29:0/1917642037 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6660031800 con 0x7f66641520b0 2024-01-25T15:06:00.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.414+0000 7f665bfff640 1 -- 172.21.15.29:0/1917642037 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6660031960 con 0x7f66641520b0 2024-01-25T15:06:00.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.414+0000 7f665bfff640 1 -- 172.21.15.29:0/1917642037 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6660031cd0 con 0x7f66641520b0 2024-01-25T15:06:00.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.414+0000 7f666b83a640 1 -- 172.21.15.29:0/1917642037 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f66641520b0 msgr2=0x7f6664155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:00.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.414+0000 7f666b83a640 1 --2- 172.21.15.29:0/1917642037 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f66641520b0 0x7f6664155570 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f66600097d0 tx=0x7f666002b8a0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.414+0000 7f666b83a640 1 -- 172.21.15.29:0/1917642037 shutdown_connections 2024-01-25T15:06:00.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.414+0000 7f666b83a640 1 --2- 172.21.15.29:0/1917642037 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f66641520b0 0x7f6664155570 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.414+0000 7f666b83a640 1 -- 172.21.15.29:0/1917642037 >> 172.21.15.29:0/1917642037 conn(0x7f66640ca220 msgr2=0x7f66640ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:00.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.415+0000 7f666b83a640 1 -- 172.21.15.29:0/1917642037 shutdown_connections 2024-01-25T15:06:00.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.415+0000 7f666b83a640 1 -- 172.21.15.29:0/1917642037 wait complete. 2024-01-25T15:06:00.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.416+0000 7f666b83a640 1 Processor -- start 2024-01-25T15:06:00.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.416+0000 7f666b83a640 1 -- start start 2024-01-25T15:06:00.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.416+0000 7f666b83a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66640c4f00 0x7f66640aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:00.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.416+0000 7f666b83a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66641520b0 0x7f666414ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:00.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.416+0000 7f666b83a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f66641ea570 0x7f666414d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:00.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.416+0000 7f666b83a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66641eaa20 con 0x7f66640c4f00 2024-01-25T15:06:00.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.416+0000 7f666b83a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66640ab2a0 con 0x7f66641520b0 2024-01-25T15:06:00.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.416+0000 7f666b83a640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66640ab580 con 0x7f66641ea570 2024-01-25T15:06:00.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.416+0000 7f66695d6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66640c4f00 0x7f66640aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:00.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.416+0000 7f66695d6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66640c4f00 0x7f66640aacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52370/0 (socket says 172.21.15.29:52370) 2024-01-25T15:06:00.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.416+0000 7f66695d6640 1 -- 172.21.15.29:0/1231240799 learned_addr learned my addr 172.21.15.29:0/1231240799 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:00.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.417+0000 7f6669dd7640 1 --2- 172.21.15.29:0/1231240799 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f66641ea570 0x7f666414d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:00.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.417+0000 7f6668dd5640 1 --2- 172.21.15.29:0/1231240799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66641520b0 0x7f666414ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:00.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.417+0000 7f66695d6640 1 -- 172.21.15.29:0/1231240799 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f66641ea570 msgr2=0x7f666414d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:00.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.417+0000 7f66695d6640 1 --2- 172.21.15.29:0/1231240799 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f66641ea570 0x7f666414d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.417+0000 7f66695d6640 1 -- 172.21.15.29:0/1231240799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66641520b0 msgr2=0x7f666414ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:00.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.417+0000 7f66695d6640 1 --2- 172.21.15.29:0/1231240799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66641520b0 0x7f666414ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.417+0000 7f66695d6640 1 -- 172.21.15.29:0/1231240799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6660009400 con 0x7f66640c4f00 2024-01-25T15:06:00.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.417+0000 7f6669dd7640 1 --2- 172.21.15.29:0/1231240799 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f66641ea570 0x7f666414d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:06:00.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.417+0000 7f6668dd5640 1 --2- 172.21.15.29:0/1231240799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66641520b0 0x7f666414ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:06:00.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.417+0000 7f66695d6640 1 --2- 172.21.15.29:0/1231240799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66640c4f00 0x7f66640aacc0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f666002b8e0 tx=0x7f66600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:00.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.417+0000 7f6659ffb640 1 -- 172.21.15.29:0/1231240799 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6660003610 con 0x7f66640c4f00 2024-01-25T15:06:00.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.417+0000 7f6659ffb640 1 -- 172.21.15.29:0/1231240799 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6660003770 con 0x7f66640c4f00 2024-01-25T15:06:00.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.417+0000 7f666b83a640 1 -- 172.21.15.29:0/1231240799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f666414c3f0 con 0x7f66640c4f00 2024-01-25T15:06:00.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.417+0000 7f6659ffb640 1 -- 172.21.15.29:0/1231240799 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6660003ae0 con 0x7f66640c4f00 2024-01-25T15:06:00.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.417+0000 7f666b83a640 1 -- 172.21.15.29:0/1231240799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f666414c9b0 con 0x7f66640c4f00 2024-01-25T15:06:00.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.418+0000 7f666b83a640 1 -- 172.21.15.29:0/1231240799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66641549a0 con 0x7f66640c4f00 2024-01-25T15:06:00.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.419+0000 7f6659ffb640 1 -- 172.21.15.29:0/1231240799 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6660003c40 con 0x7f66640c4f00 2024-01-25T15:06:00.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.419+0000 7f6659ffb640 1 --2- 172.21.15.29:0/1231240799 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f664806aed0 0x7f664806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:00.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.419+0000 7f6659ffb640 1 -- 172.21.15.29:0/1231240799 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f666002e070 con 0x7f66640c4f00 2024-01-25T15:06:00.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.419+0000 7f6668dd5640 1 --2- 172.21.15.29:0/1231240799 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f664806aed0 0x7f664806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:00.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.420+0000 7f6668dd5640 1 --2- 172.21.15.29:0/1231240799 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f664806aed0 0x7f664806d390 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f66640bd740 tx=0x7f6654009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:00.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.423+0000 7f6659ffb640 1 -- 172.21.15.29:0/1231240799 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6660076330 con 0x7f66640c4f00 2024-01-25T15:06:00.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.639+0000 7f666b83a640 1 -- 172.21.15.29:0/1231240799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6664074080 con 0x7f66640c4f00 2024-01-25T15:06:00.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.639+0000 7f6659ffb640 1 -- 172.21.15.29:0/1231240799 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6180 (secure 0 0 0) 0x7f6660079950 con 0x7f66640c4f00 2024-01-25T15:06:00.643 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:06:00.643 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/3901576943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6835","nonce":3901576943},{"type":"v1","addr":"172.21.15.52:6837","nonce":3901576943}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6836/1878395580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1878395580},{"type":"v1","addr":"172.21.15.52:6836","nonce":1878395580}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:05:26.577307+0000","modified":"2024-01-25T15:05:28.881837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3222226893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3222226893},{"type":"v1","addr":"172.21.15.29:6835","nonce":3222226893}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:05:42.928937+0000","modified":"2024-01-25T15:05:44.918053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.29:6834/1607449141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1607449141},{"type":"v1","addr":"172.21.15.29:6834","nonce":1607449141}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-25T15:06:00.644 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 20 2024-01-25T15:06:00.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.641+0000 7f666b83a640 1 -- 172.21.15.29:0/1231240799 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f664806aed0 msgr2=0x7f664806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:00.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.641+0000 7f666b83a640 1 --2- 172.21.15.29:0/1231240799 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f664806aed0 0x7f664806d390 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f66640bd740 tx=0x7f6654009040 comp rx=0 tx=0).stop 2024-01-25T15:06:00.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.641+0000 7f666b83a640 1 -- 172.21.15.29:0/1231240799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66640c4f00 msgr2=0x7f66640aacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:00.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.641+0000 7f666b83a640 1 --2- 172.21.15.29:0/1231240799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66640c4f00 0x7f66640aacc0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f666002b8e0 tx=0x7f66600046c0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.641+0000 7f666b83a640 1 -- 172.21.15.29:0/1231240799 shutdown_connections 2024-01-25T15:06:00.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.641+0000 7f666b83a640 1 --2- 172.21.15.29:0/1231240799 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f66641ea570 0x7f666414d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.641+0000 7f666b83a640 1 --2- 172.21.15.29:0/1231240799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66641520b0 0x7f666414ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.641+0000 7f666b83a640 1 --2- 172.21.15.29:0/1231240799 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f664806aed0 0x7f664806d390 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.641+0000 7f666b83a640 1 --2- 172.21.15.29:0/1231240799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66640c4f00 0x7f66640aacc0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.641+0000 7f666b83a640 1 -- 172.21.15.29:0/1231240799 >> 172.21.15.29:0/1231240799 conn(0x7f66640ca220 msgr2=0x7f666406b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:00.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.641+0000 7f666b83a640 1 -- 172.21.15.29:0/1231240799 shutdown_connections 2024-01-25T15:06:00.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.641+0000 7f666b83a640 1 -- 172.21.15.29:0/1231240799 wait complete. 2024-01-25T15:06:00.653 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:06:00.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.753+0000 7f8bec3a2640 1 Processor -- start 2024-01-25T15:06:00.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.753+0000 7f8bec3a2640 1 -- start start 2024-01-25T15:06:00.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.754+0000 7f8bec3a2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8be40c6980 0x7f8be41530b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:00.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.754+0000 7f8bec3a2640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be40c3100 con 0x7f8be414c6f0 2024-01-25T15:06:00.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.754+0000 7f8bec3a2640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be40c41d0 con 0x7f8be40c3c30 2024-01-25T15:06:00.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.754+0000 7f8bec3a2640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be41525d0 con 0x7f8be40c6980 2024-01-25T15:06:00.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.754+0000 7f8be993d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8be40c6980 0x7f8be41530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:00.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.754+0000 7f8bea13e640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8be414c6f0 0x7f8be40c29f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54324/0 (socket says 172.21.15.29:54324) 2024-01-25T15:06:00.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.754+0000 7f8bea13e640 1 -- 172.21.15.29:0/3111150775 learned_addr learned my addr 172.21.15.29:0/3111150775 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:00.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.755+0000 7f8be993d640 1 -- 172.21.15.29:0/3111150775 >> v1:172.21.15.52:6789/0 conn(0x7f8be40c3c30 legacy=0x7f8be40c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:00.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.755+0000 7f8be993d640 1 -- 172.21.15.29:0/3111150775 >> v1:172.21.15.29:6789/0 conn(0x7f8be414c6f0 legacy=0x7f8be40c29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:00.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.755+0000 7f8be913c640 1 -- 172.21.15.29:0/3111150775 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743640593 0 0) 0x7f8be40c3100 con 0x7f8be414c6f0 2024-01-25T15:06:00.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.755+0000 7f8be993d640 1 -- 172.21.15.29:0/3111150775 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be41528b0 con 0x7f8be40c6980 2024-01-25T15:06:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.756+0000 7f8be993d640 1 --2- 172.21.15.29:0/3111150775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8be40c6980 0x7f8be41530b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40097a0 tx=0x7f8bd402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9dd8c6098fb5f8 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.756+0000 7f8be913c640 1 -- 172.21.15.29:0/3111150775 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4030610 con 0x7f8be40c6980 2024-01-25T15:06:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.756+0000 7f8be913c640 1 -- 172.21.15.29:0/3111150775 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd4030770 con 0x7f8be40c6980 2024-01-25T15:06:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.756+0000 7f8be913c640 1 -- 172.21.15.29:0/3111150775 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4030b00 con 0x7f8be40c6980 2024-01-25T15:06:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.756+0000 7f8bec3a2640 1 -- 172.21.15.29:0/3111150775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8be40c6980 msgr2=0x7f8be41530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.756+0000 7f8bec3a2640 1 --2- 172.21.15.29:0/3111150775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8be40c6980 0x7f8be41530b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40097a0 tx=0x7f8bd402b960 comp rx=0 tx=0).stop 2024-01-25T15:06:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.756+0000 7f8bec3a2640 1 -- 172.21.15.29:0/3111150775 shutdown_connections 2024-01-25T15:06:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.756+0000 7f8bec3a2640 1 --2- 172.21.15.29:0/3111150775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8be40c6980 0x7f8be41530b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.756+0000 7f8bec3a2640 1 -- 172.21.15.29:0/3111150775 >> 172.21.15.29:0/3111150775 conn(0x7f8be406a8a0 msgr2=0x7f8be406acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.756+0000 7f8bec3a2640 1 -- 172.21.15.29:0/3111150775 shutdown_connections 2024-01-25T15:06:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.756+0000 7f8bec3a2640 1 -- 172.21.15.29:0/3111150775 wait complete. 2024-01-25T15:06:00.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.757+0000 7f8bec3a2640 1 Processor -- start 2024-01-25T15:06:00.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.757+0000 7f8bec3a2640 1 -- start start 2024-01-25T15:06:00.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.758+0000 7f8bec3a2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8be40c3c30 0x7f8be4144f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:00.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.758+0000 7f8bec3a2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8be40c6980 0x7f8be40c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.758+0000 7f8bec3a2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8be414c6f0 0x7f8be414dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.758+0000 7f8bec3a2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be4156270 con 0x7f8be414c6f0 2024-01-25T15:06:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.758+0000 7f8bec3a2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be41eb320 con 0x7f8be40c6980 2024-01-25T15:06:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.758+0000 7f8bec3a2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be41eb600 con 0x7f8be40c3c30 2024-01-25T15:06:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.758+0000 7f8bea93f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8be414c6f0 0x7f8be414dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.758+0000 7f8bea93f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8be414c6f0 0x7f8be414dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52390/0 (socket says 172.21.15.29:52390) 2024-01-25T15:06:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.758+0000 7f8bea93f640 1 -- 172.21.15.29:0/3594755478 learned_addr learned my addr 172.21.15.29:0/3594755478 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.758+0000 7f8bea93f640 1 -- 172.21.15.29:0/3594755478 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8be40c3c30 msgr2=0x7f8be4144f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.758+0000 7f8bea93f640 1 --2- 172.21.15.29:0/3594755478 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8be40c3c30 0x7f8be4144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.758+0000 7f8bea93f640 1 -- 172.21.15.29:0/3594755478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8be40c6980 msgr2=0x7f8be40c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.758+0000 7f8bea93f640 1 --2- 172.21.15.29:0/3594755478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8be40c6980 0x7f8be40c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.758+0000 7f8bea93f640 1 -- 172.21.15.29:0/3594755478 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd4009400 con 0x7f8be414c6f0 2024-01-25T15:06:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.759+0000 7f8bea93f640 1 --2- 172.21.15.29:0/3594755478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8be414c6f0 0x7f8be414dae0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00c7a0 tx=0x7f8bdc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:00.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.759+0000 7f8bdaffd640 1 -- 172.21.15.29:0/3594755478 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc003b70 con 0x7f8be414c6f0 2024-01-25T15:06:00.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.759+0000 7f8bdaffd640 1 -- 172.21.15.29:0/3594755478 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bdc003cf0 con 0x7f8be414c6f0 2024-01-25T15:06:00.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.759+0000 7f8bec3a2640 1 -- 172.21.15.29:0/3594755478 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be41eb8e0 con 0x7f8be414c6f0 2024-01-25T15:06:00.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.759+0000 7f8bdaffd640 1 -- 172.21.15.29:0/3594755478 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc003ea0 con 0x7f8be414c6f0 2024-01-25T15:06:00.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.759+0000 7f8bec3a2640 1 -- 172.21.15.29:0/3594755478 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be41ebea0 con 0x7f8be414c6f0 2024-01-25T15:06:00.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.760+0000 7f8bec3a2640 1 -- 172.21.15.29:0/3594755478 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be41ec030 con 0x7f8be414c6f0 2024-01-25T15:06:00.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.760+0000 7f8bdaffd640 1 -- 172.21.15.29:0/3594755478 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8bdc00aa90 con 0x7f8be414c6f0 2024-01-25T15:06:00.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.761+0000 7f8bdaffd640 1 --2- 172.21.15.29:0/3594755478 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8bc806aed0 0x7f8bc806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:00.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.761+0000 7f8bdaffd640 1 -- 172.21.15.29:0/3594755478 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f8bdc089890 con 0x7f8be414c6f0 2024-01-25T15:06:00.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.761+0000 7f8bea13e640 1 --2- 172.21.15.29:0/3594755478 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8bc806aed0 0x7f8bc806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:00.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.762+0000 7f8bea13e640 1 --2- 172.21.15.29:0/3594755478 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8bc806aed0 0x7f8bc806d390 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8be0000c00 tx=0x7f8be00079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:00.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.765+0000 7f8bdaffd640 1 -- 172.21.15.29:0/3594755478 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8bdc054350 con 0x7f8be414c6f0 2024-01-25T15:06:00.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.980+0000 7f8bec3a2640 1 -- 172.21.15.29:0/3594755478 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8be4074080 con 0x7f8be414c6f0 2024-01-25T15:06:00.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.980+0000 7f8bdaffd640 1 -- 172.21.15.29:0/3594755478 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6180 (secure 0 0 0) 0x7f8bdc057970 con 0x7f8be414c6f0 2024-01-25T15:06:00.981 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:06:00.982 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/3901576943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6835","nonce":3901576943},{"type":"v1","addr":"172.21.15.52:6837","nonce":3901576943}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6836/1878395580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1878395580},{"type":"v1","addr":"172.21.15.52:6836","nonce":1878395580}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:05:26.577307+0000","modified":"2024-01-25T15:05:28.881837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3222226893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3222226893},{"type":"v1","addr":"172.21.15.29:6835","nonce":3222226893}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:05:42.928937+0000","modified":"2024-01-25T15:05:44.918053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.29:6834/1607449141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1607449141},{"type":"v1","addr":"172.21.15.29:6834","nonce":1607449141}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-25T15:06:00.982 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 20 2024-01-25T15:06:00.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.982+0000 7f8bec3a2640 1 -- 172.21.15.29:0/3594755478 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8bc806aed0 msgr2=0x7f8bc806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:00.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.982+0000 7f8bec3a2640 1 --2- 172.21.15.29:0/3594755478 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8bc806aed0 0x7f8bc806d390 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8be0000c00 tx=0x7f8be00079c0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.982+0000 7f8bec3a2640 1 -- 172.21.15.29:0/3594755478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8be414c6f0 msgr2=0x7f8be414dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:00.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.982+0000 7f8bec3a2640 1 --2- 172.21.15.29:0/3594755478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8be414c6f0 0x7f8be414dae0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00c7a0 tx=0x7f8bdc00cc60 comp rx=0 tx=0).stop 2024-01-25T15:06:00.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.982+0000 7f8bec3a2640 1 -- 172.21.15.29:0/3594755478 shutdown_connections 2024-01-25T15:06:00.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.982+0000 7f8bec3a2640 1 --2- 172.21.15.29:0/3594755478 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8bc806aed0 0x7f8bc806d390 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.982+0000 7f8bec3a2640 1 --2- 172.21.15.29:0/3594755478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8be414c6f0 0x7f8be414dae0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.982+0000 7f8bec3a2640 1 --2- 172.21.15.29:0/3594755478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8be40c6980 0x7f8be40c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.982+0000 7f8bec3a2640 1 --2- 172.21.15.29:0/3594755478 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8be40c3c30 0x7f8be4144f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:00.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.982+0000 7f8bec3a2640 1 -- 172.21.15.29:0/3594755478 >> 172.21.15.29:0/3594755478 conn(0x7f8be406a8a0 msgr2=0x7f8be4148180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:00.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.982+0000 7f8bec3a2640 1 -- 172.21.15.29:0/3594755478 shutdown_connections 2024-01-25T15:06:00.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:00.982+0000 7f8bec3a2640 1 -- 172.21.15.29:0/3594755478 wait complete. 2024-01-25T15:06:00.994 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:06:01.018 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-25T15:06:01.040 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-25T15:06:01.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.096+0000 7fa36e4d3640 1 Processor -- start 2024-01-25T15:06:01.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.096+0000 7fa36e4d3640 1 -- start start 2024-01-25T15:06:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.097+0000 7fa36e4d3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa3681520b0 0x7fa368155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.097+0000 7fa36e4d3640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3680c55e0 0x7fa3680c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.097+0000 7fa36e4d3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa3680c4f00 0x7fa3680c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.097+0000 7fa36e4d3640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3680c66c0 con 0x7fa3681520b0 2024-01-25T15:06:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.097+0000 7fa36e4d3640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa36806cfc0 con 0x7fa3680c4f00 2024-01-25T15:06:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.097+0000 7fa36e4d3640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa368152490 con 0x7fa3680c55e0 2024-01-25T15:06:01.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.097+0000 7fa367fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa3681520b0 0x7fa368155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:01.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.097+0000 7fa367fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa3681520b0 0x7fa368155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52404/0 (socket says 172.21.15.29:52404) 2024-01-25T15:06:01.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.097+0000 7fa367fff640 1 -- 172.21.15.29:0/2607944597 learned_addr learned my addr 172.21.15.29:0/2607944597 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:01.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.097+0000 7fa367fff640 1 -- 172.21.15.29:0/2607944597 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3680c55e0 msgr2=0x7fa3680c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:01.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.097+0000 7fa36ca70640 1 --2- 172.21.15.29:0/2607944597 >> v2:172.21.15.52:3300/0 conn(0x7fa3680c4f00 0x7fa3680c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:01.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.097+0000 7fa3677fe640 1 --2- 172.21.15.29:0/2607944597 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3680c55e0 0x7fa3680c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:01.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.097+0000 7fa367fff640 1 --2- 172.21.15.29:0/2607944597 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3680c55e0 0x7fa3680c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.097+0000 7fa367fff640 1 -- 172.21.15.29:0/2607944597 >> v2:172.21.15.52:3300/0 conn(0x7fa3680c4f00 msgr2=0x7fa3680c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:01.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.097+0000 7fa367fff640 1 --2- 172.21.15.29:0/2607944597 >> v2:172.21.15.52:3300/0 conn(0x7fa3680c4f00 0x7fa3680c5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.097+0000 7fa367fff640 1 -- 172.21.15.29:0/2607944597 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3680c6910 con 0x7fa3681520b0 2024-01-25T15:06:01.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.098+0000 7fa367fff640 1 --2- 172.21.15.29:0/2607944597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3681520b0 0x7fa368155570 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa3680c65f0 tx=0x7fa35c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb443194874d76a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:01.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.098+0000 7fa366ffd640 1 -- 172.21.15.29:0/2607944597 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c0317e0 con 0x7fa3681520b0 2024-01-25T15:06:01.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.098+0000 7fa366ffd640 1 -- 172.21.15.29:0/2607944597 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35c031940 con 0x7fa3681520b0 2024-01-25T15:06:01.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.098+0000 7fa366ffd640 1 -- 172.21.15.29:0/2607944597 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c031cd0 con 0x7fa3681520b0 2024-01-25T15:06:01.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.098+0000 7fa36e4d3640 1 -- 172.21.15.29:0/2607944597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3681520b0 msgr2=0x7fa368155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:01.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.098+0000 7fa36e4d3640 1 --2- 172.21.15.29:0/2607944597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3681520b0 0x7fa368155570 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa3680c65f0 tx=0x7fa35c02b880 comp rx=0 tx=0).stop 2024-01-25T15:06:01.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.098+0000 7fa36e4d3640 1 -- 172.21.15.29:0/2607944597 shutdown_connections 2024-01-25T15:06:01.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.098+0000 7fa36e4d3640 1 --2- 172.21.15.29:0/2607944597 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3680c55e0 0x7fa3680c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.098+0000 7fa36e4d3640 1 --2- 172.21.15.29:0/2607944597 >> v2:172.21.15.52:3300/0 conn(0x7fa3680c4f00 0x7fa3680c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.098+0000 7fa36e4d3640 1 --2- 172.21.15.29:0/2607944597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3681520b0 0x7fa368155570 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.098+0000 7fa36e4d3640 1 -- 172.21.15.29:0/2607944597 >> 172.21.15.29:0/2607944597 conn(0x7fa3680ca220 msgr2=0x7fa3680ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:01.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.099+0000 7fa36e4d3640 1 -- 172.21.15.29:0/2607944597 shutdown_connections 2024-01-25T15:06:01.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.099+0000 7fa36e4d3640 1 -- 172.21.15.29:0/2607944597 wait complete. 2024-01-25T15:06:01.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.100+0000 7fa36e4d3640 1 Processor -- start 2024-01-25T15:06:01.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.100+0000 7fa36e4d3640 1 -- start start 2024-01-25T15:06:01.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.100+0000 7fa36e4d3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3680c4f00 0x7fa3681ed910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:01.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.100+0000 7fa36e4d3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3681520b0 0x7fa3681ede50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:01.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.100+0000 7fa36e4d3640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3680acdd0 0x7fa3681e7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:01.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.100+0000 7fa36e4d3640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3680af250 con 0x7fa3680c4f00 2024-01-25T15:06:01.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.100+0000 7fa36e4d3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3680af4c0 con 0x7fa3681520b0 2024-01-25T15:06:01.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.100+0000 7fa36e4d3640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3680af7a0 con 0x7fa3680acdd0 2024-01-25T15:06:01.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.100+0000 7fa367fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3680c4f00 0x7fa3681ed910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.101+0000 7fa367fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3680c4f00 0x7fa3681ed910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52408/0 (socket says 172.21.15.29:52408) 2024-01-25T15:06:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.101+0000 7fa367fff640 1 -- 172.21.15.29:0/2563545367 learned_addr learned my addr 172.21.15.29:0/2563545367 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.101+0000 7fa36ca70640 1 --2- 172.21.15.29:0/2563545367 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3680acdd0 0x7fa3681e7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.101+0000 7fa3677fe640 1 --2- 172.21.15.29:0/2563545367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3681520b0 0x7fa3681ede50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.101+0000 7fa367fff640 1 -- 172.21.15.29:0/2563545367 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3680acdd0 msgr2=0x7fa3681e7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.101+0000 7fa367fff640 1 --2- 172.21.15.29:0/2563545367 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3680acdd0 0x7fa3681e7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.101+0000 7fa367fff640 1 -- 172.21.15.29:0/2563545367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3681520b0 msgr2=0x7fa3681ede50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.101+0000 7fa367fff640 1 --2- 172.21.15.29:0/2563545367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3681520b0 0x7fa3681ede50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.101+0000 7fa367fff640 1 -- 172.21.15.29:0/2563545367 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c0094d0 con 0x7fa3680c4f00 2024-01-25T15:06:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.101+0000 7fa36ca70640 1 --2- 172.21.15.29:0/2563545367 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3680acdd0 0x7fa3681e7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:06:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.101+0000 7fa367fff640 1 --2- 172.21.15.29:0/2563545367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3680c4f00 0x7fa3681ed910 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa35c02b8c0 tx=0x7fa35c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.101+0000 7fa364ff9640 1 -- 172.21.15.29:0/2563545367 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c032980 con 0x7fa3680c4f00 2024-01-25T15:06:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.101+0000 7fa364ff9640 1 -- 172.21.15.29:0/2563545367 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35c032b00 con 0x7fa3680c4f00 2024-01-25T15:06:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.101+0000 7fa36e4d3640 1 -- 172.21.15.29:0/2563545367 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3680afa80 con 0x7fa3680c4f00 2024-01-25T15:06:01.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.101+0000 7fa364ff9640 1 -- 172.21.15.29:0/2563545367 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c0453f0 con 0x7fa3680c4f00 2024-01-25T15:06:01.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.101+0000 7fa36e4d3640 1 -- 172.21.15.29:0/2563545367 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3680c5d70 con 0x7fa3680c4f00 2024-01-25T15:06:01.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.102+0000 7fa36e4d3640 1 -- 172.21.15.29:0/2563545367 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3680af8e0 con 0x7fa3680c4f00 2024-01-25T15:06:01.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.103+0000 7fa364ff9640 1 -- 172.21.15.29:0/2563545367 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fa35c04e450 con 0x7fa3680c4f00 2024-01-25T15:06:01.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.103+0000 7fa364ff9640 1 --2- 172.21.15.29:0/2563545367 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa35406aed0 0x7fa35406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:01.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.103+0000 7fa364ff9640 1 -- 172.21.15.29:0/2563545367 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fa35c0abdc0 con 0x7fa3680c4f00 2024-01-25T15:06:01.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.103+0000 7fa3677fe640 1 --2- 172.21.15.29:0/2563545367 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa35406aed0 0x7fa35406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:01.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.104+0000 7fa3677fe640 1 --2- 172.21.15.29:0/2563545367 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa35406aed0 0x7fa35406d390 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa3680ae490 tx=0x7fa358008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:01.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.107+0000 7fa364ff9640 1 -- 172.21.15.29:0/2563545367 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fa3680af8e0 con 0x7fa3680c4f00 2024-01-25T15:06:01.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.286+0000 7fa36e4d3640 1 -- 172.21.15.29:0/2563545367 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3680af8e0 con 0x7fa3680c4f00 2024-01-25T15:06:01.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.288+0000 7fa364ff9640 1 -- 172.21.15.29:0/2563545367 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+20455 (secure 0 0 0) 0x7fa3680af8e0 con 0x7fa3680c4f00 2024-01-25T15:06:01.289 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:06:01.289 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":42,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:05:44.564655+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-25T15:05:25.099043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-25T15:05:25.537967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-25T15:05:40.935431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-25T15:05:41.895611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:06:01.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.289+0000 7fa36e4d3640 1 -- 172.21.15.29:0/2563545367 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa35406aed0 msgr2=0x7fa35406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:01.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.289+0000 7fa36e4d3640 1 --2- 172.21.15.29:0/2563545367 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa35406aed0 0x7fa35406d390 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa3680ae490 tx=0x7fa358008040 comp rx=0 tx=0).stop 2024-01-25T15:06:01.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.289+0000 7fa36e4d3640 1 -- 172.21.15.29:0/2563545367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3680c4f00 msgr2=0x7fa3681ed910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:01.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.289+0000 7fa36e4d3640 1 --2- 172.21.15.29:0/2563545367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3680c4f00 0x7fa3681ed910 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa35c02b8c0 tx=0x7fa35c0046c0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.289+0000 7fa36e4d3640 1 -- 172.21.15.29:0/2563545367 shutdown_connections 2024-01-25T15:06:01.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.289+0000 7fa36e4d3640 1 --2- 172.21.15.29:0/2563545367 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3680acdd0 0x7fa3681e7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.289+0000 7fa36e4d3640 1 --2- 172.21.15.29:0/2563545367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3681520b0 0x7fa3681ede50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.289+0000 7fa36e4d3640 1 --2- 172.21.15.29:0/2563545367 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa35406aed0 0x7fa35406d390 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.289+0000 7fa36e4d3640 1 --2- 172.21.15.29:0/2563545367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3680c4f00 0x7fa3681ed910 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.289+0000 7fa36e4d3640 1 -- 172.21.15.29:0/2563545367 >> 172.21.15.29:0/2563545367 conn(0x7fa3680ca220 msgr2=0x7fa36814aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:01.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.290+0000 7fa36e4d3640 1 -- 172.21.15.29:0/2563545367 shutdown_connections 2024-01-25T15:06:01.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.290+0000 7fa36e4d3640 1 -- 172.21.15.29:0/2563545367 wait complete. 2024-01-25T15:06:01.301 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-25T15:06:01.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.442+0000 7f2f1b516640 1 Processor -- start 2024-01-25T15:06:01.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.442+0000 7f2f1b516640 1 -- start start 2024-01-25T15:06:01.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.443+0000 7f2f1b516640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f1406b710 0x7f2f140c6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:01.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.443+0000 7f2f1b516640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f140c58c0 con 0x7f2f14151d80 2024-01-25T15:06:01.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.443+0000 7f2f1b516640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f140c4990 con 0x7f2f1406b2b0 2024-01-25T15:06:01.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.443+0000 7f2f1b516640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1406c0a0 con 0x7f2f1406b710 2024-01-25T15:06:01.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.443+0000 7f2f192b2640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2f14151d80 0x7f2f14155120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54330/0 (socket says 172.21.15.29:54330) 2024-01-25T15:06:01.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.443+0000 7f2f192b2640 1 -- 172.21.15.29:0/4053265719 learned_addr learned my addr 172.21.15.29:0/4053265719 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:01.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.443+0000 7f2f19ab3640 1 --2- 172.21.15.29:0/4053265719 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f1406b710 0x7f2f140c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:01.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.443+0000 7f2f0bfff640 1 -- 172.21.15.29:0/4053265719 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625667520 0 0) 0x7f2f140c58c0 con 0x7f2f14151d80 2024-01-25T15:06:01.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.443+0000 7f2f0bfff640 1 -- 172.21.15.29:0/4053265719 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f00003520 con 0x7f2f14151d80 2024-01-25T15:06:01.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.443+0000 7f2f0bfff640 1 -- 172.21.15.29:0/4053265719 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2679854832 0 0) 0x7f2f00003520 con 0x7f2f14151d80 2024-01-25T15:06:01.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.443+0000 7f2f0bfff640 1 -- 172.21.15.29:0/4053265719 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f1406b710 msgr2=0x7f2f140c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:01.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.443+0000 7f2f0bfff640 1 --2- 172.21.15.29:0/4053265719 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f1406b710 0x7f2f140c6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.443+0000 7f2f0bfff640 1 -- 172.21.15.29:0/4053265719 >> v1:172.21.15.52:6789/0 conn(0x7f2f1406b2b0 legacy=0x7f2f140c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:01.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.443+0000 7f2f0bfff640 1 -- 172.21.15.29:0/4053265719 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f140c4c30 con 0x7f2f14151d80 2024-01-25T15:06:01.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.443+0000 7f2f0bfff640 1 -- 172.21.15.29:0/4053265719 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f2f0c001670 con 0x7f2f14151d80 2024-01-25T15:06:01.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.444+0000 7f2f0bfff640 1 -- 172.21.15.29:0/4053265719 >> v1:172.21.15.29:6789/0 conn(0x7f2f14151d80 legacy=0x7f2f14155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:01.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.444+0000 7f2f0bfff640 1 --2- 172.21.15.29:0/4053265719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f00003a10 0x7f2f00003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:01.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.444+0000 7f2f0bfff640 1 --2- 172.21.15.29:0/4053265719 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f000047c0 0x7f2f00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:01.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.444+0000 7f2f0bfff640 1 --2- 172.21.15.29:0/4053265719 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f1406b710 0x7f2f00005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:01.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.444+0000 7f2f0bfff640 1 -- 172.21.15.29:0/4053265719 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0000bb40 con 0x7f2f000047c0 2024-01-25T15:06:01.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.444+0000 7f2f0bfff640 1 -- 172.21.15.29:0/4053265719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0000bcb0 con 0x7f2f00003a10 2024-01-25T15:06:01.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.444+0000 7f2f0bfff640 1 -- 172.21.15.29:0/4053265719 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0000be70 con 0x7f2f1406b710 2024-01-25T15:06:01.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.444+0000 7f2f18ab1640 1 --2- 172.21.15.29:0/4053265719 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f000047c0 0x7f2f00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:01.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.444+0000 7f2f192b2640 1 --2- 172.21.15.29:0/4053265719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f00003a10 0x7f2f00003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:01.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.444+0000 7f2f19ab3640 1 --2- 172.21.15.29:0/4053265719 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f1406b710 0x7f2f00005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:01.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.444+0000 7f2f18ab1640 1 -- 172.21.15.29:0/4053265719 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f1406b710 msgr2=0x7f2f00005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:01.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.444+0000 7f2f18ab1640 1 --2- 172.21.15.29:0/4053265719 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f1406b710 0x7f2f00005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.444+0000 7f2f18ab1640 1 -- 172.21.15.29:0/4053265719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f00003a10 msgr2=0x7f2f00003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:01.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.444+0000 7f2f18ab1640 1 --2- 172.21.15.29:0/4053265719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f00003a10 0x7f2f00003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.444+0000 7f2f18ab1640 1 -- 172.21.15.29:0/4053265719 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f00003520 con 0x7f2f000047c0 2024-01-25T15:06:01.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.444+0000 7f2f19ab3640 1 --2- 172.21.15.29:0/4053265719 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f1406b710 0x7f2f00005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:01.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.445+0000 7f2f18ab1640 1 --2- 172.21.15.29:0/4053265719 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f000047c0 0x7f2f00004c40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f2f14155830 tx=0x7f2f000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ada04e293bfc39 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:01.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.445+0000 7f2f0bfff640 1 -- 172.21.15.29:0/4053265719 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f040052d0 con 0x7f2f000047c0 2024-01-25T15:06:01.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.445+0000 7f2f0bfff640 1 -- 172.21.15.29:0/4053265719 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0402e050 con 0x7f2f000047c0 2024-01-25T15:06:01.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.445+0000 7f2f0bfff640 1 -- 172.21.15.29:0/4053265719 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f040035f0 con 0x7f2f000047c0 2024-01-25T15:06:01.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.445+0000 7f2f1b516640 1 -- 172.21.15.29:0/4053265719 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f000047c0 msgr2=0x7f2f00004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:01.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.445+0000 7f2f1b516640 1 --2- 172.21.15.29:0/4053265719 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f000047c0 0x7f2f00004c40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f2f14155830 tx=0x7f2f000057f0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.445+0000 7f2f19ab3640 1 -- 172.21.15.29:0/4053265719 reap_dead start 2024-01-25T15:06:01.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.445+0000 7f2f1b516640 1 -- 172.21.15.29:0/4053265719 shutdown_connections 2024-01-25T15:06:01.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.445+0000 7f2f1b516640 1 -- 172.21.15.29:0/4053265719 >> 172.21.15.29:0/4053265719 conn(0x7f2f140ca1f0 msgr2=0x7f2f140ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:01.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.446+0000 7f2f1b516640 1 -- 172.21.15.29:0/4053265719 shutdown_connections 2024-01-25T15:06:01.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.446+0000 7f2f1b516640 1 -- 172.21.15.29:0/4053265719 wait complete. 2024-01-25T15:06:01.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.447+0000 7f2f1b516640 1 Processor -- start 2024-01-25T15:06:01.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.447+0000 7f2f1b516640 1 -- start start 2024-01-25T15:06:01.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.447+0000 7f2f1b516640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f000047c0 0x7f2f141ed9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:01.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.447+0000 7f2f1b516640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f14148a00 0x7f2f140c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:01.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.447+0000 7f2f1b516640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f140c2220 0x7f2f140c26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:01.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.447+0000 7f2f1b516640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f140c2be0 con 0x7f2f000047c0 2024-01-25T15:06:01.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.447+0000 7f2f1b516640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f141edf20 con 0x7f2f14148a00 2024-01-25T15:06:01.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.447+0000 7f2f1b516640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f140c1d90 con 0x7f2f140c2220 2024-01-25T15:06:01.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.447+0000 7f2f192b2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f000047c0 0x7f2f141ed9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:01.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.447+0000 7f2f192b2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f000047c0 0x7f2f141ed9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52422/0 (socket says 172.21.15.29:52422) 2024-01-25T15:06:01.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.447+0000 7f2f192b2640 1 -- 172.21.15.29:0/982243682 learned_addr learned my addr 172.21.15.29:0/982243682 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:01.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.448+0000 7f2f19ab3640 1 --2- 172.21.15.29:0/982243682 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f140c2220 0x7f2f140c26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:01.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.448+0000 7f2f18ab1640 1 --2- 172.21.15.29:0/982243682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f14148a00 0x7f2f140c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:01.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.448+0000 7f2f192b2640 1 -- 172.21.15.29:0/982243682 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f140c2220 msgr2=0x7f2f140c26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:01.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.448+0000 7f2f192b2640 1 --2- 172.21.15.29:0/982243682 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f140c2220 0x7f2f140c26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.448+0000 7f2f192b2640 1 -- 172.21.15.29:0/982243682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f14148a00 msgr2=0x7f2f140c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:01.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.448+0000 7f2f192b2640 1 --2- 172.21.15.29:0/982243682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f14148a00 0x7f2f140c3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.448+0000 7f2f192b2640 1 -- 172.21.15.29:0/982243682 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f140c1180 con 0x7f2f000047c0 2024-01-25T15:06:01.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.448+0000 7f2f19ab3640 1 --2- 172.21.15.29:0/982243682 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f140c2220 0x7f2f140c26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:06:01.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.448+0000 7f2f18ab1640 1 --2- 172.21.15.29:0/982243682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f14148a00 0x7f2f140c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:06:01.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.448+0000 7f2f192b2640 1 --2- 172.21.15.29:0/982243682 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f000047c0 0x7f2f141ed9e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c004ec0 tx=0x7f2f0c007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:01.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.448+0000 7f2f09ffb640 1 -- 172.21.15.29:0/982243682 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c00f7b0 con 0x7f2f000047c0 2024-01-25T15:06:01.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.448+0000 7f2f09ffb640 1 -- 172.21.15.29:0/982243682 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0c00f950 con 0x7f2f000047c0 2024-01-25T15:06:01.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.448+0000 7f2f1b516640 1 -- 172.21.15.29:0/982243682 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f140c1460 con 0x7f2f000047c0 2024-01-25T15:06:01.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.448+0000 7f2f09ffb640 1 -- 172.21.15.29:0/982243682 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c00fd00 con 0x7f2f000047c0 2024-01-25T15:06:01.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.448+0000 7f2f1b516640 1 -- 172.21.15.29:0/982243682 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f140c1a20 con 0x7f2f000047c0 2024-01-25T15:06:01.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.449+0000 7f2f1b516640 1 -- 172.21.15.29:0/982243682 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f140c1bb0 con 0x7f2f000047c0 2024-01-25T15:06:01.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.449+0000 7f2f09ffb640 1 -- 172.21.15.29:0/982243682 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2f0c01d460 con 0x7f2f000047c0 2024-01-25T15:06:01.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.450+0000 7f2f09ffb640 1 --2- 172.21.15.29:0/982243682 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2ef806aed0 0x7f2ef806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:01.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.450+0000 7f2f09ffb640 1 -- 172.21.15.29:0/982243682 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f2f0c089ac0 con 0x7f2f000047c0 2024-01-25T15:06:01.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.450+0000 7f2f18ab1640 1 --2- 172.21.15.29:0/982243682 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2ef806aed0 0x7f2ef806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:01.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.451+0000 7f2f18ab1640 1 --2- 172.21.15.29:0/982243682 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2ef806aed0 0x7f2ef806d390 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2f04033000 tx=0x7f2f04009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:01.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.454+0000 7f2f09ffb640 1 -- 172.21.15.29:0/982243682 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2f0c054580 con 0x7f2f000047c0 2024-01-25T15:06:01.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.669+0000 7f2f1b516640 1 -- 172.21.15.29:0/982243682 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2f14074010 con 0x7f2f000047c0 2024-01-25T15:06:01.670 INFO:tasks.ceph.mon.a.smithi029.stderr:2024-01-25T15:06:01.669+0000 7ff1677c4640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-25T15:06:01.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.670+0000 7f2f09ffb640 1 -- 172.21.15.29:0/982243682 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2f0c089e60 con 0x7f2f000047c0 2024-01-25T15:06:01.671 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-25T15:06:01.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.674+0000 7f2f1b516640 1 -- 172.21.15.29:0/982243682 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2ef806aed0 msgr2=0x7f2ef806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:01.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.674+0000 7f2f1b516640 1 --2- 172.21.15.29:0/982243682 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2ef806aed0 0x7f2ef806d390 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2f04033000 tx=0x7f2f04009030 comp rx=0 tx=0).stop 2024-01-25T15:06:01.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.674+0000 7f2f1b516640 1 -- 172.21.15.29:0/982243682 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f000047c0 msgr2=0x7f2f141ed9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:01.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.674+0000 7f2f1b516640 1 --2- 172.21.15.29:0/982243682 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f000047c0 0x7f2f141ed9e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c004ec0 tx=0x7f2f0c007430 comp rx=0 tx=0).stop 2024-01-25T15:06:01.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.675+0000 7f2f1b516640 1 -- 172.21.15.29:0/982243682 shutdown_connections 2024-01-25T15:06:01.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.675+0000 7f2f1b516640 1 --2- 172.21.15.29:0/982243682 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f140c2220 0x7f2f140c26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.675+0000 7f2f1b516640 1 --2- 172.21.15.29:0/982243682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f14148a00 0x7f2f140c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.675+0000 7f2f1b516640 1 --2- 172.21.15.29:0/982243682 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2ef806aed0 0x7f2ef806d390 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.675+0000 7f2f1b516640 1 --2- 172.21.15.29:0/982243682 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f000047c0 0x7f2f141ed9e0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.675+0000 7f2f1b516640 1 -- 172.21.15.29:0/982243682 >> 172.21.15.29:0/982243682 conn(0x7f2f140ca1f0 msgr2=0x7f2f1414f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:01.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.675+0000 7f2f1b516640 1 -- 172.21.15.29:0/982243682 shutdown_connections 2024-01-25T15:06:01.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.675+0000 7f2f1b516640 1 -- 172.21.15.29:0/982243682 wait complete. 2024-01-25T15:06:01.677 INFO:tasks.ceph.mds.c.smithi029.stderr: -2664> 2024-01-25T15:05:32.196+0000 7f760b4ea640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-25T15:06:01.687 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-25T15:06:01.704 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2024-01-25T15:06:01.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.791+0000 7f6eefab2640 1 Processor -- start 2024-01-25T15:06:01.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.791+0000 7f6eefab2640 1 -- start start 2024-01-25T15:06:01.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.792+0000 7f6eefab2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ee813ddd0 0x7f6ee8158800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:01.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.792+0000 7f6eefab2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6ee806f290 0x7f6ee80c0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:01.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.792+0000 7f6eefab2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ee806b380 0x7f6ee806a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:01.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.792+0000 7f6eefab2640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee806dcd0 con 0x7f6ee806f290 2024-01-25T15:06:01.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.792+0000 7f6eefab2640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee8158d40 con 0x7f6ee806b380 2024-01-25T15:06:01.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.792+0000 7f6eefab2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee8072350 con 0x7f6ee813ddd0 2024-01-25T15:06:01.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.792+0000 7f6eed04d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6ee806f290 0x7f6ee80c0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:01.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.792+0000 7f6eed04d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6ee806f290 0x7f6ee80c0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52436/0 (socket says 172.21.15.29:52436) 2024-01-25T15:06:01.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.792+0000 7f6eed04d640 1 -- 172.21.15.29:0/1122633138 learned_addr learned my addr 172.21.15.29:0/1122633138 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:01.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.792+0000 7f6eed84e640 1 --2- 172.21.15.29:0/1122633138 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ee813ddd0 0x7f6ee8158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:01.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.792+0000 7f6eee04f640 1 --2- 172.21.15.29:0/1122633138 >> v2:172.21.15.52:3300/0 conn(0x7f6ee806b380 0x7f6ee806a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:01.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.792+0000 7f6eed04d640 1 -- 172.21.15.29:0/1122633138 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ee813ddd0 msgr2=0x7f6ee8158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:01.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.792+0000 7f6eed04d640 1 --2- 172.21.15.29:0/1122633138 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ee813ddd0 0x7f6ee8158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.792+0000 7f6eed04d640 1 -- 172.21.15.29:0/1122633138 >> v2:172.21.15.52:3300/0 conn(0x7f6ee806b380 msgr2=0x7f6ee806a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:01.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.792+0000 7f6eed04d640 1 --2- 172.21.15.29:0/1122633138 >> v2:172.21.15.52:3300/0 conn(0x7f6ee806b380 0x7f6ee806a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.792+0000 7f6eed04d640 1 -- 172.21.15.29:0/1122633138 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee8157db0 con 0x7f6ee806f290 2024-01-25T15:06:01.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.793+0000 7f6eed04d640 1 --2- 172.21.15.29:0/1122633138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee806f290 0x7f6ee80c0430 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80c3a10 tx=0x7f6ed802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee24630b75374a3c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:01.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.793+0000 7f6eec84c640 1 -- 172.21.15.29:0/1122633138 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8031750 con 0x7f6ee806f290 2024-01-25T15:06:01.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.793+0000 7f6eec84c640 1 -- 172.21.15.29:0/1122633138 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed80318b0 con 0x7f6ee806f290 2024-01-25T15:06:01.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.793+0000 7f6eec84c640 1 -- 172.21.15.29:0/1122633138 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8031c40 con 0x7f6ee806f290 2024-01-25T15:06:01.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.794+0000 7f6eefab2640 1 -- 172.21.15.29:0/1122633138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee806f290 msgr2=0x7f6ee80c0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:01.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.794+0000 7f6eefab2640 1 --2- 172.21.15.29:0/1122633138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee806f290 0x7f6ee80c0430 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80c3a10 tx=0x7f6ed802b7f0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.794+0000 7f6eefab2640 1 -- 172.21.15.29:0/1122633138 shutdown_connections 2024-01-25T15:06:01.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.794+0000 7f6eefab2640 1 --2- 172.21.15.29:0/1122633138 >> v2:172.21.15.52:3300/0 conn(0x7f6ee806b380 0x7f6ee806a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.794+0000 7f6eefab2640 1 --2- 172.21.15.29:0/1122633138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee806f290 0x7f6ee80c0430 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.794+0000 7f6eefab2640 1 --2- 172.21.15.29:0/1122633138 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ee813ddd0 0x7f6ee8158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.794+0000 7f6eefab2640 1 -- 172.21.15.29:0/1122633138 >> 172.21.15.29:0/1122633138 conn(0x7f6ee80c3b00 msgr2=0x7f6ee80c3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:01.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.794+0000 7f6eefab2640 1 -- 172.21.15.29:0/1122633138 shutdown_connections 2024-01-25T15:06:01.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.794+0000 7f6eefab2640 1 -- 172.21.15.29:0/1122633138 wait complete. 2024-01-25T15:06:01.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.795+0000 7f6eefab2640 1 Processor -- start 2024-01-25T15:06:01.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.795+0000 7f6eefab2640 1 -- start start 2024-01-25T15:06:01.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.796+0000 7f6eefab2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ee806b380 0x7f6ee81eda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:01.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.796+0000 7f6eefab2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee813ddd0 0x7f6ee80a9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:01.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.796+0000 7f6eefab2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ee81edfd0 0x7f6ee80aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:01.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.796+0000 7f6eefab2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee8122920 con 0x7f6ee813ddd0 2024-01-25T15:06:01.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.796+0000 7f6eefab2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee81ee510 con 0x7f6ee806b380 2024-01-25T15:06:01.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.796+0000 7f6eefab2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee81371a0 con 0x7f6ee81edfd0 2024-01-25T15:06:01.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.796+0000 7f6eed04d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee813ddd0 0x7f6ee80a9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:01.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.796+0000 7f6eed04d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee813ddd0 0x7f6ee80a9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52452/0 (socket says 172.21.15.29:52452) 2024-01-25T15:06:01.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.796+0000 7f6eed04d640 1 -- 172.21.15.29:0/498091992 learned_addr learned my addr 172.21.15.29:0/498091992 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:01.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.796+0000 7f6eed84e640 1 --2- 172.21.15.29:0/498091992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ee806b380 0x7f6ee81eda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:01.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.796+0000 7f6eee04f640 1 --2- 172.21.15.29:0/498091992 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ee81edfd0 0x7f6ee80aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:01.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.796+0000 7f6eed04d640 1 -- 172.21.15.29:0/498091992 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ee81edfd0 msgr2=0x7f6ee80aa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:01.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.796+0000 7f6eed04d640 1 --2- 172.21.15.29:0/498091992 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ee81edfd0 0x7f6ee80aa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.796+0000 7f6eed04d640 1 -- 172.21.15.29:0/498091992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ee806b380 msgr2=0x7f6ee81eda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:01.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.796+0000 7f6eed04d640 1 --2- 172.21.15.29:0/498091992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ee806b380 0x7f6ee81eda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:01.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.796+0000 7f6eed04d640 1 -- 172.21.15.29:0/498091992 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed80094d0 con 0x7f6ee813ddd0 2024-01-25T15:06:01.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.796+0000 7f6eed84e640 1 --2- 172.21.15.29:0/498091992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ee806b380 0x7f6ee81eda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:01.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.796+0000 7f6eee04f640 1 --2- 172.21.15.29:0/498091992 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ee81edfd0 0x7f6ee80aa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:01.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.796+0000 7f6eed04d640 1 --2- 172.21.15.29:0/498091992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee813ddd0 0x7f6ee80a9f80 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6ed802b830 tx=0x7f6ed80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:01.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.796+0000 7f6ede7fc640 1 -- 172.21.15.29:0/498091992 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8033c80 con 0x7f6ee813ddd0 2024-01-25T15:06:01.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.797+0000 7f6ede7fc640 1 -- 172.21.15.29:0/498091992 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed8033e00 con 0x7f6ee813ddd0 2024-01-25T15:06:01.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.797+0000 7f6ede7fc640 1 -- 172.21.15.29:0/498091992 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed803c640 con 0x7f6ee813ddd0 2024-01-25T15:06:01.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.797+0000 7f6eefab2640 1 -- 172.21.15.29:0/498091992 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee80aba90 con 0x7f6ee813ddd0 2024-01-25T15:06:01.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.797+0000 7f6eefab2640 1 -- 172.21.15.29:0/498091992 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee8136e30 con 0x7f6ee813ddd0 2024-01-25T15:06:01.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.797+0000 7f6eefab2640 1 -- 172.21.15.29:0/498091992 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee81ee680 con 0x7f6ee813ddd0 2024-01-25T15:06:01.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.798+0000 7f6ede7fc640 1 -- 172.21.15.29:0/498091992 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6ed803a040 con 0x7f6ee813ddd0 2024-01-25T15:06:01.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.798+0000 7f6ede7fc640 1 --2- 172.21.15.29:0/498091992 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6ecc06af00 0x7f6ecc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:01.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.799+0000 7f6ede7fc640 1 -- 172.21.15.29:0/498091992 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6971+0+0 (secure 0 0 0) 0x7f6ed80ab6f0 con 0x7f6ee813ddd0 2024-01-25T15:06:01.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.799+0000 7f6eed84e640 1 --2- 172.21.15.29:0/498091992 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6ecc06af00 0x7f6ecc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:01.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.799+0000 7f6eed84e640 1 --2- 172.21.15.29:0/498091992 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6ecc06af00 0x7f6ecc06d3c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6ee813c6f0 tx=0x7f6ee0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:01.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:01.803+0000 7f6ede7fc640 1 -- 172.21.15.29:0/498091992 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6ed8076280 con 0x7f6ee813ddd0 2024-01-25T15:06:02.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.021+0000 7f6eefab2640 1 -- 172.21.15.29:0/498091992 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6ee8074010 con 0x7f6ee813ddd0 2024-01-25T15:06:02.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.672+0000 7f6ede7fc640 1 -- 172.21.15.29:0/498091992 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6ed80798a0 con 0x7f6ee813ddd0 2024-01-25T15:06:02.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.675+0000 7f6eefab2640 1 -- 172.21.15.29:0/498091992 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6ecc06af00 msgr2=0x7f6ecc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:02.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.675+0000 7f6eefab2640 1 --2- 172.21.15.29:0/498091992 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6ecc06af00 0x7f6ecc06d3c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6ee813c6f0 tx=0x7f6ee0008040 comp rx=0 tx=0).stop 2024-01-25T15:06:02.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.675+0000 7f6eefab2640 1 -- 172.21.15.29:0/498091992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee813ddd0 msgr2=0x7f6ee80a9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:02.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.675+0000 7f6eefab2640 1 --2- 172.21.15.29:0/498091992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee813ddd0 0x7f6ee80a9f80 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6ed802b830 tx=0x7f6ed80046c0 comp rx=0 tx=0).stop 2024-01-25T15:06:02.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.675+0000 7f6eefab2640 1 -- 172.21.15.29:0/498091992 shutdown_connections 2024-01-25T15:06:02.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.675+0000 7f6eefab2640 1 --2- 172.21.15.29:0/498091992 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6ee81edfd0 0x7f6ee80aa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:02.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.675+0000 7f6eefab2640 1 --2- 172.21.15.29:0/498091992 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f6ecc06af00 0x7f6ecc06d3c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:02.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.675+0000 7f6eefab2640 1 --2- 172.21.15.29:0/498091992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ee813ddd0 0x7f6ee80a9f80 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:02.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.675+0000 7f6eefab2640 1 --2- 172.21.15.29:0/498091992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ee806b380 0x7f6ee81eda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:02.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.675+0000 7f6eefab2640 1 -- 172.21.15.29:0/498091992 >> 172.21.15.29:0/498091992 conn(0x7f6ee80c3b00 msgr2=0x7f6ee813b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:02.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.675+0000 7f6eefab2640 1 -- 172.21.15.29:0/498091992 shutdown_connections 2024-01-25T15:06:02.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.675+0000 7f6eefab2640 1 -- 172.21.15.29:0/498091992 wait complete. 2024-01-25T15:06:02.689 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-25T15:06:02.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.843+0000 7f51f8ff8640 1 Processor -- start 2024-01-25T15:06:02.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.843+0000 7f51f8ff8640 1 -- start start 2024-01-25T15:06:02.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.844+0000 7f51f8ff8640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f4149190 0x7f51f40ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:02.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.844+0000 7f51f8ff8640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f51f4070510 0x7f51f40c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:02.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.844+0000 7f51f8ff8640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f4070d40 con 0x7f51f40c7890 2024-01-25T15:06:02.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.844+0000 7f51f8ff8640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f4155c00 con 0x7f51f4070510 2024-01-25T15:06:02.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.844+0000 7f51f8ff8640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f4155ee0 con 0x7f51f4149190 2024-01-25T15:06:02.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.845+0000 7f51f259c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f4149190 0x7f51f40ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:02.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.845+0000 7f51f1d9b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f51f4070510 0x7f51f40c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:02.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.845+0000 7f51f2d9d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f51f40c7890 0x7f51f4152590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:55808/0 (socket says 172.21.15.29:55808) 2024-01-25T15:06:02.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.845+0000 7f51f2d9d640 1 -- 172.21.15.29:0/1948903363 learned_addr learned my addr 172.21.15.29:0/1948903363 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:02.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.845+0000 7f51f259c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f4149190 0x7f51f40ad0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:46344/0 (socket says 172.21.15.29:46344) 2024-01-25T15:06:02.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.845+0000 7f51f259c640 1 -- 172.21.15.29:0/1948903363 >> v2:172.21.15.52:3300/0 conn(0x7f51f4070510 msgr2=0x7f51f40c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:02.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.845+0000 7f51f259c640 1 --2- 172.21.15.29:0/1948903363 >> v2:172.21.15.52:3300/0 conn(0x7f51f4070510 0x7f51f40c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:02.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.845+0000 7f51f259c640 1 -- 172.21.15.29:0/1948903363 >> v1:172.21.15.52:6789/0 conn(0x7f51f40c7890 legacy=0x7f51f4152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:02.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.845+0000 7f51f159a640 1 -- 172.21.15.29:0/1948903363 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3916816625 0 0) 0x7f51f4070d40 con 0x7f51f40c7890 2024-01-25T15:06:02.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.845+0000 7f51f259c640 1 -- 172.21.15.29:0/1948903363 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f41561c0 con 0x7f51f4149190 2024-01-25T15:06:02.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.846+0000 7f51f259c640 1 --2- 172.21.15.29:0/1948903363 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f4149190 0x7f51f40ad0b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0097a0 tx=0x7f51ec02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4569d243b7309fcf server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:02.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.846+0000 7f51f159a640 1 -- 172.21.15.29:0/1948903363 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec031830 con 0x7f51f4149190 2024-01-25T15:06:02.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.846+0000 7f51f159a640 1 -- 172.21.15.29:0/1948903363 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec031990 con 0x7f51f4149190 2024-01-25T15:06:02.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.846+0000 7f51f159a640 1 -- 172.21.15.29:0/1948903363 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec031d20 con 0x7f51f4149190 2024-01-25T15:06:02.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.847+0000 7f51f8ff8640 1 -- 172.21.15.29:0/1948903363 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f4149190 msgr2=0x7f51f40ad0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:02.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.847+0000 7f51f8ff8640 1 --2- 172.21.15.29:0/1948903363 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f4149190 0x7f51f40ad0b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0097a0 tx=0x7f51ec02b8d0 comp rx=0 tx=0).stop 2024-01-25T15:06:02.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.847+0000 7f51f8ff8640 1 -- 172.21.15.29:0/1948903363 shutdown_connections 2024-01-25T15:06:02.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.847+0000 7f51f8ff8640 1 --2- 172.21.15.29:0/1948903363 >> v2:172.21.15.52:3300/0 conn(0x7f51f4070510 0x7f51f40c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:02.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.847+0000 7f51f8ff8640 1 --2- 172.21.15.29:0/1948903363 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f4149190 0x7f51f40ad0b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:02.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.847+0000 7f51f8ff8640 1 -- 172.21.15.29:0/1948903363 >> 172.21.15.29:0/1948903363 conn(0x7f51f40c7f80 msgr2=0x7f51f40c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:02.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.847+0000 7f51f8ff8640 1 -- 172.21.15.29:0/1948903363 shutdown_connections 2024-01-25T15:06:02.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.847+0000 7f51f8ff8640 1 -- 172.21.15.29:0/1948903363 wait complete. 2024-01-25T15:06:02.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.848+0000 7f51f8ff8640 1 Processor -- start 2024-01-25T15:06:02.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.848+0000 7f51f8ff8640 1 -- start start 2024-01-25T15:06:02.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.849+0000 7f51f8ff8640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f4070510 0x7f51f4152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:02.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.849+0000 7f51f8ff8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51f40c7890 0x7f51f40bef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:02.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.849+0000 7f51f8ff8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f4149190 0x7f51f41eb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:02.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.849+0000 7f51f8ff8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f40be440 con 0x7f51f40c7890 2024-01-25T15:06:02.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.849+0000 7f51f8ff8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f40bdc30 con 0x7f51f4149190 2024-01-25T15:06:02.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.849+0000 7f51f8ff8640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f4152f80 con 0x7f51f4070510 2024-01-25T15:06:02.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.849+0000 7f51f1d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51f40c7890 0x7f51f40bef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:02.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.849+0000 7f51f259c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f4070510 0x7f51f4152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:02.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.849+0000 7f51f1d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51f40c7890 0x7f51f40bef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52466/0 (socket says 172.21.15.29:52466) 2024-01-25T15:06:02.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.849+0000 7f51f1d9b640 1 -- 172.21.15.29:0/4279863760 learned_addr learned my addr 172.21.15.29:0/4279863760 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:02.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.849+0000 7f51f2d9d640 1 --2- 172.21.15.29:0/4279863760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f4149190 0x7f51f41eb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:02.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.849+0000 7f51f1d9b640 1 -- 172.21.15.29:0/4279863760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f4070510 msgr2=0x7f51f4152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:02.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.849+0000 7f51f1d9b640 1 --2- 172.21.15.29:0/4279863760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f4070510 0x7f51f4152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:02.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.849+0000 7f51f1d9b640 1 -- 172.21.15.29:0/4279863760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f4149190 msgr2=0x7f51f41eb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:02.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.849+0000 7f51f1d9b640 1 --2- 172.21.15.29:0/4279863760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f4149190 0x7f51f41eb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:02.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.849+0000 7f51f1d9b640 1 -- 172.21.15.29:0/4279863760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec009400 con 0x7f51f40c7890 2024-01-25T15:06:02.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.849+0000 7f51f259c640 1 --2- 172.21.15.29:0/4279863760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f4070510 0x7f51f4152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:06:02.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.849+0000 7f51f1d9b640 1 --2- 172.21.15.29:0/4279863760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51f40c7890 0x7f51f40bef30 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00e870 tx=0x7f51dc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:02.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.850+0000 7f51eaffd640 1 -- 172.21.15.29:0/4279863760 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0094f0 con 0x7f51f40c7890 2024-01-25T15:06:02.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.850+0000 7f51eaffd640 1 -- 172.21.15.29:0/4279863760 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc00c940 con 0x7f51f40c7890 2024-01-25T15:06:02.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.850+0000 7f51eaffd640 1 -- 172.21.15.29:0/4279863760 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc00ccf0 con 0x7f51f40c7890 2024-01-25T15:06:02.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.850+0000 7f51f8ff8640 1 -- 172.21.15.29:0/4279863760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f40bde80 con 0x7f51f40c7890 2024-01-25T15:06:02.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.850+0000 7f51f8ff8640 1 -- 172.21.15.29:0/4279863760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f4152240 con 0x7f51f40c7890 2024-01-25T15:06:02.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.851+0000 7f51f8ff8640 1 -- 172.21.15.29:0/4279863760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f4152050 con 0x7f51f40c7890 2024-01-25T15:06:02.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.851+0000 7f51eaffd640 1 -- 172.21.15.29:0/4279863760 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f51dc013470 con 0x7f51f40c7890 2024-01-25T15:06:02.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.851+0000 7f51eaffd640 1 --2- 172.21.15.29:0/4279863760 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f51d406aed0 0x7f51d406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:02.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.852+0000 7f51eaffd640 1 -- 172.21.15.29:0/4279863760 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6971+0+0 (secure 0 0 0) 0x7f51dc089c60 con 0x7f51f40c7890 2024-01-25T15:06:02.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.852+0000 7f51f259c640 1 --2- 172.21.15.29:0/4279863760 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f51d406aed0 0x7f51d406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:02.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.852+0000 7f51f259c640 1 --2- 172.21.15.29:0/4279863760 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f51d406aed0 0x7f51d406d390 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f51ec036000 tx=0x7f51ec03e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:02.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:02.856+0000 7f51eaffd640 1 -- 172.21.15.29:0/4279863760 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f51dc054660 con 0x7f51f40c7890 2024-01-25T15:06:03.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.034+0000 7f51f8ff8640 1 -- 172.21.15.29:0/4279863760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f51f4074010 con 0x7f51f40c7890 2024-01-25T15:06:03.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.676+0000 7f51eaffd640 1 -- 172.21.15.29:0/4279863760 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) v1 ==== 181+0+0 (secure 0 0 0) 0x7f51dc057c80 con 0x7f51f40c7890 2024-01-25T15:06:03.677 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' removed 2024-01-25T15:06:03.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.680+0000 7f51f8ff8640 1 -- 172.21.15.29:0/4279863760 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f51d406aed0 msgr2=0x7f51d406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:03.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.680+0000 7f51f8ff8640 1 --2- 172.21.15.29:0/4279863760 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f51d406aed0 0x7f51d406d390 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f51ec036000 tx=0x7f51ec03e040 comp rx=0 tx=0).stop 2024-01-25T15:06:03.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.680+0000 7f51f8ff8640 1 -- 172.21.15.29:0/4279863760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51f40c7890 msgr2=0x7f51f40bef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:03.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.680+0000 7f51f8ff8640 1 --2- 172.21.15.29:0/4279863760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51f40c7890 0x7f51f40bef30 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00e870 tx=0x7f51dc00ed30 comp rx=0 tx=0).stop 2024-01-25T15:06:03.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.680+0000 7f51f8ff8640 1 -- 172.21.15.29:0/4279863760 shutdown_connections 2024-01-25T15:06:03.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.680+0000 7f51f8ff8640 1 --2- 172.21.15.29:0/4279863760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f4149190 0x7f51f41eb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:03.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.680+0000 7f51f8ff8640 1 --2- 172.21.15.29:0/4279863760 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f51d406aed0 0x7f51d406d390 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:03.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.680+0000 7f51f8ff8640 1 --2- 172.21.15.29:0/4279863760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51f40c7890 0x7f51f40bef30 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:03.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.680+0000 7f51f8ff8640 1 --2- 172.21.15.29:0/4279863760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f51f4070510 0x7f51f4152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:03.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.680+0000 7f51f8ff8640 1 -- 172.21.15.29:0/4279863760 >> 172.21.15.29:0/4279863760 conn(0x7f51f40c7f80 msgr2=0x7f51f4154380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:03.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.680+0000 7f51f8ff8640 1 -- 172.21.15.29:0/4279863760 shutdown_connections 2024-01-25T15:06:03.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.681+0000 7f51f8ff8640 1 -- 172.21.15.29:0/4279863760 wait complete. 2024-01-25T15:06:03.695 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-25T15:06:03.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.805+0000 7f0c707ca640 1 Processor -- start 2024-01-25T15:06:03.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.805+0000 7f0c707ca640 1 -- start start 2024-01-25T15:06:03.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.806+0000 7f0c707ca640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0c6813ddd0 0x7f0c68158800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:03.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.806+0000 7f0c707ca640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c6806b380 0x7f0c6806a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:03.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.806+0000 7f0c707ca640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c68158d40 con 0x7f0c6806f290 2024-01-25T15:06:03.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.806+0000 7f0c707ca640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c6806dcd0 con 0x7f0c6813ddd0 2024-01-25T15:06:03.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.806+0000 7f0c707ca640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c68072350 con 0x7f0c6806b380 2024-01-25T15:06:03.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.806+0000 7f0c6e566640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0c6813ddd0 0x7f0c68158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:03.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.806+0000 7f0c6e566640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0c6813ddd0 0x7f0c68158800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52482/0 (socket says 172.21.15.29:52482) 2024-01-25T15:06:03.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.806+0000 7f0c6e566640 1 -- 172.21.15.29:0/3176243940 learned_addr learned my addr 172.21.15.29:0/3176243940 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:03.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.807+0000 7f0c6ed67640 1 --2- 172.21.15.29:0/3176243940 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c6806b380 0x7f0c6806a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:03.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.807+0000 7f0c6e566640 1 -- 172.21.15.29:0/3176243940 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c6806b380 msgr2=0x7f0c6806a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:03.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.807+0000 7f0c6e566640 1 --2- 172.21.15.29:0/3176243940 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c6806b380 0x7f0c6806a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:03.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.807+0000 7f0c6e566640 1 -- 172.21.15.29:0/3176243940 >> v1:172.21.15.52:6789/0 conn(0x7f0c6806f290 legacy=0x7f0c680c0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:03.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.807+0000 7f0c6e566640 1 -- 172.21.15.29:0/3176243940 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c68157db0 con 0x7f0c6813ddd0 2024-01-25T15:06:03.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.807+0000 7f0c6ed67640 1 --2- 172.21.15.29:0/3176243940 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c6806b380 0x7f0c6806a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:06:03.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.807+0000 7f0c6e566640 1 --2- 172.21.15.29:0/3176243940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c6813ddd0 0x7f0c68158800 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009870 tx=0x7f0c6402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7262724c70f3ed30 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:03.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.808+0000 7f0c6d564640 1 -- 172.21.15.29:0/3176243940 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c64031740 con 0x7f0c6813ddd0 2024-01-25T15:06:03.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.808+0000 7f0c6d564640 1 -- 172.21.15.29:0/3176243940 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c640318a0 con 0x7f0c6813ddd0 2024-01-25T15:06:03.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.808+0000 7f0c6d564640 1 -- 172.21.15.29:0/3176243940 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c64031c30 con 0x7f0c6813ddd0 2024-01-25T15:06:03.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.808+0000 7f0c707ca640 1 -- 172.21.15.29:0/3176243940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c6813ddd0 msgr2=0x7f0c68158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:03.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.808+0000 7f0c707ca640 1 --2- 172.21.15.29:0/3176243940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c6813ddd0 0x7f0c68158800 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009870 tx=0x7f0c6402b7e0 comp rx=0 tx=0).stop 2024-01-25T15:06:03.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.808+0000 7f0c707ca640 1 -- 172.21.15.29:0/3176243940 shutdown_connections 2024-01-25T15:06:03.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.808+0000 7f0c707ca640 1 --2- 172.21.15.29:0/3176243940 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c6806b380 0x7f0c6806a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:03.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.808+0000 7f0c707ca640 1 --2- 172.21.15.29:0/3176243940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c6813ddd0 0x7f0c68158800 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:03.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.808+0000 7f0c707ca640 1 -- 172.21.15.29:0/3176243940 >> 172.21.15.29:0/3176243940 conn(0x7f0c680c3b00 msgr2=0x7f0c680c3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:03.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.808+0000 7f0c707ca640 1 -- 172.21.15.29:0/3176243940 shutdown_connections 2024-01-25T15:06:03.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.808+0000 7f0c707ca640 1 -- 172.21.15.29:0/3176243940 wait complete. 2024-01-25T15:06:03.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.809+0000 7f0c707ca640 1 Processor -- start 2024-01-25T15:06:03.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.809+0000 7f0c707ca640 1 -- start start 2024-01-25T15:06:03.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.810+0000 7f0c707ca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c6806b380 0x7f0c681363d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:03.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.810+0000 7f0c707ca640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c6813ddd0 0x7f0c681ed760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:03.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.810+0000 7f0c707ca640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c681359f0 0x7f0c68133390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:03.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.810+0000 7f0c707ca640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c681535c0 con 0x7f0c6806b380 2024-01-25T15:06:03.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.810+0000 7f0c707ca640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c68134b40 con 0x7f0c681359f0 2024-01-25T15:06:03.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.810+0000 7f0c707ca640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c68152a70 con 0x7f0c6813ddd0 2024-01-25T15:06:03.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.810+0000 7f0c6e566640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c6806b380 0x7f0c681363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:03.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.810+0000 7f0c6e566640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c6806b380 0x7f0c681363d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52488/0 (socket says 172.21.15.29:52488) 2024-01-25T15:06:03.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.810+0000 7f0c6e566640 1 -- 172.21.15.29:0/578607717 learned_addr learned my addr 172.21.15.29:0/578607717 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:03.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.810+0000 7f0c6dd65640 1 --2- 172.21.15.29:0/578607717 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c6813ddd0 0x7f0c681ed760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:03.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.810+0000 7f0c6ed67640 1 --2- 172.21.15.29:0/578607717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c681359f0 0x7f0c68133390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:03.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.810+0000 7f0c6e566640 1 -- 172.21.15.29:0/578607717 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c6813ddd0 msgr2=0x7f0c681ed760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:03.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.810+0000 7f0c6e566640 1 --2- 172.21.15.29:0/578607717 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c6813ddd0 0x7f0c681ed760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:03.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.811+0000 7f0c6e566640 1 -- 172.21.15.29:0/578607717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c681359f0 msgr2=0x7f0c68133390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:03.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.811+0000 7f0c6e566640 1 --2- 172.21.15.29:0/578607717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c681359f0 0x7f0c68133390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:03.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.811+0000 7f0c6e566640 1 -- 172.21.15.29:0/578607717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c640094d0 con 0x7f0c6806b380 2024-01-25T15:06:03.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.811+0000 7f0c6e566640 1 --2- 172.21.15.29:0/578607717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c6806b380 0x7f0c681363d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009870 tx=0x7f0c640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:03.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.811+0000 7f0c5effd640 1 -- 172.21.15.29:0/578607717 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c64033c70 con 0x7f0c6806b380 2024-01-25T15:06:03.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.811+0000 7f0c5effd640 1 -- 172.21.15.29:0/578607717 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c64033dd0 con 0x7f0c6806b380 2024-01-25T15:06:03.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.811+0000 7f0c707ca640 1 -- 172.21.15.29:0/578607717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c68134d90 con 0x7f0c6806b380 2024-01-25T15:06:03.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.811+0000 7f0c5effd640 1 -- 172.21.15.29:0/578607717 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6403c640 con 0x7f0c6806b380 2024-01-25T15:06:03.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.811+0000 7f0c707ca640 1 -- 172.21.15.29:0/578607717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c68136910 con 0x7f0c6806b380 2024-01-25T15:06:03.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.812+0000 7f0c707ca640 1 -- 172.21.15.29:0/578607717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c681ee420 con 0x7f0c6806b380 2024-01-25T15:06:03.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.812+0000 7f0c5effd640 1 -- 172.21.15.29:0/578607717 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0c6403a040 con 0x7f0c6806b380 2024-01-25T15:06:03.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.813+0000 7f0c5effd640 1 --2- 172.21.15.29:0/578607717 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0c4c06af00 0x7f0c4c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:03.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.813+0000 7f0c5effd640 1 -- 172.21.15.29:0/578607717 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6533+0+0 (secure 0 0 0) 0x7f0c640ab310 con 0x7f0c6806b380 2024-01-25T15:06:03.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.813+0000 7f0c6dd65640 1 --2- 172.21.15.29:0/578607717 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0c4c06af00 0x7f0c4c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:03.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.814+0000 7f0c6dd65640 1 --2- 172.21.15.29:0/578607717 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0c4c06af00 0x7f0c4c06d3c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0c58003d90 tx=0x7f0c58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:03.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.817+0000 7f0c5effd640 1 -- 172.21.15.29:0/578607717 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f0c64075f30 con 0x7f0c6806b380 2024-01-25T15:06:03.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:03.996+0000 7f0c707ca640 1 -- 172.21.15.29:0/578607717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0c68158d40 con 0x7f0c6806b380 2024-01-25T15:06:04.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.681+0000 7f0c5effd640 1 -- 172.21.15.29:0/578607717 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0c68158d40 con 0x7f0c6806b380 2024-01-25T15:06:04.682 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' removed 2024-01-25T15:06:04.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.686+0000 7f0c707ca640 1 -- 172.21.15.29:0/578607717 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0c4c06af00 msgr2=0x7f0c4c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:04.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.686+0000 7f0c707ca640 1 --2- 172.21.15.29:0/578607717 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0c4c06af00 0x7f0c4c06d3c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0c58003d90 tx=0x7f0c58009040 comp rx=0 tx=0).stop 2024-01-25T15:06:04.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.686+0000 7f0c707ca640 1 -- 172.21.15.29:0/578607717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c6806b380 msgr2=0x7f0c681363d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:04.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.686+0000 7f0c707ca640 1 --2- 172.21.15.29:0/578607717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c6806b380 0x7f0c681363d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009870 tx=0x7f0c640046c0 comp rx=0 tx=0).stop 2024-01-25T15:06:04.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.688+0000 7f0c707ca640 1 -- 172.21.15.29:0/578607717 shutdown_connections 2024-01-25T15:06:04.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.688+0000 7f0c707ca640 1 --2- 172.21.15.29:0/578607717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c681359f0 0x7f0c68133390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:04.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.688+0000 7f0c707ca640 1 --2- 172.21.15.29:0/578607717 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0c6813ddd0 0x7f0c681ed760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:04.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.688+0000 7f0c707ca640 1 --2- 172.21.15.29:0/578607717 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f0c4c06af00 0x7f0c4c06d3c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:04.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.688+0000 7f0c707ca640 1 --2- 172.21.15.29:0/578607717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c6806b380 0x7f0c681363d0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:04.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.688+0000 7f0c707ca640 1 -- 172.21.15.29:0/578607717 >> 172.21.15.29:0/578607717 conn(0x7f0c680c3b00 msgr2=0x7f0c6813b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:04.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.689+0000 7f0c707ca640 1 -- 172.21.15.29:0/578607717 shutdown_connections 2024-01-25T15:06:04.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.689+0000 7f0c707ca640 1 -- 172.21.15.29:0/578607717 wait complete. 2024-01-25T15:06:04.706 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:06:04.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.812+0000 7fba4db41640 1 Processor -- start 2024-01-25T15:06:04.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.812+0000 7fba4db41640 1 -- start start 2024-01-25T15:06:04.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.813+0000 7fba4db41640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fba4814eb20 0x7fba480c1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:04.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.813+0000 7fba4db41640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fba480c2140 0x7fba4815bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:04.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.813+0000 7fba4db41640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba480c2a80 con 0x7fba480c37b0 2024-01-25T15:06:04.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.813+0000 7fba4db41640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba4814ef00 con 0x7fba4814eb20 2024-01-25T15:06:04.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.813+0000 7fba4db41640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba48155720 con 0x7fba480c2140 2024-01-25T15:06:04.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.813+0000 7fba477fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fba4814eb20 0x7fba480c1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:04.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.813+0000 7fba477fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fba4814eb20 0x7fba480c1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52500/0 (socket says 172.21.15.29:52500) 2024-01-25T15:06:04.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.813+0000 7fba477fe640 1 -- 172.21.15.29:0/3048128934 learned_addr learned my addr 172.21.15.29:0/3048128934 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:04.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.813+0000 7fba47fff640 1 --2- 172.21.15.29:0/3048128934 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fba480c2140 0x7fba4815bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:04.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.813+0000 7fba477fe640 1 -- 172.21.15.29:0/3048128934 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fba480c2140 msgr2=0x7fba4815bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:04.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.813+0000 7fba477fe640 1 --2- 172.21.15.29:0/3048128934 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fba480c2140 0x7fba4815bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:04.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.813+0000 7fba477fe640 1 -- 172.21.15.29:0/3048128934 >> v1:172.21.15.52:6789/0 conn(0x7fba480c37b0 legacy=0x7fba4806d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:04.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.813+0000 7fba477fe640 1 -- 172.21.15.29:0/3048128934 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba480c2cd0 con 0x7fba4814eb20 2024-01-25T15:06:04.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.814+0000 7fba477fe640 1 --2- 172.21.15.29:0/3048128934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba4814eb20 0x7fba480c1c00 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fba38009870 tx=0x7fba3802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc533cc0a8297338 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:04.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.814+0000 7fba467fc640 1 -- 172.21.15.29:0/3048128934 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba38030840 con 0x7fba4814eb20 2024-01-25T15:06:04.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.814+0000 7fba467fc640 1 -- 172.21.15.29:0/3048128934 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba380309a0 con 0x7fba4814eb20 2024-01-25T15:06:04.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.814+0000 7fba467fc640 1 -- 172.21.15.29:0/3048128934 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba38030d30 con 0x7fba4814eb20 2024-01-25T15:06:04.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.815+0000 7fba4db41640 1 -- 172.21.15.29:0/3048128934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba4814eb20 msgr2=0x7fba480c1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:04.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.815+0000 7fba4db41640 1 --2- 172.21.15.29:0/3048128934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba4814eb20 0x7fba480c1c00 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fba38009870 tx=0x7fba3802b980 comp rx=0 tx=0).stop 2024-01-25T15:06:04.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.815+0000 7fba4db41640 1 -- 172.21.15.29:0/3048128934 shutdown_connections 2024-01-25T15:06:04.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.815+0000 7fba4db41640 1 --2- 172.21.15.29:0/3048128934 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fba480c2140 0x7fba4815bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:04.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.815+0000 7fba4db41640 1 --2- 172.21.15.29:0/3048128934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba4814eb20 0x7fba480c1c00 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:04.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.815+0000 7fba4db41640 1 -- 172.21.15.29:0/3048128934 >> 172.21.15.29:0/3048128934 conn(0x7fba480a8be0 msgr2=0x7fba4806a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:04.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.815+0000 7fba4db41640 1 -- 172.21.15.29:0/3048128934 shutdown_connections 2024-01-25T15:06:04.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.815+0000 7fba4db41640 1 -- 172.21.15.29:0/3048128934 wait complete. 2024-01-25T15:06:04.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.816+0000 7fba4db41640 1 Processor -- start 2024-01-25T15:06:04.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.816+0000 7fba4db41640 1 -- start start 2024-01-25T15:06:04.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.817+0000 7fba4db41640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba480c2140 0x7fba480c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:04.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.817+0000 7fba4db41640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba480c37b0 0x7fba481ea7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:04.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.817+0000 7fba4db41640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fba4814eb20 0x7fba4813e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:04.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.817+0000 7fba4db41640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba481ea3d0 con 0x7fba480c2140 2024-01-25T15:06:04.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.817+0000 7fba4db41640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba480bf8c0 con 0x7fba480c37b0 2024-01-25T15:06:04.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.817+0000 7fba4db41640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba481ea100 con 0x7fba4814eb20 2024-01-25T15:06:04.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.817+0000 7fba477fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba480c2140 0x7fba480c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:04.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.817+0000 7fba477fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba480c2140 0x7fba480c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52516/0 (socket says 172.21.15.29:52516) 2024-01-25T15:06:04.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.817+0000 7fba477fe640 1 -- 172.21.15.29:0/4199220949 learned_addr learned my addr 172.21.15.29:0/4199220949 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:04.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.817+0000 7fba477fe640 1 -- 172.21.15.29:0/4199220949 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fba4814eb20 msgr2=0x7fba4813e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:04.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.817+0000 7fba47fff640 1 --2- 172.21.15.29:0/4199220949 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fba4814eb20 0x7fba4813e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:04.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.817+0000 7fba477fe640 1 --2- 172.21.15.29:0/4199220949 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fba4814eb20 0x7fba4813e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:04.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.817+0000 7fba46ffd640 1 --2- 172.21.15.29:0/4199220949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba480c37b0 0x7fba481ea7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:04.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.817+0000 7fba477fe640 1 -- 172.21.15.29:0/4199220949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba480c37b0 msgr2=0x7fba481ea7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:04.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.817+0000 7fba477fe640 1 --2- 172.21.15.29:0/4199220949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba480c37b0 0x7fba481ea7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:04.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.817+0000 7fba477fe640 1 -- 172.21.15.29:0/4199220949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba380094d0 con 0x7fba480c2140 2024-01-25T15:06:04.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.818+0000 7fba477fe640 1 --2- 172.21.15.29:0/4199220949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba480c2140 0x7fba480c4920 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fba38000c00 tx=0x7fba38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:04.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.818+0000 7fba2ffff640 1 -- 172.21.15.29:0/4199220949 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba38039c90 con 0x7fba480c2140 2024-01-25T15:06:04.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.818+0000 7fba2ffff640 1 -- 172.21.15.29:0/4199220949 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba38039df0 con 0x7fba480c2140 2024-01-25T15:06:04.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.818+0000 7fba2ffff640 1 -- 172.21.15.29:0/4199220949 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba38043640 con 0x7fba480c2140 2024-01-25T15:06:04.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.818+0000 7fba4db41640 1 -- 172.21.15.29:0/4199220949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4814a050 con 0x7fba480c2140 2024-01-25T15:06:04.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.818+0000 7fba4db41640 1 -- 172.21.15.29:0/4199220949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba481ee080 con 0x7fba480c2140 2024-01-25T15:06:04.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.819+0000 7fba4db41640 1 -- 172.21.15.29:0/4199220949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba48074080 con 0x7fba480c2140 2024-01-25T15:06:04.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.819+0000 7fba2ffff640 1 -- 172.21.15.29:0/4199220949 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fba380437a0 con 0x7fba480c2140 2024-01-25T15:06:04.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.819+0000 7fba2ffff640 1 --2- 172.21.15.29:0/4199220949 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fba3406aed0 0x7fba3406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:04.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.820+0000 7fba2ffff640 1 -- 172.21.15.29:0/4199220949 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6119+0+0 (secure 0 0 0) 0x7fba3803e070 con 0x7fba480c2140 2024-01-25T15:06:04.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.820+0000 7fba46ffd640 1 --2- 172.21.15.29:0/4199220949 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fba3406aed0 0x7fba3406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:04.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.820+0000 7fba46ffd640 1 --2- 172.21.15.29:0/4199220949 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fba3406aed0 0x7fba3406d390 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fba480bfc80 tx=0x7fba3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:04.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:04.824+0000 7fba2ffff640 1 -- 172.21.15.29:0/4199220949 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fba38077550 con 0x7fba480c2140 2024-01-25T15:06:05.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.003+0000 7fba4db41640 1 -- 172.21.15.29:0/4199220949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba4806cd10 con 0x7fba480c2140 2024-01-25T15:06:05.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.004+0000 7fba2ffff640 1 -- 172.21.15.29:0/4199220949 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16872 (secure 0 0 0) 0x7fba3807ab70 con 0x7fba480c2140 2024-01-25T15:06:05.005 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:06:05.005 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":45,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:06:04.677930+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-25T15:05:40.935431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-25T15:05:41.895611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:6835/3222226893":"2024-01-26T15:06:01.670426+0000","172.21.15.29:6833/3222226893":"2024-01-26T15:06:01.670426+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:06:05.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.006+0000 7fba4db41640 1 -- 172.21.15.29:0/4199220949 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fba3406aed0 msgr2=0x7fba3406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:05.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.006+0000 7fba4db41640 1 --2- 172.21.15.29:0/4199220949 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fba3406aed0 0x7fba3406d390 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fba480bfc80 tx=0x7fba3c009040 comp rx=0 tx=0).stop 2024-01-25T15:06:05.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.006+0000 7fba4db41640 1 -- 172.21.15.29:0/4199220949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba480c2140 msgr2=0x7fba480c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:05.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.006+0000 7fba4db41640 1 --2- 172.21.15.29:0/4199220949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba480c2140 0x7fba480c4920 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fba38000c00 tx=0x7fba38004730 comp rx=0 tx=0).stop 2024-01-25T15:06:05.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.006+0000 7fba4db41640 1 -- 172.21.15.29:0/4199220949 shutdown_connections 2024-01-25T15:06:05.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.006+0000 7fba4db41640 1 --2- 172.21.15.29:0/4199220949 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fba4814eb20 0x7fba4813e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.006+0000 7fba4db41640 1 --2- 172.21.15.29:0/4199220949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba480c37b0 0x7fba481ea7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.006+0000 7fba4db41640 1 --2- 172.21.15.29:0/4199220949 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fba3406aed0 0x7fba3406d390 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.006+0000 7fba4db41640 1 --2- 172.21.15.29:0/4199220949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba480c2140 0x7fba480c4920 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.006+0000 7fba4db41640 1 -- 172.21.15.29:0/4199220949 >> 172.21.15.29:0/4199220949 conn(0x7fba480a8be0 msgr2=0x7fba4806d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:05.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.006+0000 7fba4db41640 1 -- 172.21.15.29:0/4199220949 shutdown_connections 2024-01-25T15:06:05.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.006+0000 7fba4db41640 1 -- 172.21.15.29:0/4199220949 wait complete. 2024-01-25T15:06:05.018 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T15:04:14.955791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-25T15:05:40.935431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-25T15:05:41.895611+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-25T15:06:05.018 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:06:05.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.122+0000 7f4dd6e1e640 1 Processor -- start 2024-01-25T15:06:05.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.122+0000 7f4dd6e1e640 1 -- start start 2024-01-25T15:06:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.123+0000 7f4dd6e1e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4dd00c6030 0x7f4dd0155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.123+0000 7f4dd6e1e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd0158120 con 0x7f4dd00c48d0 2024-01-25T15:06:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.123+0000 7f4dd6e1e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd00c64e0 con 0x7f4dd0151f80 2024-01-25T15:06:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.123+0000 7f4dd6e1e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd01556d0 con 0x7f4dd00c6030 2024-01-25T15:06:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.123+0000 7f4dcffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4dd00c48d0 0x7f4dd00c74f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54354/0 (socket says 172.21.15.29:54354) 2024-01-25T15:06:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.123+0000 7f4dcffff640 1 -- 172.21.15.29:0/1409102712 learned_addr learned my addr 172.21.15.29:0/1409102712 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.123+0000 7f4dd53bb640 1 --2- 172.21.15.29:0/1409102712 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4dd00c6030 0x7f4dd0155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.123+0000 7f4dcf7fe640 1 -- 172.21.15.29:0/1409102712 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813829227 0 0) 0x7f4dd0158120 con 0x7f4dd00c48d0 2024-01-25T15:06:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.123+0000 7f4dcf7fe640 1 -- 172.21.15.29:0/1409102712 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dbc003520 con 0x7f4dd00c48d0 2024-01-25T15:06:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.124+0000 7f4dcf7fe640 1 -- 172.21.15.29:0/1409102712 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2729187260 0 0) 0x7f4dbc003520 con 0x7f4dd00c48d0 2024-01-25T15:06:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.124+0000 7f4dcf7fe640 1 -- 172.21.15.29:0/1409102712 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4dd00c6030 msgr2=0x7f4dd0155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.124+0000 7f4dcf7fe640 1 --2- 172.21.15.29:0/1409102712 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4dd00c6030 0x7f4dd0155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.124+0000 7f4dcf7fe640 1 -- 172.21.15.29:0/1409102712 >> v1:172.21.15.52:6789/0 conn(0x7f4dd0151f80 legacy=0x7f4dd01585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:05.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.124+0000 7f4dcf7fe640 1 -- 172.21.15.29:0/1409102712 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd00c4db0 con 0x7f4dd00c48d0 2024-01-25T15:06:05.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.124+0000 7f4dcf7fe640 1 -- 172.21.15.29:0/1409102712 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f4dc0001670 con 0x7f4dd00c48d0 2024-01-25T15:06:05.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.124+0000 7f4dcf7fe640 1 -- 172.21.15.29:0/1409102712 >> v1:172.21.15.29:6789/0 conn(0x7f4dd00c48d0 legacy=0x7f4dd00c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:05.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.124+0000 7f4dcf7fe640 1 --2- 172.21.15.29:0/1409102712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dbc003a10 0x7f4dbc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:05.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.124+0000 7f4dcf7fe640 1 --2- 172.21.15.29:0/1409102712 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4dd00c6030 0x7f4dbc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:05.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.124+0000 7f4dcf7fe640 1 --2- 172.21.15.29:0/1409102712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dbc004d00 0x7f4dbc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:05.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.124+0000 7f4dcf7fe640 1 -- 172.21.15.29:0/1409102712 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd01556d0 con 0x7f4dbc004d00 2024-01-25T15:06:05.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.124+0000 7f4dcf7fe640 1 -- 172.21.15.29:0/1409102712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc00ba90 con 0x7f4dbc003a10 2024-01-25T15:06:05.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.124+0000 7f4dcf7fe640 1 -- 172.21.15.29:0/1409102712 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc00bc50 con 0x7f4dd00c6030 2024-01-25T15:06:05.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.124+0000 7f4dd53bb640 1 --2- 172.21.15.29:0/1409102712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dbc004d00 0x7f4dbc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:05.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.124+0000 7f4dd4bba640 1 --2- 172.21.15.29:0/1409102712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dbc003a10 0x7f4dbc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:05.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.124+0000 7f4dcffff640 1 --2- 172.21.15.29:0/1409102712 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4dd00c6030 0x7f4dbc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:05.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.124+0000 7f4dd53bb640 1 -- 172.21.15.29:0/1409102712 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4dd00c6030 msgr2=0x7f4dbc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:05.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.124+0000 7f4dd53bb640 1 --2- 172.21.15.29:0/1409102712 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4dd00c6030 0x7f4dbc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.124+0000 7f4dd53bb640 1 -- 172.21.15.29:0/1409102712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dbc003a10 msgr2=0x7f4dbc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:05.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.124+0000 7f4dd53bb640 1 --2- 172.21.15.29:0/1409102712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dbc003a10 0x7f4dbc003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.124+0000 7f4dd53bb640 1 -- 172.21.15.29:0/1409102712 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc003520 con 0x7f4dbc004d00 2024-01-25T15:06:05.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.125+0000 7f4dd53bb640 1 --2- 172.21.15.29:0/1409102712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dbc004d00 0x7f4dbc005180 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8009f90 tx=0x7f4dbc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39bb52f18bc3202 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:05.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.125+0000 7f4dcf7fe640 1 -- 172.21.15.29:0/1409102712 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc802cbd0 con 0x7f4dbc004d00 2024-01-25T15:06:05.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.125+0000 7f4dcf7fe640 1 -- 172.21.15.29:0/1409102712 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc800f040 con 0x7f4dbc004d00 2024-01-25T15:06:05.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.125+0000 7f4dcf7fe640 1 -- 172.21.15.29:0/1409102712 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8034440 con 0x7f4dbc004d00 2024-01-25T15:06:05.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.126+0000 7f4dd6e1e640 1 -- 172.21.15.29:0/1409102712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dbc004d00 msgr2=0x7f4dbc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:05.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.126+0000 7f4dd6e1e640 1 --2- 172.21.15.29:0/1409102712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dbc004d00 0x7f4dbc005180 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8009f90 tx=0x7f4dbc0057f0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.126+0000 7f4dd53bb640 1 -- 172.21.15.29:0/1409102712 reap_dead start 2024-01-25T15:06:05.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.126+0000 7f4dd6e1e640 1 -- 172.21.15.29:0/1409102712 shutdown_connections 2024-01-25T15:06:05.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.126+0000 7f4dd6e1e640 1 -- 172.21.15.29:0/1409102712 >> 172.21.15.29:0/1409102712 conn(0x7f4dd00c7f10 msgr2=0x7f4dd00c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.126+0000 7f4dd6e1e640 1 -- 172.21.15.29:0/1409102712 shutdown_connections 2024-01-25T15:06:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.126+0000 7f4dd6e1e640 1 -- 172.21.15.29:0/1409102712 wait complete. 2024-01-25T15:06:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.127+0000 7f4dd6e1e640 1 Processor -- start 2024-01-25T15:06:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.127+0000 7f4dd6e1e640 1 -- start start 2024-01-25T15:06:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.128+0000 7f4dd6e1e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dbc004d00 0x7f4dd00701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.128+0000 7f4dd6e1e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dd01525b0 0x7f4dd0149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.128+0000 7f4dd6e1e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4dd00706e0 0x7f4dd014a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.128+0000 7f4dd6e1e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd014a580 con 0x7f4dbc004d00 2024-01-25T15:06:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.128+0000 7f4dd6e1e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd009a180 con 0x7f4dd01525b0 2024-01-25T15:06:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.128+0000 7f4dd6e1e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd0099ea0 con 0x7f4dd00706e0 2024-01-25T15:06:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.128+0000 7f4dd4bba640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dbc004d00 0x7f4dd00701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.128+0000 7f4dd4bba640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dbc004d00 0x7f4dd00701a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52522/0 (socket says 172.21.15.29:52522) 2024-01-25T15:06:05.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.128+0000 7f4dd4bba640 1 -- 172.21.15.29:0/4093548831 learned_addr learned my addr 172.21.15.29:0/4093548831 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:05.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.128+0000 7f4dcffff640 1 --2- 172.21.15.29:0/4093548831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dd01525b0 0x7f4dd0149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:05.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.128+0000 7f4dd53bb640 1 --2- 172.21.15.29:0/4093548831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4dd00706e0 0x7f4dd014a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:05.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.128+0000 7f4dd4bba640 1 -- 172.21.15.29:0/4093548831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4dd00706e0 msgr2=0x7f4dd014a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:05.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.128+0000 7f4dd4bba640 1 --2- 172.21.15.29:0/4093548831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4dd00706e0 0x7f4dd014a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.128+0000 7f4dd4bba640 1 -- 172.21.15.29:0/4093548831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dd01525b0 msgr2=0x7f4dd0149b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:05.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.128+0000 7f4dd4bba640 1 --2- 172.21.15.29:0/4093548831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dd01525b0 0x7f4dd0149b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.128+0000 7f4dd4bba640 1 -- 172.21.15.29:0/4093548831 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd006e3c0 con 0x7f4dbc004d00 2024-01-25T15:06:05.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.128+0000 7f4dcffff640 1 --2- 172.21.15.29:0/4093548831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dd01525b0 0x7f4dd0149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:05.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.128+0000 7f4dd53bb640 1 --2- 172.21.15.29:0/4093548831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4dd00706e0 0x7f4dd014a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:05.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.128+0000 7f4dd4bba640 1 --2- 172.21.15.29:0/4093548831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dbc004d00 0x7f4dd00701a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4db800f820 tx=0x7f4db800fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:05.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.129+0000 7f4dcd7fa640 1 -- 172.21.15.29:0/4093548831 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db80050d0 con 0x7f4dbc004d00 2024-01-25T15:06:05.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.129+0000 7f4dcd7fa640 1 -- 172.21.15.29:0/4093548831 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db8005230 con 0x7f4dbc004d00 2024-01-25T15:06:05.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.129+0000 7f4dd6e1e640 1 -- 172.21.15.29:0/4093548831 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd006e6a0 con 0x7f4dbc004d00 2024-01-25T15:06:05.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.129+0000 7f4dcd7fa640 1 -- 172.21.15.29:0/4093548831 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db800d730 con 0x7f4dbc004d00 2024-01-25T15:06:05.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.129+0000 7f4dd6e1e640 1 -- 172.21.15.29:0/4093548831 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd00c3490 con 0x7f4dbc004d00 2024-01-25T15:06:05.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.130+0000 7f4dd6e1e640 1 -- 172.21.15.29:0/4093548831 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd004eb10 con 0x7f4dbc004d00 2024-01-25T15:06:05.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.130+0000 7f4dcd7fa640 1 -- 172.21.15.29:0/4093548831 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4db800d890 con 0x7f4dbc004d00 2024-01-25T15:06:05.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.130+0000 7f4dcd7fa640 1 --2- 172.21.15.29:0/4093548831 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4db006af00 0x7f4db006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:05.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.131+0000 7f4dcd7fa640 1 -- 172.21.15.29:0/4093548831 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f4db8089750 con 0x7f4dbc004d00 2024-01-25T15:06:05.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.131+0000 7f4dcffff640 1 --2- 172.21.15.29:0/4093548831 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4db006af00 0x7f4db006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:05.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.131+0000 7f4dcffff640 1 --2- 172.21.15.29:0/4093548831 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4db006af00 0x7f4db006d3c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00c5ce0 tx=0x7f4dc0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:05.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.135+0000 7f4dcd7fa640 1 -- 172.21.15.29:0/4093548831 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4db8054480 con 0x7f4dbc004d00 2024-01-25T15:06:05.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.312+0000 7f4dd6e1e640 1 -- 172.21.15.29:0/4093548831 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4dd0074010 con 0x7f4dbc004d00 2024-01-25T15:06:05.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.312+0000 7f4dcd7fa640 1 -- 172.21.15.29:0/4093548831 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4db8057aa0 con 0x7f4dbc004d00 2024-01-25T15:06:05.313 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-01-25T15:06:05.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.314+0000 7f4dd6e1e640 1 -- 172.21.15.29:0/4093548831 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4db006af00 msgr2=0x7f4db006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:05.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.314+0000 7f4dd6e1e640 1 --2- 172.21.15.29:0/4093548831 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4db006af00 0x7f4db006d3c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00c5ce0 tx=0x7f4dc0009040 comp rx=0 tx=0).stop 2024-01-25T15:06:05.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.314+0000 7f4dd6e1e640 1 -- 172.21.15.29:0/4093548831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dbc004d00 msgr2=0x7f4dd00701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:05.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.314+0000 7f4dd6e1e640 1 --2- 172.21.15.29:0/4093548831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dbc004d00 0x7f4dd00701a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4db800f820 tx=0x7f4db800fce0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.314+0000 7f4dd6e1e640 1 -- 172.21.15.29:0/4093548831 shutdown_connections 2024-01-25T15:06:05.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.314+0000 7f4dd6e1e640 1 --2- 172.21.15.29:0/4093548831 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4dd00706e0 0x7f4dd014a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.314+0000 7f4dd6e1e640 1 --2- 172.21.15.29:0/4093548831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dd01525b0 0x7f4dd0149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.314+0000 7f4dd6e1e640 1 --2- 172.21.15.29:0/4093548831 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4db006af00 0x7f4db006d3c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.314+0000 7f4dd6e1e640 1 --2- 172.21.15.29:0/4093548831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dbc004d00 0x7f4dd00701a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.314+0000 7f4dd6e1e640 1 -- 172.21.15.29:0/4093548831 >> 172.21.15.29:0/4093548831 conn(0x7f4dd00c7f10 msgr2=0x7f4dd006b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:05.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.314+0000 7f4dd6e1e640 1 -- 172.21.15.29:0/4093548831 shutdown_connections 2024-01-25T15:06:05.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.314+0000 7f4dd6e1e640 1 -- 172.21.15.29:0/4093548831 wait complete. 2024-01-25T15:06:05.325 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-25T15:06:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.429+0000 7fcf967f8640 1 Processor -- start 2024-01-25T15:06:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.429+0000 7fcf967f8640 1 -- start start 2024-01-25T15:06:05.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.430+0000 7fcf967f8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcf900af6c0 0x7fcf900c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:05.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.430+0000 7fcf967f8640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf900c5a70 0x7fcf9006b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:05.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.430+0000 7fcf967f8640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf900afaa0 con 0x7fcf9006d560 2024-01-25T15:06:05.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.430+0000 7fcf967f8640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9006c480 con 0x7fcf900af6c0 2024-01-25T15:06:05.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.430+0000 7fcf967f8640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf90155290 con 0x7fcf900c5a70 2024-01-25T15:06:05.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.430+0000 7fcf8ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcf900af6c0 0x7fcf900c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:05.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.430+0000 7fcf8ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcf900af6c0 0x7fcf900c5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52536/0 (socket says 172.21.15.29:52536) 2024-01-25T15:06:05.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.430+0000 7fcf8ffff640 1 -- 172.21.15.29:0/3062912167 learned_addr learned my addr 172.21.15.29:0/3062912167 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:05.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.430+0000 7fcf94d95640 1 --2- 172.21.15.29:0/3062912167 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf900c5a70 0x7fcf9006b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:05.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.431+0000 7fcf8ffff640 1 -- 172.21.15.29:0/3062912167 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf900c5a70 msgr2=0x7fcf9006b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:05.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.431+0000 7fcf8ffff640 1 --2- 172.21.15.29:0/3062912167 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf900c5a70 0x7fcf9006b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.431+0000 7fcf8ffff640 1 -- 172.21.15.29:0/3062912167 >> v1:172.21.15.52:6789/0 conn(0x7fcf9006d560 legacy=0x7fcf9006b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:05.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.431+0000 7fcf8ffff640 1 -- 172.21.15.29:0/3062912167 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf900c6060 con 0x7fcf900af6c0 2024-01-25T15:06:05.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.431+0000 7fcf94d95640 1 --2- 172.21.15.29:0/3062912167 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf900c5a70 0x7fcf9006b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:06:05.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.431+0000 7fcf8ffff640 1 --2- 172.21.15.29:0/3062912167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf900af6c0 0x7fcf900c5530 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009870 tx=0x7fcf8002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91d1c2bc7d82853 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:05.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.431+0000 7fcf8effd640 1 -- 172.21.15.29:0/3062912167 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf80031640 con 0x7fcf900af6c0 2024-01-25T15:06:05.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.432+0000 7fcf8effd640 1 -- 172.21.15.29:0/3062912167 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf800317a0 con 0x7fcf900af6c0 2024-01-25T15:06:05.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.432+0000 7fcf8effd640 1 -- 172.21.15.29:0/3062912167 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf80031b30 con 0x7fcf900af6c0 2024-01-25T15:06:05.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.432+0000 7fcf967f8640 1 -- 172.21.15.29:0/3062912167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf900af6c0 msgr2=0x7fcf900c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:05.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.432+0000 7fcf967f8640 1 --2- 172.21.15.29:0/3062912167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf900af6c0 0x7fcf900c5530 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009870 tx=0x7fcf8002b8f0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.432+0000 7fcf967f8640 1 -- 172.21.15.29:0/3062912167 shutdown_connections 2024-01-25T15:06:05.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.432+0000 7fcf967f8640 1 --2- 172.21.15.29:0/3062912167 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf900c5a70 0x7fcf9006b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.432+0000 7fcf967f8640 1 --2- 172.21.15.29:0/3062912167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf900af6c0 0x7fcf900c5530 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.432+0000 7fcf967f8640 1 -- 172.21.15.29:0/3062912167 >> 172.21.15.29:0/3062912167 conn(0x7fcf900c6ca0 msgr2=0x7fcf900c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:05.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.432+0000 7fcf967f8640 1 -- 172.21.15.29:0/3062912167 shutdown_connections 2024-01-25T15:06:05.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.432+0000 7fcf967f8640 1 -- 172.21.15.29:0/3062912167 wait complete. 2024-01-25T15:06:05.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.433+0000 7fcf967f8640 1 Processor -- start 2024-01-25T15:06:05.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.433+0000 7fcf967f8640 1 -- start start 2024-01-25T15:06:05.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.434+0000 7fcf967f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf9006d560 0x7fcf900be490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:05.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.434+0000 7fcf967f8640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf900af6c0 0x7fcf900c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:05.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.434+0000 7fcf967f8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf900c5a70 0x7fcf900c23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.434+0000 7fcf967f8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900c0450 con 0x7fcf900c5a70 2024-01-25T15:06:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.434+0000 7fcf967f8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf901e1d00 con 0x7fcf9006d560 2024-01-25T15:06:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.434+0000 7fcf967f8640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900c4550 con 0x7fcf900af6c0 2024-01-25T15:06:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.434+0000 7fcf94d95640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf900c5a70 0x7fcf900c23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.434+0000 7fcf94d95640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf900c5a70 0x7fcf900c23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52544/0 (socket says 172.21.15.29:52544) 2024-01-25T15:06:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.434+0000 7fcf94d95640 1 -- 172.21.15.29:0/3294898025 learned_addr learned my addr 172.21.15.29:0/3294898025 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.434+0000 7fcf8f7fe640 1 --2- 172.21.15.29:0/3294898025 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf900af6c0 0x7fcf900c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.434+0000 7fcf8ffff640 1 --2- 172.21.15.29:0/3294898025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf9006d560 0x7fcf900be490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.434+0000 7fcf94d95640 1 -- 172.21.15.29:0/3294898025 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf900af6c0 msgr2=0x7fcf900c3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.434+0000 7fcf94d95640 1 --2- 172.21.15.29:0/3294898025 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf900af6c0 0x7fcf900c3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.434+0000 7fcf94d95640 1 -- 172.21.15.29:0/3294898025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf9006d560 msgr2=0x7fcf900be490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.434+0000 7fcf94d95640 1 --2- 172.21.15.29:0/3294898025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf9006d560 0x7fcf900be490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.434+0000 7fcf94d95640 1 -- 172.21.15.29:0/3294898025 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf800094d0 con 0x7fcf900c5a70 2024-01-25T15:06:05.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.435+0000 7fcf94d95640 1 --2- 172.21.15.29:0/3294898025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf900c5a70 0x7fcf900c23a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fcf8800cd80 tx=0x7fcf8800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:05.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.435+0000 7fcf8cff9640 1 -- 172.21.15.29:0/3294898025 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8800f680 con 0x7fcf900c5a70 2024-01-25T15:06:05.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.435+0000 7fcf8cff9640 1 -- 172.21.15.29:0/3294898025 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8800f800 con 0x7fcf900c5a70 2024-01-25T15:06:05.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.435+0000 7fcf967f8640 1 -- 172.21.15.29:0/3294898025 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf900c1300 con 0x7fcf900c5a70 2024-01-25T15:06:05.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.435+0000 7fcf8cff9640 1 -- 172.21.15.29:0/3294898025 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8800fbb0 con 0x7fcf900c5a70 2024-01-25T15:06:05.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.435+0000 7fcf967f8640 1 -- 172.21.15.29:0/3294898025 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf900c18c0 con 0x7fcf900c5a70 2024-01-25T15:06:05.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.436+0000 7fcf967f8640 1 -- 172.21.15.29:0/3294898025 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf90153dc0 con 0x7fcf900c5a70 2024-01-25T15:06:05.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.436+0000 7fcf8cff9640 1 -- 172.21.15.29:0/3294898025 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fcf8800b040 con 0x7fcf900c5a70 2024-01-25T15:06:05.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.437+0000 7fcf8cff9640 1 --2- 172.21.15.29:0/3294898025 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcf7006aed0 0x7fcf7006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:05.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.437+0000 7fcf8cff9640 1 -- 172.21.15.29:0/3294898025 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6119+0+0 (secure 0 0 0) 0x7fcf8808a130 con 0x7fcf900c5a70 2024-01-25T15:06:05.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.437+0000 7fcf8ffff640 1 --2- 172.21.15.29:0/3294898025 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcf7006aed0 0x7fcf7006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:05.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.437+0000 7fcf8ffff640 1 --2- 172.21.15.29:0/3294898025 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcf7006aed0 0x7fcf7006d390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcf80036000 tx=0x7fcf8003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:05.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.441+0000 7fcf8cff9640 1 -- 172.21.15.29:0/3294898025 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fcf88054ef0 con 0x7fcf900c5a70 2024-01-25T15:06:05.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.618+0000 7fcf967f8640 1 -- 172.21.15.29:0/3294898025 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcf900c54b0 con 0x7fcf900c5a70 2024-01-25T15:06:05.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.618+0000 7fcf8cff9640 1 -- 172.21.15.29:0/3294898025 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v45) v1 ==== 105+0+11 (secure 0 0 0) 0x7fcf88058510 con 0x7fcf900c5a70 2024-01-25T15:06:05.619 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-01-25T15:06:05.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.620+0000 7fcf967f8640 1 -- 172.21.15.29:0/3294898025 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcf7006aed0 msgr2=0x7fcf7006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:05.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.620+0000 7fcf967f8640 1 --2- 172.21.15.29:0/3294898025 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcf7006aed0 0x7fcf7006d390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcf80036000 tx=0x7fcf8003c040 comp rx=0 tx=0).stop 2024-01-25T15:06:05.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.620+0000 7fcf967f8640 1 -- 172.21.15.29:0/3294898025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf900c5a70 msgr2=0x7fcf900c23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:05.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.620+0000 7fcf967f8640 1 --2- 172.21.15.29:0/3294898025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf900c5a70 0x7fcf900c23a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fcf8800cd80 tx=0x7fcf8800a650 comp rx=0 tx=0).stop 2024-01-25T15:06:05.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.620+0000 7fcf967f8640 1 -- 172.21.15.29:0/3294898025 shutdown_connections 2024-01-25T15:06:05.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.620+0000 7fcf967f8640 1 --2- 172.21.15.29:0/3294898025 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fcf7006aed0 0x7fcf7006d390 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.620+0000 7fcf967f8640 1 --2- 172.21.15.29:0/3294898025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf900c5a70 0x7fcf900c23a0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.620+0000 7fcf967f8640 1 --2- 172.21.15.29:0/3294898025 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcf900af6c0 0x7fcf900c3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.620+0000 7fcf967f8640 1 --2- 172.21.15.29:0/3294898025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf9006d560 0x7fcf900be490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.620+0000 7fcf967f8640 1 -- 172.21.15.29:0/3294898025 >> 172.21.15.29:0/3294898025 conn(0x7fcf900c6ca0 msgr2=0x7fcf9006b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:05.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.620+0000 7fcf967f8640 1 -- 172.21.15.29:0/3294898025 shutdown_connections 2024-01-25T15:06:05.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.620+0000 7fcf967f8640 1 -- 172.21.15.29:0/3294898025 wait complete. 2024-01-25T15:06:05.632 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-25T15:06:05.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.736+0000 7f65d73a4640 1 Processor -- start 2024-01-25T15:06:05.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.736+0000 7f65d73a4640 1 -- start start 2024-01-25T15:06:05.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.737+0000 7f65d73a4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f65d00abe10 0x7f65d00a8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:05.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.737+0000 7f65d73a4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f65d0152e90 0x7f65d015cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:05.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.737+0000 7f65d73a4640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d00a9ce0 con 0x7f65d014fbf0 2024-01-25T15:06:05.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.737+0000 7f65d73a4640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d0153400 con 0x7f65d00abe10 2024-01-25T15:06:05.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.737+0000 7f65d73a4640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d00ab050 con 0x7f65d0152e90 2024-01-25T15:06:05.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.737+0000 7f65d5140640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f65d014fbf0 0x7f65d00c1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52398/0 (socket says 172.21.15.29:52398) 2024-01-25T15:06:05.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.737+0000 7f65d493f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f65d00abe10 0x7f65d00a8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:05.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.737+0000 7f65d5140640 1 -- 172.21.15.29:0/4117272235 learned_addr learned my addr 172.21.15.29:0/4117272235 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:05.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.737+0000 7f65d5941640 1 --2- 172.21.15.29:0/4117272235 >> v2:172.21.15.52:3300/0 conn(0x7f65d0152e90 0x7f65d015cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:05.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.737+0000 7f65c7fff640 1 -- 172.21.15.29:0/4117272235 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221700 0 0) 0x7f65cc001110 con 0x7f65d014fbf0 2024-01-25T15:06:05.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.737+0000 7f65d493f640 1 -- 172.21.15.29:0/4117272235 >> v2:172.21.15.52:3300/0 conn(0x7f65d0152e90 msgr2=0x7f65d015cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:05.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.738+0000 7f65d493f640 1 --2- 172.21.15.29:0/4117272235 >> v2:172.21.15.52:3300/0 conn(0x7f65d0152e90 0x7f65d015cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.738+0000 7f65d493f640 1 -- 172.21.15.29:0/4117272235 >> v1:172.21.15.29:6789/0 conn(0x7f65d014fbf0 legacy=0x7f65d00c1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:05.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.738+0000 7f65d493f640 1 -- 172.21.15.29:0/4117272235 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d00ab330 con 0x7f65d00abe10 2024-01-25T15:06:05.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.738+0000 7f65d493f640 1 --2- 172.21.15.29:0/4117272235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d00abe10 0x7f65d00a8490 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f65d006e1c0 tx=0x7f65c002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646ab8232314d25d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:05.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.739+0000 7f65c7fff640 1 -- 172.21.15.29:0/4117272235 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c0031830 con 0x7f65d00abe10 2024-01-25T15:06:05.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.739+0000 7f65c7fff640 1 -- 172.21.15.29:0/4117272235 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c0031990 con 0x7f65d00abe10 2024-01-25T15:06:05.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.739+0000 7f65c7fff640 1 -- 172.21.15.29:0/4117272235 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c0031d20 con 0x7f65d00abe10 2024-01-25T15:06:05.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.740+0000 7f65d73a4640 1 -- 172.21.15.29:0/4117272235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d00abe10 msgr2=0x7f65d00a8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:05.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.740+0000 7f65d73a4640 1 --2- 172.21.15.29:0/4117272235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d00abe10 0x7f65d00a8490 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f65d006e1c0 tx=0x7f65c002b8d0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.740+0000 7f65d73a4640 1 -- 172.21.15.29:0/4117272235 shutdown_connections 2024-01-25T15:06:05.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.740+0000 7f65d73a4640 1 --2- 172.21.15.29:0/4117272235 >> v2:172.21.15.52:3300/0 conn(0x7f65d0152e90 0x7f65d015cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.740+0000 7f65d73a4640 1 --2- 172.21.15.29:0/4117272235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d00abe10 0x7f65d00a8490 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.740+0000 7f65d73a4640 1 -- 172.21.15.29:0/4117272235 >> 172.21.15.29:0/4117272235 conn(0x7f65d00c2a10 msgr2=0x7f65d00c2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:05.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.740+0000 7f65d73a4640 1 -- 172.21.15.29:0/4117272235 shutdown_connections 2024-01-25T15:06:05.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.740+0000 7f65d73a4640 1 -- 172.21.15.29:0/4117272235 wait complete. 2024-01-25T15:06:05.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.742+0000 7f65d73a4640 1 Processor -- start 2024-01-25T15:06:05.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.742+0000 7f65d73a4640 1 -- start start 2024-01-25T15:06:05.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.743+0000 7f65d73a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d00abe10 0x7f65d00bf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:05.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.743+0000 7f65d73a4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65d014fbf0 0x7f65d013f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:05.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.743+0000 7f65d73a4640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f65d0152e90 0x7f65d013fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:05.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.743+0000 7f65d73a4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d0151640 con 0x7f65d00abe10 2024-01-25T15:06:05.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.743+0000 7f65d73a4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d01edc10 con 0x7f65d014fbf0 2024-01-25T15:06:05.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.743+0000 7f65d73a4640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d01edef0 con 0x7f65d0152e90 2024-01-25T15:06:05.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.743+0000 7f65d5140640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d00abe10 0x7f65d00bf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:05.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.743+0000 7f65d5140640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d00abe10 0x7f65d00bf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53932/0 (socket says 172.21.15.29:53932) 2024-01-25T15:06:05.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.743+0000 7f65d5140640 1 -- 172.21.15.29:0/1389415456 learned_addr learned my addr 172.21.15.29:0/1389415456 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:05.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.743+0000 7f65d493f640 1 --2- 172.21.15.29:0/1389415456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65d014fbf0 0x7f65d013f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:05.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.743+0000 7f65d5941640 1 --2- 172.21.15.29:0/1389415456 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f65d0152e90 0x7f65d013fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:05.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.743+0000 7f65d5140640 1 -- 172.21.15.29:0/1389415456 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f65d0152e90 msgr2=0x7f65d013fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:05.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.743+0000 7f65d5140640 1 --2- 172.21.15.29:0/1389415456 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f65d0152e90 0x7f65d013fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.743+0000 7f65d5140640 1 -- 172.21.15.29:0/1389415456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65d014fbf0 msgr2=0x7f65d013f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:05.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.743+0000 7f65d5140640 1 --2- 172.21.15.29:0/1389415456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65d014fbf0 0x7f65d013f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.743+0000 7f65d5140640 1 -- 172.21.15.29:0/1389415456 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c0009400 con 0x7f65d00abe10 2024-01-25T15:06:05.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.743+0000 7f65d5941640 1 --2- 172.21.15.29:0/1389415456 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f65d0152e90 0x7f65d013fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:05.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.744+0000 7f65d5140640 1 --2- 172.21.15.29:0/1389415456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d00abe10 0x7f65d00bf5b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f65cc00c780 tx=0x7f65cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:05.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.744+0000 7f65c5ffb640 1 -- 172.21.15.29:0/1389415456 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc0072d0 con 0x7f65d00abe10 2024-01-25T15:06:05.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.744+0000 7f65c5ffb640 1 -- 172.21.15.29:0/1389415456 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65cc007450 con 0x7f65d00abe10 2024-01-25T15:06:05.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.744+0000 7f65d73a4640 1 -- 172.21.15.29:0/1389415456 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d01512d0 con 0x7f65d00abe10 2024-01-25T15:06:05.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.744+0000 7f65c5ffb640 1 -- 172.21.15.29:0/1389415456 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc0047e0 con 0x7f65d00abe10 2024-01-25T15:06:05.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.744+0000 7f65d73a4640 1 -- 172.21.15.29:0/1389415456 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d00bfaf0 con 0x7f65d00abe10 2024-01-25T15:06:05.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.745+0000 7f65d73a4640 1 -- 172.21.15.29:0/1389415456 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d0074010 con 0x7f65d00abe10 2024-01-25T15:06:05.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.745+0000 7f65c5ffb640 1 -- 172.21.15.29:0/1389415456 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f65cc004960 con 0x7f65d00abe10 2024-01-25T15:06:05.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.746+0000 7f65c5ffb640 1 --2- 172.21.15.29:0/1389415456 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f65b406aed0 0x7f65b406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:05.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.746+0000 7f65c5ffb640 1 -- 172.21.15.29:0/1389415456 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f65cc088b80 con 0x7f65d00abe10 2024-01-25T15:06:05.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.746+0000 7f65d493f640 1 --2- 172.21.15.29:0/1389415456 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f65b406aed0 0x7f65b406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:05.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.747+0000 7f65d493f640 1 --2- 172.21.15.29:0/1389415456 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f65b406aed0 0x7f65b406d390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f65c0036000 tx=0x7f65c003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:05.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.750+0000 7f65c5ffb640 1 -- 172.21.15.29:0/1389415456 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f65cc0538d0 con 0x7f65d00abe10 2024-01-25T15:06:05.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.929+0000 7f65d73a4640 1 -- 172.21.15.29:0/1389415456 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f65d00a9ce0 con 0x7f65d00abe10 2024-01-25T15:06:05.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.930+0000 7f65c5ffb640 1 -- 172.21.15.29:0/1389415456 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v45) v1 ==== 101+0+11 (secure 0 0 0) 0x7f65d00a9ce0 con 0x7f65d00abe10 2024-01-25T15:06:05.931 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-01-25T15:06:05.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.932+0000 7f65d73a4640 1 -- 172.21.15.29:0/1389415456 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f65b406aed0 msgr2=0x7f65b406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:05.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.932+0000 7f65d73a4640 1 --2- 172.21.15.29:0/1389415456 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f65b406aed0 0x7f65b406d390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f65c0036000 tx=0x7f65c003c040 comp rx=0 tx=0).stop 2024-01-25T15:06:05.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.932+0000 7f65d73a4640 1 -- 172.21.15.29:0/1389415456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d00abe10 msgr2=0x7f65d00bf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:05.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.932+0000 7f65d73a4640 1 --2- 172.21.15.29:0/1389415456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d00abe10 0x7f65d00bf5b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f65cc00c780 tx=0x7f65cc00cc40 comp rx=0 tx=0).stop 2024-01-25T15:06:05.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.932+0000 7f65d73a4640 1 -- 172.21.15.29:0/1389415456 shutdown_connections 2024-01-25T15:06:05.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.932+0000 7f65d73a4640 1 --2- 172.21.15.29:0/1389415456 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f65d0152e90 0x7f65d013fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.932+0000 7f65d73a4640 1 --2- 172.21.15.29:0/1389415456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65d014fbf0 0x7f65d013f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.932+0000 7f65d73a4640 1 --2- 172.21.15.29:0/1389415456 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f65b406aed0 0x7f65b406d390 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.932+0000 7f65d73a4640 1 --2- 172.21.15.29:0/1389415456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d00abe10 0x7f65d00bf5b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:05.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.932+0000 7f65d73a4640 1 -- 172.21.15.29:0/1389415456 >> 172.21.15.29:0/1389415456 conn(0x7f65d00c2a10 msgr2=0x7f65d00c5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:05.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.932+0000 7f65d73a4640 1 -- 172.21.15.29:0/1389415456 shutdown_connections 2024-01-25T15:06:05.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:05.932+0000 7f65d73a4640 1 -- 172.21.15.29:0/1389415456 wait complete. 2024-01-25T15:06:05.944 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:06:06.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.045+0000 7faace69b640 1 Processor -- start 2024-01-25T15:06:06.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.045+0000 7faace69b640 1 -- start start 2024-01-25T15:06:06.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.046+0000 7faace69b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faac814c690 0x7faac8152f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:06.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.046+0000 7faace69b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faac8071500 0x7faac8071990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:06.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.046+0000 7faace69b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac80c0830 con 0x7faac80a9090 2024-01-25T15:06:06.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.046+0000 7faace69b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac8070fd0 con 0x7faac8071500 2024-01-25T15:06:06.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.046+0000 7faace69b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac80c0b90 con 0x7faac814c690 2024-01-25T15:06:06.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.046+0000 7faac77fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7faac80a9090 0x7faac80aabd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52410/0 (socket says 172.21.15.29:52410) 2024-01-25T15:06:06.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.046+0000 7faac77fe640 1 -- 172.21.15.29:0/3896890974 learned_addr learned my addr 172.21.15.29:0/3896890974 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:06.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.046+0000 7faac7fff640 1 --2- 172.21.15.29:0/3896890974 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faac814c690 0x7faac8152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:06.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.046+0000 7faaccc38640 1 --2- 172.21.15.29:0/3896890974 >> v2:172.21.15.52:3300/0 conn(0x7faac8071500 0x7faac8071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:06.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.046+0000 7faac6ffd640 1 -- 172.21.15.29:0/3896890974 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524259206 0 0) 0x7faac80c0830 con 0x7faac80a9090 2024-01-25T15:06:06.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.046+0000 7faac6ffd640 1 -- 172.21.15.29:0/3896890974 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faab0003520 con 0x7faac80a9090 2024-01-25T15:06:06.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.046+0000 7faac6ffd640 1 -- 172.21.15.29:0/3896890974 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 778355974 0 0) 0x7faab0003520 con 0x7faac80a9090 2024-01-25T15:06:06.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.046+0000 7faac6ffd640 1 -- 172.21.15.29:0/3896890974 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faac814c690 msgr2=0x7faac8152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:06.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.046+0000 7faac6ffd640 1 --2- 172.21.15.29:0/3896890974 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faac814c690 0x7faac8152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.046+0000 7faac6ffd640 1 -- 172.21.15.29:0/3896890974 >> v2:172.21.15.52:3300/0 conn(0x7faac8071500 msgr2=0x7faac8071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:06.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.046+0000 7faac6ffd640 1 --2- 172.21.15.29:0/3896890974 >> v2:172.21.15.52:3300/0 conn(0x7faac8071500 0x7faac8071990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.046+0000 7faac6ffd640 1 -- 172.21.15.29:0/3896890974 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac80c0e70 con 0x7faac80a9090 2024-01-25T15:06:06.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.046+0000 7faac6ffd640 1 -- 172.21.15.29:0/3896890974 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7faab8001670 con 0x7faac80a9090 2024-01-25T15:06:06.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.046+0000 7faac6ffd640 1 -- 172.21.15.29:0/3896890974 >> v1:172.21.15.29:6789/0 conn(0x7faac80a9090 legacy=0x7faac80aabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:06.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.046+0000 7faac6ffd640 1 --2- 172.21.15.29:0/3896890974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faab0003970 0x7faab0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:06.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.047+0000 7faac6ffd640 1 --2- 172.21.15.29:0/3896890974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab00047c0 0x7faab0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:06.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.047+0000 7faac6ffd640 1 --2- 172.21.15.29:0/3896890974 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faac814c690 0x7faab0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:06.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.047+0000 7faac6ffd640 1 -- 172.21.15.29:0/3896890974 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac80c0b90 con 0x7faab0003970 2024-01-25T15:06:06.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.047+0000 7faac6ffd640 1 -- 172.21.15.29:0/3896890974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab000b980 con 0x7faab00047c0 2024-01-25T15:06:06.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.047+0000 7faac6ffd640 1 -- 172.21.15.29:0/3896890974 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab000bac0 con 0x7faac814c690 2024-01-25T15:06:06.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.047+0000 7faac7fff640 1 --2- 172.21.15.29:0/3896890974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faab0003970 0x7faab0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:06.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.047+0000 7faac77fe640 1 --2- 172.21.15.29:0/3896890974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab00047c0 0x7faab0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:06.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.047+0000 7faaccc38640 1 --2- 172.21.15.29:0/3896890974 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faac814c690 0x7faab0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:06.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.047+0000 7faac7fff640 1 -- 172.21.15.29:0/3896890974 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faac814c690 msgr2=0x7faab0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:06.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.047+0000 7faac7fff640 1 --2- 172.21.15.29:0/3896890974 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faac814c690 0x7faab0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.047+0000 7faac7fff640 1 -- 172.21.15.29:0/3896890974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab00047c0 msgr2=0x7faab0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:06.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.047+0000 7faac7fff640 1 --2- 172.21.15.29:0/3896890974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab00047c0 0x7faab0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.047+0000 7faac7fff640 1 -- 172.21.15.29:0/3896890974 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab0003520 con 0x7faab0003970 2024-01-25T15:06:06.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.047+0000 7faaccc38640 1 --2- 172.21.15.29:0/3896890974 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faac814c690 0x7faab0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:06.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.048+0000 7faac7fff640 1 --2- 172.21.15.29:0/3896890974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faab0003970 0x7faab0003d90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7faabc009ac0 tx=0x7faab00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9daf1da430f847e server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:06.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.048+0000 7faac6ffd640 1 -- 172.21.15.29:0/3896890974 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc02c6b0 con 0x7faab0003970 2024-01-25T15:06:06.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.048+0000 7faac6ffd640 1 -- 172.21.15.29:0/3896890974 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faabc02c810 con 0x7faab0003970 2024-01-25T15:06:06.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.048+0000 7faac6ffd640 1 -- 172.21.15.29:0/3896890974 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc02cba0 con 0x7faab0003970 2024-01-25T15:06:06.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.048+0000 7faace69b640 1 -- 172.21.15.29:0/3896890974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faab0003970 msgr2=0x7faab0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:06.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.048+0000 7faace69b640 1 --2- 172.21.15.29:0/3896890974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faab0003970 0x7faab0003d90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7faabc009ac0 tx=0x7faab00057f0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.048+0000 7faaccc38640 1 -- 172.21.15.29:0/3896890974 reap_dead start 2024-01-25T15:06:06.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.048+0000 7faace69b640 1 -- 172.21.15.29:0/3896890974 shutdown_connections 2024-01-25T15:06:06.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.048+0000 7faace69b640 1 -- 172.21.15.29:0/3896890974 >> 172.21.15.29:0/3896890974 conn(0x7faac80a8be0 msgr2=0x7faac806a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:06.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.048+0000 7faace69b640 1 -- 172.21.15.29:0/3896890974 shutdown_connections 2024-01-25T15:06:06.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.048+0000 7faace69b640 1 -- 172.21.15.29:0/3896890974 wait complete. 2024-01-25T15:06:06.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.049+0000 7faace69b640 1 Processor -- start 2024-01-25T15:06:06.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.050+0000 7faace69b640 1 -- start start 2024-01-25T15:06:06.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.050+0000 7faace69b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab0003970 0x7faac81541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:06.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.050+0000 7faace69b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faac81538a0 0x7faac8145920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:06.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.050+0000 7faace69b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faac814ca70 0x7faac81eacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:06.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.050+0000 7faace69b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac81e8530 con 0x7faac814ca70 2024-01-25T15:06:06.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.050+0000 7faace69b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac814e9c0 con 0x7faab0003970 2024-01-25T15:06:06.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.050+0000 7faace69b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac814eca0 con 0x7faac81538a0 2024-01-25T15:06:06.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.050+0000 7faaccc38640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faac814ca70 0x7faac81eacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:06.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.050+0000 7faaccc38640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faac814ca70 0x7faac81eacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53940/0 (socket says 172.21.15.29:53940) 2024-01-25T15:06:06.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.050+0000 7faaccc38640 1 -- 172.21.15.29:0/1934717379 learned_addr learned my addr 172.21.15.29:0/1934717379 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:06.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.051+0000 7faac77fe640 1 --2- 172.21.15.29:0/1934717379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faac81538a0 0x7faac8145920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:06.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.051+0000 7faac7fff640 1 --2- 172.21.15.29:0/1934717379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab0003970 0x7faac81541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:06.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.051+0000 7faaccc38640 1 -- 172.21.15.29:0/1934717379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faac81538a0 msgr2=0x7faac8145920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:06.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.051+0000 7faaccc38640 1 --2- 172.21.15.29:0/1934717379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faac81538a0 0x7faac8145920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.051+0000 7faaccc38640 1 -- 172.21.15.29:0/1934717379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab0003970 msgr2=0x7faac81541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:06.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.051+0000 7faaccc38640 1 --2- 172.21.15.29:0/1934717379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab0003970 0x7faac81541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.051+0000 7faaccc38640 1 -- 172.21.15.29:0/1934717379 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac814ef80 con 0x7faac814ca70 2024-01-25T15:06:06.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.051+0000 7faaccc38640 1 --2- 172.21.15.29:0/1934717379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faac814ca70 0x7faac81eacc0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7faac806e8c0 tx=0x7faac0010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:06.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.051+0000 7faac4ff9640 1 -- 172.21.15.29:0/1934717379 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac000e050 con 0x7faac814ca70 2024-01-25T15:06:06.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.051+0000 7faac4ff9640 1 -- 172.21.15.29:0/1934717379 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac000f040 con 0x7faac814ca70 2024-01-25T15:06:06.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.051+0000 7faace69b640 1 -- 172.21.15.29:0/1934717379 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac81546e0 con 0x7faac814ca70 2024-01-25T15:06:06.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.051+0000 7faac4ff9640 1 -- 172.21.15.29:0/1934717379 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac0003990 con 0x7faac814ca70 2024-01-25T15:06:06.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.051+0000 7faace69b640 1 -- 172.21.15.29:0/1934717379 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac81e8150 con 0x7faac814ca70 2024-01-25T15:06:06.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.052+0000 7faace69b640 1 -- 172.21.15.29:0/1934717379 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac814e830 con 0x7faac814ca70 2024-01-25T15:06:06.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.053+0000 7faac4ff9640 1 -- 172.21.15.29:0/1934717379 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7faac0003af0 con 0x7faac814ca70 2024-01-25T15:06:06.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.053+0000 7faac4ff9640 1 --2- 172.21.15.29:0/1934717379 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faab406af00 0x7faab406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:06.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.053+0000 7faac4ff9640 1 -- 172.21.15.29:0/1934717379 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6119+0+0 (secure 0 0 0) 0x7faac0089b70 con 0x7faac814ca70 2024-01-25T15:06:06.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.053+0000 7faac7fff640 1 --2- 172.21.15.29:0/1934717379 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faab406af00 0x7faab406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:06.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.054+0000 7faac7fff640 1 --2- 172.21.15.29:0/1934717379 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faab406af00 0x7faab406d3c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7faabc036000 tx=0x7faabc030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:06.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.057+0000 7faac4ff9640 1 -- 172.21.15.29:0/1934717379 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7faac0054930 con 0x7faac814ca70 2024-01-25T15:06:06.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.274+0000 7faace69b640 1 -- 172.21.15.29:0/1934717379 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faac8074080 con 0x7faac814ca70 2024-01-25T15:06:06.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.274+0000 7faac4ff9640 1 -- 172.21.15.29:0/1934717379 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4940 (secure 0 0 0) 0x7faac0057f50 con 0x7faac814ca70 2024-01-25T15:06:06.275 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:06:06.275 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/3901576943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6835","nonce":3901576943},{"type":"v1","addr":"172.21.15.52:6837","nonce":3901576943}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6836/1878395580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1878395580},{"type":"v1","addr":"172.21.15.52:6836","nonce":1878395580}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5841,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1669682360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1669682360},{"type":"v1","addr":"172.21.15.29:6835","nonce":1669682360}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:05:42.928937+0000","modified":"2024-01-25T15:05:44.918053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.29:6834/1607449141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1607449141},{"type":"v1","addr":"172.21.15.29:6834","nonce":1607449141}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-25T15:06:06.275 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 22 2024-01-25T15:06:06.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.276+0000 7faace69b640 1 -- 172.21.15.29:0/1934717379 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faab406af00 msgr2=0x7faab406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:06.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.276+0000 7faace69b640 1 --2- 172.21.15.29:0/1934717379 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faab406af00 0x7faab406d3c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7faabc036000 tx=0x7faabc030000 comp rx=0 tx=0).stop 2024-01-25T15:06:06.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.276+0000 7faace69b640 1 -- 172.21.15.29:0/1934717379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faac814ca70 msgr2=0x7faac81eacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:06.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.276+0000 7faace69b640 1 --2- 172.21.15.29:0/1934717379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faac814ca70 0x7faac81eacc0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7faac806e8c0 tx=0x7faac0010590 comp rx=0 tx=0).stop 2024-01-25T15:06:06.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.276+0000 7faace69b640 1 -- 172.21.15.29:0/1934717379 shutdown_connections 2024-01-25T15:06:06.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.276+0000 7faace69b640 1 --2- 172.21.15.29:0/1934717379 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7faab406af00 0x7faab406d3c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.276+0000 7faace69b640 1 --2- 172.21.15.29:0/1934717379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faac814ca70 0x7faac81eacc0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.276+0000 7faace69b640 1 --2- 172.21.15.29:0/1934717379 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7faac81538a0 0x7faac8145920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.276+0000 7faace69b640 1 --2- 172.21.15.29:0/1934717379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab0003970 0x7faac81541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.276+0000 7faace69b640 1 -- 172.21.15.29:0/1934717379 >> 172.21.15.29:0/1934717379 conn(0x7faac80a8be0 msgr2=0x7faac806a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:06.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.276+0000 7faace69b640 1 -- 172.21.15.29:0/1934717379 shutdown_connections 2024-01-25T15:06:06.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.276+0000 7faace69b640 1 -- 172.21.15.29:0/1934717379 wait complete. 2024-01-25T15:06:06.288 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:06:06.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.389+0000 7fa96e8ad640 1 Processor -- start 2024-01-25T15:06:06.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.389+0000 7fa96e8ad640 1 -- start start 2024-01-25T15:06:06.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.389+0000 7fa96e8ad640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa9681520b0 0x7fa968155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:06.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.389+0000 7fa96e8ad640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa9680c4f00 0x7fa9680c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:06.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.389+0000 7fa96e8ad640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9680c66c0 con 0x7fa9680c55e0 2024-01-25T15:06:06.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.389+0000 7fa96e8ad640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa96806cfc0 con 0x7fa9681520b0 2024-01-25T15:06:06.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.389+0000 7fa96e8ad640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa968152490 con 0x7fa9680c4f00 2024-01-25T15:06:06.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.390+0000 7fa96ce4a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa9680c4f00 0x7fa9680c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:06.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.390+0000 7fa967fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa9681520b0 0x7fa968155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:06.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.390+0000 7fa96ce4a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa9680c4f00 0x7fa9680c5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:51242/0 (socket says 172.21.15.29:51242) 2024-01-25T15:06:06.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.390+0000 7fa967fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa9681520b0 0x7fa968155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:49694/0 (socket says 172.21.15.29:49694) 2024-01-25T15:06:06.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.390+0000 7fa96ce4a640 1 -- 172.21.15.29:0/2379116793 learned_addr learned my addr 172.21.15.29:0/2379116793 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:06.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.390+0000 7fa9677fe640 1 --1- 172.21.15.29:0/2379116793 >> v1:172.21.15.52:6789/0 conn(0x7fa9680c55e0 0x7fa9680c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:58462/0 (socket says 172.21.15.29:58462) 2024-01-25T15:06:06.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.390+0000 7fa96ce4a640 1 -- 172.21.15.29:0/2379116793 >> v2:172.21.15.52:3300/0 conn(0x7fa9681520b0 msgr2=0x7fa968155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:06.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.390+0000 7fa96ce4a640 1 --2- 172.21.15.29:0/2379116793 >> v2:172.21.15.52:3300/0 conn(0x7fa9681520b0 0x7fa968155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.390+0000 7fa96ce4a640 1 -- 172.21.15.29:0/2379116793 >> v1:172.21.15.52:6789/0 conn(0x7fa9680c55e0 legacy=0x7fa9680c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:06.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.390+0000 7fa96ce4a640 1 -- 172.21.15.29:0/2379116793 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9680c8830 con 0x7fa9680c4f00 2024-01-25T15:06:06.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.391+0000 7fa96ce4a640 1 --2- 172.21.15.29:0/2379116793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa9680c4f00 0x7fa9680c5b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa960009e50 tx=0x7fa96002bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19cdb22f37a42c5a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:06.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.391+0000 7fa966ffd640 1 -- 172.21.15.29:0/2379116793 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96002ca70 con 0x7fa9680c4f00 2024-01-25T15:06:06.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.391+0000 7fa966ffd640 1 -- 172.21.15.29:0/2379116793 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96002cbd0 con 0x7fa9680c4f00 2024-01-25T15:06:06.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.391+0000 7fa966ffd640 1 -- 172.21.15.29:0/2379116793 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9600343f0 con 0x7fa9680c4f00 2024-01-25T15:06:06.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.391+0000 7fa96e8ad640 1 -- 172.21.15.29:0/2379116793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa9680c4f00 msgr2=0x7fa9680c5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:06.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.391+0000 7fa96e8ad640 1 --2- 172.21.15.29:0/2379116793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa9680c4f00 0x7fa9680c5b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa960009e50 tx=0x7fa96002bed0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.391+0000 7fa96e8ad640 1 -- 172.21.15.29:0/2379116793 shutdown_connections 2024-01-25T15:06:06.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.391+0000 7fa96e8ad640 1 --2- 172.21.15.29:0/2379116793 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa9680c4f00 0x7fa9680c5b30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.391+0000 7fa96e8ad640 1 --2- 172.21.15.29:0/2379116793 >> v2:172.21.15.52:3300/0 conn(0x7fa9681520b0 0x7fa968155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.391+0000 7fa96e8ad640 1 -- 172.21.15.29:0/2379116793 >> 172.21.15.29:0/2379116793 conn(0x7fa9680ca220 msgr2=0x7fa9680ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:06.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.392+0000 7fa96e8ad640 1 -- 172.21.15.29:0/2379116793 shutdown_connections 2024-01-25T15:06:06.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.392+0000 7fa96e8ad640 1 -- 172.21.15.29:0/2379116793 wait complete. 2024-01-25T15:06:06.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.393+0000 7fa96e8ad640 1 Processor -- start 2024-01-25T15:06:06.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.393+0000 7fa96e8ad640 1 -- start start 2024-01-25T15:06:06.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.393+0000 7fa96e8ad640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9680c4f00 0x7fa9681edeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:06.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.393+0000 7fa96e8ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9681520b0 0x7fa96814a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:06.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.393+0000 7fa96e8ad640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa9681eb3a0 0x7fa96814c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:06.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.393+0000 7fa96e8ad640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96814d950 con 0x7fa9680c4f00 2024-01-25T15:06:06.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.393+0000 7fa96e8ad640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96814c120 con 0x7fa9681520b0 2024-01-25T15:06:06.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.393+0000 7fa96e8ad640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96814c3e0 con 0x7fa9681eb3a0 2024-01-25T15:06:06.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.394+0000 7fa967fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9680c4f00 0x7fa9681edeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:06.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.394+0000 7fa967fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9680c4f00 0x7fa9681edeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53952/0 (socket says 172.21.15.29:53952) 2024-01-25T15:06:06.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.394+0000 7fa967fff640 1 -- 172.21.15.29:0/2116727121 learned_addr learned my addr 172.21.15.29:0/2116727121 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:06.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.394+0000 7fa96ce4a640 1 --2- 172.21.15.29:0/2116727121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa9681eb3a0 0x7fa96814c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:06.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.394+0000 7fa9677fe640 1 --2- 172.21.15.29:0/2116727121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9681520b0 0x7fa96814a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:06.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.394+0000 7fa967fff640 1 -- 172.21.15.29:0/2116727121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa9681eb3a0 msgr2=0x7fa96814c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:06.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.394+0000 7fa967fff640 1 --2- 172.21.15.29:0/2116727121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa9681eb3a0 0x7fa96814c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.394+0000 7fa967fff640 1 -- 172.21.15.29:0/2116727121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9681520b0 msgr2=0x7fa96814a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:06.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.394+0000 7fa967fff640 1 --2- 172.21.15.29:0/2116727121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9681520b0 0x7fa96814a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.394+0000 7fa967fff640 1 -- 172.21.15.29:0/2116727121 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa960009b30 con 0x7fa9680c4f00 2024-01-25T15:06:06.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.394+0000 7fa9677fe640 1 --2- 172.21.15.29:0/2116727121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9681520b0 0x7fa96814a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:06.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.394+0000 7fa967fff640 1 --2- 172.21.15.29:0/2116727121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9680c4f00 0x7fa9681edeb0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa95000e870 tx=0x7fa95000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:06.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.394+0000 7fa964ff9640 1 -- 172.21.15.29:0/2116727121 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9500094f0 con 0x7fa9680c4f00 2024-01-25T15:06:06.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.394+0000 7fa964ff9640 1 -- 172.21.15.29:0/2116727121 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95000c8e0 con 0x7fa9680c4f00 2024-01-25T15:06:06.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.394+0000 7fa96e8ad640 1 -- 172.21.15.29:0/2116727121 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9681ee3f0 con 0x7fa9680c4f00 2024-01-25T15:06:06.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.394+0000 7fa964ff9640 1 -- 172.21.15.29:0/2116727121 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95000cc90 con 0x7fa9680c4f00 2024-01-25T15:06:06.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.394+0000 7fa96e8ad640 1 -- 172.21.15.29:0/2116727121 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa96814db60 con 0x7fa9680c4f00 2024-01-25T15:06:06.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.395+0000 7fa96e8ad640 1 -- 172.21.15.29:0/2116727121 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa968074080 con 0x7fa9680c4f00 2024-01-25T15:06:06.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.396+0000 7fa964ff9640 1 -- 172.21.15.29:0/2116727121 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fa950013470 con 0x7fa9680c4f00 2024-01-25T15:06:06.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.396+0000 7fa964ff9640 1 --2- 172.21.15.29:0/2116727121 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa94806af00 0x7fa94806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:06.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.396+0000 7fa964ff9640 1 -- 172.21.15.29:0/2116727121 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6119+0+0 (secure 0 0 0) 0x7fa950089a90 con 0x7fa9680c4f00 2024-01-25T15:06:06.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.396+0000 7fa9677fe640 1 --2- 172.21.15.29:0/2116727121 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa94806af00 0x7fa94806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:06.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.397+0000 7fa9677fe640 1 --2- 172.21.15.29:0/2116727121 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa94806af00 0x7fa94806d3c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa958007fd0 tx=0x7fa958007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:06.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.401+0000 7fa964ff9640 1 -- 172.21.15.29:0/2116727121 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fa950054900 con 0x7fa9680c4f00 2024-01-25T15:06:06.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.580+0000 7fa96e8ad640 1 -- 172.21.15.29:0/2116727121 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9680c4ce0 con 0x7fa9680c4f00 2024-01-25T15:06:06.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.581+0000 7fa964ff9640 1 -- 172.21.15.29:0/2116727121 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16872 (secure 0 0 0) 0x7fa950017090 con 0x7fa9680c4f00 2024-01-25T15:06:06.585 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:06:06.585 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":45,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:06:04.677930+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-25T15:05:40.935431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-25T15:05:41.895611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:6835/3222226893":"2024-01-26T15:06:01.670426+0000","172.21.15.29:6833/3222226893":"2024-01-26T15:06:01.670426+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:06:06.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.583+0000 7fa96e8ad640 1 -- 172.21.15.29:0/2116727121 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa94806af00 msgr2=0x7fa94806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:06.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.583+0000 7fa96e8ad640 1 --2- 172.21.15.29:0/2116727121 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa94806af00 0x7fa94806d3c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa958007fd0 tx=0x7fa958007d60 comp rx=0 tx=0).stop 2024-01-25T15:06:06.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.583+0000 7fa96e8ad640 1 -- 172.21.15.29:0/2116727121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9680c4f00 msgr2=0x7fa9681edeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:06.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.583+0000 7fa96e8ad640 1 --2- 172.21.15.29:0/2116727121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9680c4f00 0x7fa9681edeb0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa95000e870 tx=0x7fa95000ed30 comp rx=0 tx=0).stop 2024-01-25T15:06:06.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.583+0000 7fa96e8ad640 1 -- 172.21.15.29:0/2116727121 shutdown_connections 2024-01-25T15:06:06.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.583+0000 7fa96e8ad640 1 --2- 172.21.15.29:0/2116727121 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa9681eb3a0 0x7fa96814c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.583+0000 7fa96e8ad640 1 --2- 172.21.15.29:0/2116727121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9681520b0 0x7fa96814a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.583+0000 7fa96e8ad640 1 --2- 172.21.15.29:0/2116727121 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa94806af00 0x7fa94806d3c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.583+0000 7fa96e8ad640 1 --2- 172.21.15.29:0/2116727121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9680c4f00 0x7fa9681edeb0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.583+0000 7fa96e8ad640 1 -- 172.21.15.29:0/2116727121 >> 172.21.15.29:0/2116727121 conn(0x7fa9680ca220 msgr2=0x7fa9680ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:06.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.583+0000 7fa96e8ad640 1 -- 172.21.15.29:0/2116727121 shutdown_connections 2024-01-25T15:06:06.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.583+0000 7fa96e8ad640 1 -- 172.21.15.29:0/2116727121 wait complete. 2024-01-25T15:06:06.595 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2024-01-25T15:06:06.595 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:06:06.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.696+0000 7f7bc8503640 1 Processor -- start 2024-01-25T15:06:06.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.696+0000 7f7bc8503640 1 -- start start 2024-01-25T15:06:06.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.697+0000 7f7bc8503640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7bc006cc80 0x7f7bc0155140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:06.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.697+0000 7f7bc8503640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7bc00c4620 0x7f7bc00c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:06.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.697+0000 7f7bc8503640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc00c2750 con 0x7f7bc00c29f0 2024-01-25T15:06:06.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.697+0000 7f7bc8503640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc00c1f40 con 0x7f7bc00c4620 2024-01-25T15:06:06.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.697+0000 7f7bc8503640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc00c6120 con 0x7f7bc006cc80 2024-01-25T15:06:06.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.697+0000 7f7bc6aa0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7bc00c4620 0x7f7bc00c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:06.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.697+0000 7f7bc5a9e640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7bc00c29f0 0x7f7bc00c82d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52422/0 (socket says 172.21.15.29:52422) 2024-01-25T15:06:06.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.697+0000 7f7bc5a9e640 1 -- 172.21.15.29:0/1453213629 learned_addr learned my addr 172.21.15.29:0/1453213629 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:06.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.697+0000 7f7bc6aa0640 1 -- 172.21.15.29:0/1453213629 >> v2:172.21.15.52:3300/0 conn(0x7f7bc006cc80 msgr2=0x7f7bc0155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:06.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.697+0000 7f7bc6aa0640 1 --2- 172.21.15.29:0/1453213629 >> v2:172.21.15.52:3300/0 conn(0x7f7bc006cc80 0x7f7bc0155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.697+0000 7f7bc6aa0640 1 -- 172.21.15.29:0/1453213629 >> v1:172.21.15.29:6789/0 conn(0x7f7bc00c29f0 legacy=0x7f7bc00c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:06.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.697+0000 7f7bc529d640 1 -- 172.21.15.29:0/1453213629 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628779293 0 0) 0x7f7bb4001110 con 0x7f7bc00c29f0 2024-01-25T15:06:06.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.697+0000 7f7bc6aa0640 1 -- 172.21.15.29:0/1453213629 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc006d790 con 0x7f7bc00c4620 2024-01-25T15:06:06.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.698+0000 7f7bc6aa0640 1 --2- 172.21.15.29:0/1453213629 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bc00c4620 0x7f7bc00c4a90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f7bb80097a0 tx=0x7f7bb802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846e9fb363b51620 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:06.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.698+0000 7f7bc529d640 1 -- 172.21.15.29:0/1453213629 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb802e070 con 0x7f7bc00c4620 2024-01-25T15:06:06.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.698+0000 7f7bc529d640 1 -- 172.21.15.29:0/1453213629 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb80315a0 con 0x7f7bc00c4620 2024-01-25T15:06:06.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.698+0000 7f7bc529d640 1 -- 172.21.15.29:0/1453213629 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8031930 con 0x7f7bc00c4620 2024-01-25T15:06:06.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.699+0000 7f7bc8503640 1 -- 172.21.15.29:0/1453213629 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bc00c4620 msgr2=0x7f7bc00c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:06.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.699+0000 7f7bc8503640 1 --2- 172.21.15.29:0/1453213629 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bc00c4620 0x7f7bc00c4a90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f7bb80097a0 tx=0x7f7bb802b840 comp rx=0 tx=0).stop 2024-01-25T15:06:06.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.699+0000 7f7bc8503640 1 -- 172.21.15.29:0/1453213629 shutdown_connections 2024-01-25T15:06:06.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.699+0000 7f7bc8503640 1 --2- 172.21.15.29:0/1453213629 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bc00c4620 0x7f7bc00c4a90 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.699+0000 7f7bc8503640 1 --2- 172.21.15.29:0/1453213629 >> v2:172.21.15.52:3300/0 conn(0x7f7bc006cc80 0x7f7bc0155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.699+0000 7f7bc8503640 1 -- 172.21.15.29:0/1453213629 >> 172.21.15.29:0/1453213629 conn(0x7f7bc006a8a0 msgr2=0x7f7bc006acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:06.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.699+0000 7f7bc8503640 1 -- 172.21.15.29:0/1453213629 shutdown_connections 2024-01-25T15:06:06.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.699+0000 7f7bc8503640 1 -- 172.21.15.29:0/1453213629 wait complete. 2024-01-25T15:06:06.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.700+0000 7f7bc8503640 1 Processor -- start 2024-01-25T15:06:06.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.700+0000 7f7bc8503640 1 -- start start 2024-01-25T15:06:06.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.701+0000 7f7bc8503640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7bc006cc80 0x7f7bc01ed150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:06.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.701+0000 7f7bc8503640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bc00c29f0 0x7f7bc01eae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:06.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.701+0000 7f7bc8503640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7bc00c4620 0x7f7bc006e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:06.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.701+0000 7f7bc8503640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc01e1810 con 0x7f7bc00c29f0 2024-01-25T15:06:06.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.701+0000 7f7bc8503640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc01e12e0 con 0x7f7bc006cc80 2024-01-25T15:06:06.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.701+0000 7f7bc8503640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc01e1530 con 0x7f7bc00c4620 2024-01-25T15:06:06.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.701+0000 7f7bc5a9e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bc00c29f0 0x7f7bc01eae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:06.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.701+0000 7f7bc5a9e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bc00c29f0 0x7f7bc01eae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53972/0 (socket says 172.21.15.29:53972) 2024-01-25T15:06:06.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.701+0000 7f7bc5a9e640 1 -- 172.21.15.29:0/3298297148 learned_addr learned my addr 172.21.15.29:0/3298297148 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:06.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.701+0000 7f7bc5a9e640 1 -- 172.21.15.29:0/3298297148 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7bc00c4620 msgr2=0x7f7bc006e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:06.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.701+0000 7f7bc5a9e640 1 --2- 172.21.15.29:0/3298297148 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7bc00c4620 0x7f7bc006e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.701+0000 7f7bc5a9e640 1 -- 172.21.15.29:0/3298297148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7bc006cc80 msgr2=0x7f7bc01ed150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:06.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.701+0000 7f7bc5a9e640 1 --2- 172.21.15.29:0/3298297148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7bc006cc80 0x7f7bc01ed150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.701+0000 7f7bc5a9e640 1 -- 172.21.15.29:0/3298297148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb8009400 con 0x7f7bc00c29f0 2024-01-25T15:06:06.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.701+0000 7f7bc5a9e640 1 --2- 172.21.15.29:0/3298297148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bc00c29f0 0x7f7bc01eae50 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400c780 tx=0x7f7bb400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:06.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.701+0000 7f7bbeffd640 1 -- 172.21.15.29:0/3298297148 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb40072d0 con 0x7f7bc00c29f0 2024-01-25T15:06:06.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.701+0000 7f7bbeffd640 1 -- 172.21.15.29:0/3298297148 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb4007450 con 0x7f7bc00c29f0 2024-01-25T15:06:06.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.701+0000 7f7bc8503640 1 -- 172.21.15.29:0/3298297148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc01eda90 con 0x7f7bc00c29f0 2024-01-25T15:06:06.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.702+0000 7f7bbeffd640 1 -- 172.21.15.29:0/3298297148 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb40047e0 con 0x7f7bc00c29f0 2024-01-25T15:06:06.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.702+0000 7f7bc8503640 1 -- 172.21.15.29:0/3298297148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc00c6bc0 con 0x7f7bc00c29f0 2024-01-25T15:06:06.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.702+0000 7f7bc8503640 1 -- 172.21.15.29:0/3298297148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc0074080 con 0x7f7bc00c29f0 2024-01-25T15:06:06.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.703+0000 7f7bbeffd640 1 -- 172.21.15.29:0/3298297148 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7bb4004960 con 0x7f7bc00c29f0 2024-01-25T15:06:06.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.703+0000 7f7bbeffd640 1 --2- 172.21.15.29:0/3298297148 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7bac06aed0 0x7f7bac06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:06.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.703+0000 7f7bbeffd640 1 -- 172.21.15.29:0/3298297148 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f7bb4088b00 con 0x7f7bc00c29f0 2024-01-25T15:06:06.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.704+0000 7f7bc629f640 1 --2- 172.21.15.29:0/3298297148 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7bac06aed0 0x7f7bac06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:06.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.704+0000 7f7bc629f640 1 --2- 172.21.15.29:0/3298297148 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7bac06aed0 0x7f7bac06d390 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7bc014ea70 tx=0x7f7bb0009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:06.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.708+0000 7f7bbeffd640 1 -- 172.21.15.29:0/3298297148 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7bb40538c0 con 0x7f7bc00c29f0 2024-01-25T15:06:06.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.930+0000 7f7bc8503640 1 -- 172.21.15.29:0/3298297148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7bc00c2750 con 0x7f7bc00c29f0 2024-01-25T15:06:06.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.930+0000 7f7bbeffd640 1 -- 172.21.15.29:0/3298297148 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4940 (secure 0 0 0) 0x7f7bc00c2750 con 0x7f7bc00c29f0 2024-01-25T15:06:06.931 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:06:06.931 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/3901576943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6835","nonce":3901576943},{"type":"v1","addr":"172.21.15.52:6837","nonce":3901576943}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6836/1878395580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1878395580},{"type":"v1","addr":"172.21.15.52:6836","nonce":1878395580}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5841,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1669682360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1669682360},{"type":"v1","addr":"172.21.15.29:6835","nonce":1669682360}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:05:42.928937+0000","modified":"2024-01-25T15:05:44.918053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.29:6834/1607449141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1607449141},{"type":"v1","addr":"172.21.15.29:6834","nonce":1607449141}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-25T15:06:06.932 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 22 2024-01-25T15:06:06.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.933+0000 7f7bc8503640 1 -- 172.21.15.29:0/3298297148 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7bac06aed0 msgr2=0x7f7bac06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:06.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.933+0000 7f7bc8503640 1 --2- 172.21.15.29:0/3298297148 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7bac06aed0 0x7f7bac06d390 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7bc014ea70 tx=0x7f7bb0009250 comp rx=0 tx=0).stop 2024-01-25T15:06:06.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.933+0000 7f7bc8503640 1 -- 172.21.15.29:0/3298297148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bc00c29f0 msgr2=0x7f7bc01eae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:06.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.933+0000 7f7bc8503640 1 --2- 172.21.15.29:0/3298297148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bc00c29f0 0x7f7bc01eae50 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400c780 tx=0x7f7bb400cc40 comp rx=0 tx=0).stop 2024-01-25T15:06:06.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.933+0000 7f7bc8503640 1 -- 172.21.15.29:0/3298297148 shutdown_connections 2024-01-25T15:06:06.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.933+0000 7f7bc8503640 1 --2- 172.21.15.29:0/3298297148 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7bc00c4620 0x7f7bc006e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.933+0000 7f7bc8503640 1 --2- 172.21.15.29:0/3298297148 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f7bac06aed0 0x7f7bac06d390 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.933+0000 7f7bc8503640 1 --2- 172.21.15.29:0/3298297148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bc00c29f0 0x7f7bc01eae50 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.933+0000 7f7bc8503640 1 --2- 172.21.15.29:0/3298297148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7bc006cc80 0x7f7bc01ed150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:06.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.933+0000 7f7bc8503640 1 -- 172.21.15.29:0/3298297148 >> 172.21.15.29:0/3298297148 conn(0x7f7bc006a8a0 msgr2=0x7f7bc00c52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:06.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.933+0000 7f7bc8503640 1 -- 172.21.15.29:0/3298297148 shutdown_connections 2024-01-25T15:06:06.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:06.933+0000 7f7bc8503640 1 -- 172.21.15.29:0/3298297148 wait complete. 2024-01-25T15:06:06.944 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:06:07.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.045+0000 7f3e8fc9b640 1 Processor -- start 2024-01-25T15:06:07.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.045+0000 7f3e8fc9b640 1 -- start start 2024-01-25T15:06:07.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.046+0000 7f3e8fc9b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e88151d60 0x7f3e88155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:07.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.046+0000 7f3e8fc9b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e88155010 0x7f3e880ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:07.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.046+0000 7f3e8fc9b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e88152140 con 0x7f3e880ad030 2024-01-25T15:06:07.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.046+0000 7f3e8fc9b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e880c9ae0 con 0x7f3e88155010 2024-01-25T15:06:07.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.046+0000 7f3e8fc9b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e880c9520 con 0x7f3e88151d60 2024-01-25T15:06:07.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.047+0000 7f3e8e238640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e88155010 0x7f3e880ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:07.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.047+0000 7f3e8da37640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e88151d60 0x7f3e88155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:07.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.047+0000 7f3e8e238640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e88155010 0x7f3e880ae760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:49744/0 (socket says 172.21.15.29:49744) 2024-01-25T15:06:07.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.047+0000 7f3e8da37640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e88151d60 0x7f3e88155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.29:51270/0 (socket says 172.21.15.29:51270) 2024-01-25T15:06:07.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.047+0000 7f3e8d236640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3e880ad030 0x7f3e88158690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:58472/0 (socket says 172.21.15.29:58472) 2024-01-25T15:06:07.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.047+0000 7f3e8da37640 1 -- 172.21.15.29:0/2737391699 learned_addr learned my addr 172.21.15.29:0/2737391699 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:07.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.047+0000 7f3e8e238640 1 -- 172.21.15.29:0/2737391699 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e88151d60 msgr2=0x7f3e88155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:07.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.047+0000 7f3e8e238640 1 --2- 172.21.15.29:0/2737391699 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e88151d60 0x7f3e88155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.047+0000 7f3e8e238640 1 -- 172.21.15.29:0/2737391699 >> v1:172.21.15.52:6789/0 conn(0x7f3e880ad030 legacy=0x7f3e88158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:07.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.047+0000 7f3e8e238640 1 -- 172.21.15.29:0/2737391699 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e880c9800 con 0x7f3e88155010 2024-01-25T15:06:07.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.047+0000 7f3e8da37640 1 --2- 172.21.15.29:0/2737391699 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e88151d60 0x7f3e88155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:06:07.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.048+0000 7f3e8e238640 1 --2- 172.21.15.29:0/2737391699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e88155010 0x7f3e880ae760 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3e80009d90 tx=0x7f3e8002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6db3722889866d2 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:07.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.048+0000 7f3e8ca35640 1 -- 172.21.15.29:0/2737391699 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8002cc50 con 0x7f3e88155010 2024-01-25T15:06:07.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.048+0000 7f3e8ca35640 1 -- 172.21.15.29:0/2737391699 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8002cdb0 con 0x7f3e88155010 2024-01-25T15:06:07.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.048+0000 7f3e8ca35640 1 -- 172.21.15.29:0/2737391699 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e80034660 con 0x7f3e88155010 2024-01-25T15:06:07.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.048+0000 7f3e8fc9b640 1 -- 172.21.15.29:0/2737391699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e88155010 msgr2=0x7f3e880ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:07.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.048+0000 7f3e8fc9b640 1 --2- 172.21.15.29:0/2737391699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e88155010 0x7f3e880ae760 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3e80009d90 tx=0x7f3e8002bea0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.049+0000 7f3e8fc9b640 1 -- 172.21.15.29:0/2737391699 shutdown_connections 2024-01-25T15:06:07.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.049+0000 7f3e8fc9b640 1 --2- 172.21.15.29:0/2737391699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e88155010 0x7f3e880ae760 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.049+0000 7f3e8fc9b640 1 --2- 172.21.15.29:0/2737391699 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e88151d60 0x7f3e88155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.049+0000 7f3e8fc9b640 1 -- 172.21.15.29:0/2737391699 >> 172.21.15.29:0/2737391699 conn(0x7f3e88072420 msgr2=0x7f3e880abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:07.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.049+0000 7f3e8fc9b640 1 -- 172.21.15.29:0/2737391699 shutdown_connections 2024-01-25T15:06:07.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.049+0000 7f3e8fc9b640 1 -- 172.21.15.29:0/2737391699 wait complete. 2024-01-25T15:06:07.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.050+0000 7f3e8fc9b640 1 Processor -- start 2024-01-25T15:06:07.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.050+0000 7f3e8fc9b640 1 -- start start 2024-01-25T15:06:07.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.050+0000 7f3e8fc9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e880ad030 0x7f3e8814bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:07.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.050+0000 7f3e8fc9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e88151d60 0x7f3e881ea3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:07.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.050+0000 7f3e8fc9b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e88155010 0x7f3e881ea8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:07.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.050+0000 7f3e8fc9b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e880c61b0 con 0x7f3e880ad030 2024-01-25T15:06:07.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.050+0000 7f3e8fc9b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e880c6490 con 0x7f3e88151d60 2024-01-25T15:06:07.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.050+0000 7f3e8fc9b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e880c6770 con 0x7f3e88155010 2024-01-25T15:06:07.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.050+0000 7f3e8da37640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e880ad030 0x7f3e8814bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:07.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.051+0000 7f3e8da37640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e880ad030 0x7f3e8814bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53974/0 (socket says 172.21.15.29:53974) 2024-01-25T15:06:07.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.051+0000 7f3e8da37640 1 -- 172.21.15.29:0/3139328195 learned_addr learned my addr 172.21.15.29:0/3139328195 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:07.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.051+0000 7f3e8e238640 1 --2- 172.21.15.29:0/3139328195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e88155010 0x7f3e881ea8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:07.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.051+0000 7f3e8d236640 1 --2- 172.21.15.29:0/3139328195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e88151d60 0x7f3e881ea3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:07.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.051+0000 7f3e8da37640 1 -- 172.21.15.29:0/3139328195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e88155010 msgr2=0x7f3e881ea8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:07.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.051+0000 7f3e8da37640 1 --2- 172.21.15.29:0/3139328195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e88155010 0x7f3e881ea8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.051+0000 7f3e8da37640 1 -- 172.21.15.29:0/3139328195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e88151d60 msgr2=0x7f3e881ea3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:07.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.051+0000 7f3e8da37640 1 --2- 172.21.15.29:0/3139328195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e88151d60 0x7f3e881ea3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.051+0000 7f3e8da37640 1 -- 172.21.15.29:0/3139328195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e840094d0 con 0x7f3e880ad030 2024-01-25T15:06:07.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.051+0000 7f3e8e238640 1 --2- 172.21.15.29:0/3139328195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e88155010 0x7f3e881ea8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:07.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.051+0000 7f3e8d236640 1 --2- 172.21.15.29:0/3139328195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e88151d60 0x7f3e881ea3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:07.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.051+0000 7f3e8da37640 1 --2- 172.21.15.29:0/3139328195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e880ad030 0x7f3e8814bf60 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400e9d0 tx=0x7f3e8400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:07.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.051+0000 7f3e7e7fc640 1 -- 172.21.15.29:0/3139328195 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8400ca60 con 0x7f3e880ad030 2024-01-25T15:06:07.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.051+0000 7f3e7e7fc640 1 -- 172.21.15.29:0/3139328195 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8400cbc0 con 0x7f3e880ad030 2024-01-25T15:06:07.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.051+0000 7f3e7e7fc640 1 -- 172.21.15.29:0/3139328195 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84013470 con 0x7f3e880ad030 2024-01-25T15:06:07.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.051+0000 7f3e8fc9b640 1 -- 172.21.15.29:0/3139328195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e80009a70 con 0x7f3e880ad030 2024-01-25T15:06:07.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.051+0000 7f3e8fc9b640 1 -- 172.21.15.29:0/3139328195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e8806cf20 con 0x7f3e880ad030 2024-01-25T15:06:07.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.052+0000 7f3e8fc9b640 1 -- 172.21.15.29:0/3139328195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e880737f0 con 0x7f3e880ad030 2024-01-25T15:06:07.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.053+0000 7f3e7e7fc640 1 -- 172.21.15.29:0/3139328195 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f3e840135d0 con 0x7f3e880ad030 2024-01-25T15:06:07.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.053+0000 7f3e7e7fc640 1 --2- 172.21.15.29:0/3139328195 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3e6c06aed0 0x7f3e6c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:07.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.053+0000 7f3e7e7fc640 1 -- 172.21.15.29:0/3139328195 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f3e84089a90 con 0x7f3e880ad030 2024-01-25T15:06:07.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.054+0000 7f3e8d236640 1 --2- 172.21.15.29:0/3139328195 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3e6c06aed0 0x7f3e6c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:07.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.054+0000 7f3e8d236640 1 --2- 172.21.15.29:0/3139328195 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3e6c06aed0 0x7f3e6c06d390 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3e78007fd0 tx=0x7f3e78007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:07.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.058+0000 7f3e7e7fc640 1 -- 172.21.15.29:0/3139328195 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f3e840547d0 con 0x7f3e880ad030 2024-01-25T15:06:07.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.277+0000 7f3e8fc9b640 1 -- 172.21.15.29:0/3139328195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e88074080 con 0x7f3e880ad030 2024-01-25T15:06:07.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.278+0000 7f3e7e7fc640 1 -- 172.21.15.29:0/3139328195 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4940 (secure 0 0 0) 0x7f3e84057df0 con 0x7f3e880ad030 2024-01-25T15:06:07.279 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:06:07.279 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/3901576943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6835","nonce":3901576943},{"type":"v1","addr":"172.21.15.52:6837","nonce":3901576943}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6836/1878395580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1878395580},{"type":"v1","addr":"172.21.15.52:6836","nonce":1878395580}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5841,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1669682360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1669682360},{"type":"v1","addr":"172.21.15.29:6835","nonce":1669682360}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-25T15:05:42.928937+0000","modified":"2024-01-25T15:05:44.918053+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.29:6834/1607449141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1607449141},{"type":"v1","addr":"172.21.15.29:6834","nonce":1607449141}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-25T15:06:07.279 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 22 2024-01-25T15:06:07.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.280+0000 7f3e8fc9b640 1 -- 172.21.15.29:0/3139328195 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3e6c06aed0 msgr2=0x7f3e6c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:07.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.280+0000 7f3e8fc9b640 1 --2- 172.21.15.29:0/3139328195 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3e6c06aed0 0x7f3e6c06d390 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3e78007fd0 tx=0x7f3e78007d60 comp rx=0 tx=0).stop 2024-01-25T15:06:07.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.280+0000 7f3e8fc9b640 1 -- 172.21.15.29:0/3139328195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e880ad030 msgr2=0x7f3e8814bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:07.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.280+0000 7f3e8fc9b640 1 --2- 172.21.15.29:0/3139328195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e880ad030 0x7f3e8814bf60 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400e9d0 tx=0x7f3e8400ee90 comp rx=0 tx=0).stop 2024-01-25T15:06:07.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.280+0000 7f3e8fc9b640 1 -- 172.21.15.29:0/3139328195 shutdown_connections 2024-01-25T15:06:07.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.280+0000 7f3e8fc9b640 1 --2- 172.21.15.29:0/3139328195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e88155010 0x7f3e881ea8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.280+0000 7f3e8fc9b640 1 --2- 172.21.15.29:0/3139328195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e88151d60 0x7f3e881ea3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.280+0000 7f3e8fc9b640 1 --2- 172.21.15.29:0/3139328195 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3e6c06aed0 0x7f3e6c06d390 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.280+0000 7f3e8fc9b640 1 --2- 172.21.15.29:0/3139328195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e880ad030 0x7f3e8814bf60 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.280+0000 7f3e8fc9b640 1 -- 172.21.15.29:0/3139328195 >> 172.21.15.29:0/3139328195 conn(0x7f3e88072420 msgr2=0x7f3e881568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:07.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.280+0000 7f3e8fc9b640 1 -- 172.21.15.29:0/3139328195 shutdown_connections 2024-01-25T15:06:07.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.280+0000 7f3e8fc9b640 1 -- 172.21.15.29:0/3139328195 wait complete. 2024-01-25T15:06:07.292 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:06:07.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.392+0000 7f20338fc640 1 Processor -- start 2024-01-25T15:06:07.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.393+0000 7f20338fc640 1 -- start start 2024-01-25T15:06:07.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.393+0000 7f20338fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f202c0c37b0 0x7f202c06d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:07.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.393+0000 7f20338fc640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f202c06cf30 0x7f202c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:07.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.393+0000 7f20338fc640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f202c0c2a80 con 0x7f202c14eb20 2024-01-25T15:06:07.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.393+0000 7f20338fc640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f202c14ef00 con 0x7f202c0c37b0 2024-01-25T15:06:07.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.393+0000 7f20338fc640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c155720 con 0x7f202c06cf30 2024-01-25T15:06:07.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.394+0000 7f2030e97640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f202c0c37b0 0x7f202c06d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:07.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.394+0000 7f2030e97640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f202c0c37b0 0x7f202c06d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53978/0 (socket says 172.21.15.29:53978) 2024-01-25T15:06:07.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.394+0000 7f2030e97640 1 -- 172.21.15.29:0/3061178003 learned_addr learned my addr 172.21.15.29:0/3061178003 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:07.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.394+0000 7f2031e99640 1 --2- 172.21.15.29:0/3061178003 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f202c06cf30 0x7f202c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:07.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.394+0000 7f2030e97640 1 -- 172.21.15.29:0/3061178003 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f202c06cf30 msgr2=0x7f202c06d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:07.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.394+0000 7f2030e97640 1 --2- 172.21.15.29:0/3061178003 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f202c06cf30 0x7f202c06d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.394+0000 7f2030e97640 1 -- 172.21.15.29:0/3061178003 >> v1:172.21.15.52:6789/0 conn(0x7f202c14eb20 legacy=0x7f202c0c1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:07.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.394+0000 7f2030e97640 1 -- 172.21.15.29:0/3061178003 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c0c2cd0 con 0x7f202c0c37b0 2024-01-25T15:06:07.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.395+0000 7f2030e97640 1 --2- 172.21.15.29:0/3061178003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f202c0c37b0 0x7f202c06d480 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f201c009870 tx=0x7f201c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0408351f5dbadaf server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:07.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.395+0000 7f2023fff640 1 -- 172.21.15.29:0/3061178003 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c030840 con 0x7f202c0c37b0 2024-01-25T15:06:07.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.395+0000 7f2023fff640 1 -- 172.21.15.29:0/3061178003 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c0309a0 con 0x7f202c0c37b0 2024-01-25T15:06:07.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.395+0000 7f2023fff640 1 -- 172.21.15.29:0/3061178003 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c030d30 con 0x7f202c0c37b0 2024-01-25T15:06:07.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.395+0000 7f20338fc640 1 -- 172.21.15.29:0/3061178003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f202c0c37b0 msgr2=0x7f202c06d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:07.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.395+0000 7f20338fc640 1 --2- 172.21.15.29:0/3061178003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f202c0c37b0 0x7f202c06d480 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f201c009870 tx=0x7f201c02b980 comp rx=0 tx=0).stop 2024-01-25T15:06:07.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.395+0000 7f20338fc640 1 -- 172.21.15.29:0/3061178003 shutdown_connections 2024-01-25T15:06:07.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.395+0000 7f20338fc640 1 --2- 172.21.15.29:0/3061178003 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f202c06cf30 0x7f202c06d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.395+0000 7f20338fc640 1 --2- 172.21.15.29:0/3061178003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f202c0c37b0 0x7f202c06d480 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.395+0000 7f20338fc640 1 -- 172.21.15.29:0/3061178003 >> 172.21.15.29:0/3061178003 conn(0x7f202c0a8be0 msgr2=0x7f202c06a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:07.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.395+0000 7f20338fc640 1 -- 172.21.15.29:0/3061178003 shutdown_connections 2024-01-25T15:06:07.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.395+0000 7f20338fc640 1 -- 172.21.15.29:0/3061178003 wait complete. 2024-01-25T15:06:07.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.396+0000 7f20338fc640 1 Processor -- start 2024-01-25T15:06:07.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.397+0000 7f20338fc640 1 -- start start 2024-01-25T15:06:07.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.397+0000 7f20338fc640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f202c06cf30 0x7f202c142ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:07.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.397+0000 7f20338fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f202c0c37b0 0x7f202c1eda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:07.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.397+0000 7f20338fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f202c14eb20 0x7f202c146ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:07.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.397+0000 7f20338fc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c143530 con 0x7f202c0c37b0 2024-01-25T15:06:07.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.397+0000 7f20338fc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c1ee350 con 0x7f202c14eb20 2024-01-25T15:06:07.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.397+0000 7f20338fc640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c149780 con 0x7f202c06cf30 2024-01-25T15:06:07.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.397+0000 7f2030e97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f202c0c37b0 0x7f202c1eda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:07.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.397+0000 7f2030e97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f202c0c37b0 0x7f202c1eda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53984/0 (socket says 172.21.15.29:53984) 2024-01-25T15:06:07.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.397+0000 7f2030e97640 1 -- 172.21.15.29:0/2070015624 learned_addr learned my addr 172.21.15.29:0/2070015624 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:07.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.397+0000 7f2031698640 1 --2- 172.21.15.29:0/2070015624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f202c06cf30 0x7f202c142ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:07.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.397+0000 7f2031e99640 1 --2- 172.21.15.29:0/2070015624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f202c14eb20 0x7f202c146ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:07.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.398+0000 7f2030e97640 1 -- 172.21.15.29:0/2070015624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f202c06cf30 msgr2=0x7f202c142ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:07.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.398+0000 7f2030e97640 1 --2- 172.21.15.29:0/2070015624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f202c06cf30 0x7f202c142ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.398+0000 7f2030e97640 1 -- 172.21.15.29:0/2070015624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f202c14eb20 msgr2=0x7f202c146ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:07.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.398+0000 7f2030e97640 1 --2- 172.21.15.29:0/2070015624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f202c14eb20 0x7f202c146ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.398+0000 7f2030e97640 1 -- 172.21.15.29:0/2070015624 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c0094d0 con 0x7f202c0c37b0 2024-01-25T15:06:07.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.398+0000 7f2031e99640 1 --2- 172.21.15.29:0/2070015624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f202c14eb20 0x7f202c146ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:07.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.398+0000 7f2030e97640 1 --2- 172.21.15.29:0/2070015624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f202c0c37b0 0x7f202c1eda80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f201c000c00 tx=0x7f201c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:07.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.398+0000 7f2021ffb640 1 -- 172.21.15.29:0/2070015624 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c039c90 con 0x7f202c0c37b0 2024-01-25T15:06:07.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.398+0000 7f2021ffb640 1 -- 172.21.15.29:0/2070015624 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c039df0 con 0x7f202c0c37b0 2024-01-25T15:06:07.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.398+0000 7f20338fc640 1 -- 172.21.15.29:0/2070015624 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202c149a60 con 0x7f202c0c37b0 2024-01-25T15:06:07.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.398+0000 7f2021ffb640 1 -- 172.21.15.29:0/2070015624 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c043640 con 0x7f202c0c37b0 2024-01-25T15:06:07.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.398+0000 7f20338fc640 1 -- 172.21.15.29:0/2070015624 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202c1ee630 con 0x7f202c0c37b0 2024-01-25T15:06:07.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.399+0000 7f20338fc640 1 -- 172.21.15.29:0/2070015624 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202c0c19e0 con 0x7f202c0c37b0 2024-01-25T15:06:07.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.400+0000 7f2021ffb640 1 -- 172.21.15.29:0/2070015624 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f201c0437a0 con 0x7f202c0c37b0 2024-01-25T15:06:07.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.400+0000 7f2021ffb640 1 --2- 172.21.15.29:0/2070015624 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f201006aed0 0x7f201006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:07.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.400+0000 7f2021ffb640 1 -- 172.21.15.29:0/2070015624 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f201c03e070 con 0x7f202c0c37b0 2024-01-25T15:06:07.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.400+0000 7f2031698640 1 --2- 172.21.15.29:0/2070015624 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f201006aed0 0x7f201006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:07.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.401+0000 7f2031698640 1 --2- 172.21.15.29:0/2070015624 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f201006aed0 0x7f201006d390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f202c1436d0 tx=0x7f2028009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:07.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.404+0000 7f2021ffb640 1 -- 172.21.15.29:0/2070015624 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f201c0774b0 con 0x7f202c0c37b0 2024-01-25T15:06:07.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.590+0000 7f20338fc640 1 -- 172.21.15.29:0/2070015624 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f202c074080 con 0x7f202c0c37b0 2024-01-25T15:06:07.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.592+0000 7f2021ffb640 1 -- 172.21.15.29:0/2070015624 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16872 (secure 0 0 0) 0x7f201c07aad0 con 0x7f202c0c37b0 2024-01-25T15:06:07.593 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:06:07.593 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":45,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:06:04.677930+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2024-01-25T15:05:40.935431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2024-01-25T15:05:41.895611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:6835/3222226893":"2024-01-26T15:06:01.670426+0000","172.21.15.29:6833/3222226893":"2024-01-26T15:06:01.670426+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:06:07.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.594+0000 7f20338fc640 1 -- 172.21.15.29:0/2070015624 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f201006aed0 msgr2=0x7f201006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:07.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.594+0000 7f20338fc640 1 --2- 172.21.15.29:0/2070015624 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f201006aed0 0x7f201006d390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f202c1436d0 tx=0x7f2028009040 comp rx=0 tx=0).stop 2024-01-25T15:06:07.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.594+0000 7f20338fc640 1 -- 172.21.15.29:0/2070015624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f202c0c37b0 msgr2=0x7f202c1eda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:07.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.594+0000 7f20338fc640 1 --2- 172.21.15.29:0/2070015624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f202c0c37b0 0x7f202c1eda80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f201c000c00 tx=0x7f201c004730 comp rx=0 tx=0).stop 2024-01-25T15:06:07.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.594+0000 7f20338fc640 1 -- 172.21.15.29:0/2070015624 shutdown_connections 2024-01-25T15:06:07.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.594+0000 7f20338fc640 1 --2- 172.21.15.29:0/2070015624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f202c14eb20 0x7f202c146ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.594+0000 7f20338fc640 1 --2- 172.21.15.29:0/2070015624 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f201006aed0 0x7f201006d390 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.594+0000 7f20338fc640 1 --2- 172.21.15.29:0/2070015624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f202c0c37b0 0x7f202c1eda80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.594+0000 7f20338fc640 1 --2- 172.21.15.29:0/2070015624 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f202c06cf30 0x7f202c142ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.594+0000 7f20338fc640 1 -- 172.21.15.29:0/2070015624 >> 172.21.15.29:0/2070015624 conn(0x7f202c0a8be0 msgr2=0x7f202c0c4980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:07.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.594+0000 7f20338fc640 1 -- 172.21.15.29:0/2070015624 shutdown_connections 2024-01-25T15:06:07.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.594+0000 7f20338fc640 1 -- 172.21.15.29:0/2070015624 wait complete. 2024-01-25T15:06:07.606 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2024-01-25T15:06:07.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.710+0000 7fdb2f0a6640 1 Processor -- start 2024-01-25T15:06:07.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.710+0000 7fdb2f0a6640 1 -- start start 2024-01-25T15:06:07.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.711+0000 7fdb2f0a6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb28151f80 0x7fdb280c6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:07.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.711+0000 7fdb2f0a6640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdb280c48d0 0x7fdb28155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:07.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.711+0000 7fdb2f0a6640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb28158120 con 0x7fdb281585b0 2024-01-25T15:06:07.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.711+0000 7fdb2f0a6640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb281556d0 con 0x7fdb280c48d0 2024-01-25T15:06:07.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.711+0000 7fdb2f0a6640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb280c4db0 con 0x7fdb28151f80 2024-01-25T15:06:07.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.711+0000 7fdb27fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdb280c48d0 0x7fdb28155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:07.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.711+0000 7fdb27fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdb280c48d0 0x7fdb28155190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53986/0 (socket says 172.21.15.29:53986) 2024-01-25T15:06:07.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.711+0000 7fdb27fff640 1 -- 172.21.15.29:0/3088931018 learned_addr learned my addr 172.21.15.29:0/3088931018 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:07.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.711+0000 7fdb2ce42640 1 --2- 172.21.15.29:0/3088931018 >> v2:172.21.15.52:3300/0 conn(0x7fdb28151f80 0x7fdb280c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:07.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.711+0000 7fdb27fff640 1 -- 172.21.15.29:0/3088931018 >> v2:172.21.15.52:3300/0 conn(0x7fdb28151f80 msgr2=0x7fdb280c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:07.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.711+0000 7fdb27fff640 1 --2- 172.21.15.29:0/3088931018 >> v2:172.21.15.52:3300/0 conn(0x7fdb28151f80 0x7fdb280c6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.711+0000 7fdb27fff640 1 -- 172.21.15.29:0/3088931018 >> v1:172.21.15.52:6789/0 conn(0x7fdb281585b0 legacy=0x7fdb280c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:07.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.711+0000 7fdb27fff640 1 -- 172.21.15.29:0/3088931018 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb280c5090 con 0x7fdb280c48d0 2024-01-25T15:06:07.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.712+0000 7fdb27fff640 1 --2- 172.21.15.29:0/3088931018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb280c48d0 0x7fdb28155190 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdb280aad60 tx=0x7fdb1402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e39ae1380c7fbd server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:07.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.712+0000 7fdb277fe640 1 -- 172.21.15.29:0/3088931018 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14030860 con 0x7fdb280c48d0 2024-01-25T15:06:07.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.712+0000 7fdb277fe640 1 -- 172.21.15.29:0/3088931018 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb140309c0 con 0x7fdb280c48d0 2024-01-25T15:06:07.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.712+0000 7fdb277fe640 1 -- 172.21.15.29:0/3088931018 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14030d50 con 0x7fdb280c48d0 2024-01-25T15:06:07.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.712+0000 7fdb2f0a6640 1 -- 172.21.15.29:0/3088931018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb280c48d0 msgr2=0x7fdb28155190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:07.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.712+0000 7fdb2f0a6640 1 --2- 172.21.15.29:0/3088931018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb280c48d0 0x7fdb28155190 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdb280aad60 tx=0x7fdb1402b9a0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.713+0000 7fdb2f0a6640 1 -- 172.21.15.29:0/3088931018 shutdown_connections 2024-01-25T15:06:07.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.713+0000 7fdb2f0a6640 1 --2- 172.21.15.29:0/3088931018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb280c48d0 0x7fdb28155190 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.713+0000 7fdb2f0a6640 1 --2- 172.21.15.29:0/3088931018 >> v2:172.21.15.52:3300/0 conn(0x7fdb28151f80 0x7fdb280c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.713+0000 7fdb2f0a6640 1 -- 172.21.15.29:0/3088931018 >> 172.21.15.29:0/3088931018 conn(0x7fdb280c7f10 msgr2=0x7fdb280c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:07.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.713+0000 7fdb2f0a6640 1 -- 172.21.15.29:0/3088931018 shutdown_connections 2024-01-25T15:06:07.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.713+0000 7fdb2f0a6640 1 -- 172.21.15.29:0/3088931018 wait complete. 2024-01-25T15:06:07.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.714+0000 7fdb2f0a6640 1 Processor -- start 2024-01-25T15:06:07.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.714+0000 7fdb2f0a6640 1 -- start start 2024-01-25T15:06:07.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.714+0000 7fdb2f0a6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb280c48d0 0x7fdb28070500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:07.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.715+0000 7fdb2f0a6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb28151f80 0x7fdb280ac020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:07.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.715+0000 7fdb2f0a6640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb281585b0 0x7fdb2814e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:07.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.715+0000 7fdb2f0a6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2806ff80 con 0x7fdb280c48d0 2024-01-25T15:06:07.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.715+0000 7fdb2f0a6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb281ea7f0 con 0x7fdb28151f80 2024-01-25T15:06:07.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.715+0000 7fdb2f0a6640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb28070220 con 0x7fdb281585b0 2024-01-25T15:06:07.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.715+0000 7fdb2ce42640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb280c48d0 0x7fdb28070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:07.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.715+0000 7fdb2ce42640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb280c48d0 0x7fdb28070500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54000/0 (socket says 172.21.15.29:54000) 2024-01-25T15:06:07.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.715+0000 7fdb2ce42640 1 -- 172.21.15.29:0/53925457 learned_addr learned my addr 172.21.15.29:0/53925457 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:07.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.715+0000 7fdb2d643640 1 --2- 172.21.15.29:0/53925457 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb281585b0 0x7fdb2814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:07.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.715+0000 7fdb27fff640 1 --2- 172.21.15.29:0/53925457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb28151f80 0x7fdb280ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:07.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.715+0000 7fdb2ce42640 1 -- 172.21.15.29:0/53925457 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb281585b0 msgr2=0x7fdb2814e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:07.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.715+0000 7fdb2ce42640 1 --2- 172.21.15.29:0/53925457 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb281585b0 0x7fdb2814e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.715+0000 7fdb2ce42640 1 -- 172.21.15.29:0/53925457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb28151f80 msgr2=0x7fdb280ac020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:07.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.715+0000 7fdb2ce42640 1 --2- 172.21.15.29:0/53925457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb28151f80 0x7fdb280ac020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.715+0000 7fdb2ce42640 1 -- 172.21.15.29:0/53925457 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb140094d0 con 0x7fdb280c48d0 2024-01-25T15:06:07.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.715+0000 7fdb2ce42640 1 --2- 172.21.15.29:0/53925457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb280c48d0 0x7fdb28070500 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00c7f0 tx=0x7fdb1c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:07.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.715+0000 7fdb257fa640 1 -- 172.21.15.29:0/53925457 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c004220 con 0x7fdb280c48d0 2024-01-25T15:06:07.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.715+0000 7fdb257fa640 1 -- 172.21.15.29:0/53925457 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1c0043a0 con 0x7fdb280c48d0 2024-01-25T15:06:07.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.715+0000 7fdb2f0a6640 1 -- 172.21.15.29:0/53925457 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb281eaa90 con 0x7fdb280c48d0 2024-01-25T15:06:07.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.715+0000 7fdb257fa640 1 -- 172.21.15.29:0/53925457 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c007860 con 0x7fdb280c48d0 2024-01-25T15:06:07.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.715+0000 7fdb2f0a6640 1 -- 172.21.15.29:0/53925457 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb281e7920 con 0x7fdb280c48d0 2024-01-25T15:06:07.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.716+0000 7fdb2f0a6640 1 -- 172.21.15.29:0/53925457 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb2804eb10 con 0x7fdb280c48d0 2024-01-25T15:06:07.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.717+0000 7fdb257fa640 1 -- 172.21.15.29:0/53925457 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fdb1c007bd0 con 0x7fdb280c48d0 2024-01-25T15:06:07.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.717+0000 7fdb257fa640 1 --2- 172.21.15.29:0/53925457 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdb0c06af00 0x7fdb0c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:07.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.717+0000 7fdb257fa640 1 -- 172.21.15.29:0/53925457 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6119+0+0 (secure 0 0 0) 0x7fdb1c0897a0 con 0x7fdb280c48d0 2024-01-25T15:06:07.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.717+0000 7fdb27fff640 1 --2- 172.21.15.29:0/53925457 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdb0c06af00 0x7fdb0c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:07.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.718+0000 7fdb27fff640 1 --2- 172.21.15.29:0/53925457 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdb0c06af00 0x7fdb0c06d3c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdb14036000 tx=0x7fdb1403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:07.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.721+0000 7fdb257fa640 1 -- 172.21.15.29:0/53925457 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fdb1c0544d0 con 0x7fdb280c48d0 2024-01-25T15:06:07.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.937+0000 7fdb2f0a6640 1 -- 172.21.15.29:0/53925457 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7fdb28099a30 con 0x7fdb280c48d0 2024-01-25T15:06:07.938 INFO:tasks.ceph.mon.a.smithi029.stderr:2024-01-25T15:06:07.937+0000 7ff1677c4640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-25T15:06:07.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.939+0000 7fdb257fa640 1 -- 172.21.15.29:0/53925457 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 163+0+0 (secure 0 0 0) 0x7fdb28099a30 con 0x7fdb280c48d0 2024-01-25T15:06:07.939 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-25T15:06:07.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.942+0000 7fdb2f0a6640 1 -- 172.21.15.29:0/53925457 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdb0c06af00 msgr2=0x7fdb0c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:07.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.942+0000 7fdb2f0a6640 1 --2- 172.21.15.29:0/53925457 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdb0c06af00 0x7fdb0c06d3c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdb14036000 tx=0x7fdb1403b040 comp rx=0 tx=0).stop 2024-01-25T15:06:07.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.942+0000 7fdb2f0a6640 1 -- 172.21.15.29:0/53925457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb280c48d0 msgr2=0x7fdb28070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:07.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.942+0000 7fdb2f0a6640 1 --2- 172.21.15.29:0/53925457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb280c48d0 0x7fdb28070500 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00c7f0 tx=0x7fdb1c00ccb0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.942+0000 7fdb2f0a6640 1 -- 172.21.15.29:0/53925457 shutdown_connections 2024-01-25T15:06:07.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.942+0000 7fdb2f0a6640 1 --2- 172.21.15.29:0/53925457 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb281585b0 0x7fdb2814e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.942+0000 7fdb2f0a6640 1 --2- 172.21.15.29:0/53925457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb28151f80 0x7fdb280ac020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.942+0000 7fdb2f0a6640 1 --2- 172.21.15.29:0/53925457 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdb0c06af00 0x7fdb0c06d3c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.942+0000 7fdb2f0a6640 1 --2- 172.21.15.29:0/53925457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb280c48d0 0x7fdb28070500 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:07.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.942+0000 7fdb2f0a6640 1 -- 172.21.15.29:0/53925457 >> 172.21.15.29:0/53925457 conn(0x7fdb280c7f10 msgr2=0x7fdb280c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:07.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.942+0000 7fdb2f0a6640 1 -- 172.21.15.29:0/53925457 shutdown_connections 2024-01-25T15:06:07.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:07.942+0000 7fdb2f0a6640 1 -- 172.21.15.29:0/53925457 wait complete. 2024-01-25T15:06:07.944 INFO:tasks.ceph.mds.a.smithi029.stderr: -1933> 2024-01-25T15:05:46.198+0000 7f941c58b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-25T15:06:07.955 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2024-01-25T15:06:07.970 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2024-01-25T15:06:08.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.059+0000 7f2badb9e640 1 Processor -- start 2024-01-25T15:06:08.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.059+0000 7f2badb9e640 1 -- start start 2024-01-25T15:06:08.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.059+0000 7f2badb9e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2ba8151e10 0x7f2ba80c8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:08.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.059+0000 7f2badb9e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2ba80c7e80 0x7f2ba80abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:08.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.059+0000 7f2badb9e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2ba80ac500 0x7f2ba8157d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:08.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.059+0000 7f2badb9e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba80c88d0 con 0x7f2ba80ac500 2024-01-25T15:06:08.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.059+0000 7f2badb9e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba81521f0 con 0x7f2ba80c7e80 2024-01-25T15:06:08.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.059+0000 7f2badb9e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba806ced0 con 0x7f2ba8151e10 2024-01-25T15:06:08.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.060+0000 7f2bad39d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2ba80ac500 0x7f2ba8157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:08.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.060+0000 7f2bad39d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2ba80ac500 0x7f2ba8157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54030/0 (socket says 172.21.15.29:54030) 2024-01-25T15:06:08.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.060+0000 7f2bad39d640 1 -- 172.21.15.29:0/3594090743 learned_addr learned my addr 172.21.15.29:0/3594090743 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:08.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.060+0000 7f2ba7fff640 1 --2- 172.21.15.29:0/3594090743 >> v2:172.21.15.52:3300/0 conn(0x7f2ba80c7e80 0x7f2ba80abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:08.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.060+0000 7f2bacb9c640 1 --2- 172.21.15.29:0/3594090743 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2ba8151e10 0x7f2ba80c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:08.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.060+0000 7f2bad39d640 1 -- 172.21.15.29:0/3594090743 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2ba8151e10 msgr2=0x7f2ba80c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:08.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.060+0000 7f2bad39d640 1 --2- 172.21.15.29:0/3594090743 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2ba8151e10 0x7f2ba80c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:08.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.060+0000 7f2bad39d640 1 -- 172.21.15.29:0/3594090743 >> v2:172.21.15.52:3300/0 conn(0x7f2ba80c7e80 msgr2=0x7f2ba80abfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:08.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.060+0000 7f2bad39d640 1 --2- 172.21.15.29:0/3594090743 >> v2:172.21.15.52:3300/0 conn(0x7f2ba80c7e80 0x7f2ba80abfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:08.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.060+0000 7f2bad39d640 1 -- 172.21.15.29:0/3594090743 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba8154750 con 0x7f2ba80ac500 2024-01-25T15:06:08.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.061+0000 7f2bad39d640 1 --2- 172.21.15.29:0/3594090743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ba80ac500 0x7f2ba8157d40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80acb90 tx=0x7f2ba002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796e2fa37c3c3490 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:08.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.061+0000 7f2ba77fe640 1 -- 172.21.15.29:0/3594090743 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba002c9e0 con 0x7f2ba80ac500 2024-01-25T15:06:08.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.061+0000 7f2ba77fe640 1 -- 172.21.15.29:0/3594090743 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba002cb40 con 0x7f2ba80ac500 2024-01-25T15:06:08.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.061+0000 7f2ba77fe640 1 -- 172.21.15.29:0/3594090743 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba00343f0 con 0x7f2ba80ac500 2024-01-25T15:06:08.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.061+0000 7f2badb9e640 1 -- 172.21.15.29:0/3594090743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ba80ac500 msgr2=0x7f2ba8157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:08.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.061+0000 7f2badb9e640 1 --2- 172.21.15.29:0/3594090743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ba80ac500 0x7f2ba8157d40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80acb90 tx=0x7f2ba002be40 comp rx=0 tx=0).stop 2024-01-25T15:06:08.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.061+0000 7f2badb9e640 1 -- 172.21.15.29:0/3594090743 shutdown_connections 2024-01-25T15:06:08.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.061+0000 7f2badb9e640 1 --2- 172.21.15.29:0/3594090743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ba80ac500 0x7f2ba8157d40 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:08.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.061+0000 7f2badb9e640 1 --2- 172.21.15.29:0/3594090743 >> v2:172.21.15.52:3300/0 conn(0x7f2ba80c7e80 0x7f2ba80abfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:08.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.061+0000 7f2badb9e640 1 --2- 172.21.15.29:0/3594090743 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2ba8151e10 0x7f2ba80c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:08.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.061+0000 7f2badb9e640 1 -- 172.21.15.29:0/3594090743 >> 172.21.15.29:0/3594090743 conn(0x7f2ba8072210 msgr2=0x7f2ba8072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:08.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.061+0000 7f2badb9e640 1 -- 172.21.15.29:0/3594090743 shutdown_connections 2024-01-25T15:06:08.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.061+0000 7f2badb9e640 1 -- 172.21.15.29:0/3594090743 wait complete. 2024-01-25T15:06:08.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.063+0000 7f2badb9e640 1 Processor -- start 2024-01-25T15:06:08.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.063+0000 7f2badb9e640 1 -- start start 2024-01-25T15:06:08.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.063+0000 7f2badb9e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ba80ac500 0x7f2ba81ea750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:08.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.063+0000 7f2badb9e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2ba80c7e80 0x7f2ba80ab070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:08.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.063+0000 7f2badb9e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ba8151e10 0x7f2ba80c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:08.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.063+0000 7f2badb9e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba814c0b0 con 0x7f2ba8151e10 2024-01-25T15:06:08.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.063+0000 7f2badb9e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba80c1410 con 0x7f2ba80ac500 2024-01-25T15:06:08.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.063+0000 7f2badb9e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba81eac90 con 0x7f2ba80c7e80 2024-01-25T15:06:08.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.064+0000 7f2bad39d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ba8151e10 0x7f2ba80c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:08.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.064+0000 7f2bad39d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ba8151e10 0x7f2ba80c28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54036/0 (socket says 172.21.15.29:54036) 2024-01-25T15:06:08.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.064+0000 7f2bad39d640 1 -- 172.21.15.29:0/754820583 learned_addr learned my addr 172.21.15.29:0/754820583 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:08.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.064+0000 7f2bacb9c640 1 --2- 172.21.15.29:0/754820583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ba80ac500 0x7f2ba81ea750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:08.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.064+0000 7f2ba7fff640 1 --2- 172.21.15.29:0/754820583 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2ba80c7e80 0x7f2ba80ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:08.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.064+0000 7f2bad39d640 1 -- 172.21.15.29:0/754820583 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2ba80c7e80 msgr2=0x7f2ba80ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:08.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.064+0000 7f2bad39d640 1 --2- 172.21.15.29:0/754820583 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2ba80c7e80 0x7f2ba80ab070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:08.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.064+0000 7f2bad39d640 1 -- 172.21.15.29:0/754820583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ba80ac500 msgr2=0x7f2ba81ea750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:08.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.064+0000 7f2bad39d640 1 --2- 172.21.15.29:0/754820583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ba80ac500 0x7f2ba81ea750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:08.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.064+0000 7f2bad39d640 1 -- 172.21.15.29:0/754820583 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba0009b30 con 0x7f2ba8151e10 2024-01-25T15:06:08.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.064+0000 7f2bad39d640 1 --2- 172.21.15.29:0/754820583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ba8151e10 0x7f2ba80c28e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0036040 tx=0x7f2ba0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:08.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.064+0000 7f2ba57fa640 1 -- 172.21.15.29:0/754820583 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0009510 con 0x7f2ba8151e10 2024-01-25T15:06:08.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.064+0000 7f2ba57fa640 1 -- 172.21.15.29:0/754820583 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba003e450 con 0x7f2ba8151e10 2024-01-25T15:06:08.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.064+0000 7f2badb9e640 1 -- 172.21.15.29:0/754820583 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba814d980 con 0x7f2ba8151e10 2024-01-25T15:06:08.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.064+0000 7f2ba57fa640 1 -- 172.21.15.29:0/754820583 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba003e800 con 0x7f2ba8151e10 2024-01-25T15:06:08.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.064+0000 7f2badb9e640 1 -- 172.21.15.29:0/754820583 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba814df40 con 0x7f2ba8151e10 2024-01-25T15:06:08.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.065+0000 7f2badb9e640 1 -- 172.21.15.29:0/754820583 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba814c220 con 0x7f2ba8151e10 2024-01-25T15:06:08.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.066+0000 7f2ba57fa640 1 -- 172.21.15.29:0/754820583 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2ba003e960 con 0x7f2ba8151e10 2024-01-25T15:06:08.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.066+0000 7f2ba57fa640 1 --2- 172.21.15.29:0/754820583 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2b8c06aed0 0x7f2b8c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:08.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.066+0000 7f2ba57fa640 1 -- 172.21.15.29:0/754820583 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6263+0+0 (secure 0 0 0) 0x7f2ba00ac450 con 0x7f2ba8151e10 2024-01-25T15:06:08.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.066+0000 7f2bacb9c640 1 --2- 172.21.15.29:0/754820583 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2b8c06aed0 0x7f2b8c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:08.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.067+0000 7f2bacb9c640 1 --2- 172.21.15.29:0/754820583 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2b8c06aed0 0x7f2b8c06d390 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c006fd0 tx=0x7f2b9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:08.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.070+0000 7f2ba57fa640 1 -- 172.21.15.29:0/754820583 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2ba814c220 con 0x7f2ba8151e10 2024-01-25T15:06:08.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.292+0000 7f2badb9e640 1 -- 172.21.15.29:0/754820583 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2ba814c1f0 con 0x7f2ba8151e10 2024-01-25T15:06:08.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.940+0000 7f2ba57fa640 1 -- 172.21.15.29:0/754820583 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 105+0+0 (secure 0 0 0) 0x7f2ba0077230 con 0x7f2ba8151e10 2024-01-25T15:06:08.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.942+0000 7f2badb9e640 1 -- 172.21.15.29:0/754820583 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2b8c06aed0 msgr2=0x7f2b8c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:08.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.942+0000 7f2badb9e640 1 --2- 172.21.15.29:0/754820583 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2b8c06aed0 0x7f2b8c06d390 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c006fd0 tx=0x7f2b9c008040 comp rx=0 tx=0).stop 2024-01-25T15:06:08.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.942+0000 7f2badb9e640 1 -- 172.21.15.29:0/754820583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ba8151e10 msgr2=0x7f2ba80c28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:08.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.942+0000 7f2badb9e640 1 --2- 172.21.15.29:0/754820583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ba8151e10 0x7f2ba80c28e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0036040 tx=0x7f2ba0004a40 comp rx=0 tx=0).stop 2024-01-25T15:06:08.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.943+0000 7f2badb9e640 1 -- 172.21.15.29:0/754820583 shutdown_connections 2024-01-25T15:06:08.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.943+0000 7f2badb9e640 1 --2- 172.21.15.29:0/754820583 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2b8c06aed0 0x7f2b8c06d390 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:08.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.943+0000 7f2badb9e640 1 --2- 172.21.15.29:0/754820583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ba8151e10 0x7f2ba80c28e0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:08.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.943+0000 7f2badb9e640 1 --2- 172.21.15.29:0/754820583 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2ba80c7e80 0x7f2ba80ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:08.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.943+0000 7f2badb9e640 1 --2- 172.21.15.29:0/754820583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ba80ac500 0x7f2ba81ea750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:08.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.943+0000 7f2badb9e640 1 -- 172.21.15.29:0/754820583 >> 172.21.15.29:0/754820583 conn(0x7f2ba8072210 msgr2=0x7f2ba8153ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:08.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.943+0000 7f2badb9e640 1 -- 172.21.15.29:0/754820583 shutdown_connections 2024-01-25T15:06:08.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:08.943+0000 7f2badb9e640 1 -- 172.21.15.29:0/754820583 wait complete. 2024-01-25T15:06:08.958 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2024-01-25T15:06:09.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.112+0000 7f4bd765d640 1 Processor -- start 2024-01-25T15:06:09.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.112+0000 7f4bd765d640 1 -- start start 2024-01-25T15:06:09.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.113+0000 7f4bd765d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4bd0151f80 0x7f4bd00c6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:09.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.113+0000 7f4bd765d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4bd00c48d0 0x7f4bd0155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:09.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.113+0000 7f4bd765d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4bd01585b0 0x7f4bd00c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:09.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.113+0000 7f4bd765d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd01556d0 con 0x7f4bd01585b0 2024-01-25T15:06:09.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.113+0000 7f4bd765d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd0158120 con 0x7f4bd0151f80 2024-01-25T15:06:09.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.113+0000 7f4bd765d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd00c4db0 con 0x7f4bd00c48d0 2024-01-25T15:06:09.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.113+0000 7f4bd5bfa640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4bd01585b0 0x7f4bd00c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:09.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.113+0000 7f4bd5bfa640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4bd01585b0 0x7f4bd00c74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54042/0 (socket says 172.21.15.29:54042) 2024-01-25T15:06:09.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.113+0000 7f4bd5bfa640 1 -- 172.21.15.29:0/2577353764 learned_addr learned my addr 172.21.15.29:0/2577353764 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:09.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.113+0000 7f4bd4bf8640 1 --2- 172.21.15.29:0/2577353764 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4bd00c48d0 0x7f4bd0155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:09.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.113+0000 7f4bd53f9640 1 --2- 172.21.15.29:0/2577353764 >> v2:172.21.15.52:3300/0 conn(0x7f4bd0151f80 0x7f4bd00c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:09.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.113+0000 7f4bd5bfa640 1 -- 172.21.15.29:0/2577353764 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4bd00c48d0 msgr2=0x7f4bd0155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:09.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.113+0000 7f4bd5bfa640 1 --2- 172.21.15.29:0/2577353764 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4bd00c48d0 0x7f4bd0155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:09.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.113+0000 7f4bd5bfa640 1 -- 172.21.15.29:0/2577353764 >> v2:172.21.15.52:3300/0 conn(0x7f4bd0151f80 msgr2=0x7f4bd00c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:09.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.113+0000 7f4bd5bfa640 1 --2- 172.21.15.29:0/2577353764 >> v2:172.21.15.52:3300/0 conn(0x7f4bd0151f80 0x7f4bd00c6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:09.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.113+0000 7f4bd5bfa640 1 -- 172.21.15.29:0/2577353764 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd00c5090 con 0x7f4bd01585b0 2024-01-25T15:06:09.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.114+0000 7f4bd5bfa640 1 --2- 172.21.15.29:0/2577353764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bd01585b0 0x7f4bd00c74f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00aad60 tx=0x7f4bc002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ccbec47ccdcdca8 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:09.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.114+0000 7f4bcffff640 1 -- 172.21.15.29:0/2577353764 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0030860 con 0x7f4bd01585b0 2024-01-25T15:06:09.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.114+0000 7f4bcffff640 1 -- 172.21.15.29:0/2577353764 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc00309c0 con 0x7f4bd01585b0 2024-01-25T15:06:09.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.114+0000 7f4bcffff640 1 -- 172.21.15.29:0/2577353764 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0030d50 con 0x7f4bd01585b0 2024-01-25T15:06:09.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.115+0000 7f4bd765d640 1 -- 172.21.15.29:0/2577353764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bd01585b0 msgr2=0x7f4bd00c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:09.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.115+0000 7f4bd765d640 1 --2- 172.21.15.29:0/2577353764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bd01585b0 0x7f4bd00c74f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00aad60 tx=0x7f4bc002b9a0 comp rx=0 tx=0).stop 2024-01-25T15:06:09.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.115+0000 7f4bd765d640 1 -- 172.21.15.29:0/2577353764 shutdown_connections 2024-01-25T15:06:09.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.115+0000 7f4bd765d640 1 --2- 172.21.15.29:0/2577353764 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4bd00c48d0 0x7f4bd0155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:09.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.115+0000 7f4bd765d640 1 --2- 172.21.15.29:0/2577353764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bd01585b0 0x7f4bd00c74f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:09.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.115+0000 7f4bd765d640 1 --2- 172.21.15.29:0/2577353764 >> v2:172.21.15.52:3300/0 conn(0x7f4bd0151f80 0x7f4bd00c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:09.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.115+0000 7f4bd765d640 1 -- 172.21.15.29:0/2577353764 >> 172.21.15.29:0/2577353764 conn(0x7f4bd00c7f10 msgr2=0x7f4bd00c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:09.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.115+0000 7f4bd765d640 1 -- 172.21.15.29:0/2577353764 shutdown_connections 2024-01-25T15:06:09.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.115+0000 7f4bd765d640 1 -- 172.21.15.29:0/2577353764 wait complete. 2024-01-25T15:06:09.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.116+0000 7f4bd765d640 1 Processor -- start 2024-01-25T15:06:09.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.116+0000 7f4bd765d640 1 -- start start 2024-01-25T15:06:09.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.117+0000 7f4bd765d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd00c48d0 0x7f4bd0146780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:09.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.117+0000 7f4bd765d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4bd0151f80 0x7f4bd01ed0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:09.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.117+0000 7f4bd765d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bd01585b0 0x7f4bd006f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:09.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.117+0000 7f4bd765d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd01471a0 con 0x7f4bd01585b0 2024-01-25T15:06:09.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.117+0000 7f4bd765d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd006eed0 con 0x7f4bd00c48d0 2024-01-25T15:06:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.117+0000 7f4bd765d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd006ebc0 con 0x7f4bd0151f80 2024-01-25T15:06:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.117+0000 7f4bd5bfa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bd01585b0 0x7f4bd006f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.117+0000 7f4bd5bfa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bd01585b0 0x7f4bd006f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54058/0 (socket says 172.21.15.29:54058) 2024-01-25T15:06:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.117+0000 7f4bd5bfa640 1 -- 172.21.15.29:0/2079976163 learned_addr learned my addr 172.21.15.29:0/2079976163 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.117+0000 7f4bd4bf8640 1 --2- 172.21.15.29:0/2079976163 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4bd0151f80 0x7f4bd01ed0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.117+0000 7f4bd53f9640 1 --2- 172.21.15.29:0/2079976163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd00c48d0 0x7f4bd0146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.117+0000 7f4bd5bfa640 1 -- 172.21.15.29:0/2079976163 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4bd0151f80 msgr2=0x7f4bd01ed0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.117+0000 7f4bd5bfa640 1 --2- 172.21.15.29:0/2079976163 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4bd0151f80 0x7f4bd01ed0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.117+0000 7f4bd5bfa640 1 -- 172.21.15.29:0/2079976163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd00c48d0 msgr2=0x7f4bd0146780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.117+0000 7f4bd5bfa640 1 --2- 172.21.15.29:0/2079976163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd00c48d0 0x7f4bd0146780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.117+0000 7f4bd5bfa640 1 -- 172.21.15.29:0/2079976163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc00094d0 con 0x7f4bd01585b0 2024-01-25T15:06:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.117+0000 7f4bd5bfa640 1 --2- 172.21.15.29:0/2079976163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bd01585b0 0x7f4bd006f360 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00090b0 tx=0x7f4bc0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.118+0000 7f4bcdffb640 1 -- 172.21.15.29:0/2079976163 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0039a90 con 0x7f4bd01585b0 2024-01-25T15:06:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.118+0000 7f4bcdffb640 1 -- 172.21.15.29:0/2079976163 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc0039bf0 con 0x7f4bd01585b0 2024-01-25T15:06:09.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.118+0000 7f4bd765d640 1 -- 172.21.15.29:0/2079976163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd0152a20 con 0x7f4bd01585b0 2024-01-25T15:06:09.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.118+0000 7f4bcdffb640 1 -- 172.21.15.29:0/2079976163 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc00433f0 con 0x7f4bd01585b0 2024-01-25T15:06:09.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.118+0000 7f4bd765d640 1 -- 172.21.15.29:0/2079976163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd01ede50 con 0x7f4bd01585b0 2024-01-25T15:06:09.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.119+0000 7f4bd765d640 1 -- 172.21.15.29:0/2079976163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd004eb10 con 0x7f4bd01585b0 2024-01-25T15:06:09.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.119+0000 7f4bcdffb640 1 -- 172.21.15.29:0/2079976163 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4bc004c3b0 con 0x7f4bd01585b0 2024-01-25T15:06:09.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.120+0000 7f4bcdffb640 1 --2- 172.21.15.29:0/2079976163 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4bbc06aed0 0x7f4bbc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:09.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.120+0000 7f4bcdffb640 1 -- 172.21.15.29:0/2079976163 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6263+0+0 (secure 0 0 0) 0x7f4bc00abd20 con 0x7f4bd01585b0 2024-01-25T15:06:09.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.120+0000 7f4bd53f9640 1 --2- 172.21.15.29:0/2079976163 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4bbc06aed0 0x7f4bbc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:09.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.120+0000 7f4bd53f9640 1 --2- 172.21.15.29:0/2079976163 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4bbc06aed0 0x7f4bbc06d390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8003aa0 tx=0x7f4bc80098d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:09.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.124+0000 7f4bcdffb640 1 -- 172.21.15.29:0/2079976163 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4bc0076a60 con 0x7f4bd01585b0 2024-01-25T15:06:09.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.304+0000 7f4bd765d640 1 -- 172.21.15.29:0/2079976163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4bd0074010 con 0x7f4bd01585b0 2024-01-25T15:06:09.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.947+0000 7f4bcdffb640 1 -- 172.21.15.29:0/2079976163 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v48) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4bc00340e0 con 0x7f4bd01585b0 2024-01-25T15:06:09.948 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs2_metadata' removed 2024-01-25T15:06:09.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.953+0000 7f4bd765d640 1 -- 172.21.15.29:0/2079976163 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4bbc06aed0 msgr2=0x7f4bbc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:09.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.953+0000 7f4bd765d640 1 --2- 172.21.15.29:0/2079976163 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4bbc06aed0 0x7f4bbc06d390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8003aa0 tx=0x7f4bc80098d0 comp rx=0 tx=0).stop 2024-01-25T15:06:09.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.953+0000 7f4bd765d640 1 -- 172.21.15.29:0/2079976163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bd01585b0 msgr2=0x7f4bd006f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:09.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.953+0000 7f4bd765d640 1 --2- 172.21.15.29:0/2079976163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bd01585b0 0x7f4bd006f360 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00090b0 tx=0x7f4bc0004730 comp rx=0 tx=0).stop 2024-01-25T15:06:09.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.953+0000 7f4bd765d640 1 -- 172.21.15.29:0/2079976163 shutdown_connections 2024-01-25T15:06:09.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.953+0000 7f4bd765d640 1 --2- 172.21.15.29:0/2079976163 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4bbc06aed0 0x7f4bbc06d390 secure :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8003aa0 tx=0x7f4bc80098d0 comp rx=0 tx=0).stop 2024-01-25T15:06:09.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.953+0000 7f4bd765d640 1 --2- 172.21.15.29:0/2079976163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4bd01585b0 0x7f4bd006f360 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:09.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.953+0000 7f4bd765d640 1 --2- 172.21.15.29:0/2079976163 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4bd0151f80 0x7f4bd01ed0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:09.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.953+0000 7f4bd765d640 1 --2- 172.21.15.29:0/2079976163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd00c48d0 0x7f4bd0146780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:09.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.953+0000 7f4bd765d640 1 -- 172.21.15.29:0/2079976163 >> 172.21.15.29:0/2079976163 conn(0x7f4bd00c7f10 msgr2=0x7f4bd006b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:09.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.953+0000 7f4bd765d640 1 -- 172.21.15.29:0/2079976163 shutdown_connections 2024-01-25T15:06:09.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:09.954+0000 7f4bd765d640 1 -- 172.21.15.29:0/2079976163 wait complete. 2024-01-25T15:06:09.971 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2024-01-25T15:06:10.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.079+0000 7f9b65f1f640 1 Processor -- start 2024-01-25T15:06:10.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.079+0000 7f9b65f1f640 1 -- start start 2024-01-25T15:06:10.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.080+0000 7f9b65f1f640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b600c48d0 0x7f9b600c6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:10.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.080+0000 7f9b65f1f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9b60155190 0x7f9b600c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:10.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.080+0000 7f9b65f1f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b60158120 con 0x7f9b60151f80 2024-01-25T15:06:10.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.080+0000 7f9b65f1f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b60155640 con 0x7f9b60155190 2024-01-25T15:06:10.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.080+0000 7f9b65f1f640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b600c4db0 con 0x7f9b600c48d0 2024-01-25T15:06:10.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.080+0000 7f9b5f7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9b60151f80 0x7f9b601585b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52430/0 (socket says 172.21.15.29:52430) 2024-01-25T15:06:10.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.080+0000 7f9b5f7fe640 1 -- 172.21.15.29:0/3679817824 learned_addr learned my addr 172.21.15.29:0/3679817824 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:10.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.080+0000 7f9b5effd640 1 --2- 172.21.15.29:0/3679817824 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b600c48d0 0x7f9b600c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:10.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.080+0000 7f9b5ffff640 1 --2- 172.21.15.29:0/3679817824 >> v2:172.21.15.52:3300/0 conn(0x7f9b60155190 0x7f9b600c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:10.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.080+0000 7f9b5e7fc640 1 -- 172.21.15.29:0/3679817824 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3817849031 0 0) 0x7f9b60158120 con 0x7f9b60151f80 2024-01-25T15:06:10.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.080+0000 7f9b5e7fc640 1 -- 172.21.15.29:0/3679817824 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b48003520 con 0x7f9b60151f80 2024-01-25T15:06:10.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.080+0000 7f9b5ffff640 1 -- 172.21.15.29:0/3679817824 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b600c48d0 msgr2=0x7f9b600c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:10.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.080+0000 7f9b5ffff640 1 --2- 172.21.15.29:0/3679817824 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b600c48d0 0x7f9b600c6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:10.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.080+0000 7f9b5ffff640 1 -- 172.21.15.29:0/3679817824 >> v1:172.21.15.29:6789/0 conn(0x7f9b60151f80 legacy=0x7f9b601585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:10.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.080+0000 7f9b5ffff640 1 -- 172.21.15.29:0/3679817824 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b600c5090 con 0x7f9b60155190 2024-01-25T15:06:10.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.081+0000 7f9b5ffff640 1 --2- 172.21.15.29:0/3679817824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b60155190 0x7f9b600c74f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9b58009d90 tx=0x7f9b5802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=437dc4125db12f07 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:10.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.081+0000 7f9b5e7fc640 1 -- 172.21.15.29:0/3679817824 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5802cc50 con 0x7f9b60155190 2024-01-25T15:06:10.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.081+0000 7f9b5e7fc640 1 -- 172.21.15.29:0/3679817824 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5802cdb0 con 0x7f9b60155190 2024-01-25T15:06:10.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.081+0000 7f9b5e7fc640 1 -- 172.21.15.29:0/3679817824 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b58034640 con 0x7f9b60155190 2024-01-25T15:06:10.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.082+0000 7f9b65f1f640 1 -- 172.21.15.29:0/3679817824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b60155190 msgr2=0x7f9b600c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:10.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.082+0000 7f9b65f1f640 1 --2- 172.21.15.29:0/3679817824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b60155190 0x7f9b600c74f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9b58009d90 tx=0x7f9b5802bea0 comp rx=0 tx=0).stop 2024-01-25T15:06:10.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.082+0000 7f9b65f1f640 1 -- 172.21.15.29:0/3679817824 shutdown_connections 2024-01-25T15:06:10.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.082+0000 7f9b65f1f640 1 --2- 172.21.15.29:0/3679817824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b60155190 0x7f9b600c74f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:10.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.082+0000 7f9b65f1f640 1 --2- 172.21.15.29:0/3679817824 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b600c48d0 0x7f9b600c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:10.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.082+0000 7f9b65f1f640 1 -- 172.21.15.29:0/3679817824 >> 172.21.15.29:0/3679817824 conn(0x7f9b600c7f10 msgr2=0x7f9b600c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:10.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.082+0000 7f9b65f1f640 1 -- 172.21.15.29:0/3679817824 shutdown_connections 2024-01-25T15:06:10.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.082+0000 7f9b65f1f640 1 -- 172.21.15.29:0/3679817824 wait complete. 2024-01-25T15:06:10.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.083+0000 7f9b65f1f640 1 Processor -- start 2024-01-25T15:06:10.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.083+0000 7f9b65f1f640 1 -- start start 2024-01-25T15:06:10.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.084+0000 7f9b65f1f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b600c48d0 0x7f9b60148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:10.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.084+0000 7f9b65f1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b60151f80 0x7f9b6014ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:10.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.084+0000 7f9b65f1f640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b60155190 0x7f9b6006e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:10.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.084+0000 7f9b65f1f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b60157c10 con 0x7f9b600c48d0 2024-01-25T15:06:10.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.084+0000 7f9b65f1f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b601ea940 con 0x7f9b60151f80 2024-01-25T15:06:10.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.084+0000 7f9b65f1f640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6006f840 con 0x7f9b60155190 2024-01-25T15:06:10.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.084+0000 7f9b5f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b600c48d0 0x7f9b60148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:10.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.084+0000 7f9b5f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b600c48d0 0x7f9b60148eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54066/0 (socket says 172.21.15.29:54066) 2024-01-25T15:06:10.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.084+0000 7f9b5f7fe640 1 -- 172.21.15.29:0/1888353428 learned_addr learned my addr 172.21.15.29:0/1888353428 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:10.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.084+0000 7f9b5ffff640 1 --2- 172.21.15.29:0/1888353428 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b60155190 0x7f9b6006e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:10.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.084+0000 7f9b5effd640 1 --2- 172.21.15.29:0/1888353428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b60151f80 0x7f9b6014ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:10.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.084+0000 7f9b5f7fe640 1 -- 172.21.15.29:0/1888353428 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b60155190 msgr2=0x7f9b6006e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:10.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.084+0000 7f9b5f7fe640 1 --2- 172.21.15.29:0/1888353428 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b60155190 0x7f9b6006e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:10.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.084+0000 7f9b5f7fe640 1 -- 172.21.15.29:0/1888353428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b60151f80 msgr2=0x7f9b6014ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:10.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.084+0000 7f9b5f7fe640 1 --2- 172.21.15.29:0/1888353428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b60151f80 0x7f9b6014ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:10.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.084+0000 7f9b5f7fe640 1 -- 172.21.15.29:0/1888353428 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b58009a70 con 0x7f9b600c48d0 2024-01-25T15:06:10.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.084+0000 7f9b5f7fe640 1 --2- 172.21.15.29:0/1888353428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b600c48d0 0x7f9b60148eb0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000c460 tx=0x7f9b5000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:10.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.085+0000 7f9b47fff640 1 -- 172.21.15.29:0/1888353428 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b50005ce0 con 0x7f9b600c48d0 2024-01-25T15:06:10.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.085+0000 7f9b47fff640 1 -- 172.21.15.29:0/1888353428 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b50005e40 con 0x7f9b600c48d0 2024-01-25T15:06:10.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.085+0000 7f9b65f1f640 1 -- 172.21.15.29:0/1888353428 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6006ecd0 con 0x7f9b600c48d0 2024-01-25T15:06:10.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.085+0000 7f9b47fff640 1 -- 172.21.15.29:0/1888353428 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b50007290 con 0x7f9b600c48d0 2024-01-25T15:06:10.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.085+0000 7f9b65f1f640 1 -- 172.21.15.29:0/1888353428 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6014cf80 con 0x7f9b600c48d0 2024-01-25T15:06:10.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.086+0000 7f9b65f1f640 1 -- 172.21.15.29:0/1888353428 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b6004eb10 con 0x7f9b600c48d0 2024-01-25T15:06:10.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.086+0000 7f9b47fff640 1 -- 172.21.15.29:0/1888353428 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9b500073f0 con 0x7f9b600c48d0 2024-01-25T15:06:10.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.086+0000 7f9b47fff640 1 --2- 172.21.15.29:0/1888353428 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9b4c06af00 0x7f9b4c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:10.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.086+0000 7f9b47fff640 1 -- 172.21.15.29:0/1888353428 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f9b50088be0 con 0x7f9b600c48d0 2024-01-25T15:06:10.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.087+0000 7f9b5effd640 1 --2- 172.21.15.29:0/1888353428 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9b4c06af00 0x7f9b4c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:10.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.087+0000 7f9b5effd640 1 --2- 172.21.15.29:0/1888353428 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9b4c06af00 0x7f9b4c06d3c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9b601550d0 tx=0x7f9b54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:10.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.091+0000 7f9b47fff640 1 -- 172.21.15.29:0/1888353428 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f9b50053a50 con 0x7f9b600c48d0 2024-01-25T15:06:10.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.270+0000 7f9b65f1f640 1 -- 172.21.15.29:0/1888353428 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9b60074010 con 0x7f9b600c48d0 2024-01-25T15:06:10.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.949+0000 7f9b47fff640 1 -- 172.21.15.29:0/1888353428 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v49) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9b50057070 con 0x7f9b600c48d0 2024-01-25T15:06:10.950 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs2_data' removed 2024-01-25T15:06:10.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.954+0000 7f9b65f1f640 1 -- 172.21.15.29:0/1888353428 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9b4c06af00 msgr2=0x7f9b4c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:10.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.954+0000 7f9b65f1f640 1 --2- 172.21.15.29:0/1888353428 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9b4c06af00 0x7f9b4c06d3c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9b601550d0 tx=0x7f9b54008040 comp rx=0 tx=0).stop 2024-01-25T15:06:10.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.954+0000 7f9b65f1f640 1 -- 172.21.15.29:0/1888353428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b600c48d0 msgr2=0x7f9b60148eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:10.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.954+0000 7f9b65f1f640 1 --2- 172.21.15.29:0/1888353428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b600c48d0 0x7f9b60148eb0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000c460 tx=0x7f9b5000c920 comp rx=0 tx=0).stop 2024-01-25T15:06:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.955+0000 7f9b65f1f640 1 -- 172.21.15.29:0/1888353428 shutdown_connections 2024-01-25T15:06:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.955+0000 7f9b65f1f640 1 --2- 172.21.15.29:0/1888353428 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9b60155190 0x7f9b6006e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.955+0000 7f9b65f1f640 1 --2- 172.21.15.29:0/1888353428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b60151f80 0x7f9b6014ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.955+0000 7f9b65f1f640 1 --2- 172.21.15.29:0/1888353428 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9b4c06af00 0x7f9b4c06d3c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.955+0000 7f9b65f1f640 1 --2- 172.21.15.29:0/1888353428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b600c48d0 0x7f9b60148eb0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.955+0000 7f9b65f1f640 1 -- 172.21.15.29:0/1888353428 >> 172.21.15.29:0/1888353428 conn(0x7f9b600c7f10 msgr2=0x7f9b600c1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:10.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.957+0000 7f9b65f1f640 1 -- 172.21.15.29:0/1888353428 shutdown_connections 2024-01-25T15:06:10.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:10.957+0000 7f9b65f1f640 1 -- 172.21.15.29:0/1888353428 wait complete. 2024-01-25T15:06:10.975 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-25T15:06:11.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.087+0000 7f9bbf578640 1 Processor -- start 2024-01-25T15:06:11.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.087+0000 7f9bbf578640 1 -- start start 2024-01-25T15:06:11.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.088+0000 7f9bbf578640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9bb8154d60 0x7f9bb8155140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:11.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.088+0000 7f9bbf578640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9bb806dba0 0x7f9bb814e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:11.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.088+0000 7f9bbf578640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb80c23e0 con 0x7f9bb814ea40 2024-01-25T15:06:11.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.088+0000 7f9bbf578640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb8155ac0 con 0x7f9bb806dba0 2024-01-25T15:06:11.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.088+0000 7f9bbf578640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb806d0d0 con 0x7f9bb8154d60 2024-01-25T15:06:11.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.088+0000 7f9bbcb13640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9bb806dba0 0x7f9bb814e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:11.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.088+0000 7f9bbdb15640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9bb814ea40 0x7f9bb80c2b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52438/0 (socket says 172.21.15.29:52438) 2024-01-25T15:06:11.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.088+0000 7f9bbdb15640 1 -- 172.21.15.29:0/785887863 learned_addr learned my addr 172.21.15.29:0/785887863 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:11.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.088+0000 7f9bbcb13640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9bb806dba0 0x7f9bb814e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54080/0 (socket says 172.21.15.29:54080) 2024-01-25T15:06:11.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.088+0000 7f9bbd314640 1 --2- 172.21.15.29:0/785887863 >> v2:172.21.15.52:3300/0 conn(0x7f9bb8154d60 0x7f9bb8155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:11.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.088+0000 7f9bbcb13640 1 -- 172.21.15.29:0/785887863 >> v2:172.21.15.52:3300/0 conn(0x7f9bb8154d60 msgr2=0x7f9bb8155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:11.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.088+0000 7f9bbcb13640 1 --2- 172.21.15.29:0/785887863 >> v2:172.21.15.52:3300/0 conn(0x7f9bb8154d60 0x7f9bb8155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.088+0000 7f9bbcb13640 1 -- 172.21.15.29:0/785887863 >> v1:172.21.15.29:6789/0 conn(0x7f9bb814ea40 legacy=0x7f9bb80c2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:11.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.088+0000 7f9bbcb13640 1 -- 172.21.15.29:0/785887863 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb806d3b0 con 0x7f9bb806dba0 2024-01-25T15:06:11.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.089+0000 7f9bbcb13640 1 --2- 172.21.15.29:0/785887863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bb806dba0 0x7f9bb814e500 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9bb806ccb0 tx=0x7f9bb402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a3903aa2164530 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:11.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.089+0000 7f9babfff640 1 -- 172.21.15.29:0/785887863 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4031710 con 0x7f9bb806dba0 2024-01-25T15:06:11.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.089+0000 7f9babfff640 1 -- 172.21.15.29:0/785887863 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb402f050 con 0x7f9bb806dba0 2024-01-25T15:06:11.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.089+0000 7f9babfff640 1 -- 172.21.15.29:0/785887863 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4031a90 con 0x7f9bb806dba0 2024-01-25T15:06:11.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.090+0000 7f9bbf578640 1 -- 172.21.15.29:0/785887863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bb806dba0 msgr2=0x7f9bb814e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:11.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.090+0000 7f9bbf578640 1 --2- 172.21.15.29:0/785887863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bb806dba0 0x7f9bb814e500 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9bb806ccb0 tx=0x7f9bb402b7b0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.090+0000 7f9bbf578640 1 -- 172.21.15.29:0/785887863 shutdown_connections 2024-01-25T15:06:11.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.090+0000 7f9bbf578640 1 --2- 172.21.15.29:0/785887863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bb806dba0 0x7f9bb814e500 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.090+0000 7f9bbf578640 1 --2- 172.21.15.29:0/785887863 >> v2:172.21.15.52:3300/0 conn(0x7f9bb8154d60 0x7f9bb8155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.090+0000 7f9bbf578640 1 -- 172.21.15.29:0/785887863 >> 172.21.15.29:0/785887863 conn(0x7f9bb80c3b00 msgr2=0x7f9bb80c3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:11.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.090+0000 7f9bbf578640 1 -- 172.21.15.29:0/785887863 shutdown_connections 2024-01-25T15:06:11.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.090+0000 7f9bbf578640 1 -- 172.21.15.29:0/785887863 wait complete. 2024-01-25T15:06:11.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.091+0000 7f9bbf578640 1 Processor -- start 2024-01-25T15:06:11.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.091+0000 7f9bbf578640 1 -- start start 2024-01-25T15:06:11.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.092+0000 7f9bbf578640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bb806dba0 0x7f9bb80c06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:11.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.092+0000 7f9bbf578640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9bb814ea40 0x7f9bb8131850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:11.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.092+0000 7f9bbf578640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bb8154d60 0x7f9bb8131d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:11.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.092+0000 7f9bbf578640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80c5390 con 0x7f9bb806dba0 2024-01-25T15:06:11.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.092+0000 7f9bbf578640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb81ead90 con 0x7f9bb8154d60 2024-01-25T15:06:11.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.092+0000 7f9bbf578640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb81322d0 con 0x7f9bb814ea40 2024-01-25T15:06:11.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.092+0000 7f9bbd314640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bb806dba0 0x7f9bb80c06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:11.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.092+0000 7f9bbd314640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bb806dba0 0x7f9bb80c06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54094/0 (socket says 172.21.15.29:54094) 2024-01-25T15:06:11.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.092+0000 7f9bbd314640 1 -- 172.21.15.29:0/2428445876 learned_addr learned my addr 172.21.15.29:0/2428445876 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:11.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.092+0000 7f9bbcb13640 1 --2- 172.21.15.29:0/2428445876 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9bb814ea40 0x7f9bb8131850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:11.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.092+0000 7f9bbdb15640 1 --2- 172.21.15.29:0/2428445876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bb8154d60 0x7f9bb8131d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:11.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.092+0000 7f9bbd314640 1 -- 172.21.15.29:0/2428445876 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9bb814ea40 msgr2=0x7f9bb8131850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:11.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.092+0000 7f9bbd314640 1 --2- 172.21.15.29:0/2428445876 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9bb814ea40 0x7f9bb8131850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.092+0000 7f9bbd314640 1 -- 172.21.15.29:0/2428445876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bb8154d60 msgr2=0x7f9bb8131d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:11.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.092+0000 7f9bbd314640 1 --2- 172.21.15.29:0/2428445876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bb8154d60 0x7f9bb8131d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.092+0000 7f9bbd314640 1 -- 172.21.15.29:0/2428445876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb4009400 con 0x7f9bb806dba0 2024-01-25T15:06:11.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.092+0000 7f9bbd314640 1 --2- 172.21.15.29:0/2428445876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bb806dba0 0x7f9bb80c06a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00d800 tx=0x7f9bac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:11.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.092+0000 7f9ba9ffb640 1 -- 172.21.15.29:0/2428445876 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00b6c0 con 0x7f9bb806dba0 2024-01-25T15:06:11.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.092+0000 7f9ba9ffb640 1 -- 172.21.15.29:0/2428445876 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac00b820 con 0x7f9bb806dba0 2024-01-25T15:06:11.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.092+0000 7f9bbf578640 1 -- 172.21.15.29:0/2428445876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb81ee740 con 0x7f9bb806dba0 2024-01-25T15:06:11.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.092+0000 7f9ba9ffb640 1 -- 172.21.15.29:0/2428445876 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00bbb0 con 0x7f9bb806dba0 2024-01-25T15:06:11.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.093+0000 7f9bbf578640 1 -- 172.21.15.29:0/2428445876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb81ea740 con 0x7f9bb806dba0 2024-01-25T15:06:11.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.093+0000 7f9bbf578640 1 -- 172.21.15.29:0/2428445876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb806e2d0 con 0x7f9bb806dba0 2024-01-25T15:06:11.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.094+0000 7f9ba9ffb640 1 -- 172.21.15.29:0/2428445876 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9bac00bd10 con 0x7f9bb806dba0 2024-01-25T15:06:11.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.094+0000 7f9ba9ffb640 1 --2- 172.21.15.29:0/2428445876 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9b9c06af00 0x7f9b9c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:11.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.094+0000 7f9ba9ffb640 1 -- 172.21.15.29:0/2428445876 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f9bac0899c0 con 0x7f9bb806dba0 2024-01-25T15:06:11.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.094+0000 7f9bbcb13640 1 --2- 172.21.15.29:0/2428445876 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9b9c06af00 0x7f9b9c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:11.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.095+0000 7f9bbcb13640 1 --2- 172.21.15.29:0/2428445876 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9b9c06af00 0x7f9b9c06d3c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4035000 tx=0x7f9bb4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:11.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.098+0000 7f9ba9ffb640 1 -- 172.21.15.29:0/2428445876 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f9bac054a80 con 0x7f9bb806dba0 2024-01-25T15:06:11.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.278+0000 7f9bbf578640 1 -- 172.21.15.29:0/2428445876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9bb8074010 con 0x7f9bb806dba0 2024-01-25T15:06:11.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.281+0000 7f9ba9ffb640 1 -- 172.21.15.29:0/2428445876 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9bac0580a0 con 0x7f9bb806dba0 2024-01-25T15:06:11.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.283+0000 7f9bbf578640 1 -- 172.21.15.29:0/2428445876 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9b9c06af00 msgr2=0x7f9b9c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:11.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.283+0000 7f9bbf578640 1 --2- 172.21.15.29:0/2428445876 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9b9c06af00 0x7f9b9c06d3c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4035000 tx=0x7f9bb4008030 comp rx=0 tx=0).stop 2024-01-25T15:06:11.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.283+0000 7f9bbf578640 1 -- 172.21.15.29:0/2428445876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bb806dba0 msgr2=0x7f9bb80c06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:11.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.283+0000 7f9bbf578640 1 --2- 172.21.15.29:0/2428445876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bb806dba0 0x7f9bb80c06a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00d800 tx=0x7f9bac00dcc0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.283+0000 7f9bbf578640 1 -- 172.21.15.29:0/2428445876 shutdown_connections 2024-01-25T15:06:11.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.283+0000 7f9bbf578640 1 --2- 172.21.15.29:0/2428445876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bb8154d60 0x7f9bb8131d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.283+0000 7f9bbf578640 1 --2- 172.21.15.29:0/2428445876 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9bb814ea40 0x7f9bb8131850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.283+0000 7f9bbf578640 1 --2- 172.21.15.29:0/2428445876 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9b9c06af00 0x7f9b9c06d3c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.283+0000 7f9bbf578640 1 --2- 172.21.15.29:0/2428445876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bb806dba0 0x7f9bb80c06a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.283+0000 7f9bbf578640 1 -- 172.21.15.29:0/2428445876 >> 172.21.15.29:0/2428445876 conn(0x7f9bb80c3b00 msgr2=0x7f9bb813e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:11.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.283+0000 7f9bbf578640 1 -- 172.21.15.29:0/2428445876 shutdown_connections 2024-01-25T15:06:11.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.283+0000 7f9bbf578640 1 -- 172.21.15.29:0/2428445876 wait complete. 2024-01-25T15:06:11.294 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2024-01-25T15:06:11.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.395+0000 7f98a30c2640 1 Processor -- start 2024-01-25T15:06:11.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.395+0000 7f98a30c2640 1 -- start start 2024-01-25T15:06:11.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.396+0000 7f98a30c2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f989c151d60 0x7f989c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:11.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.396+0000 7f98a30c2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f989c0ad030 0x7f989c158690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:11.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.396+0000 7f98a30c2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f989c155010 0x7f989c0ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:11.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.396+0000 7f98a30c2640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f989c152140 con 0x7f989c155010 2024-01-25T15:06:11.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.396+0000 7f98a30c2640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f989c0c9ae0 con 0x7f989c151d60 2024-01-25T15:06:11.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.396+0000 7f98a30c2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989c158bd0 con 0x7f989c0ad030 2024-01-25T15:06:11.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.396+0000 7f98a165f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f989c155010 0x7f989c0ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:11.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.396+0000 7f98a165f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f989c155010 0x7f989c0ae760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54106/0 (socket says 172.21.15.29:54106) 2024-01-25T15:06:11.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.396+0000 7f98a165f640 1 -- 172.21.15.29:0/3798735195 learned_addr learned my addr 172.21.15.29:0/3798735195 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:11.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.397+0000 7f98a165f640 1 -- 172.21.15.29:0/3798735195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f989c0ad030 msgr2=0x7f989c158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:11.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.397+0000 7f98a0e5e640 1 --2- 172.21.15.29:0/3798735195 >> v2:172.21.15.52:3300/0 conn(0x7f989c151d60 0x7f989c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:11.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.397+0000 7f989bfff640 1 --2- 172.21.15.29:0/3798735195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f989c0ad030 0x7f989c158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:11.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.397+0000 7f98a165f640 1 --2- 172.21.15.29:0/3798735195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f989c0ad030 0x7f989c158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.397+0000 7f98a165f640 1 -- 172.21.15.29:0/3798735195 >> v2:172.21.15.52:3300/0 conn(0x7f989c151d60 msgr2=0x7f989c155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:11.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.397+0000 7f98a165f640 1 --2- 172.21.15.29:0/3798735195 >> v2:172.21.15.52:3300/0 conn(0x7f989c151d60 0x7f989c155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.397+0000 7f98a165f640 1 -- 172.21.15.29:0/3798735195 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c0c9520 con 0x7f989c155010 2024-01-25T15:06:11.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.397+0000 7f98a165f640 1 --2- 172.21.15.29:0/3798735195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f989c155010 0x7f989c0ae760 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f989c072d90 tx=0x7f989402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a18360a2ea7bd6d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:11.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.398+0000 7f989b7fe640 1 -- 172.21.15.29:0/3798735195 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989402ca70 con 0x7f989c155010 2024-01-25T15:06:11.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.398+0000 7f989b7fe640 1 -- 172.21.15.29:0/3798735195 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989402cbd0 con 0x7f989c155010 2024-01-25T15:06:11.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.398+0000 7f989b7fe640 1 -- 172.21.15.29:0/3798735195 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98940343f0 con 0x7f989c155010 2024-01-25T15:06:11.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.398+0000 7f98a30c2640 1 -- 172.21.15.29:0/3798735195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f989c155010 msgr2=0x7f989c0ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:11.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.398+0000 7f98a30c2640 1 --2- 172.21.15.29:0/3798735195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f989c155010 0x7f989c0ae760 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f989c072d90 tx=0x7f989402bed0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.398+0000 7f98a30c2640 1 -- 172.21.15.29:0/3798735195 shutdown_connections 2024-01-25T15:06:11.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.398+0000 7f98a30c2640 1 --2- 172.21.15.29:0/3798735195 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f989c0ad030 0x7f989c158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.398+0000 7f98a30c2640 1 --2- 172.21.15.29:0/3798735195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f989c155010 0x7f989c0ae760 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.398+0000 7f98a30c2640 1 --2- 172.21.15.29:0/3798735195 >> v2:172.21.15.52:3300/0 conn(0x7f989c151d60 0x7f989c155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.398+0000 7f98a30c2640 1 -- 172.21.15.29:0/3798735195 >> 172.21.15.29:0/3798735195 conn(0x7f989c072420 msgr2=0x7f989c0abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.398+0000 7f98a30c2640 1 -- 172.21.15.29:0/3798735195 shutdown_connections 2024-01-25T15:06:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.398+0000 7f98a30c2640 1 -- 172.21.15.29:0/3798735195 wait complete. 2024-01-25T15:06:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.399+0000 7f98a30c2640 1 Processor -- start 2024-01-25T15:06:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.399+0000 7f98a30c2640 1 -- start start 2024-01-25T15:06:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.400+0000 7f98a30c2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f989c0ad030 0x7f989c14ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.400+0000 7f98a30c2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f989c151d60 0x7f989c06c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.400+0000 7f98a30c2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f989c155010 0x7f989c148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.400+0000 7f98a30c2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c06c100 con 0x7f989c155010 2024-01-25T15:06:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.400+0000 7f98a30c2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c14efa0 con 0x7f989c0ad030 2024-01-25T15:06:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.400+0000 7f98a30c2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989c0c4110 con 0x7f989c151d60 2024-01-25T15:06:11.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.400+0000 7f98a165f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f989c155010 0x7f989c148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:11.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.400+0000 7f98a165f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f989c155010 0x7f989c148950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54110/0 (socket says 172.21.15.29:54110) 2024-01-25T15:06:11.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.400+0000 7f98a165f640 1 -- 172.21.15.29:0/3045036125 learned_addr learned my addr 172.21.15.29:0/3045036125 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:11.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.400+0000 7f98a0e5e640 1 --2- 172.21.15.29:0/3045036125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f989c0ad030 0x7f989c14ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:11.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.400+0000 7f989bfff640 1 --2- 172.21.15.29:0/3045036125 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f989c151d60 0x7f989c06c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:11.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.400+0000 7f98a165f640 1 -- 172.21.15.29:0/3045036125 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f989c151d60 msgr2=0x7f989c06c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:11.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.400+0000 7f98a165f640 1 --2- 172.21.15.29:0/3045036125 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f989c151d60 0x7f989c06c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.401+0000 7f98a165f640 1 -- 172.21.15.29:0/3045036125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f989c0ad030 msgr2=0x7f989c14ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:11.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.401+0000 7f98a165f640 1 --2- 172.21.15.29:0/3045036125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f989c0ad030 0x7f989c14ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.401+0000 7f98a165f640 1 -- 172.21.15.29:0/3045036125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9894009b30 con 0x7f989c155010 2024-01-25T15:06:11.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.401+0000 7f98a165f640 1 --2- 172.21.15.29:0/3045036125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f989c155010 0x7f989c148950 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9894036040 tx=0x7f9894004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:11.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.401+0000 7f98997fa640 1 -- 172.21.15.29:0/3045036125 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894009510 con 0x7f989c155010 2024-01-25T15:06:11.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.401+0000 7f98997fa640 1 -- 172.21.15.29:0/3045036125 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989403e450 con 0x7f989c155010 2024-01-25T15:06:11.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.401+0000 7f98a30c2640 1 -- 172.21.15.29:0/3045036125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989c06ca60 con 0x7f989c155010 2024-01-25T15:06:11.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.401+0000 7f98997fa640 1 -- 172.21.15.29:0/3045036125 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989403e800 con 0x7f989c155010 2024-01-25T15:06:11.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.401+0000 7f98a30c2640 1 -- 172.21.15.29:0/3045036125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989c14dae0 con 0x7f989c155010 2024-01-25T15:06:11.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.402+0000 7f98a30c2640 1 -- 172.21.15.29:0/3045036125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f989c06c240 con 0x7f989c155010 2024-01-25T15:06:11.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.402+0000 7f98997fa640 1 -- 172.21.15.29:0/3045036125 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f989403e960 con 0x7f989c155010 2024-01-25T15:06:11.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.403+0000 7f98997fa640 1 --2- 172.21.15.29:0/3045036125 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f988006af00 0x7f988006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:11.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.403+0000 7f98997fa640 1 -- 172.21.15.29:0/3045036125 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f98940abff0 con 0x7f989c155010 2024-01-25T15:06:11.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.403+0000 7f98a0e5e640 1 --2- 172.21.15.29:0/3045036125 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f988006af00 0x7f988006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:11.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.403+0000 7f98a0e5e640 1 --2- 172.21.15.29:0/3045036125 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f988006af00 0x7f988006d3c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f989000b7c0 tx=0x7f9890008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:11.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.407+0000 7f98997fa640 1 -- 172.21.15.29:0/3045036125 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f989c06c240 con 0x7f989c155010 2024-01-25T15:06:11.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.654+0000 7f98a30c2640 1 -- 172.21.15.29:0/3045036125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f989c06c240 con 0x7f989c155010 2024-01-25T15:06:11.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.950+0000 7f98997fa640 1 -- 172.21.15.29:0/3045036125 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v126) v1 ==== 159+0+0 (secure 0 0 0) 0x7f989c06c240 con 0x7f989c155010 2024-01-25T15:06:11.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.953+0000 7f98a30c2640 1 -- 172.21.15.29:0/3045036125 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f988006af00 msgr2=0x7f988006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:11.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.953+0000 7f98a30c2640 1 --2- 172.21.15.29:0/3045036125 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f988006af00 0x7f988006d3c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f989000b7c0 tx=0x7f9890008040 comp rx=0 tx=0).stop 2024-01-25T15:06:11.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.953+0000 7f98a30c2640 1 -- 172.21.15.29:0/3045036125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f989c155010 msgr2=0x7f989c148950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:11.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.953+0000 7f98a30c2640 1 --2- 172.21.15.29:0/3045036125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f989c155010 0x7f989c148950 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9894036040 tx=0x7f9894004a40 comp rx=0 tx=0).stop 2024-01-25T15:06:11.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.953+0000 7f98a30c2640 1 -- 172.21.15.29:0/3045036125 shutdown_connections 2024-01-25T15:06:11.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.953+0000 7f98a30c2640 1 --2- 172.21.15.29:0/3045036125 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f988006af00 0x7f988006d3c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.953+0000 7f98a30c2640 1 --2- 172.21.15.29:0/3045036125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f989c155010 0x7f989c148950 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.953+0000 7f98a30c2640 1 --2- 172.21.15.29:0/3045036125 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f989c151d60 0x7f989c06c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.953+0000 7f98a30c2640 1 --2- 172.21.15.29:0/3045036125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f989c0ad030 0x7f989c14ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:11.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.953+0000 7f98a30c2640 1 -- 172.21.15.29:0/3045036125 >> 172.21.15.29:0/3045036125 conn(0x7f989c072420 msgr2=0x7f989c0a9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:11.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.953+0000 7f98a30c2640 1 -- 172.21.15.29:0/3045036125 shutdown_connections 2024-01-25T15:06:11.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:11.953+0000 7f98a30c2640 1 -- 172.21.15.29:0/3045036125 wait complete. 2024-01-25T15:06:11.966 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... FAIL 2024-01-25T15:06:11.966 INFO:tasks.cephfs_test_runner: 2024-01-25T15:06:11.966 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-25T15:06:11.966 INFO:tasks.cephfs_test_runner:FAIL: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2024-01-25T15:06:11.966 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-25T15:06:11.967 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-25T15:06:11.967 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/cephfs/test_multifs_auth.py", line 293, in test_mount_all_caps_absent 2024-01-25T15:06:11.967 INFO:tasks.cephfs_test_runner: self.check_that_mount_failed_for_right_reason(retval[2]) 2024-01-25T15:06:11.967 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/cephfs/test_multifs_auth.py", line 274, in check_that_mount_failed_for_right_reason 2024-01-25T15:06:11.967 INFO:tasks.cephfs_test_runner: raise AssertionError('can\'t find expected set of words in the ' 2024-01-25T15:06:11.967 INFO:tasks.cephfs_test_runner:AssertionError: can't find expected set of words in the stderr 2024-01-25T15:06:11.967 INFO:tasks.cephfs_test_runner:self.errmsgs - ('permission denied', 'no mds server is up or the cluster is laggy', 'no such file or directory', 'input/output error') 2024-01-25T15:06:11.967 INFO:tasks.cephfs_test_runner:stderr - mount.ceph: kernel bug! 2024-01-25T15:06:11.967 INFO:tasks.cephfs_test_runner:mount error: no mds (metadata server) is up. the cluster might be laggy, or you may not be authorized 2024-01-25T15:06:11.967 INFO:tasks.cephfs_test_runner: 2024-01-25T15:06:11.967 INFO:tasks.cephfs_test_runner: 2024-01-25T15:06:11.967 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-25T15:06:11.967 INFO:tasks.cephfs_test_runner:Ran 1 test in 67.115s 2024-01-25T15:06:11.967 INFO:tasks.cephfs_test_runner: 2024-01-25T15:06:11.967 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-01-25T15:06:11.967 INFO:tasks.cephfs_test_runner: 2024-01-25T15:06:11.967 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-25T15:06:11.967 INFO:tasks.cephfs_test_runner:FAIL: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2024-01-25T15:06:11.968 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-25T15:06:11.968 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-25T15:06:11.968 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/cephfs/test_multifs_auth.py", line 293, in test_mount_all_caps_absent 2024-01-25T15:06:11.968 INFO:tasks.cephfs_test_runner: self.check_that_mount_failed_for_right_reason(retval[2]) 2024-01-25T15:06:11.968 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/cephfs/test_multifs_auth.py", line 274, in check_that_mount_failed_for_right_reason 2024-01-25T15:06:11.968 INFO:tasks.cephfs_test_runner: raise AssertionError('can\'t find expected set of words in the ' 2024-01-25T15:06:11.968 INFO:tasks.cephfs_test_runner:AssertionError: can't find expected set of words in the stderr 2024-01-25T15:06:11.968 INFO:tasks.cephfs_test_runner:self.errmsgs - ('permission denied', 'no mds server is up or the cluster is laggy', 'no such file or directory', 'input/output error') 2024-01-25T15:06:11.968 INFO:tasks.cephfs_test_runner:stderr - mount.ceph: kernel bug! 2024-01-25T15:06:11.968 INFO:tasks.cephfs_test_runner:mount error: no mds (metadata server) is up. the cluster might be laggy, or you may not be authorized 2024-01-25T15:06:11.968 INFO:tasks.cephfs_test_runner: 2024-01-25T15:06:11.968 INFO:tasks.cephfs_test_runner: 2024-01-25T15:06:11.969 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2024-01-25T15:06:12.203 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=fae7829f7b8c457b83068fce3fe9a775 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2024-01-25T15:06:12.204 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-01-25T15:06:12.220 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-01-25T15:06:12.228 INFO:tasks.kclient:Unmounting kernel clients... 2024-01-25T15:06:12.228 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-01-25T15:06:12.228 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:06:12.257 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057150,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498940k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17629 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249468k,nr_inodes=812367,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498940k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-25T15:06:12.257 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-01-25T15:06:12.257 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:06:12.276 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057151,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498940k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15783 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249468k,nr_inodes=812367,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498940k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-01-25T15:06:12.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:06:12.277 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-01-25T15:06:12.313 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-25T15:06:12.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:06:12.313 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-25T15:06:12.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:06:12.383 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2024-01-25T15:06:12.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:06:12.482 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-01-25T15:06:12.499 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-25T15:06:12.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:06:12.500 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-25T15:06:12.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:06:12.572 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2024-01-25T15:06:12.675 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-25T15:06:12.685 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-25T15:06:12.685 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-25T15:06:12.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.790+0000 7fb9a8c56640 1 Processor -- start 2024-01-25T15:06:12.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.790+0000 7fb9a8c56640 1 -- start start 2024-01-25T15:06:12.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.790+0000 7fb9a8c56640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb9a414eb20 0x7fb9a40c1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:12.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.790+0000 7fb9a8c56640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9a40c37b0 0x7fb9a406d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:12.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.790+0000 7fb9a8c56640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb9a40c2140 0x7fb9a406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:12.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.790+0000 7fb9a8c56640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a414ef00 con 0x7fb9a414eb20 2024-01-25T15:06:12.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.790+0000 7fb9a8c56640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a40c2a80 con 0x7fb9a40c2140 2024-01-25T15:06:12.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.790+0000 7fb9a8c56640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a4155720 con 0x7fb9a40c37b0 2024-01-25T15:06:12.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.790+0000 7fb9a259c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb9a414eb20 0x7fb9a40c1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:12.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.791+0000 7fb9a259c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb9a414eb20 0x7fb9a40c1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54118/0 (socket says 172.21.15.29:54118) 2024-01-25T15:06:12.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.791+0000 7fb9a259c640 1 -- 172.21.15.29:0/3227987300 learned_addr learned my addr 172.21.15.29:0/3227987300 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:12.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.791+0000 7fb999d9b640 1 --2- 172.21.15.29:0/3227987300 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9a40c37b0 0x7fb9a406d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:12.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.791+0000 7fb9a2d9d640 1 --2- 172.21.15.29:0/3227987300 >> v2:172.21.15.52:3300/0 conn(0x7fb9a40c2140 0x7fb9a406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:12.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.791+0000 7fb9a259c640 1 -- 172.21.15.29:0/3227987300 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9a40c37b0 msgr2=0x7fb9a406d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:12.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.791+0000 7fb9a259c640 1 --2- 172.21.15.29:0/3227987300 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9a40c37b0 0x7fb9a406d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:12.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.791+0000 7fb9a259c640 1 -- 172.21.15.29:0/3227987300 >> v2:172.21.15.52:3300/0 conn(0x7fb9a40c2140 msgr2=0x7fb9a406d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:12.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.791+0000 7fb9a259c640 1 --2- 172.21.15.29:0/3227987300 >> v2:172.21.15.52:3300/0 conn(0x7fb9a40c2140 0x7fb9a406d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:12.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.791+0000 7fb9a259c640 1 -- 172.21.15.29:0/3227987300 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a40c2cd0 con 0x7fb9a414eb20 2024-01-25T15:06:12.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.791+0000 7fb999d9b640 1 --2- 172.21.15.29:0/3227987300 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9a40c37b0 0x7fb9a406d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:12.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.791+0000 7fb9a2d9d640 1 --2- 172.21.15.29:0/3227987300 >> v2:172.21.15.52:3300/0 conn(0x7fb9a40c2140 0x7fb9a406d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:12.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.792+0000 7fb9a259c640 1 --2- 172.21.15.29:0/3227987300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9a414eb20 0x7fb9a40c1c00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40702a0 tx=0x7fb99402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f086fc2e9a1cae9 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:12.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.792+0000 7fb9a1d9b640 1 -- 172.21.15.29:0/3227987300 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb994031870 con 0x7fb9a414eb20 2024-01-25T15:06:12.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.792+0000 7fb9a1d9b640 1 -- 172.21.15.29:0/3227987300 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9940319d0 con 0x7fb9a414eb20 2024-01-25T15:06:12.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.792+0000 7fb9a1d9b640 1 -- 172.21.15.29:0/3227987300 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb994031d60 con 0x7fb9a414eb20 2024-01-25T15:06:12.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.792+0000 7fb9a8c56640 1 -- 172.21.15.29:0/3227987300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9a414eb20 msgr2=0x7fb9a40c1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:12.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.792+0000 7fb9a8c56640 1 --2- 172.21.15.29:0/3227987300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9a414eb20 0x7fb9a40c1c00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40702a0 tx=0x7fb99402b910 comp rx=0 tx=0).stop 2024-01-25T15:06:12.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.792+0000 7fb9a8c56640 1 -- 172.21.15.29:0/3227987300 shutdown_connections 2024-01-25T15:06:12.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.792+0000 7fb9a8c56640 1 --2- 172.21.15.29:0/3227987300 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9a40c37b0 0x7fb9a406d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:12.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.792+0000 7fb9a8c56640 1 --2- 172.21.15.29:0/3227987300 >> v2:172.21.15.52:3300/0 conn(0x7fb9a40c2140 0x7fb9a406d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:12.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.792+0000 7fb9a8c56640 1 --2- 172.21.15.29:0/3227987300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9a414eb20 0x7fb9a40c1c00 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:12.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.792+0000 7fb9a8c56640 1 -- 172.21.15.29:0/3227987300 >> 172.21.15.29:0/3227987300 conn(0x7fb9a40a8be0 msgr2=0x7fb9a406a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:12.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.792+0000 7fb9a8c56640 1 -- 172.21.15.29:0/3227987300 shutdown_connections 2024-01-25T15:06:12.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.792+0000 7fb9a8c56640 1 -- 172.21.15.29:0/3227987300 wait complete. 2024-01-25T15:06:12.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.794+0000 7fb9a8c56640 1 Processor -- start 2024-01-25T15:06:12.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.794+0000 7fb9a8c56640 1 -- start start 2024-01-25T15:06:12.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.795+0000 7fb9a8c56640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9a40c2140 0x7fb9a41443a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:12.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.795+0000 7fb9a8c56640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9a40c37b0 0x7fb9a41ecdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:12.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.795+0000 7fb9a8c56640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9a414eb20 0x7fb9a414fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:12.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.795+0000 7fb9a8c56640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a41edc10 con 0x7fb9a40c37b0 2024-01-25T15:06:12.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.795+0000 7fb9a8c56640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a41518a0 con 0x7fb9a414eb20 2024-01-25T15:06:12.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.795+0000 7fb9a8c56640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a41ed8a0 con 0x7fb9a40c2140 2024-01-25T15:06:12.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.795+0000 7fb999d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9a40c37b0 0x7fb9a41ecdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:12.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.795+0000 7fb999d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9a40c37b0 0x7fb9a41ecdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54122/0 (socket says 172.21.15.29:54122) 2024-01-25T15:06:12.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.795+0000 7fb999d9b640 1 -- 172.21.15.29:0/1649890698 learned_addr learned my addr 172.21.15.29:0/1649890698 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:12.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.795+0000 7fb9a259c640 1 --2- 172.21.15.29:0/1649890698 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9a40c2140 0x7fb9a41443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:12.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.795+0000 7fb9a2d9d640 1 --2- 172.21.15.29:0/1649890698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9a414eb20 0x7fb9a414fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:12.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.795+0000 7fb999d9b640 1 -- 172.21.15.29:0/1649890698 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9a40c2140 msgr2=0x7fb9a41443a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:12.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.795+0000 7fb999d9b640 1 --2- 172.21.15.29:0/1649890698 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9a40c2140 0x7fb9a41443a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:12.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.795+0000 7fb999d9b640 1 -- 172.21.15.29:0/1649890698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9a414eb20 msgr2=0x7fb9a414fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:12.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.795+0000 7fb999d9b640 1 --2- 172.21.15.29:0/1649890698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9a414eb20 0x7fb9a414fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:12.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.795+0000 7fb999d9b640 1 -- 172.21.15.29:0/1649890698 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9940094d0 con 0x7fb9a40c37b0 2024-01-25T15:06:12.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.795+0000 7fb9a2d9d640 1 --2- 172.21.15.29:0/1649890698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9a414eb20 0x7fb9a414fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:06:12.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.795+0000 7fb999d9b640 1 --2- 172.21.15.29:0/1649890698 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9a40c37b0 0x7fb9a41ecdf0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00e730 tx=0x7fb98c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:12.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.796+0000 7fb99b7fe640 1 -- 172.21.15.29:0/1649890698 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c004230 con 0x7fb9a40c37b0 2024-01-25T15:06:12.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.796+0000 7fb99b7fe640 1 -- 172.21.15.29:0/1649890698 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98c004390 con 0x7fb9a40c37b0 2024-01-25T15:06:12.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.796+0000 7fb9a8c56640 1 -- 172.21.15.29:0/1649890698 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a41509e0 con 0x7fb9a40c37b0 2024-01-25T15:06:12.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.796+0000 7fb99b7fe640 1 -- 172.21.15.29:0/1649890698 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c00c8f0 con 0x7fb9a40c37b0 2024-01-25T15:06:12.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.796+0000 7fb9a8c56640 1 -- 172.21.15.29:0/1649890698 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a4151140 con 0x7fb9a40c37b0 2024-01-25T15:06:12.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.797+0000 7fb9a8c56640 1 -- 172.21.15.29:0/1649890698 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a4074080 con 0x7fb9a40c37b0 2024-01-25T15:06:12.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.797+0000 7fb99b7fe640 1 -- 172.21.15.29:0/1649890698 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fb98c00ca50 con 0x7fb9a40c37b0 2024-01-25T15:06:12.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.798+0000 7fb99b7fe640 1 --2- 172.21.15.29:0/1649890698 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb98406aed0 0x7fb98406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:12.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.798+0000 7fb99b7fe640 1 -- 172.21.15.29:0/1649890698 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fb98c088ff0 con 0x7fb9a40c37b0 2024-01-25T15:06:12.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.798+0000 7fb9a259c640 1 --2- 172.21.15.29:0/1649890698 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb98406aed0 0x7fb98406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:12.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.798+0000 7fb9a259c640 1 --2- 172.21.15.29:0/1649890698 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb98406aed0 0x7fb98406d390 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb994036000 tx=0x7fb99403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:12.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.802+0000 7fb99b7fe640 1 -- 172.21.15.29:0/1649890698 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fb98c0540b0 con 0x7fb9a40c37b0 2024-01-25T15:06:12.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.978+0000 7fb9a8c56640 1 -- 172.21.15.29:0/1649890698 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb9a41553b0 con 0x7fb98406aed0 2024-01-25T15:06:12.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.981+0000 7fb99b7fe640 1 -- 172.21.15.29:0/1649890698 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50362 (secure 0 0 0) 0x7fb994031bc0 con 0x7fb98406aed0 2024-01-25T15:06:12.982 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:06:12.982 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-25T15:06:12.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.983+0000 7fb9a8c56640 1 -- 172.21.15.29:0/1649890698 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb98406aed0 msgr2=0x7fb98406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:12.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.983+0000 7fb9a8c56640 1 --2- 172.21.15.29:0/1649890698 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb98406aed0 0x7fb98406d390 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb994036000 tx=0x7fb99403c040 comp rx=0 tx=0).stop 2024-01-25T15:06:12.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.983+0000 7fb9a8c56640 1 -- 172.21.15.29:0/1649890698 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9a40c37b0 msgr2=0x7fb9a41ecdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:12.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.983+0000 7fb9a8c56640 1 --2- 172.21.15.29:0/1649890698 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9a40c37b0 0x7fb9a41ecdf0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00e730 tx=0x7fb98c00ebf0 comp rx=0 tx=0).stop 2024-01-25T15:06:12.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.983+0000 7fb9a8c56640 1 -- 172.21.15.29:0/1649890698 shutdown_connections 2024-01-25T15:06:12.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.983+0000 7fb9a8c56640 1 --2- 172.21.15.29:0/1649890698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9a414eb20 0x7fb9a414fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:12.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.983+0000 7fb9a8c56640 1 --2- 172.21.15.29:0/1649890698 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fb98406aed0 0x7fb98406d390 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:12.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.983+0000 7fb9a8c56640 1 --2- 172.21.15.29:0/1649890698 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9a40c37b0 0x7fb9a41ecdf0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:12.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.983+0000 7fb9a8c56640 1 --2- 172.21.15.29:0/1649890698 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb9a40c2140 0x7fb9a41443a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:12.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.983+0000 7fb9a8c56640 1 -- 172.21.15.29:0/1649890698 >> 172.21.15.29:0/1649890698 conn(0x7fb9a40a8be0 msgr2=0x7fb9a40a96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:12.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.983+0000 7fb9a8c56640 1 -- 172.21.15.29:0/1649890698 shutdown_connections 2024-01-25T15:06:12.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:12.983+0000 7fb9a8c56640 1 -- 172.21.15.29:0/1649890698 wait complete. 2024-01-25T15:06:12.994 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-01-25T15:06:12.942749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":260,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254908,"kb_used_data":5456,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719812,"statfs":{"total":773094113280,"available":772833087488,"internally_reserved":0,"allocated":5586944,"data_stored":3145454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3794,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-48,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.001910"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":217,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-25T15:06:08.441426+0000","last_change":"2024-01-25T15:04:16.181635+0000","last_active":"2024-01-25T15:06:08.441426+0000","last_peered":"2024-01-25T15:06:08.441426+0000","last_clean":"2024-01-25T15:06:08.441426+0000","last_became_active":"2024-01-25T15:04:16.179890+0000","last_became_peered":"2024-01-25T15:04:16.179890+0000","last_unstale":"2024-01-25T15:06:08.441426+0000","last_undegraded":"2024-01-25T15:06:08.441426+0000","last_fullsized":"2024-01-25T15:06:08.441426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_clean_scrub_stamp":"2024-01-25T15:04:14.956188+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:49:00.618327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":830178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.69699999999999995}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.499}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.40300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":552960,"data_stored":246945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.753},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.81100000000000005}]},{"osd":2,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.76600000000000001}]},{"osd":3,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.59299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":544768,"data_stored":246293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68899999999999995}]},{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.502}]},{"osd":2,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.747},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.83799999999999997}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.621},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.879}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.93300000000000005}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.90600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":548864,"data_stored":246875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.57499999999999996}]},{"osd":1,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.441}]},{"osd":2,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":548864,"data_stored":242704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":3.3559999999999999,"5min":3.3559999999999999,"15min":3.3559999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.4209999999999998,"5min":3.4209999999999998,"15min":3.4209999999999998},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.4689999999999999,"5min":3.4689999999999999,"15min":3.4689999999999999},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":3.508,"5min":3.508,"15min":3.508},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.5449999999999999,"5min":3.5449999999999999,"15min":3.5449999999999999},"last":0.56899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31724,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":557056,"data_stored":249289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.247},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.22900000000000001}]},{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.26700000000000002}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.501}]},{"osd":5,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.59799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31724,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":552960,"data_stored":246453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.752}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.70499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1146880,"data_stored":836717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.748},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.60199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:06:12.997 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-25T15:06:13.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.098+0000 7ff24303a640 1 Processor -- start 2024-01-25T15:06:13.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.098+0000 7ff24303a640 1 -- start start 2024-01-25T15:06:13.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.098+0000 7ff24303a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff23c152160 0x7ff23c06bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:13.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.098+0000 7ff24303a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff23c0c4990 0x7ff23c0c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:13.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.098+0000 7ff24303a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff23c0c53e0 0x7ff23c0c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:13.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.098+0000 7ff24303a640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23c155430 con 0x7ff23c0c53e0 2024-01-25T15:06:13.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.098+0000 7ff24303a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23c154b40 con 0x7ff23c0c4990 2024-01-25T15:06:13.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.098+0000 7ff24303a640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c152540 con 0x7ff23c152160 2024-01-25T15:06:13.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.099+0000 7ff2415d7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff23c0c53e0 0x7ff23c0c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:13.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.099+0000 7ff2415d7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff23c0c53e0 0x7ff23c0c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54130/0 (socket says 172.21.15.29:54130) 2024-01-25T15:06:13.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.099+0000 7ff2415d7640 1 -- 172.21.15.29:0/3564873916 learned_addr learned my addr 172.21.15.29:0/3564873916 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:13.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.099+0000 7ff240dd6640 1 --2- 172.21.15.29:0/3564873916 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff23c152160 0x7ff23c06bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:13.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.099+0000 7ff2415d7640 1 -- 172.21.15.29:0/3564873916 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff23c152160 msgr2=0x7ff23c06bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:13.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.099+0000 7ff23bfff640 1 --2- 172.21.15.29:0/3564873916 >> v2:172.21.15.52:3300/0 conn(0x7ff23c0c4990 0x7ff23c0c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:13.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.099+0000 7ff2415d7640 1 --2- 172.21.15.29:0/3564873916 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff23c152160 0x7ff23c06bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.099+0000 7ff2415d7640 1 -- 172.21.15.29:0/3564873916 >> v2:172.21.15.52:3300/0 conn(0x7ff23c0c4990 msgr2=0x7ff23c0c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:13.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.099+0000 7ff2415d7640 1 --2- 172.21.15.29:0/3564873916 >> v2:172.21.15.52:3300/0 conn(0x7ff23c0c4990 0x7ff23c0c4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.099+0000 7ff2415d7640 1 -- 172.21.15.29:0/3564873916 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23c0c64b0 con 0x7ff23c0c53e0 2024-01-25T15:06:13.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.099+0000 7ff240dd6640 1 --2- 172.21.15.29:0/3564873916 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff23c152160 0x7ff23c06bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:06:13.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.099+0000 7ff23bfff640 1 --2- 172.21.15.29:0/3564873916 >> v2:172.21.15.52:3300/0 conn(0x7ff23c0c4990 0x7ff23c0c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:06:13.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.100+0000 7ff2415d7640 1 --2- 172.21.15.29:0/3564873916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff23c0c53e0 0x7ff23c0c7f10 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff23c08b640 tx=0x7ff23402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf01935504dc2855 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:13.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.100+0000 7ff23b7fe640 1 -- 172.21.15.29:0/3564873916 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23402c9e0 con 0x7ff23c0c53e0 2024-01-25T15:06:13.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.100+0000 7ff23b7fe640 1 -- 172.21.15.29:0/3564873916 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23402cb40 con 0x7ff23c0c53e0 2024-01-25T15:06:13.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.100+0000 7ff23b7fe640 1 -- 172.21.15.29:0/3564873916 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2340343f0 con 0x7ff23c0c53e0 2024-01-25T15:06:13.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.100+0000 7ff24303a640 1 -- 172.21.15.29:0/3564873916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff23c0c53e0 msgr2=0x7ff23c0c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:13.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.100+0000 7ff24303a640 1 --2- 172.21.15.29:0/3564873916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff23c0c53e0 0x7ff23c0c7f10 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff23c08b640 tx=0x7ff23402be40 comp rx=0 tx=0).stop 2024-01-25T15:06:13.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.100+0000 7ff24303a640 1 -- 172.21.15.29:0/3564873916 shutdown_connections 2024-01-25T15:06:13.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.100+0000 7ff24303a640 1 --2- 172.21.15.29:0/3564873916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff23c0c53e0 0x7ff23c0c7f10 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.100+0000 7ff24303a640 1 --2- 172.21.15.29:0/3564873916 >> v2:172.21.15.52:3300/0 conn(0x7ff23c0c4990 0x7ff23c0c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.100+0000 7ff24303a640 1 --2- 172.21.15.29:0/3564873916 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff23c152160 0x7ff23c06bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.100+0000 7ff24303a640 1 -- 172.21.15.29:0/3564873916 >> 172.21.15.29:0/3564873916 conn(0x7ff23c0ca1f0 msgr2=0x7ff23c0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:13.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.100+0000 7ff24303a640 1 -- 172.21.15.29:0/3564873916 shutdown_connections 2024-01-25T15:06:13.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.100+0000 7ff24303a640 1 -- 172.21.15.29:0/3564873916 wait complete. 2024-01-25T15:06:13.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.101+0000 7ff24303a640 1 Processor -- start 2024-01-25T15:06:13.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.102+0000 7ff24303a640 1 -- start start 2024-01-25T15:06:13.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.102+0000 7ff24303a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff23c0c4990 0x7ff23c156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:13.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.102+0000 7ff24303a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff23c0c53e0 0x7ff23c0c2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:13.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.102+0000 7ff24303a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23c152160 0x7ff23c0c3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:13.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.102+0000 7ff24303a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0c2130 con 0x7ff23c0c4990 2024-01-25T15:06:13.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.102+0000 7ff24303a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c148e30 con 0x7ff23c152160 2024-01-25T15:06:13.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.102+0000 7ff24303a640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c1edf90 con 0x7ff23c0c53e0 2024-01-25T15:06:13.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.102+0000 7ff240dd6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff23c0c4990 0x7ff23c156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:13.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.102+0000 7ff240dd6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff23c0c4990 0x7ff23c156140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54140/0 (socket says 172.21.15.29:54140) 2024-01-25T15:06:13.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.102+0000 7ff240dd6640 1 -- 172.21.15.29:0/1276920757 learned_addr learned my addr 172.21.15.29:0/1276920757 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:13.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.103+0000 7ff23bfff640 1 --2- 172.21.15.29:0/1276920757 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff23c0c53e0 0x7ff23c0c2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:13.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.103+0000 7ff2415d7640 1 --2- 172.21.15.29:0/1276920757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23c152160 0x7ff23c0c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:13.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.103+0000 7ff240dd6640 1 -- 172.21.15.29:0/1276920757 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff23c0c53e0 msgr2=0x7ff23c0c2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:13.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.103+0000 7ff240dd6640 1 --2- 172.21.15.29:0/1276920757 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff23c0c53e0 0x7ff23c0c2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.103+0000 7ff240dd6640 1 -- 172.21.15.29:0/1276920757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23c152160 msgr2=0x7ff23c0c3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:13.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.103+0000 7ff240dd6640 1 --2- 172.21.15.29:0/1276920757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23c152160 0x7ff23c0c3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.103+0000 7ff240dd6640 1 -- 172.21.15.29:0/1276920757 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff234009b30 con 0x7ff23c0c4990 2024-01-25T15:06:13.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.103+0000 7ff240dd6640 1 --2- 172.21.15.29:0/1276920757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff23c0c4990 0x7ff23c156140 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff23000c820 tx=0x7ff23000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:13.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.103+0000 7ff2397fa640 1 -- 172.21.15.29:0/1276920757 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff230007a30 con 0x7ff23c0c4990 2024-01-25T15:06:13.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.103+0000 7ff2397fa640 1 -- 172.21.15.29:0/1276920757 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff230007b90 con 0x7ff23c0c4990 2024-01-25T15:06:13.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.103+0000 7ff2397fa640 1 -- 172.21.15.29:0/1276920757 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23000ce70 con 0x7ff23c0c4990 2024-01-25T15:06:13.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.103+0000 7ff24303a640 1 -- 172.21.15.29:0/1276920757 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23c0c2310 con 0x7ff23c0c4990 2024-01-25T15:06:13.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.103+0000 7ff24303a640 1 -- 172.21.15.29:0/1276920757 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23c0c28d0 con 0x7ff23c0c4990 2024-01-25T15:06:13.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.104+0000 7ff24303a640 1 -- 172.21.15.29:0/1276920757 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23c0a97d0 con 0x7ff23c0c4990 2024-01-25T15:06:13.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.105+0000 7ff2397fa640 1 -- 172.21.15.29:0/1276920757 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ff2300113f0 con 0x7ff23c0c4990 2024-01-25T15:06:13.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.105+0000 7ff2397fa640 1 --2- 172.21.15.29:0/1276920757 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff22006aed0 0x7ff22006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:13.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.105+0000 7ff2397fa640 1 -- 172.21.15.29:0/1276920757 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7ff2300895b0 con 0x7ff23c0c4990 2024-01-25T15:06:13.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.105+0000 7ff23bfff640 1 --2- 172.21.15.29:0/1276920757 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff22006aed0 0x7ff22006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:13.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.106+0000 7ff23bfff640 1 --2- 172.21.15.29:0/1276920757 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff22006aed0 0x7ff22006d390 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff23c0c93a0 tx=0x7ff228008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:13.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.109+0000 7ff2397fa640 1 -- 172.21.15.29:0/1276920757 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7ff2300545f0 con 0x7ff23c0c4990 2024-01-25T15:06:13.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.288+0000 7ff24303a640 1 -- 172.21.15.29:0/1276920757 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff23c0c5970 con 0x7ff22006aed0 2024-01-25T15:06:13.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.290+0000 7ff2397fa640 1 -- 172.21.15.29:0/1276920757 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50362 (secure 0 0 0) 0x7ff23c0c5970 con 0x7ff22006aed0 2024-01-25T15:06:13.291 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:06:13.292 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-25T15:06:13.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.292+0000 7ff24303a640 1 -- 172.21.15.29:0/1276920757 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff22006aed0 msgr2=0x7ff22006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:13.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.292+0000 7ff24303a640 1 --2- 172.21.15.29:0/1276920757 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff22006aed0 0x7ff22006d390 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff23c0c93a0 tx=0x7ff228008040 comp rx=0 tx=0).stop 2024-01-25T15:06:13.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.292+0000 7ff24303a640 1 -- 172.21.15.29:0/1276920757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff23c0c4990 msgr2=0x7ff23c156140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:13.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.292+0000 7ff24303a640 1 --2- 172.21.15.29:0/1276920757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff23c0c4990 0x7ff23c156140 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff23000c820 tx=0x7ff23000cc20 comp rx=0 tx=0).stop 2024-01-25T15:06:13.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.292+0000 7ff24303a640 1 -- 172.21.15.29:0/1276920757 shutdown_connections 2024-01-25T15:06:13.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.292+0000 7ff24303a640 1 --2- 172.21.15.29:0/1276920757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23c152160 0x7ff23c0c3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.292+0000 7ff24303a640 1 --2- 172.21.15.29:0/1276920757 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff23c0c53e0 0x7ff23c0c2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.292+0000 7ff24303a640 1 --2- 172.21.15.29:0/1276920757 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff22006aed0 0x7ff22006d390 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.292+0000 7ff24303a640 1 --2- 172.21.15.29:0/1276920757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff23c0c4990 0x7ff23c156140 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.292+0000 7ff24303a640 1 -- 172.21.15.29:0/1276920757 >> 172.21.15.29:0/1276920757 conn(0x7ff23c0ca1f0 msgr2=0x7ff23c150930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:13.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.292+0000 7ff24303a640 1 -- 172.21.15.29:0/1276920757 shutdown_connections 2024-01-25T15:06:13.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.292+0000 7ff24303a640 1 -- 172.21.15.29:0/1276920757 wait complete. 2024-01-25T15:06:13.303 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-01-25T15:06:12.942749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":260,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254908,"kb_used_data":5456,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719812,"statfs":{"total":773094113280,"available":772833087488,"internally_reserved":0,"allocated":5586944,"data_stored":3145454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3794,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-48,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.001910"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":217,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-25T15:06:08.441426+0000","last_change":"2024-01-25T15:04:16.181635+0000","last_active":"2024-01-25T15:06:08.441426+0000","last_peered":"2024-01-25T15:06:08.441426+0000","last_clean":"2024-01-25T15:06:08.441426+0000","last_became_active":"2024-01-25T15:04:16.179890+0000","last_became_peered":"2024-01-25T15:04:16.179890+0000","last_unstale":"2024-01-25T15:06:08.441426+0000","last_undegraded":"2024-01-25T15:06:08.441426+0000","last_fullsized":"2024-01-25T15:06:08.441426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_clean_scrub_stamp":"2024-01-25T15:04:14.956188+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:49:00.618327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":830178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.69699999999999995}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.499}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.40300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":552960,"data_stored":246945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.753},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.81100000000000005}]},{"osd":2,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.76600000000000001}]},{"osd":3,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.59299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":544768,"data_stored":246293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68899999999999995}]},{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.502}]},{"osd":2,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.747},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.83799999999999997}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.621},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.879}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.93300000000000005}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.90600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":548864,"data_stored":246875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.57499999999999996}]},{"osd":1,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.441}]},{"osd":2,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":548864,"data_stored":242704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":3.3559999999999999,"5min":3.3559999999999999,"15min":3.3559999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.4209999999999998,"5min":3.4209999999999998,"15min":3.4209999999999998},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.4689999999999999,"5min":3.4689999999999999,"15min":3.4689999999999999},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":3.508,"5min":3.508,"15min":3.508},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.5449999999999999,"5min":3.5449999999999999,"15min":3.5449999999999999},"last":0.56899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31724,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":557056,"data_stored":249289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.247},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.22900000000000001}]},{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.26700000000000002}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.501}]},{"osd":5,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.59799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31724,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":552960,"data_stored":246453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.752}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.70499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1146880,"data_stored":836717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.748},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.60199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:06:13.305 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-25T15:06:13.305 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-25T15:06:13.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.406+0000 7f8db156f640 1 Processor -- start 2024-01-25T15:06:13.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.406+0000 7f8db156f640 1 -- start start 2024-01-25T15:06:13.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8db156f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8dac06e8f0 0x7f8dac152010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:13.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8db156f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dac0c3710 con 0x7f8dac14b5c0 2024-01-25T15:06:13.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8db156f640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dac06db30 con 0x7f8dac0c4510 2024-01-25T15:06:13.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8db156f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dac06d920 con 0x7f8dac06e8f0 2024-01-25T15:06:13.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8daaffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8dac14b5c0 0x7f8dac06ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52446/0 (socket says 172.21.15.29:52446) 2024-01-25T15:06:13.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8daaffd640 1 -- 172.21.15.29:0/3279338035 learned_addr learned my addr 172.21.15.29:0/3279338035 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:13.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8da27fc640 1 --2- 172.21.15.29:0/3279338035 >> v2:172.21.15.52:3300/0 conn(0x7f8dac06e8f0 0x7f8dac152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:13.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8daa7fc640 1 -- 172.21.15.29:0/3279338035 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 784513833 0 0) 0x7f8dac0c3710 con 0x7f8dac14b5c0 2024-01-25T15:06:13.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8daa7fc640 1 -- 172.21.15.29:0/3279338035 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d98005730 con 0x7f8dac14b5c0 2024-01-25T15:06:13.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8daa7fc640 1 -- 172.21.15.29:0/3279338035 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4040352749 0 0) 0x7f8d98005730 con 0x7f8dac14b5c0 2024-01-25T15:06:13.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8daa7fc640 1 -- 172.21.15.29:0/3279338035 >> v2:172.21.15.52:3300/0 conn(0x7f8dac06e8f0 msgr2=0x7f8dac152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:13.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8daa7fc640 1 --2- 172.21.15.29:0/3279338035 >> v2:172.21.15.52:3300/0 conn(0x7f8dac06e8f0 0x7f8dac152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8daa7fc640 1 -- 172.21.15.29:0/3279338035 >> v1:172.21.15.52:6789/0 conn(0x7f8dac0c4510 legacy=0x7f8dac0c1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:13.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8daa7fc640 1 -- 172.21.15.29:0/3279338035 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac06de10 con 0x7f8dac14b5c0 2024-01-25T15:06:13.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8daa7fc640 1 -- 172.21.15.29:0/3279338035 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f8d9c001670 con 0x7f8dac14b5c0 2024-01-25T15:06:13.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8da27fc640 1 --2- 172.21.15.29:0/3279338035 >> v2:172.21.15.52:3300/0 conn(0x7f8dac06e8f0 0x7f8dac152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:06:13.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8daa7fc640 1 -- 172.21.15.29:0/3279338035 >> v1:172.21.15.29:6789/0 conn(0x7f8dac14b5c0 legacy=0x7f8dac06ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:13.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8daa7fc640 1 --2- 172.21.15.29:0/3279338035 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d98005b80 0x7f8d98005f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:13.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8daa7fc640 1 --2- 172.21.15.29:0/3279338035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d980069d0 0x7f8d98006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:13.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8daa7fc640 1 --2- 172.21.15.29:0/3279338035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d98007390 0x7f8d9800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:13.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8daa7fc640 1 -- 172.21.15.29:0/3279338035 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac06d920 con 0x7f8d980069d0 2024-01-25T15:06:13.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8daa7fc640 1 -- 172.21.15.29:0/3279338035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9800e2e0 con 0x7f8d98007390 2024-01-25T15:06:13.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.407+0000 7f8daa7fc640 1 -- 172.21.15.29:0/3279338035 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9800e4a0 con 0x7f8d98005b80 2024-01-25T15:06:13.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.408+0000 7f8da27fc640 1 --2- 172.21.15.29:0/3279338035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d980069d0 0x7f8d98006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:13.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.408+0000 7f8daaffd640 1 --2- 172.21.15.29:0/3279338035 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d98005b80 0x7f8d98005f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:13.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.408+0000 7f8dab7fe640 1 --2- 172.21.15.29:0/3279338035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d98007390 0x7f8d9800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:13.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.408+0000 7f8da27fc640 1 -- 172.21.15.29:0/3279338035 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d98005b80 msgr2=0x7f8d98005f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:13.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.408+0000 7f8da27fc640 1 --2- 172.21.15.29:0/3279338035 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8d98005b80 0x7f8d98005f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.408+0000 7f8da27fc640 1 -- 172.21.15.29:0/3279338035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d98007390 msgr2=0x7f8d9800db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:13.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.408+0000 7f8da27fc640 1 --2- 172.21.15.29:0/3279338035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d98007390 0x7f8d9800db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.408+0000 7f8da27fc640 1 -- 172.21.15.29:0/3279338035 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d98005730 con 0x7f8d980069d0 2024-01-25T15:06:13.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.408+0000 7f8dab7fe640 1 --2- 172.21.15.29:0/3279338035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d98007390 0x7f8d9800db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:13.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.408+0000 7f8dab7fe640 1 -- 172.21.15.29:0/3279338035 reap_dead start 2024-01-25T15:06:13.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.409+0000 7f8da27fc640 1 --2- 172.21.15.29:0/3279338035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d980069d0 0x7f8d98006e50 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f8d94009c90 tx=0x7f8d98007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8af1284f9193aab server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:13.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.409+0000 7f8daa7fc640 1 -- 172.21.15.29:0/3279338035 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9402c8f0 con 0x7f8d980069d0 2024-01-25T15:06:13.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.409+0000 7f8daa7fc640 1 -- 172.21.15.29:0/3279338035 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9402ca50 con 0x7f8d980069d0 2024-01-25T15:06:13.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.409+0000 7f8daa7fc640 1 -- 172.21.15.29:0/3279338035 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9402ce40 con 0x7f8d980069d0 2024-01-25T15:06:13.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.409+0000 7f8db156f640 1 -- 172.21.15.29:0/3279338035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d980069d0 msgr2=0x7f8d98006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:13.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.409+0000 7f8db156f640 1 --2- 172.21.15.29:0/3279338035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d980069d0 0x7f8d98006e50 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f8d94009c90 tx=0x7f8d98007a00 comp rx=0 tx=0).stop 2024-01-25T15:06:13.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.409+0000 7f8db156f640 1 -- 172.21.15.29:0/3279338035 shutdown_connections 2024-01-25T15:06:13.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.409+0000 7f8db156f640 1 --2- 172.21.15.29:0/3279338035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d980069d0 0x7f8d98006e50 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.409+0000 7f8db156f640 1 -- 172.21.15.29:0/3279338035 >> 172.21.15.29:0/3279338035 conn(0x7f8dac0c3a20 msgr2=0x7f8dac0c3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:13.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.409+0000 7f8db156f640 1 -- 172.21.15.29:0/3279338035 shutdown_connections 2024-01-25T15:06:13.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.409+0000 7f8db156f640 1 -- 172.21.15.29:0/3279338035 wait complete. 2024-01-25T15:06:13.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.410+0000 7f8db156f640 1 Processor -- start 2024-01-25T15:06:13.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.411+0000 7f8db156f640 1 -- start start 2024-01-25T15:06:13.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.411+0000 7f8db156f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d980069d0 0x7f8dac14c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:13.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.411+0000 7f8db156f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8dac155630 0x7f8dac153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:13.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.411+0000 7f8db156f640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8dac0a9340 0x7f8dac1e5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:13.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.411+0000 7f8db156f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac14cd20 con 0x7f8dac155630 2024-01-25T15:06:13.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.411+0000 7f8db156f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac153690 con 0x7f8d980069d0 2024-01-25T15:06:13.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.411+0000 7f8db156f640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac1e6230 con 0x7f8dac0a9340 2024-01-25T15:06:13.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.411+0000 7f8da27fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8dac155630 0x7f8dac153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:13.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.411+0000 7f8da27fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8dac155630 0x7f8dac153e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54162/0 (socket says 172.21.15.29:54162) 2024-01-25T15:06:13.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.411+0000 7f8da27fc640 1 -- 172.21.15.29:0/977831532 learned_addr learned my addr 172.21.15.29:0/977831532 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:13.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.412+0000 7f8daaffd640 1 --2- 172.21.15.29:0/977831532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d980069d0 0x7f8dac14c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:13.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.412+0000 7f8dab7fe640 1 --2- 172.21.15.29:0/977831532 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8dac0a9340 0x7f8dac1e5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:13.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.412+0000 7f8da27fc640 1 -- 172.21.15.29:0/977831532 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8dac0a9340 msgr2=0x7f8dac1e5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:13.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.412+0000 7f8da27fc640 1 --2- 172.21.15.29:0/977831532 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8dac0a9340 0x7f8dac1e5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.412+0000 7f8da27fc640 1 -- 172.21.15.29:0/977831532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d980069d0 msgr2=0x7f8dac14c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:13.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.412+0000 7f8da27fc640 1 --2- 172.21.15.29:0/977831532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d980069d0 0x7f8dac14c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.412+0000 7f8da27fc640 1 -- 172.21.15.29:0/977831532 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac153930 con 0x7f8dac155630 2024-01-25T15:06:13.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.412+0000 7f8daaffd640 1 --2- 172.21.15.29:0/977831532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d980069d0 0x7f8dac14c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:06:13.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.412+0000 7f8dab7fe640 1 --2- 172.21.15.29:0/977831532 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8dac0a9340 0x7f8dac1e5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:06:13.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.412+0000 7f8da27fc640 1 --2- 172.21.15.29:0/977831532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8dac155630 0x7f8dac153e50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8d94037040 tx=0x7f8d94004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:13.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.412+0000 7f8da3fff640 1 -- 172.21.15.29:0/977831532 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d94006e30 con 0x7f8dac155630 2024-01-25T15:06:13.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.412+0000 7f8da3fff640 1 -- 172.21.15.29:0/977831532 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d94034a60 con 0x7f8dac155630 2024-01-25T15:06:13.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.412+0000 7f8da3fff640 1 -- 172.21.15.29:0/977831532 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d94034df0 con 0x7f8dac155630 2024-01-25T15:06:13.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.412+0000 7f8db156f640 1 -- 172.21.15.29:0/977831532 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dac1e6510 con 0x7f8dac155630 2024-01-25T15:06:13.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.412+0000 7f8db156f640 1 -- 172.21.15.29:0/977831532 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dac154390 con 0x7f8dac155630 2024-01-25T15:06:13.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.413+0000 7f8db156f640 1 -- 172.21.15.29:0/977831532 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dac074080 con 0x7f8dac155630 2024-01-25T15:06:13.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.414+0000 7f8da3fff640 1 -- 172.21.15.29:0/977831532 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8d94040450 con 0x7f8dac155630 2024-01-25T15:06:13.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.414+0000 7f8da3fff640 1 --2- 172.21.15.29:0/977831532 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8d8c06aed0 0x7f8d8c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:13.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.414+0000 7f8da3fff640 1 -- 172.21.15.29:0/977831532 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f8d940ab6d0 con 0x7f8dac155630 2024-01-25T15:06:13.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.414+0000 7f8daaffd640 1 --2- 172.21.15.29:0/977831532 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8d8c06aed0 0x7f8d8c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:13.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.415+0000 7f8daaffd640 1 --2- 172.21.15.29:0/977831532 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8d8c06aed0 0x7f8d8c06d390 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c0010e0 tx=0x7f8d9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:13.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.418+0000 7f8da3fff640 1 -- 172.21.15.29:0/977831532 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8d94076790 con 0x7f8dac155630 2024-01-25T15:06:13.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.596+0000 7f8db156f640 1 -- 172.21.15.29:0/977831532 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8dac06e3d0 con 0x7f8d8c06aed0 2024-01-25T15:06:13.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.599+0000 7f8da3fff640 1 -- 172.21.15.29:0/977831532 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50362 (secure 0 0 0) 0x7f8d9c007e50 con 0x7f8d8c06aed0 2024-01-25T15:06:13.600 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:06:13.600 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-25T15:06:13.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.600+0000 7f8db156f640 1 -- 172.21.15.29:0/977831532 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8d8c06aed0 msgr2=0x7f8d8c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:13.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.600+0000 7f8db156f640 1 --2- 172.21.15.29:0/977831532 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8d8c06aed0 0x7f8d8c06d390 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c0010e0 tx=0x7f8d9c009040 comp rx=0 tx=0).stop 2024-01-25T15:06:13.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.600+0000 7f8db156f640 1 -- 172.21.15.29:0/977831532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8dac155630 msgr2=0x7f8dac153e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:13.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.600+0000 7f8db156f640 1 --2- 172.21.15.29:0/977831532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8dac155630 0x7f8dac153e50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8d94037040 tx=0x7f8d94004730 comp rx=0 tx=0).stop 2024-01-25T15:06:13.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.600+0000 7f8db156f640 1 -- 172.21.15.29:0/977831532 shutdown_connections 2024-01-25T15:06:13.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.600+0000 7f8db156f640 1 --2- 172.21.15.29:0/977831532 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8dac0a9340 0x7f8dac1e5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.600+0000 7f8db156f640 1 --2- 172.21.15.29:0/977831532 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f8d8c06aed0 0x7f8d8c06d390 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.600+0000 7f8db156f640 1 --2- 172.21.15.29:0/977831532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8dac155630 0x7f8dac153e50 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.600+0000 7f8db156f640 1 --2- 172.21.15.29:0/977831532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d980069d0 0x7f8dac14c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.600+0000 7f8db156f640 1 -- 172.21.15.29:0/977831532 >> 172.21.15.29:0/977831532 conn(0x7f8dac0c3a20 msgr2=0x7f8dac0c5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:13.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.601+0000 7f8db156f640 1 -- 172.21.15.29:0/977831532 shutdown_connections 2024-01-25T15:06:13.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.601+0000 7f8db156f640 1 -- 172.21.15.29:0/977831532 wait complete. 2024-01-25T15:06:13.612 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-01-25T15:06:12.942749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":260,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254908,"kb_used_data":5456,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719812,"statfs":{"total":773094113280,"available":772833087488,"internally_reserved":0,"allocated":5586944,"data_stored":3145454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3794,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-48,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.001910"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":217,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-01-25T15:06:08.441426+0000","last_change":"2024-01-25T15:04:16.181635+0000","last_active":"2024-01-25T15:06:08.441426+0000","last_peered":"2024-01-25T15:06:08.441426+0000","last_clean":"2024-01-25T15:06:08.441426+0000","last_became_active":"2024-01-25T15:04:16.179890+0000","last_became_peered":"2024-01-25T15:04:16.179890+0000","last_unstale":"2024-01-25T15:06:08.441426+0000","last_undegraded":"2024-01-25T15:06:08.441426+0000","last_fullsized":"2024-01-25T15:06:08.441426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_clean_scrub_stamp":"2024-01-25T15:04:14.956188+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:49:00.618327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":830178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.69699999999999995}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.499}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.40300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":552960,"data_stored":246945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.753},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.81100000000000005}]},{"osd":2,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.76600000000000001}]},{"osd":3,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.59299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":544768,"data_stored":246293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68899999999999995}]},{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.502}]},{"osd":2,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.747},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.83799999999999997}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.621},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.879}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.93300000000000005}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.90600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":548864,"data_stored":246875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.57499999999999996}]},{"osd":1,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.441}]},{"osd":2,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":548864,"data_stored":242704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":3.3559999999999999,"5min":3.3559999999999999,"15min":3.3559999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.4209999999999998,"5min":3.4209999999999998,"15min":3.4209999999999998},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.4689999999999999,"5min":3.4689999999999999,"15min":3.4689999999999999},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":3.508,"5min":3.508,"15min":3.508},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.5449999999999999,"5min":3.5449999999999999,"15min":3.5449999999999999},"last":0.56899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31724,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":557056,"data_stored":249289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.247},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.22900000000000001}]},{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.26700000000000002}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.501}]},{"osd":5,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.59799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31724,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":552960,"data_stored":246453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.752}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.70499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1146880,"data_stored":836717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.748},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.60199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:06:13.614 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:06:13.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.714+0000 7fcceebd1640 1 Processor -- start 2024-01-25T15:06:13.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.714+0000 7fcceebd1640 1 -- start start 2024-01-25T15:06:13.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.715+0000 7fcceebd1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcce80c4f00 0x7fcce8155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:13.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.715+0000 7fcceebd1640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce80c66c0 con 0x7fcce80c55e0 2024-01-25T15:06:13.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.715+0000 7fcceebd1640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce806cfc0 con 0x7fcce81520b0 2024-01-25T15:06:13.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.715+0000 7fcceebd1640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce8152490 con 0x7fcce80c4f00 2024-01-25T15:06:13.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.715+0000 7fcced16e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcce80c4f00 0x7fcce8155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:13.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.715+0000 7fcced16e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcce80c4f00 0x7fcce8155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54166/0 (socket says 172.21.15.29:54166) 2024-01-25T15:06:13.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.715+0000 7fcced16e640 1 -- 172.21.15.29:0/1496449736 learned_addr learned my addr 172.21.15.29:0/1496449736 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:13.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.715+0000 7fcce7fff640 1 --1- 172.21.15.29:0/1496449736 >> v1:172.21.15.29:6789/0 conn(0x7fcce80c55e0 0x7fcce80c5b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52462/0 (socket says 172.21.15.29:52462) 2024-01-25T15:06:13.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.716+0000 7fcced16e640 1 -- 172.21.15.29:0/1496449736 >> v1:172.21.15.52:6789/0 conn(0x7fcce81520b0 legacy=0x7fcce80c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:13.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.716+0000 7fcced16e640 1 -- 172.21.15.29:0/1496449736 >> v1:172.21.15.29:6789/0 conn(0x7fcce80c55e0 legacy=0x7fcce80c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:13.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.716+0000 7fcced16e640 1 -- 172.21.15.29:0/1496449736 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce80c8830 con 0x7fcce80c4f00 2024-01-25T15:06:13.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.716+0000 7fcced16e640 1 --2- 172.21.15.29:0/1496449736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcce80c4f00 0x7fcce8155570 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fccd8009870 tx=0x7fccd802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103bd56bcf824786 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:13.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.716+0000 7fcce77fe640 1 -- 172.21.15.29:0/1496449736 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd8031870 con 0x7fcce80c4f00 2024-01-25T15:06:13.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.716+0000 7fcce77fe640 1 -- 172.21.15.29:0/1496449736 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd80319d0 con 0x7fcce80c4f00 2024-01-25T15:06:13.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.716+0000 7fcce77fe640 1 -- 172.21.15.29:0/1496449736 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd8031d60 con 0x7fcce80c4f00 2024-01-25T15:06:13.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.717+0000 7fcceebd1640 1 -- 172.21.15.29:0/1496449736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcce80c4f00 msgr2=0x7fcce8155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:13.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.717+0000 7fcceebd1640 1 --2- 172.21.15.29:0/1496449736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcce80c4f00 0x7fcce8155570 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fccd8009870 tx=0x7fccd802b910 comp rx=0 tx=0).stop 2024-01-25T15:06:13.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.717+0000 7fcceebd1640 1 -- 172.21.15.29:0/1496449736 shutdown_connections 2024-01-25T15:06:13.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.717+0000 7fcceebd1640 1 --2- 172.21.15.29:0/1496449736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcce80c4f00 0x7fcce8155570 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.717+0000 7fcceebd1640 1 -- 172.21.15.29:0/1496449736 >> 172.21.15.29:0/1496449736 conn(0x7fcce80ca220 msgr2=0x7fcce80ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:13.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.717+0000 7fcceebd1640 1 -- 172.21.15.29:0/1496449736 shutdown_connections 2024-01-25T15:06:13.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.717+0000 7fcceebd1640 1 -- 172.21.15.29:0/1496449736 wait complete. 2024-01-25T15:06:13.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.718+0000 7fcceebd1640 1 Processor -- start 2024-01-25T15:06:13.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.718+0000 7fcceebd1640 1 -- start start 2024-01-25T15:06:13.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.719+0000 7fcceebd1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcce80c4f00 0x7fcce80af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:13.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.719+0000 7fcceebd1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcce81520b0 0x7fcce80c2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:13.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.719+0000 7fcceebd1640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcce8148e70 0x7fcce814ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:13.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.719+0000 7fcceebd1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8148d10 con 0x7fcce81520b0 2024-01-25T15:06:13.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.719+0000 7fcceebd1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce814e360 con 0x7fcce80c4f00 2024-01-25T15:06:13.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.719+0000 7fcceebd1640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce814d7d0 con 0x7fcce8148e70 2024-01-25T15:06:13.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.719+0000 7fcce7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcce81520b0 0x7fcce80c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:13.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.719+0000 7fcce7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcce81520b0 0x7fcce80c2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54180/0 (socket says 172.21.15.29:54180) 2024-01-25T15:06:13.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.719+0000 7fcce7fff640 1 -- 172.21.15.29:0/827469436 learned_addr learned my addr 172.21.15.29:0/827469436 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:13.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.719+0000 7fcced16e640 1 --2- 172.21.15.29:0/827469436 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcce8148e70 0x7fcce814ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:13.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.719+0000 7fccec96d640 1 --2- 172.21.15.29:0/827469436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcce80c4f00 0x7fcce80af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:13.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.719+0000 7fcce7fff640 1 -- 172.21.15.29:0/827469436 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcce8148e70 msgr2=0x7fcce814ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:13.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.719+0000 7fcce7fff640 1 --2- 172.21.15.29:0/827469436 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcce8148e70 0x7fcce814ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.719+0000 7fcce7fff640 1 -- 172.21.15.29:0/827469436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcce80c4f00 msgr2=0x7fcce80af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:13.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.719+0000 7fcce7fff640 1 --2- 172.21.15.29:0/827469436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcce80c4f00 0x7fcce80af210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.719+0000 7fcce7fff640 1 -- 172.21.15.29:0/827469436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd80094d0 con 0x7fcce81520b0 2024-01-25T15:06:13.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.720+0000 7fcce7fff640 1 --2- 172.21.15.29:0/827469436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcce81520b0 0x7fcce80c2090 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00c400 tx=0x7fccdc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:13.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.720+0000 7fcce57fa640 1 -- 172.21.15.29:0/827469436 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc0074e0 con 0x7fcce81520b0 2024-01-25T15:06:13.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.720+0000 7fcce57fa640 1 -- 172.21.15.29:0/827469436 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccdc007640 con 0x7fcce81520b0 2024-01-25T15:06:13.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.720+0000 7fcceebd1640 1 -- 172.21.15.29:0/827469436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce80af750 con 0x7fcce81520b0 2024-01-25T15:06:13.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.720+0000 7fcce57fa640 1 -- 172.21.15.29:0/827469436 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc004a00 con 0x7fcce81520b0 2024-01-25T15:06:13.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.720+0000 7fcceebd1640 1 -- 172.21.15.29:0/827469436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce814d4f0 con 0x7fcce81520b0 2024-01-25T15:06:13.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.721+0000 7fcceebd1640 1 -- 172.21.15.29:0/827469436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce80c11c0 con 0x7fcce81520b0 2024-01-25T15:06:13.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.721+0000 7fcce57fa640 1 -- 172.21.15.29:0/827469436 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fccdc004b60 con 0x7fcce81520b0 2024-01-25T15:06:13.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.721+0000 7fcce57fa640 1 --2- 172.21.15.29:0/827469436 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fccd406aed0 0x7fccd406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:13.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.722+0000 7fcce57fa640 1 -- 172.21.15.29:0/827469436 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fccdc088f80 con 0x7fcce81520b0 2024-01-25T15:06:13.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.722+0000 7fccec96d640 1 --2- 172.21.15.29:0/827469436 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fccd406aed0 0x7fccd406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:13.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.722+0000 7fccec96d640 1 --2- 172.21.15.29:0/827469436 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fccd406aed0 0x7fccd406d390 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcce0007bf0 tx=0x7fcce0007240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:13.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.726+0000 7fcce57fa640 1 -- 172.21.15.29:0/827469436 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fcce80c11c0 con 0x7fcce81520b0 2024-01-25T15:06:13.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.905+0000 7fcceebd1640 1 -- 172.21.15.29:0/827469436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcce80c11c0 con 0x7fcce81520b0 2024-01-25T15:06:13.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.906+0000 7fcce57fa640 1 -- 172.21.15.29:0/827469436 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+13286 (secure 0 0 0) 0x7fcce80c11c0 con 0x7fcce81520b0 2024-01-25T15:06:13.906 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:06:13.906 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":49,"fsid":"3f65c5fb-9e8c-471f-b2c4-a9841e901c7a","created":"2024-01-25T15:04:02.735229+0000","modified":"2024-01-25T15:06:10.948670+0000","last_up_change":"2024-01-25T15:04:13.295597+0000","last_in_change":"2024-01-25T15:04:04.970907+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T15:04:14.955791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"395fb9df-ad7b-4431-9def-b4a5848cb300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6817","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6819","nonce":1239098486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6824","nonce":1239098486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6831","nonce":1239098486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6827","nonce":1239098486},{"type":"v1","addr":"172.21.15.29:6829","nonce":1239098486}]},"public_addr":"172.21.15.29:6819/1239098486","cluster_addr":"172.21.15.29:6824/1239098486","heartbeat_back_addr":"172.21.15.29:6831/1239098486","heartbeat_front_addr":"172.21.15.29:6829/1239098486","state":["exists","up"]},{"osd":1,"uuid":"90952af7-a717-4765-890d-de32fccea0b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6809","nonce":1186362515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6811","nonce":1186362515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6815","nonce":1186362515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1186362515},{"type":"v1","addr":"172.21.15.29:6813","nonce":1186362515}]},"public_addr":"172.21.15.29:6809/1186362515","cluster_addr":"172.21.15.29:6811/1186362515","heartbeat_back_addr":"172.21.15.29:6815/1186362515","heartbeat_front_addr":"172.21.15.29:6813/1186362515","state":["exists","up"]},{"osd":2,"uuid":"f2bfdf0f-394f-4e66-b968-db6a6c98dcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6801","nonce":2245852782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6803","nonce":2245852782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6807","nonce":2245852782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2245852782},{"type":"v1","addr":"172.21.15.29:6805","nonce":2245852782}]},"public_addr":"172.21.15.29:6801/2245852782","cluster_addr":"172.21.15.29:6803/2245852782","heartbeat_back_addr":"172.21.15.29:6807/2245852782","heartbeat_front_addr":"172.21.15.29:6805/2245852782","state":["exists","up"]},{"osd":3,"uuid":"4df8b3c8-0632-4c9d-89fe-68b81e05470c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6818","nonce":2866381288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6821","nonce":2866381288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6828","nonce":2866381288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":2866381288},{"type":"v1","addr":"172.21.15.29:6825","nonce":2866381288}]},"public_addr":"172.21.15.29:6818/2866381288","cluster_addr":"172.21.15.29:6821/2866381288","heartbeat_back_addr":"172.21.15.29:6828/2866381288","heartbeat_front_addr":"172.21.15.29:6825/2866381288","state":["exists","up"]},{"osd":4,"uuid":"6aeed49b-a515-49d8-979e-9bc344d8284d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6801","nonce":2238001841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6803","nonce":2238001841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6807","nonce":2238001841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2238001841},{"type":"v1","addr":"172.21.15.52:6805","nonce":2238001841}]},"public_addr":"172.21.15.52:6801/2238001841","cluster_addr":"172.21.15.52:6803/2238001841","heartbeat_back_addr":"172.21.15.52:6807/2238001841","heartbeat_front_addr":"172.21.15.52:6805/2238001841","state":["exists","up"]},{"osd":5,"uuid":"2d0b95e7-c52a-4d07-801b-2f9cffcce796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6810","nonce":2258341795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6814","nonce":2258341795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6822","nonce":2258341795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2258341795},{"type":"v1","addr":"172.21.15.52:6818","nonce":2258341795}]},"public_addr":"172.21.15.52:6810/2258341795","cluster_addr":"172.21.15.52:6814/2258341795","heartbeat_back_addr":"172.21.15.52:6822/2258341795","heartbeat_front_addr":"172.21.15.52:6818/2258341795","state":["exists","up"]},{"osd":6,"uuid":"9f78c95a-2f4d-48db-a0b6-c9d847834329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6825","nonce":2160170066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6827","nonce":2160170066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6831","nonce":2160170066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2160170066},{"type":"v1","addr":"172.21.15.52:6829","nonce":2160170066}]},"public_addr":"172.21.15.52:6825/2160170066","cluster_addr":"172.21.15.52:6827/2160170066","heartbeat_back_addr":"172.21.15.52:6831/2160170066","heartbeat_front_addr":"172.21.15.52:6829/2160170066","state":["exists","up"]},{"osd":7,"uuid":"28497b62-b812-4fb0-8fe4-1efba56d7a9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6811","nonce":3231115782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6815","nonce":3231115782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6823","nonce":3231115782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":3231115782},{"type":"v1","addr":"172.21.15.52:6819","nonce":3231115782}]},"public_addr":"172.21.15.52:6811/3231115782","cluster_addr":"172.21.15.52:6815/3231115782","heartbeat_back_addr":"172.21.15.52:6823/3231115782","heartbeat_front_addr":"172.21.15.52:6819/3231115782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.085405+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.110693+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.148952+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.162262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.094634+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.075130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.081366+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T15:04:10.053280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:6832/1607449141":"2024-01-26T15:06:07.938521+0000","172.21.15.29:6834/1607449141":"2024-01-26T15:06:07.938521+0000","172.21.15.29:6835/3222226893":"2024-01-26T15:06:01.670426+0000","172.21.15.29:6833/3222226893":"2024-01-26T15:06:01.670426+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:06:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.907+0000 7fcceebd1640 1 -- 172.21.15.29:0/827469436 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fccd406aed0 msgr2=0x7fccd406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:13.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.907+0000 7fcceebd1640 1 --2- 172.21.15.29:0/827469436 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fccd406aed0 0x7fccd406d390 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcce0007bf0 tx=0x7fcce0007240 comp rx=0 tx=0).stop 2024-01-25T15:06:13.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.907+0000 7fcceebd1640 1 -- 172.21.15.29:0/827469436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcce81520b0 msgr2=0x7fcce80c2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:13.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.907+0000 7fcceebd1640 1 --2- 172.21.15.29:0/827469436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcce81520b0 0x7fcce80c2090 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00c400 tx=0x7fccdc00c8c0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.907+0000 7fcceebd1640 1 -- 172.21.15.29:0/827469436 shutdown_connections 2024-01-25T15:06:13.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.907+0000 7fcceebd1640 1 --2- 172.21.15.29:0/827469436 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fcce8148e70 0x7fcce814ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.907+0000 7fcceebd1640 1 --2- 172.21.15.29:0/827469436 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fccd406aed0 0x7fccd406d390 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.907+0000 7fcceebd1640 1 --2- 172.21.15.29:0/827469436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcce81520b0 0x7fcce80c2090 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.907+0000 7fcceebd1640 1 --2- 172.21.15.29:0/827469436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcce80c4f00 0x7fcce80af210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:13.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.908+0000 7fcceebd1640 1 -- 172.21.15.29:0/827469436 >> 172.21.15.29:0/827469436 conn(0x7fcce80ca220 msgr2=0x7fcce8154250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:13.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.908+0000 7fcceebd1640 1 -- 172.21.15.29:0/827469436 shutdown_connections 2024-01-25T15:06:13.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:13.908+0000 7fcceebd1640 1 -- 172.21.15.29:0/827469436 wait complete. 2024-01-25T15:06:14.919 INFO:tasks.ceph:Scrubbing osd.0 2024-01-25T15:06:14.920 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-01-25T15:06:15.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.038+0000 7f823c2e0640 1 Processor -- start 2024-01-25T15:06:15.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.038+0000 7f823c2e0640 1 -- start start 2024-01-25T15:06:15.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.039+0000 7f823c2e0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8234151d80 0x7f82340c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.039+0000 7f823c2e0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f823406c370 0x7f82340c4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.039+0000 7f823c2e0640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823406bee0 con 0x7f8234155210 2024-01-25T15:06:15.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.039+0000 7f823c2e0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82340c7400 con 0x7f8234151d80 2024-01-25T15:06:15.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.039+0000 7f823c2e0640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f823406b8d0 con 0x7f823406c370 2024-01-25T15:06:15.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.039+0000 7f823a07c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8234151d80 0x7f82340c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.039+0000 7f823987b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8234155210 0x7f82340c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52470/0 (socket says 172.21.15.29:52470) 2024-01-25T15:06:15.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.039+0000 7f823987b640 1 -- 172.21.15.29:0/3192852752 learned_addr learned my addr 172.21.15.29:0/3192852752 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:15.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.040+0000 7f823a87d640 1 --2- 172.21.15.29:0/3192852752 >> v2:172.21.15.52:3300/0 conn(0x7f823406c370 0x7f82340c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.040+0000 7f823907a640 1 -- 172.21.15.29:0/3192852752 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161655223 0 0) 0x7f823406bee0 con 0x7f8234155210 2024-01-25T15:06:15.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.040+0000 7f823907a640 1 -- 172.21.15.29:0/3192852752 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8220003520 con 0x7f8234155210 2024-01-25T15:06:15.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.040+0000 7f823a07c640 1 -- 172.21.15.29:0/3192852752 >> v2:172.21.15.52:3300/0 conn(0x7f823406c370 msgr2=0x7f82340c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:15.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.040+0000 7f823a07c640 1 --2- 172.21.15.29:0/3192852752 >> v2:172.21.15.52:3300/0 conn(0x7f823406c370 0x7f82340c4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.040+0000 7f823a07c640 1 -- 172.21.15.29:0/3192852752 >> v1:172.21.15.29:6789/0 conn(0x7f8234155210 legacy=0x7f82340c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.040+0000 7f823a07c640 1 -- 172.21.15.29:0/3192852752 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82340c7120 con 0x7f8234151d80 2024-01-25T15:06:15.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.041+0000 7f823a07c640 1 --2- 172.21.15.29:0/3192852752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8234151d80 0x7f82340c6a20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f82340c1070 tx=0x7f823002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7fe6d184162910a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:15.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.041+0000 7f823907a640 1 -- 172.21.15.29:0/3192852752 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823002e070 con 0x7f8234151d80 2024-01-25T15:06:15.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.041+0000 7f823907a640 1 -- 172.21.15.29:0/3192852752 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82300315a0 con 0x7f8234151d80 2024-01-25T15:06:15.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.041+0000 7f823907a640 1 -- 172.21.15.29:0/3192852752 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8230031930 con 0x7f8234151d80 2024-01-25T15:06:15.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.042+0000 7f823c2e0640 1 -- 172.21.15.29:0/3192852752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8234151d80 msgr2=0x7f82340c6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.042+0000 7f823c2e0640 1 --2- 172.21.15.29:0/3192852752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8234151d80 0x7f82340c6a20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f82340c1070 tx=0x7f823002b840 comp rx=0 tx=0).stop 2024-01-25T15:06:15.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.042+0000 7f823c2e0640 1 -- 172.21.15.29:0/3192852752 shutdown_connections 2024-01-25T15:06:15.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.042+0000 7f823c2e0640 1 --2- 172.21.15.29:0/3192852752 >> v2:172.21.15.52:3300/0 conn(0x7f823406c370 0x7f82340c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.042+0000 7f823c2e0640 1 --2- 172.21.15.29:0/3192852752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8234151d80 0x7f82340c6a20 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.042+0000 7f823c2e0640 1 -- 172.21.15.29:0/3192852752 >> 172.21.15.29:0/3192852752 conn(0x7f82340abd80 msgr2=0x7f82340ac190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:15.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.042+0000 7f823c2e0640 1 -- 172.21.15.29:0/3192852752 shutdown_connections 2024-01-25T15:06:15.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.042+0000 7f823c2e0640 1 -- 172.21.15.29:0/3192852752 wait complete. 2024-01-25T15:06:15.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.043+0000 7f823c2e0640 1 Processor -- start 2024-01-25T15:06:15.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.043+0000 7f823c2e0640 1 -- start start 2024-01-25T15:06:15.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.044+0000 7f823c2e0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f823406c370 0x7f82340ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.044+0000 7f823c2e0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8234151d80 0x7f82340c3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.044+0000 7f823c2e0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8234155210 0x7f82340c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.044+0000 7f823c2e0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82340af830 con 0x7f823406c370 2024-01-25T15:06:15.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.044+0000 7f823c2e0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82340c21d0 con 0x7f8234151d80 2024-01-25T15:06:15.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.044+0000 7f823c2e0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82341ea4e0 con 0x7f8234155210 2024-01-25T15:06:15.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.044+0000 7f823a07c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f823406c370 0x7f82340ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.044+0000 7f823a07c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f823406c370 0x7f82340ad3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54200/0 (socket says 172.21.15.29:54200) 2024-01-25T15:06:15.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.044+0000 7f823a07c640 1 -- 172.21.15.29:0/2084882193 learned_addr learned my addr 172.21.15.29:0/2084882193 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:15.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.044+0000 7f823a87d640 1 --2- 172.21.15.29:0/2084882193 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8234155210 0x7f82340c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.044+0000 7f823987b640 1 --2- 172.21.15.29:0/2084882193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8234151d80 0x7f82340c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.044+0000 7f823a07c640 1 -- 172.21.15.29:0/2084882193 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8234155210 msgr2=0x7f82340c2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.044+0000 7f823a07c640 1 --2- 172.21.15.29:0/2084882193 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8234155210 0x7f82340c2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.044+0000 7f823a07c640 1 -- 172.21.15.29:0/2084882193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8234151d80 msgr2=0x7f82340c3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.044+0000 7f823a07c640 1 --2- 172.21.15.29:0/2084882193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8234151d80 0x7f82340c3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.044+0000 7f823a07c640 1 -- 172.21.15.29:0/2084882193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8230009400 con 0x7f823406c370 2024-01-25T15:06:15.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.045+0000 7f823a07c640 1 --2- 172.21.15.29:0/2084882193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f823406c370 0x7f82340ad3c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8230000c00 tx=0x7f82300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:15.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.045+0000 7f822affd640 1 -- 172.21.15.29:0/2084882193 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8230032840 con 0x7f823406c370 2024-01-25T15:06:15.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.045+0000 7f822affd640 1 -- 172.21.15.29:0/2084882193 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8230031f00 con 0x7f823406c370 2024-01-25T15:06:15.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.045+0000 7f823c2e0640 1 -- 172.21.15.29:0/2084882193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82340c2470 con 0x7f823406c370 2024-01-25T15:06:15.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.045+0000 7f822affd640 1 -- 172.21.15.29:0/2084882193 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8230032c00 con 0x7f823406c370 2024-01-25T15:06:15.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.045+0000 7f823c2e0640 1 -- 172.21.15.29:0/2084882193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82341ea7c0 con 0x7f823406c370 2024-01-25T15:06:15.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.046+0000 7f823c2e0640 1 -- 172.21.15.29:0/2084882193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8234152160 con 0x7f823406c370 2024-01-25T15:06:15.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.047+0000 7f822affd640 1 -- 172.21.15.29:0/2084882193 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f823004d3f0 con 0x7f823406c370 2024-01-25T15:06:15.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.047+0000 7f822affd640 1 --2- 172.21.15.29:0/2084882193 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f821806aed0 0x7f821806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.047+0000 7f822affd640 1 -- 172.21.15.29:0/2084882193 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f82300ab3b0 con 0x7f823406c370 2024-01-25T15:06:15.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.047+0000 7f822affd640 1 --2- 172.21.15.29:0/2084882193 >> [v2:172.21.15.29:6817/1239098486,v1:172.21.15.29:6819/1239098486] conn(0x7f8218071270 0x7f82180736b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.047+0000 7f822affd640 1 -- 172.21.15.29:0/2084882193 --> [v2:172.21.15.29:6817/1239098486,v1:172.21.15.29:6819/1239098486] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8218073d80 con 0x7f8218071270 2024-01-25T15:06:15.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.047+0000 7f822affd640 1 -- 172.21.15.29:0/2084882193 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82300ab800 con 0x7f823406c370 2024-01-25T15:06:15.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.047+0000 7f823987b640 1 --2- 172.21.15.29:0/2084882193 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f821806aed0 0x7f821806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.048+0000 7f823a87d640 1 --2- 172.21.15.29:0/2084882193 >> [v2:172.21.15.29:6817/1239098486,v1:172.21.15.29:6819/1239098486] conn(0x7f8218071270 0x7f82180736b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.048+0000 7f823a87d640 1 --2- 172.21.15.29:0/2084882193 >> [v2:172.21.15.29:6817/1239098486,v1:172.21.15.29:6819/1239098486] conn(0x7f8218071270 0x7f82180736b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:15.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.048+0000 7f823987b640 1 --2- 172.21.15.29:0/2084882193 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f821806aed0 0x7f821806d390 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f82340ab610 tx=0x7f8224009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:15.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.049+0000 7f822affd640 1 -- 172.21.15.29:0/2084882193 <== osd.0 v2:172.21.15.29:6817/1239098486 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8218073d80 con 0x7f8218071270 2024-01-25T15:06:15.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.062+0000 7f823c2e0640 1 -- 172.21.15.29:0/2084882193 --> [v2:172.21.15.29:6817/1239098486,v1:172.21.15.29:6819/1239098486] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8234155670 con 0x7f8218071270 2024-01-25T15:06:15.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.062+0000 7f822affd640 1 -- 172.21.15.29:0/2084882193 <== osd.0 v2:172.21.15.29:6817/1239098486 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f822c00f040 con 0x7f8218071270 2024-01-25T15:06:15.063 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-25T15:06:15.063 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-25T15:06:15.063 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-25T15:06:15.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.062+0000 7f823c2e0640 1 -- 172.21.15.29:0/2084882193 >> [v2:172.21.15.29:6817/1239098486,v1:172.21.15.29:6819/1239098486] conn(0x7f8218071270 msgr2=0x7f82180736b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.062+0000 7f823c2e0640 1 --2- 172.21.15.29:0/2084882193 >> [v2:172.21.15.29:6817/1239098486,v1:172.21.15.29:6819/1239098486] conn(0x7f8218071270 0x7f82180736b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.063+0000 7f823c2e0640 1 -- 172.21.15.29:0/2084882193 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f821806aed0 msgr2=0x7f821806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.063+0000 7f823c2e0640 1 --2- 172.21.15.29:0/2084882193 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f821806aed0 0x7f821806d390 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f82340ab610 tx=0x7f8224009040 comp rx=0 tx=0).stop 2024-01-25T15:06:15.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.063+0000 7f823c2e0640 1 -- 172.21.15.29:0/2084882193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f823406c370 msgr2=0x7f82340ad3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.063+0000 7f823c2e0640 1 --2- 172.21.15.29:0/2084882193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f823406c370 0x7f82340ad3c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8230000c00 tx=0x7f82300046c0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.063+0000 7f823a87d640 1 -- 172.21.15.29:0/2084882193 reap_dead start 2024-01-25T15:06:15.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.063+0000 7f823c2e0640 1 -- 172.21.15.29:0/2084882193 shutdown_connections 2024-01-25T15:06:15.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.063+0000 7f823c2e0640 1 -- 172.21.15.29:0/2084882193 >> 172.21.15.29:0/2084882193 conn(0x7f82340abd80 msgr2=0x7f823414ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:15.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.063+0000 7f823c2e0640 1 -- 172.21.15.29:0/2084882193 shutdown_connections 2024-01-25T15:06:15.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.063+0000 7f823c2e0640 1 -- 172.21.15.29:0/2084882193 wait complete. 2024-01-25T15:06:15.074 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-01-25T15:06:15.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.177+0000 7f8798d89640 1 Processor -- start 2024-01-25T15:06:15.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.177+0000 7f8798d89640 1 -- start start 2024-01-25T15:06:15.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.178+0000 7f8798d89640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8794151ff0 0x7f8794154860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.178+0000 7f8798d89640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8794157db0 con 0x7f87940c6e10 2024-01-25T15:06:15.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.178+0000 7f8798d89640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8794158090 con 0x7f87940c5ef0 2024-01-25T15:06:15.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.178+0000 7f8798d89640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87940c7390 con 0x7f8794151ff0 2024-01-25T15:06:15.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.178+0000 7f8792d9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f87940c6e10 0x7f87940c6390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52476/0 (socket says 172.21.15.29:52476) 2024-01-25T15:06:15.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.178+0000 7f8792d9d640 1 -- 172.21.15.29:0/459446590 learned_addr learned my addr 172.21.15.29:0/459446590 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:15.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.178+0000 7f879259c640 1 --2- 172.21.15.29:0/459446590 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8794151ff0 0x7f8794154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f879159a640 1 -- 172.21.15.29:0/459446590 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497378971 0 0) 0x7f8794157db0 con 0x7f87940c6e10 2024-01-25T15:06:15.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f879159a640 1 -- 172.21.15.29:0/459446590 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f877c003520 con 0x7f87940c6e10 2024-01-25T15:06:15.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f879159a640 1 -- 172.21.15.29:0/459446590 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3621586347 0 0) 0x7f877c003520 con 0x7f87940c6e10 2024-01-25T15:06:15.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f879159a640 1 -- 172.21.15.29:0/459446590 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8794151ff0 msgr2=0x7f8794154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:15.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f879159a640 1 --2- 172.21.15.29:0/459446590 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8794151ff0 0x7f8794154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f879159a640 1 -- 172.21.15.29:0/459446590 >> v1:172.21.15.52:6789/0 conn(0x7f87940c5ef0 legacy=0x7f8794158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f879159a640 1 -- 172.21.15.29:0/459446590 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8794158c30 con 0x7f87940c6e10 2024-01-25T15:06:15.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f879159a640 1 -- 172.21.15.29:0/459446590 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7f878c0019f0 con 0x7f87940c6e10 2024-01-25T15:06:15.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f879259c640 1 --2- 172.21.15.29:0/459446590 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8794151ff0 0x7f8794154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:06:15.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f879159a640 1 -- 172.21.15.29:0/459446590 >> v1:172.21.15.29:6789/0 conn(0x7f87940c6e10 legacy=0x7f87940c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f879159a640 1 --2- 172.21.15.29:0/459446590 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8794151ff0 0x7f877c003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f879159a640 1 --2- 172.21.15.29:0/459446590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f877c003f50 0x7f877c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f879159a640 1 --2- 172.21.15.29:0/459446590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f877c004d00 0x7f877c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f879159a640 1 -- 172.21.15.29:0/459446590 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87940c7390 con 0x7f877c003f50 2024-01-25T15:06:15.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f879159a640 1 -- 172.21.15.29:0/459446590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c00bb90 con 0x7f877c004d00 2024-01-25T15:06:15.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f879159a640 1 -- 172.21.15.29:0/459446590 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877c00bd50 con 0x7f8794151ff0 2024-01-25T15:06:15.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f8791d9b640 1 --2- 172.21.15.29:0/459446590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f877c003f50 0x7f877c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f879259c640 1 --2- 172.21.15.29:0/459446590 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8794151ff0 0x7f877c003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f8792d9d640 1 --2- 172.21.15.29:0/459446590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f877c004d00 0x7f877c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f8791d9b640 1 -- 172.21.15.29:0/459446590 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8794151ff0 msgr2=0x7f877c003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:15.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f8791d9b640 1 --2- 172.21.15.29:0/459446590 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8794151ff0 0x7f877c003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f8791d9b640 1 -- 172.21.15.29:0/459446590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f877c004d00 msgr2=0x7f877c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:15.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f8791d9b640 1 --2- 172.21.15.29:0/459446590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f877c004d00 0x7f877c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f8791d9b640 1 -- 172.21.15.29:0/459446590 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8784009400 con 0x7f877c003f50 2024-01-25T15:06:15.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.179+0000 7f8792d9d640 1 --2- 172.21.15.29:0/459446590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f877c004d00 0x7f877c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:15.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.180+0000 7f8791d9b640 1 --2- 172.21.15.29:0/459446590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f877c003f50 0x7f877c0047c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8788001910 tx=0x7f877c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0fc58924a63cb9 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:15.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.180+0000 7f879159a640 1 -- 172.21.15.29:0/459446590 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8788032620 con 0x7f877c003f50 2024-01-25T15:06:15.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.180+0000 7f879159a640 1 -- 172.21.15.29:0/459446590 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8788032780 con 0x7f877c003f50 2024-01-25T15:06:15.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.180+0000 7f879159a640 1 -- 172.21.15.29:0/459446590 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8788032b50 con 0x7f877c003f50 2024-01-25T15:06:15.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.181+0000 7f8798d89640 1 -- 172.21.15.29:0/459446590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f877c003f50 msgr2=0x7f877c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.181+0000 7f8798d89640 1 --2- 172.21.15.29:0/459446590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f877c003f50 0x7f877c0047c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8788001910 tx=0x7f877c0057f0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.181+0000 7f8792d9d640 1 -- 172.21.15.29:0/459446590 reap_dead start 2024-01-25T15:06:15.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.181+0000 7f8798d89640 1 -- 172.21.15.29:0/459446590 shutdown_connections 2024-01-25T15:06:15.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.181+0000 7f8798d89640 1 -- 172.21.15.29:0/459446590 >> 172.21.15.29:0/459446590 conn(0x7f87940c7f80 msgr2=0x7f87940c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:15.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.181+0000 7f8798d89640 1 -- 172.21.15.29:0/459446590 shutdown_connections 2024-01-25T15:06:15.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.181+0000 7f8798d89640 1 -- 172.21.15.29:0/459446590 wait complete. 2024-01-25T15:06:15.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.183+0000 7f8798d89640 1 Processor -- start 2024-01-25T15:06:15.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.183+0000 7f8798d89640 1 -- start start 2024-01-25T15:06:15.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.184+0000 7f8798d89640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f877c003f50 0x7f879414f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.184+0000 7f8798d89640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f879409a190 0x7f879414d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.185+0000 7f8798d89640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f879414d980 0x7f8794153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.185+0000 7f8798d89640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8794152dc0 con 0x7f879409a190 2024-01-25T15:06:15.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.185+0000 7f8798d89640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879406d090 con 0x7f879414d980 2024-01-25T15:06:15.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.185+0000 7f8798d89640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87941ee5d0 con 0x7f877c003f50 2024-01-25T15:06:15.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.185+0000 7f8791d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f879409a190 0x7f879414d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.185+0000 7f8791d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f879409a190 0x7f879414d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54208/0 (socket says 172.21.15.29:54208) 2024-01-25T15:06:15.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.185+0000 7f8791d9b640 1 -- 172.21.15.29:0/1863825615 learned_addr learned my addr 172.21.15.29:0/1863825615 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:15.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.185+0000 7f879259c640 1 --2- 172.21.15.29:0/1863825615 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f877c003f50 0x7f879414f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.185+0000 7f8792d9d640 1 --2- 172.21.15.29:0/1863825615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f879414d980 0x7f8794153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.185+0000 7f8791d9b640 1 -- 172.21.15.29:0/1863825615 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f877c003f50 msgr2=0x7f879414f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.185+0000 7f8791d9b640 1 --2- 172.21.15.29:0/1863825615 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f877c003f50 0x7f879414f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.185+0000 7f8791d9b640 1 -- 172.21.15.29:0/1863825615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f879414d980 msgr2=0x7f8794153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.185+0000 7f8791d9b640 1 --2- 172.21.15.29:0/1863825615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f879414d980 0x7f8794153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.185+0000 7f8791d9b640 1 -- 172.21.15.29:0/1863825615 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8794154970 con 0x7f879409a190 2024-01-25T15:06:15.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.185+0000 7f879259c640 1 --2- 172.21.15.29:0/1863825615 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f877c003f50 0x7f879414f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:15.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.185+0000 7f8791d9b640 1 --2- 172.21.15.29:0/1863825615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f879409a190 0x7f879414d440 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f8788034040 tx=0x7f87880012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:15.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.185+0000 7f8782ffd640 1 -- 172.21.15.29:0/1863825615 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8788005270 con 0x7f879409a190 2024-01-25T15:06:15.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.185+0000 7f8782ffd640 1 -- 172.21.15.29:0/1863825615 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87880053d0 con 0x7f879409a190 2024-01-25T15:06:15.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.185+0000 7f8798d89640 1 -- 172.21.15.29:0/1863825615 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8794154c50 con 0x7f879409a190 2024-01-25T15:06:15.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.185+0000 7f8782ffd640 1 -- 172.21.15.29:0/1863825615 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87880069d0 con 0x7f879409a190 2024-01-25T15:06:15.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.185+0000 7f8798d89640 1 -- 172.21.15.29:0/1863825615 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879414fcc0 con 0x7f879409a190 2024-01-25T15:06:15.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.187+0000 7f8798d89640 1 -- 172.21.15.29:0/1863825615 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8794074010 con 0x7f879409a190 2024-01-25T15:06:15.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.187+0000 7f8782ffd640 1 -- 172.21.15.29:0/1863825615 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8788042070 con 0x7f879409a190 2024-01-25T15:06:15.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.187+0000 7f8782ffd640 1 --2- 172.21.15.29:0/1863825615 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f877406af00 0x7f877406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.187+0000 7f8782ffd640 1 -- 172.21.15.29:0/1863825615 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f87880ab1c0 con 0x7f879409a190 2024-01-25T15:06:15.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.188+0000 7f879259c640 1 --2- 172.21.15.29:0/1863825615 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f877406af00 0x7f877406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.188+0000 7f879259c640 1 --2- 172.21.15.29:0/1863825615 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f877406af00 0x7f877406d3c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8784009d50 tx=0x7f8784008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:15.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.191+0000 7f8782ffd640 1 -- 172.21.15.29:0/1863825615 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f87880761f0 con 0x7f879409a190 2024-01-25T15:06:15.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.374+0000 7f8798d89640 1 -- 172.21.15.29:0/1863825615 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f87940c8900 con 0x7f877406af00 2024-01-25T15:06:15.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.374+0000 7f8782ffd640 1 -- 172.21.15.29:0/1863825615 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f87940c8900 con 0x7f877406af00 2024-01-25T15:06:15.375 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 0 to deep-scrub 2024-01-25T15:06:15.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.376+0000 7f8798d89640 1 -- 172.21.15.29:0/1863825615 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f877406af00 msgr2=0x7f877406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.376+0000 7f8798d89640 1 --2- 172.21.15.29:0/1863825615 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f877406af00 0x7f877406d3c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8784009d50 tx=0x7f8784008040 comp rx=0 tx=0).stop 2024-01-25T15:06:15.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.376+0000 7f8798d89640 1 -- 172.21.15.29:0/1863825615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f879409a190 msgr2=0x7f879414d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.376+0000 7f8798d89640 1 --2- 172.21.15.29:0/1863825615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f879409a190 0x7f879414d440 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f8788034040 tx=0x7f87880012b0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.376+0000 7f8798d89640 1 -- 172.21.15.29:0/1863825615 shutdown_connections 2024-01-25T15:06:15.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.376+0000 7f8798d89640 1 --2- 172.21.15.29:0/1863825615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f879414d980 0x7f8794153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.376+0000 7f8798d89640 1 --2- 172.21.15.29:0/1863825615 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f877406af00 0x7f877406d3c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.376+0000 7f8798d89640 1 --2- 172.21.15.29:0/1863825615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f879409a190 0x7f879414d440 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.376+0000 7f8798d89640 1 --2- 172.21.15.29:0/1863825615 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f877c003f50 0x7f879414f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.376+0000 7f8798d89640 1 -- 172.21.15.29:0/1863825615 >> 172.21.15.29:0/1863825615 conn(0x7f87940c7f80 msgr2=0x7f87940c6390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:15.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.376+0000 7f8798d89640 1 -- 172.21.15.29:0/1863825615 shutdown_connections 2024-01-25T15:06:15.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.376+0000 7f8798d89640 1 -- 172.21.15.29:0/1863825615 wait complete. 2024-01-25T15:06:15.387 INFO:tasks.ceph:Scrubbing osd.1 2024-01-25T15:06:15.388 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-01-25T15:06:15.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.494+0000 7f9ee61e3640 1 Processor -- start 2024-01-25T15:06:15.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.494+0000 7f9ee61e3640 1 -- start start 2024-01-25T15:06:15.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.495+0000 7f9ee61e3640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ee0149190 0x7f9ee00ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.495+0000 7f9ee61e3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9ee0070510 0x7f9ee00c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.495+0000 7f9ee61e3640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee0070d40 con 0x7f9ee00c7890 2024-01-25T15:06:15.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.495+0000 7f9ee61e3640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee0155c00 con 0x7f9ee0070510 2024-01-25T15:06:15.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.495+0000 7f9ee61e3640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee0155ee0 con 0x7f9ee0149190 2024-01-25T15:06:15.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.495+0000 7f9edeffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9ee0070510 0x7f9ee00c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.495+0000 7f9edffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9ee00c7890 0x7f9ee0152590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44422/0 (socket says 172.21.15.29:44422) 2024-01-25T15:06:15.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.495+0000 7f9edffff640 1 -- 172.21.15.29:0/1732442399 learned_addr learned my addr 172.21.15.29:0/1732442399 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:15.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.495+0000 7f9edf7fe640 1 --2- 172.21.15.29:0/1732442399 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ee0149190 0x7f9ee00ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.495+0000 7f9edeffd640 1 -- 172.21.15.29:0/1732442399 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ee0149190 msgr2=0x7f9ee00ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:15.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.495+0000 7f9edeffd640 1 --2- 172.21.15.29:0/1732442399 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ee0149190 0x7f9ee00ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.495+0000 7f9edeffd640 1 -- 172.21.15.29:0/1732442399 >> v1:172.21.15.29:6789/0 conn(0x7f9ee00c7890 legacy=0x7f9ee0152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.495+0000 7f9edeffd640 1 -- 172.21.15.29:0/1732442399 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee01561c0 con 0x7f9ee0070510 2024-01-25T15:06:15.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.495+0000 7f9ede7fc640 1 -- 172.21.15.29:0/1732442399 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866595878 0 0) 0x7f9ee0070d40 con 0x7f9ee00c7890 2024-01-25T15:06:15.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.496+0000 7f9edeffd640 1 --2- 172.21.15.29:0/1732442399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee0070510 0x7f9ee00c7350 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40097a0 tx=0x7f9ed402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36bc92fb51b9eaa5 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:15.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.496+0000 7f9ede7fc640 1 -- 172.21.15.29:0/1732442399 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4031830 con 0x7f9ee0070510 2024-01-25T15:06:15.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.496+0000 7f9ede7fc640 1 -- 172.21.15.29:0/1732442399 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed4031990 con 0x7f9ee0070510 2024-01-25T15:06:15.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.496+0000 7f9ede7fc640 1 -- 172.21.15.29:0/1732442399 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4031d20 con 0x7f9ee0070510 2024-01-25T15:06:15.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.497+0000 7f9ee61e3640 1 -- 172.21.15.29:0/1732442399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee0070510 msgr2=0x7f9ee00c7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.497+0000 7f9ee61e3640 1 --2- 172.21.15.29:0/1732442399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee0070510 0x7f9ee00c7350 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40097a0 tx=0x7f9ed402b8d0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.497+0000 7f9ee61e3640 1 -- 172.21.15.29:0/1732442399 shutdown_connections 2024-01-25T15:06:15.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.497+0000 7f9ee61e3640 1 --2- 172.21.15.29:0/1732442399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee0070510 0x7f9ee00c7350 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.497+0000 7f9ee61e3640 1 --2- 172.21.15.29:0/1732442399 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ee0149190 0x7f9ee00ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.497+0000 7f9ee61e3640 1 -- 172.21.15.29:0/1732442399 >> 172.21.15.29:0/1732442399 conn(0x7f9ee00c7f80 msgr2=0x7f9ee00c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:15.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.497+0000 7f9ee61e3640 1 -- 172.21.15.29:0/1732442399 shutdown_connections 2024-01-25T15:06:15.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.497+0000 7f9ee61e3640 1 -- 172.21.15.29:0/1732442399 wait complete. 2024-01-25T15:06:15.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.498+0000 7f9ee61e3640 1 Processor -- start 2024-01-25T15:06:15.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.498+0000 7f9ee61e3640 1 -- start start 2024-01-25T15:06:15.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.499+0000 7f9ee61e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ee0070510 0x7f9ee01e7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.499+0000 7f9ee61e3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee00c7890 0x7f9ee00c18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.499+0000 7f9ee61e3640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ee0149190 0x7f9ee0152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.499+0000 7f9ee61e3640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee0153050 con 0x7f9ee00c7890 2024-01-25T15:06:15.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.499+0000 7f9ee61e3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee0151a70 con 0x7f9ee0070510 2024-01-25T15:06:15.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.499+0000 7f9ee61e3640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee0151d50 con 0x7f9ee0149190 2024-01-25T15:06:15.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.499+0000 7f9edeffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee00c7890 0x7f9ee00c18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.499+0000 7f9edeffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee00c7890 0x7f9ee00c18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50630/0 (socket says 172.21.15.29:50630) 2024-01-25T15:06:15.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.499+0000 7f9edeffd640 1 -- 172.21.15.29:0/1651571191 learned_addr learned my addr 172.21.15.29:0/1651571191 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:15.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.499+0000 7f9edffff640 1 --2- 172.21.15.29:0/1651571191 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ee0149190 0x7f9ee0152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.499+0000 7f9edf7fe640 1 --2- 172.21.15.29:0/1651571191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ee0070510 0x7f9ee01e7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.499+0000 7f9edeffd640 1 -- 172.21.15.29:0/1651571191 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ee0149190 msgr2=0x7f9ee0152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.499+0000 7f9edeffd640 1 --2- 172.21.15.29:0/1651571191 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9ee0149190 0x7f9ee0152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.499+0000 7f9edeffd640 1 -- 172.21.15.29:0/1651571191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ee0070510 msgr2=0x7f9ee01e7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.499+0000 7f9edeffd640 1 --2- 172.21.15.29:0/1651571191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ee0070510 0x7f9ee01e7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.499+0000 7f9edeffd640 1 -- 172.21.15.29:0/1651571191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed4009400 con 0x7f9ee00c7890 2024-01-25T15:06:15.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.499+0000 7f9edeffd640 1 --2- 172.21.15.29:0/1651571191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee00c7890 0x7f9ee00c18c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4034040 tx=0x7f9ed40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:15.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.499+0000 7f9ec7fff640 1 -- 172.21.15.29:0/1651571191 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed403a8f0 con 0x7f9ee00c7890 2024-01-25T15:06:15.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.499+0000 7f9ec7fff640 1 -- 172.21.15.29:0/1651571191 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed403aa70 con 0x7f9ee00c7890 2024-01-25T15:06:15.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.500+0000 7f9ec7fff640 1 -- 172.21.15.29:0/1651571191 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed403ae20 con 0x7f9ee00c7890 2024-01-25T15:06:15.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.500+0000 7f9ee61e3640 1 -- 172.21.15.29:0/1651571191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee0152030 con 0x7f9ee00c7890 2024-01-25T15:06:15.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.500+0000 7f9ee61e3640 1 -- 172.21.15.29:0/1651571191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee01525f0 con 0x7f9ee00c7890 2024-01-25T15:06:15.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.500+0000 7f9ee61e3640 1 -- 172.21.15.29:0/1651571191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ee01569c0 con 0x7f9ee00c7890 2024-01-25T15:06:15.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.501+0000 7f9ec7fff640 1 -- 172.21.15.29:0/1651571191 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9ed404d440 con 0x7f9ee00c7890 2024-01-25T15:06:15.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.501+0000 7f9ec7fff640 1 --2- 172.21.15.29:0/1651571191 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9ecc06aed0 0x7f9ecc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.502+0000 7f9ec7fff640 1 -- 172.21.15.29:0/1651571191 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f9ed40aba80 con 0x7f9ee00c7890 2024-01-25T15:06:15.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.502+0000 7f9ec7fff640 1 --2- 172.21.15.29:0/1651571191 >> [v2:172.21.15.29:6808/1186362515,v1:172.21.15.29:6809/1186362515] conn(0x7f9ecc071270 0x7f9ecc0736b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.502+0000 7f9ec7fff640 1 -- 172.21.15.29:0/1651571191 --> [v2:172.21.15.29:6808/1186362515,v1:172.21.15.29:6809/1186362515] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ecc073d80 con 0x7f9ecc071270 2024-01-25T15:06:15.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.502+0000 7f9ec7fff640 1 -- 172.21.15.29:0/1651571191 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ed40abed0 con 0x7f9ee00c7890 2024-01-25T15:06:15.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.502+0000 7f9edf7fe640 1 --2- 172.21.15.29:0/1651571191 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9ecc06aed0 0x7f9ecc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.502+0000 7f9edffff640 1 --2- 172.21.15.29:0/1651571191 >> [v2:172.21.15.29:6808/1186362515,v1:172.21.15.29:6809/1186362515] conn(0x7f9ecc071270 0x7f9ecc0736b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.502+0000 7f9edffff640 1 --2- 172.21.15.29:0/1651571191 >> [v2:172.21.15.29:6808/1186362515,v1:172.21.15.29:6809/1186362515] conn(0x7f9ecc071270 0x7f9ecc0736b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:15.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.502+0000 7f9edf7fe640 1 --2- 172.21.15.29:0/1651571191 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9ecc06aed0 0x7f9ecc06d390 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0009b40 tx=0x7f9ed0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:15.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.503+0000 7f9ec7fff640 1 -- 172.21.15.29:0/1651571191 <== osd.1 v2:172.21.15.29:6808/1186362515 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9ecc073d80 con 0x7f9ecc071270 2024-01-25T15:06:15.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.517+0000 7f9ee61e3640 1 -- 172.21.15.29:0/1651571191 --> [v2:172.21.15.29:6808/1186362515,v1:172.21.15.29:6809/1186362515] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9ee0074010 con 0x7f9ecc071270 2024-01-25T15:06:15.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.517+0000 7f9ec7fff640 1 -- 172.21.15.29:0/1651571191 <== osd.1 v2:172.21.15.29:6808/1186362515 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9ee0074010 con 0x7f9ecc071270 2024-01-25T15:06:15.518 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-25T15:06:15.518 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-25T15:06:15.518 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-25T15:06:15.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.517+0000 7f9ee61e3640 1 -- 172.21.15.29:0/1651571191 >> [v2:172.21.15.29:6808/1186362515,v1:172.21.15.29:6809/1186362515] conn(0x7f9ecc071270 msgr2=0x7f9ecc0736b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.517+0000 7f9ee61e3640 1 --2- 172.21.15.29:0/1651571191 >> [v2:172.21.15.29:6808/1186362515,v1:172.21.15.29:6809/1186362515] conn(0x7f9ecc071270 0x7f9ecc0736b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.517+0000 7f9ee61e3640 1 -- 172.21.15.29:0/1651571191 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9ecc06aed0 msgr2=0x7f9ecc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.517+0000 7f9ee61e3640 1 --2- 172.21.15.29:0/1651571191 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f9ecc06aed0 0x7f9ecc06d390 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0009b40 tx=0x7f9ed0009190 comp rx=0 tx=0).stop 2024-01-25T15:06:15.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.517+0000 7f9ee61e3640 1 -- 172.21.15.29:0/1651571191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee00c7890 msgr2=0x7f9ee00c18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.517+0000 7f9ee61e3640 1 --2- 172.21.15.29:0/1651571191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee00c7890 0x7f9ee00c18c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4034040 tx=0x7f9ed40046c0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.517+0000 7f9edffff640 1 -- 172.21.15.29:0/1651571191 reap_dead start 2024-01-25T15:06:15.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.517+0000 7f9ee61e3640 1 -- 172.21.15.29:0/1651571191 shutdown_connections 2024-01-25T15:06:15.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.517+0000 7f9ee61e3640 1 -- 172.21.15.29:0/1651571191 >> 172.21.15.29:0/1651571191 conn(0x7f9ee00c7f80 msgr2=0x7f9ee00c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:15.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.517+0000 7f9ee61e3640 1 -- 172.21.15.29:0/1651571191 shutdown_connections 2024-01-25T15:06:15.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.517+0000 7f9ee61e3640 1 -- 172.21.15.29:0/1651571191 wait complete. 2024-01-25T15:06:15.528 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-01-25T15:06:15.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.632+0000 7fa270761640 1 Processor -- start 2024-01-25T15:06:15.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.632+0000 7fa270761640 1 -- start start 2024-01-25T15:06:15.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.633+0000 7fa270761640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa268149190 0x7fa2680ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.633+0000 7fa270761640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa268152590 0x7fa2681529e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.633+0000 7fa270761640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa268070d40 con 0x7fa268070510 2024-01-25T15:06:15.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.633+0000 7fa270761640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa268155c00 con 0x7fa268152590 2024-01-25T15:06:15.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.633+0000 7fa270761640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa268155ee0 con 0x7fa268149190 2024-01-25T15:06:15.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.633+0000 7fa26ecfe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa268152590 0x7fa2681529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.633+0000 7fa26ecfe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa268152590 0x7fa2681529e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50642/0 (socket says 172.21.15.29:50642) 2024-01-25T15:06:15.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.633+0000 7fa26ecfe640 1 -- 172.21.15.29:0/3494843836 learned_addr learned my addr 172.21.15.29:0/3494843836 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:15.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.633+0000 7fa26e4fd640 1 --2- 172.21.15.29:0/3494843836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa268149190 0x7fa2680ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.633+0000 7fa26ecfe640 1 -- 172.21.15.29:0/3494843836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa268149190 msgr2=0x7fa2680ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:15.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.633+0000 7fa26ecfe640 1 --2- 172.21.15.29:0/3494843836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa268149190 0x7fa2680ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.633+0000 7fa26ecfe640 1 -- 172.21.15.29:0/3494843836 >> v1:172.21.15.52:6789/0 conn(0x7fa268070510 legacy=0x7fa2680c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.633+0000 7fa26ecfe640 1 -- 172.21.15.29:0/3494843836 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2681561c0 con 0x7fa268152590 2024-01-25T15:06:15.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.634+0000 7fa26ecfe640 1 --2- 172.21.15.29:0/3494843836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa268152590 0x7fa2681529e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa260009e50 tx=0x7fa26002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28444ed59816b6d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:15.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.634+0000 7fa26d4fb640 1 -- 172.21.15.29:0/3494843836 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26002cb00 con 0x7fa268152590 2024-01-25T15:06:15.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.634+0000 7fa26d4fb640 1 -- 172.21.15.29:0/3494843836 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26002cc60 con 0x7fa268152590 2024-01-25T15:06:15.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.634+0000 7fa26d4fb640 1 -- 172.21.15.29:0/3494843836 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2600343f0 con 0x7fa268152590 2024-01-25T15:06:15.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.634+0000 7fa270761640 1 -- 172.21.15.29:0/3494843836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa268152590 msgr2=0x7fa2681529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.634+0000 7fa270761640 1 --2- 172.21.15.29:0/3494843836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa268152590 0x7fa2681529e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa260009e50 tx=0x7fa26002bf60 comp rx=0 tx=0).stop 2024-01-25T15:06:15.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.635+0000 7fa270761640 1 -- 172.21.15.29:0/3494843836 shutdown_connections 2024-01-25T15:06:15.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.635+0000 7fa270761640 1 --2- 172.21.15.29:0/3494843836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa268152590 0x7fa2681529e0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.635+0000 7fa270761640 1 --2- 172.21.15.29:0/3494843836 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa268149190 0x7fa2680ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.635+0000 7fa270761640 1 -- 172.21.15.29:0/3494843836 >> 172.21.15.29:0/3494843836 conn(0x7fa2680c7f80 msgr2=0x7fa2680c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:15.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.635+0000 7fa270761640 1 -- 172.21.15.29:0/3494843836 shutdown_connections 2024-01-25T15:06:15.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.635+0000 7fa270761640 1 -- 172.21.15.29:0/3494843836 wait complete. 2024-01-25T15:06:15.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.636+0000 7fa270761640 1 Processor -- start 2024-01-25T15:06:15.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.636+0000 7fa270761640 1 -- start start 2024-01-25T15:06:15.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.636+0000 7fa270761640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa268070510 0x7fa2681e8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.636+0000 7fa270761640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa268149190 0x7fa2680be000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.636+0000 7fa270761640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa268152590 0x7fa2681453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.636+0000 7fa270761640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2680be880 con 0x7fa268070510 2024-01-25T15:06:15.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.636+0000 7fa270761640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26806edb0 con 0x7fa268149190 2024-01-25T15:06:15.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.636+0000 7fa270761640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2681e8ea0 con 0x7fa268152590 2024-01-25T15:06:15.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.636+0000 7fa26e4fd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa268070510 0x7fa2681e8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.636+0000 7fa26e4fd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa268070510 0x7fa2681e8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50646/0 (socket says 172.21.15.29:50646) 2024-01-25T15:06:15.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.637+0000 7fa26e4fd640 1 -- 172.21.15.29:0/3601895482 learned_addr learned my addr 172.21.15.29:0/3601895482 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:15.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.637+0000 7fa26ecfe640 1 --2- 172.21.15.29:0/3601895482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa268152590 0x7fa2681453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.637+0000 7fa26dcfc640 1 --2- 172.21.15.29:0/3601895482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa268149190 0x7fa2680be000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.637+0000 7fa26e4fd640 1 -- 172.21.15.29:0/3601895482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa268152590 msgr2=0x7fa2681453a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.637+0000 7fa26e4fd640 1 --2- 172.21.15.29:0/3601895482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa268152590 0x7fa2681453a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.637+0000 7fa26e4fd640 1 -- 172.21.15.29:0/3601895482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa268149190 msgr2=0x7fa2680be000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.637+0000 7fa26e4fd640 1 --2- 172.21.15.29:0/3601895482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa268149190 0x7fa2680be000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.637+0000 7fa26e4fd640 1 -- 172.21.15.29:0/3601895482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa260009b30 con 0x7fa268070510 2024-01-25T15:06:15.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.637+0000 7fa26dcfc640 1 --2- 172.21.15.29:0/3601895482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa268149190 0x7fa2680be000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:06:15.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.637+0000 7fa26e4fd640 1 --2- 172.21.15.29:0/3601895482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa268070510 0x7fa2681e8960 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa26400e870 tx=0x7fa26400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:15.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.637+0000 7fa25effd640 1 -- 172.21.15.29:0/3601895482 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2640094f0 con 0x7fa268070510 2024-01-25T15:06:15.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.637+0000 7fa25effd640 1 -- 172.21.15.29:0/3601895482 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26400c940 con 0x7fa268070510 2024-01-25T15:06:15.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.637+0000 7fa270761640 1 -- 172.21.15.29:0/3601895482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa26814edc0 con 0x7fa268070510 2024-01-25T15:06:15.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.637+0000 7fa25effd640 1 -- 172.21.15.29:0/3601895482 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26400ccf0 con 0x7fa268070510 2024-01-25T15:06:15.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.637+0000 7fa270761640 1 -- 172.21.15.29:0/3601895482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa26814f360 con 0x7fa268070510 2024-01-25T15:06:15.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.638+0000 7fa270761640 1 -- 172.21.15.29:0/3601895482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa268074010 con 0x7fa268070510 2024-01-25T15:06:15.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.639+0000 7fa25effd640 1 -- 172.21.15.29:0/3601895482 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fa264013470 con 0x7fa268070510 2024-01-25T15:06:15.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.639+0000 7fa25effd640 1 --2- 172.21.15.29:0/3601895482 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa24c06aed0 0x7fa24c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.639+0000 7fa25effd640 1 -- 172.21.15.29:0/3601895482 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fa264089550 con 0x7fa268070510 2024-01-25T15:06:15.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.639+0000 7fa26dcfc640 1 --2- 172.21.15.29:0/3601895482 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa24c06aed0 0x7fa24c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.640+0000 7fa26dcfc640 1 --2- 172.21.15.29:0/3601895482 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa24c06aed0 0x7fa24c06d390 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa2680c1fc0 tx=0x7fa258009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:15.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.644+0000 7fa25effd640 1 -- 172.21.15.29:0/3601895482 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fa264054610 con 0x7fa268070510 2024-01-25T15:06:15.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.824+0000 7fa270761640 1 -- 172.21.15.29:0/3601895482 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2680c8900 con 0x7fa24c06aed0 2024-01-25T15:06:15.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.824+0000 7fa25effd640 1 -- 172.21.15.29:0/3601895482 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa2680c8900 con 0x7fa24c06aed0 2024-01-25T15:06:15.826 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 1 to deep-scrub 2024-01-25T15:06:15.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.826+0000 7fa270761640 1 -- 172.21.15.29:0/3601895482 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa24c06aed0 msgr2=0x7fa24c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.826+0000 7fa270761640 1 --2- 172.21.15.29:0/3601895482 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa24c06aed0 0x7fa24c06d390 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa2680c1fc0 tx=0x7fa258009040 comp rx=0 tx=0).stop 2024-01-25T15:06:15.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.826+0000 7fa270761640 1 -- 172.21.15.29:0/3601895482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa268070510 msgr2=0x7fa2681e8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.826+0000 7fa270761640 1 --2- 172.21.15.29:0/3601895482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa268070510 0x7fa2681e8960 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa26400e870 tx=0x7fa26400ed30 comp rx=0 tx=0).stop 2024-01-25T15:06:15.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.826+0000 7fa270761640 1 -- 172.21.15.29:0/3601895482 shutdown_connections 2024-01-25T15:06:15.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.826+0000 7fa270761640 1 --2- 172.21.15.29:0/3601895482 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa268152590 0x7fa2681453a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.826+0000 7fa270761640 1 --2- 172.21.15.29:0/3601895482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa268149190 0x7fa2680be000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.826+0000 7fa270761640 1 --2- 172.21.15.29:0/3601895482 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa24c06aed0 0x7fa24c06d390 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.826+0000 7fa270761640 1 --2- 172.21.15.29:0/3601895482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa268070510 0x7fa2681e8960 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.826+0000 7fa270761640 1 -- 172.21.15.29:0/3601895482 >> 172.21.15.29:0/3601895482 conn(0x7fa2680c7f80 msgr2=0x7fa2680c7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:15.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.827+0000 7fa270761640 1 -- 172.21.15.29:0/3601895482 shutdown_connections 2024-01-25T15:06:15.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.827+0000 7fa270761640 1 -- 172.21.15.29:0/3601895482 wait complete. 2024-01-25T15:06:15.838 INFO:tasks.ceph:Scrubbing osd.2 2024-01-25T15:06:15.838 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-01-25T15:06:15.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.943+0000 7f4d86f81640 1 Processor -- start 2024-01-25T15:06:15.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.943+0000 7f4d86f81640 1 -- start start 2024-01-25T15:06:15.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.944+0000 7f4d86f81640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4d80149190 0x7f4d800ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.944+0000 7f4d86f81640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d80070510 0x7f4d800c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.944+0000 7f4d86f81640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d80070d40 con 0x7f4d800c7890 2024-01-25T15:06:15.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.944+0000 7f4d86f81640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d80155c00 con 0x7f4d80149190 2024-01-25T15:06:15.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.944+0000 7f4d86f81640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d80155ee0 con 0x7f4d80070510 2024-01-25T15:06:15.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.944+0000 7f4d84d1d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4d80149190 0x7f4d800ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.944+0000 7f4d84d1d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4d80149190 0x7f4d800ad0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50658/0 (socket says 172.21.15.29:50658) 2024-01-25T15:06:15.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.944+0000 7f4d84d1d640 1 -- 172.21.15.29:0/2517623343 learned_addr learned my addr 172.21.15.29:0/2517623343 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:15.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.944+0000 7f4d7ffff640 1 --2- 172.21.15.29:0/2517623343 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d80070510 0x7f4d800c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.944+0000 7f4d84d1d640 1 -- 172.21.15.29:0/2517623343 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d80070510 msgr2=0x7f4d800c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:15.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.944+0000 7f4d84d1d640 1 --2- 172.21.15.29:0/2517623343 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d80070510 0x7f4d800c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.944+0000 7f4d84d1d640 1 -- 172.21.15.29:0/2517623343 >> v1:172.21.15.52:6789/0 conn(0x7f4d800c7890 legacy=0x7f4d80152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:15.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.944+0000 7f4d84d1d640 1 -- 172.21.15.29:0/2517623343 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d801561c0 con 0x7f4d80149190 2024-01-25T15:06:15.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.945+0000 7f4d84d1d640 1 --2- 172.21.15.29:0/2517623343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80149190 0x7f4d800ad0b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4d74009870 tx=0x7f4d7402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1464048b16fe2c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:15.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.945+0000 7f4d7f7fe640 1 -- 172.21.15.29:0/2517623343 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d74030840 con 0x7f4d80149190 2024-01-25T15:06:15.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.945+0000 7f4d7f7fe640 1 -- 172.21.15.29:0/2517623343 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d740309a0 con 0x7f4d80149190 2024-01-25T15:06:15.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.945+0000 7f4d7f7fe640 1 -- 172.21.15.29:0/2517623343 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d74030d30 con 0x7f4d80149190 2024-01-25T15:06:15.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.946+0000 7f4d86f81640 1 -- 172.21.15.29:0/2517623343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80149190 msgr2=0x7f4d800ad0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.946+0000 7f4d86f81640 1 --2- 172.21.15.29:0/2517623343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80149190 0x7f4d800ad0b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4d74009870 tx=0x7f4d7402b980 comp rx=0 tx=0).stop 2024-01-25T15:06:15.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.946+0000 7f4d86f81640 1 -- 172.21.15.29:0/2517623343 shutdown_connections 2024-01-25T15:06:15.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.946+0000 7f4d86f81640 1 --2- 172.21.15.29:0/2517623343 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d80070510 0x7f4d800c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.946+0000 7f4d86f81640 1 --2- 172.21.15.29:0/2517623343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80149190 0x7f4d800ad0b0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.946+0000 7f4d86f81640 1 -- 172.21.15.29:0/2517623343 >> 172.21.15.29:0/2517623343 conn(0x7f4d800c7f80 msgr2=0x7f4d800c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:15.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.946+0000 7f4d86f81640 1 -- 172.21.15.29:0/2517623343 shutdown_connections 2024-01-25T15:06:15.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.946+0000 7f4d86f81640 1 -- 172.21.15.29:0/2517623343 wait complete. 2024-01-25T15:06:15.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.947+0000 7f4d86f81640 1 Processor -- start 2024-01-25T15:06:15.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.947+0000 7f4d86f81640 1 -- start start 2024-01-25T15:06:15.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.948+0000 7f4d86f81640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d80070510 0x7f4d800c1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.948+0000 7f4d86f81640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d800c7890 0x7f4d8014ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.948+0000 7f4d86f81640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80149190 0x7f4d8014f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.948+0000 7f4d86f81640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d801ea820 con 0x7f4d80149190 2024-01-25T15:06:15.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.948+0000 7f4d86f81640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d801ead50 con 0x7f4d800c7890 2024-01-25T15:06:15.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.948+0000 7f4d86f81640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d80149bb0 con 0x7f4d80070510 2024-01-25T15:06:15.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.948+0000 7f4d8551e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80149190 0x7f4d8014f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.948+0000 7f4d8551e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80149190 0x7f4d8014f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50672/0 (socket says 172.21.15.29:50672) 2024-01-25T15:06:15.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.948+0000 7f4d8551e640 1 -- 172.21.15.29:0/1449072889 learned_addr learned my addr 172.21.15.29:0/1449072889 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:15.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.948+0000 7f4d7ffff640 1 --2- 172.21.15.29:0/1449072889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d800c7890 0x7f4d8014ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.948+0000 7f4d84d1d640 1 --2- 172.21.15.29:0/1449072889 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d80070510 0x7f4d800c1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.948+0000 7f4d8551e640 1 -- 172.21.15.29:0/1449072889 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d80070510 msgr2=0x7f4d800c1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.948+0000 7f4d8551e640 1 --2- 172.21.15.29:0/1449072889 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d80070510 0x7f4d800c1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.948+0000 7f4d8551e640 1 -- 172.21.15.29:0/1449072889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d800c7890 msgr2=0x7f4d8014ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.948+0000 7f4d8551e640 1 --2- 172.21.15.29:0/1449072889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d800c7890 0x7f4d8014ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.948+0000 7f4d8551e640 1 -- 172.21.15.29:0/1449072889 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d740094d0 con 0x7f4d80149190 2024-01-25T15:06:15.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.949+0000 7f4d8551e640 1 --2- 172.21.15.29:0/1449072889 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80149190 0x7f4d8014f220 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800c6b0 tx=0x7f4d7800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:15.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.949+0000 7f4d7d7fa640 1 -- 172.21.15.29:0/1449072889 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78003b70 con 0x7f4d80149190 2024-01-25T15:06:15.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.949+0000 7f4d7d7fa640 1 -- 172.21.15.29:0/1449072889 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d78003cf0 con 0x7f4d80149190 2024-01-25T15:06:15.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.949+0000 7f4d86f81640 1 -- 172.21.15.29:0/1449072889 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d801eaa70 con 0x7f4d80149190 2024-01-25T15:06:15.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.949+0000 7f4d7d7fa640 1 -- 172.21.15.29:0/1449072889 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78003ea0 con 0x7f4d80149190 2024-01-25T15:06:15.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.949+0000 7f4d86f81640 1 -- 172.21.15.29:0/1449072889 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8014a130 con 0x7f4d80149190 2024-01-25T15:06:15.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.950+0000 7f4d86f81640 1 -- 172.21.15.29:0/1449072889 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4d801569c0 con 0x7f4d80149190 2024-01-25T15:06:15.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.950+0000 7f4d7d7fa640 1 -- 172.21.15.29:0/1449072889 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4d78005310 con 0x7f4d80149190 2024-01-25T15:06:15.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.950+0000 7f4d7d7fa640 1 --2- 172.21.15.29:0/1449072889 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4d6406aed0 0x7f4d6406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.951+0000 7f4d7d7fa640 1 -- 172.21.15.29:0/1449072889 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f4d78089060 con 0x7f4d80149190 2024-01-25T15:06:15.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.951+0000 7f4d84d1d640 1 --2- 172.21.15.29:0/1449072889 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4d6406aed0 0x7f4d6406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.951+0000 7f4d7d7fa640 1 --2- 172.21.15.29:0/1449072889 >> [v2:172.21.15.29:6800/2245852782,v1:172.21.15.29:6801/2245852782] conn(0x7f4d64071270 0x7f4d640736b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:15.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.951+0000 7f4d7d7fa640 1 -- 172.21.15.29:0/1449072889 --> [v2:172.21.15.29:6800/2245852782,v1:172.21.15.29:6801/2245852782] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d64073d80 con 0x7f4d64071270 2024-01-25T15:06:15.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.951+0000 7f4d7d7fa640 1 -- 172.21.15.29:0/1449072889 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d7808b720 con 0x7f4d80149190 2024-01-25T15:06:15.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.951+0000 7f4d7ffff640 1 --2- 172.21.15.29:0/1449072889 >> [v2:172.21.15.29:6800/2245852782,v1:172.21.15.29:6801/2245852782] conn(0x7f4d64071270 0x7f4d640736b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:15.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.951+0000 7f4d7ffff640 1 --2- 172.21.15.29:0/1449072889 >> [v2:172.21.15.29:6800/2245852782,v1:172.21.15.29:6801/2245852782] conn(0x7f4d64071270 0x7f4d640736b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:15.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.951+0000 7f4d84d1d640 1 --2- 172.21.15.29:0/1449072889 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4d6406aed0 0x7f4d6406d390 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4d74036000 tx=0x7f4d74008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:15.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.952+0000 7f4d7d7fa640 1 -- 172.21.15.29:0/1449072889 <== osd.2 v2:172.21.15.29:6800/2245852782 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4d64073d80 con 0x7f4d64071270 2024-01-25T15:06:15.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.978+0000 7f4d86f81640 1 -- 172.21.15.29:0/1449072889 --> [v2:172.21.15.29:6800/2245852782,v1:172.21.15.29:6801/2245852782] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4d80074010 con 0x7f4d64071270 2024-01-25T15:06:15.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.978+0000 7f4d7d7fa640 1 -- 172.21.15.29:0/1449072889 <== osd.2 v2:172.21.15.29:6800/2245852782 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4d80074010 con 0x7f4d64071270 2024-01-25T15:06:15.979 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-25T15:06:15.979 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-25T15:06:15.979 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-25T15:06:15.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.979+0000 7f4d86f81640 1 -- 172.21.15.29:0/1449072889 >> [v2:172.21.15.29:6800/2245852782,v1:172.21.15.29:6801/2245852782] conn(0x7f4d64071270 msgr2=0x7f4d640736b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.979+0000 7f4d86f81640 1 --2- 172.21.15.29:0/1449072889 >> [v2:172.21.15.29:6800/2245852782,v1:172.21.15.29:6801/2245852782] conn(0x7f4d64071270 0x7f4d640736b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:15.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.979+0000 7f4d86f81640 1 -- 172.21.15.29:0/1449072889 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4d6406aed0 msgr2=0x7f4d6406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.979+0000 7f4d86f81640 1 --2- 172.21.15.29:0/1449072889 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f4d6406aed0 0x7f4d6406d390 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4d74036000 tx=0x7f4d74008030 comp rx=0 tx=0).stop 2024-01-25T15:06:15.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.979+0000 7f4d86f81640 1 -- 172.21.15.29:0/1449072889 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80149190 msgr2=0x7f4d8014f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:15.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.979+0000 7f4d86f81640 1 --2- 172.21.15.29:0/1449072889 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80149190 0x7f4d8014f220 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800c6b0 tx=0x7f4d7800cb70 comp rx=0 tx=0).stop 2024-01-25T15:06:15.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.979+0000 7f4d8551e640 1 -- 172.21.15.29:0/1449072889 reap_dead start 2024-01-25T15:06:15.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.979+0000 7f4d86f81640 1 -- 172.21.15.29:0/1449072889 shutdown_connections 2024-01-25T15:06:15.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.979+0000 7f4d86f81640 1 -- 172.21.15.29:0/1449072889 >> 172.21.15.29:0/1449072889 conn(0x7f4d800c7f80 msgr2=0x7f4d800c64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:15.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.979+0000 7f4d86f81640 1 -- 172.21.15.29:0/1449072889 shutdown_connections 2024-01-25T15:06:15.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:15.979+0000 7f4d86f81640 1 -- 172.21.15.29:0/1449072889 wait complete. 2024-01-25T15:06:15.990 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-01-25T15:06:16.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.091+0000 7fdb81cd0640 1 Processor -- start 2024-01-25T15:06:16.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.091+0000 7fdb81cd0640 1 -- start start 2024-01-25T15:06:16.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.092+0000 7fdb81cd0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb7c0c4fe0 0x7fdb7c06b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.092+0000 7fdb81cd0640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7c0afaa0 con 0x7fdb7c06d560 2024-01-25T15:06:16.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.092+0000 7fdb81cd0640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7c0c6060 con 0x7fdb7c0af6c0 2024-01-25T15:06:16.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.092+0000 7fdb81cd0640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb7c06c480 con 0x7fdb7c0c4fe0 2024-01-25T15:06:16.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.092+0000 7fdb7affd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fdb7c06d560 0x7fdb7c06b220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44426/0 (socket says 172.21.15.29:44426) 2024-01-25T15:06:16.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.092+0000 7fdb7affd640 1 -- 172.21.15.29:0/772284702 learned_addr learned my addr 172.21.15.29:0/772284702 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:16.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.092+0000 7fdb7bfff640 1 --2- 172.21.15.29:0/772284702 >> v2:172.21.15.52:3300/0 conn(0x7fdb7c0c4fe0 0x7fdb7c06b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.093+0000 7fdb7a7fc640 1 -- 172.21.15.29:0/772284702 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3440059981 0 0) 0x7fdb7c0afaa0 con 0x7fdb7c06d560 2024-01-25T15:06:16.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.093+0000 7fdb7a7fc640 1 -- 172.21.15.29:0/772284702 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb64003520 con 0x7fdb7c06d560 2024-01-25T15:06:16.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.093+0000 7fdb7bfff640 1 -- 172.21.15.29:0/772284702 >> v1:172.21.15.52:6789/0 conn(0x7fdb7c0af6c0 legacy=0x7fdb7c0c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.093+0000 7fdb7bfff640 1 -- 172.21.15.29:0/772284702 >> v1:172.21.15.29:6789/0 conn(0x7fdb7c06d560 legacy=0x7fdb7c06b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.093+0000 7fdb7bfff640 1 -- 172.21.15.29:0/772284702 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c155480 con 0x7fdb7c0c4fe0 2024-01-25T15:06:16.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.094+0000 7fdb7bfff640 1 --2- 172.21.15.29:0/772284702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb7c0c4fe0 0x7fdb7c06b930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009d90 tx=0x7fdb7402bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=518c8dbb7f2944f2 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:16.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.094+0000 7fdb7a7fc640 1 -- 172.21.15.29:0/772284702 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7402cd00 con 0x7fdb7c0c4fe0 2024-01-25T15:06:16.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.094+0000 7fdb7a7fc640 1 -- 172.21.15.29:0/772284702 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7402ce60 con 0x7fdb7c0c4fe0 2024-01-25T15:06:16.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.094+0000 7fdb7a7fc640 1 -- 172.21.15.29:0/772284702 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb74034640 con 0x7fdb7c0c4fe0 2024-01-25T15:06:16.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.094+0000 7fdb81cd0640 1 -- 172.21.15.29:0/772284702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb7c0c4fe0 msgr2=0x7fdb7c06b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.094+0000 7fdb81cd0640 1 --2- 172.21.15.29:0/772284702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb7c0c4fe0 0x7fdb7c06b930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009d90 tx=0x7fdb7402bf50 comp rx=0 tx=0).stop 2024-01-25T15:06:16.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.094+0000 7fdb81cd0640 1 -- 172.21.15.29:0/772284702 shutdown_connections 2024-01-25T15:06:16.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.094+0000 7fdb81cd0640 1 --2- 172.21.15.29:0/772284702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb7c0c4fe0 0x7fdb7c06b930 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.094+0000 7fdb81cd0640 1 -- 172.21.15.29:0/772284702 >> 172.21.15.29:0/772284702 conn(0x7fdb7c0c6ca0 msgr2=0x7fdb7c0c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:16.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.095+0000 7fdb81cd0640 1 -- 172.21.15.29:0/772284702 shutdown_connections 2024-01-25T15:06:16.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.095+0000 7fdb81cd0640 1 -- 172.21.15.29:0/772284702 wait complete. 2024-01-25T15:06:16.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.096+0000 7fdb81cd0640 1 Processor -- start 2024-01-25T15:06:16.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.096+0000 7fdb81cd0640 1 -- start start 2024-01-25T15:06:16.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.096+0000 7fdb81cd0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb7c06d560 0x7fdb7c1ea7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.096+0000 7fdb81cd0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb7c0af6c0 0x7fdb7c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.096+0000 7fdb81cd0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb7c0c4fe0 0x7fdb7c1ed910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.096+0000 7fdb81cd0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c1eadc0 con 0x7fdb7c0af6c0 2024-01-25T15:06:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.096+0000 7fdb81cd0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c1581f0 con 0x7fdb7c0c4fe0 2024-01-25T15:06:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.096+0000 7fdb81cd0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c157c30 con 0x7fdb7c06d560 2024-01-25T15:06:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.097+0000 7fdb7affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb7c0af6c0 0x7fdb7c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.097+0000 7fdb7affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb7c0af6c0 0x7fdb7c153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50688/0 (socket says 172.21.15.29:50688) 2024-01-25T15:06:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.097+0000 7fdb7affd640 1 -- 172.21.15.29:0/1079176487 learned_addr learned my addr 172.21.15.29:0/1079176487 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:16.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.097+0000 7fdb7bfff640 1 --2- 172.21.15.29:0/1079176487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb7c0c4fe0 0x7fdb7c1ed910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.097+0000 7fdb7b7fe640 1 --2- 172.21.15.29:0/1079176487 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb7c06d560 0x7fdb7c1ea7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.097+0000 7fdb7affd640 1 -- 172.21.15.29:0/1079176487 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb7c06d560 msgr2=0x7fdb7c1ea7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.097+0000 7fdb7affd640 1 --2- 172.21.15.29:0/1079176487 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb7c06d560 0x7fdb7c1ea7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.097+0000 7fdb7affd640 1 -- 172.21.15.29:0/1079176487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb7c0c4fe0 msgr2=0x7fdb7c1ed910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.097+0000 7fdb7affd640 1 --2- 172.21.15.29:0/1079176487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb7c0c4fe0 0x7fdb7c1ed910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.097+0000 7fdb7affd640 1 -- 172.21.15.29:0/1079176487 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb74009a70 con 0x7fdb7c0af6c0 2024-01-25T15:06:16.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.097+0000 7fdb7affd640 1 --2- 172.21.15.29:0/1079176487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb7c0af6c0 0x7fdb7c153dd0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000c500 tx=0x7fdb7000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:16.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.097+0000 7fdb63fff640 1 -- 172.21.15.29:0/1079176487 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70005ce0 con 0x7fdb7c0af6c0 2024-01-25T15:06:16.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.097+0000 7fdb63fff640 1 -- 172.21.15.29:0/1079176487 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb70005e40 con 0x7fdb7c0af6c0 2024-01-25T15:06:16.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.097+0000 7fdb81cd0640 1 -- 172.21.15.29:0/1079176487 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb7c157f10 con 0x7fdb7c0af6c0 2024-01-25T15:06:16.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.097+0000 7fdb63fff640 1 -- 172.21.15.29:0/1079176487 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70007330 con 0x7fdb7c0af6c0 2024-01-25T15:06:16.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.097+0000 7fdb81cd0640 1 -- 172.21.15.29:0/1079176487 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7c154310 con 0x7fdb7c0af6c0 2024-01-25T15:06:16.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.098+0000 7fdb81cd0640 1 -- 172.21.15.29:0/1079176487 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7c1ed630 con 0x7fdb7c0af6c0 2024-01-25T15:06:16.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.099+0000 7fdb63fff640 1 -- 172.21.15.29:0/1079176487 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fdb70007550 con 0x7fdb7c0af6c0 2024-01-25T15:06:16.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.099+0000 7fdb63fff640 1 --2- 172.21.15.29:0/1079176487 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdb6806aed0 0x7fdb6806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.099+0000 7fdb63fff640 1 -- 172.21.15.29:0/1079176487 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fdb70088b20 con 0x7fdb7c0af6c0 2024-01-25T15:06:16.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.099+0000 7fdb7b7fe640 1 --2- 172.21.15.29:0/1079176487 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdb6806aed0 0x7fdb6806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.100+0000 7fdb7b7fe640 1 --2- 172.21.15.29:0/1079176487 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdb6806aed0 0x7fdb6806d390 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c001640 tx=0x7fdb6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:16.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.104+0000 7fdb63fff640 1 -- 172.21.15.29:0/1079176487 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fdb7c1ed630 con 0x7fdb7c0af6c0 2024-01-25T15:06:16.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.285+0000 7fdb81cd0640 1 -- 172.21.15.29:0/1079176487 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb7c0c5c40 con 0x7fdb6806aed0 2024-01-25T15:06:16.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.286+0000 7fdb63fff640 1 -- 172.21.15.29:0/1079176487 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdb6c0050d0 con 0x7fdb6806aed0 2024-01-25T15:06:16.287 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 2 to deep-scrub 2024-01-25T15:06:16.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.288+0000 7fdb81cd0640 1 -- 172.21.15.29:0/1079176487 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdb6806aed0 msgr2=0x7fdb6806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.288+0000 7fdb81cd0640 1 --2- 172.21.15.29:0/1079176487 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdb6806aed0 0x7fdb6806d390 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c001640 tx=0x7fdb6c009040 comp rx=0 tx=0).stop 2024-01-25T15:06:16.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.288+0000 7fdb81cd0640 1 -- 172.21.15.29:0/1079176487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb7c0af6c0 msgr2=0x7fdb7c153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.288+0000 7fdb81cd0640 1 --2- 172.21.15.29:0/1079176487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb7c0af6c0 0x7fdb7c153dd0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000c500 tx=0x7fdb7000c9c0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.288+0000 7fdb81cd0640 1 -- 172.21.15.29:0/1079176487 shutdown_connections 2024-01-25T15:06:16.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.288+0000 7fdb81cd0640 1 --2- 172.21.15.29:0/1079176487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb7c0c4fe0 0x7fdb7c1ed910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.288+0000 7fdb81cd0640 1 --2- 172.21.15.29:0/1079176487 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fdb6806aed0 0x7fdb6806d390 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.288+0000 7fdb81cd0640 1 --2- 172.21.15.29:0/1079176487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb7c0af6c0 0x7fdb7c153dd0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.288+0000 7fdb81cd0640 1 --2- 172.21.15.29:0/1079176487 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb7c06d560 0x7fdb7c1ea7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.288+0000 7fdb81cd0640 1 -- 172.21.15.29:0/1079176487 >> 172.21.15.29:0/1079176487 conn(0x7fdb7c0c6ca0 msgr2=0x7fdb7c0aeb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:16.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.288+0000 7fdb81cd0640 1 -- 172.21.15.29:0/1079176487 shutdown_connections 2024-01-25T15:06:16.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.288+0000 7fdb81cd0640 1 -- 172.21.15.29:0/1079176487 wait complete. 2024-01-25T15:06:16.299 INFO:tasks.ceph:Scrubbing osd.3 2024-01-25T15:06:16.299 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-01-25T15:06:16.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.405+0000 7f2614470640 1 Processor -- start 2024-01-25T15:06:16.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.405+0000 7f2614470640 1 -- start start 2024-01-25T15:06:16.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.406+0000 7f2614470640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f260c14eb20 0x7f260c06bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.406+0000 7f2614470640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f260c1520d0 0x7f260c0c1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.406+0000 7f2614470640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260c1557e0 con 0x7f260c0c1920 2024-01-25T15:06:16.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.406+0000 7f2614470640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260c0a92d0 con 0x7f260c14eb20 2024-01-25T15:06:16.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.406+0000 7f2614470640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c06e1a0 con 0x7f260c1520d0 2024-01-25T15:06:16.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.406+0000 7f261220c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f260c14eb20 0x7f260c06bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.406+0000 7f2612a0d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f260c1520d0 0x7f260c0c1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.406+0000 7f2611a0b640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f260c0c1920 0x7f260c1519c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:34366/0 (socket says 172.21.15.29:34366) 2024-01-25T15:06:16.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.406+0000 7f2611a0b640 1 -- 172.21.15.29:0/1496665104 learned_addr learned my addr 172.21.15.29:0/1496665104 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:16.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.406+0000 7f261120a640 1 -- 172.21.15.29:0/1496665104 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3157613285 0 0) 0x7f260c1557e0 con 0x7f260c0c1920 2024-01-25T15:06:16.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.406+0000 7f261120a640 1 -- 172.21.15.29:0/1496665104 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25f8003520 con 0x7f260c0c1920 2024-01-25T15:06:16.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.406+0000 7f261220c640 1 -- 172.21.15.29:0/1496665104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f260c1520d0 msgr2=0x7f260c0c1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:16.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.406+0000 7f261220c640 1 --2- 172.21.15.29:0/1496665104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f260c1520d0 0x7f260c0c1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.406+0000 7f261220c640 1 -- 172.21.15.29:0/1496665104 >> v1:172.21.15.52:6789/0 conn(0x7f260c0c1920 legacy=0x7f260c1519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.406+0000 7f261220c640 1 -- 172.21.15.29:0/1496665104 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c06e480 con 0x7f260c14eb20 2024-01-25T15:06:16.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.407+0000 7f261220c640 1 --2- 172.21.15.29:0/1496665104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f260c14eb20 0x7f260c06bf00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f26080097a0 tx=0x7f260802b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e0a5615590b395d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:16.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.407+0000 7f261120a640 1 -- 172.21.15.29:0/1496665104 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260802f050 con 0x7f260c14eb20 2024-01-25T15:06:16.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.407+0000 7f261120a640 1 -- 172.21.15.29:0/1496665104 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2608031700 con 0x7f260c14eb20 2024-01-25T15:06:16.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.407+0000 7f261120a640 1 -- 172.21.15.29:0/1496665104 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2608031a70 con 0x7f260c14eb20 2024-01-25T15:06:16.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.408+0000 7f2614470640 1 -- 172.21.15.29:0/1496665104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f260c14eb20 msgr2=0x7f260c06bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.408+0000 7f2614470640 1 --2- 172.21.15.29:0/1496665104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f260c14eb20 0x7f260c06bf00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f26080097a0 tx=0x7f260802b7a0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.408+0000 7f2614470640 1 -- 172.21.15.29:0/1496665104 shutdown_connections 2024-01-25T15:06:16.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.408+0000 7f2614470640 1 --2- 172.21.15.29:0/1496665104 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f260c1520d0 0x7f260c0c1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.408+0000 7f2614470640 1 --2- 172.21.15.29:0/1496665104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f260c14eb20 0x7f260c06bf00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.408+0000 7f2614470640 1 -- 172.21.15.29:0/1496665104 >> 172.21.15.29:0/1496665104 conn(0x7f260c0c2a10 msgr2=0x7f260c0c2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:16.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.408+0000 7f2614470640 1 -- 172.21.15.29:0/1496665104 shutdown_connections 2024-01-25T15:06:16.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.408+0000 7f2614470640 1 -- 172.21.15.29:0/1496665104 wait complete. 2024-01-25T15:06:16.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.409+0000 7f2614470640 1 Processor -- start 2024-01-25T15:06:16.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.409+0000 7f2614470640 1 -- start start 2024-01-25T15:06:16.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.410+0000 7f2614470640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f260c0c1920 0x7f260c0ab140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.410+0000 7f2614470640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f260c14eb20 0x7f260c1e7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.410+0000 7f2614470640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f260c1520d0 0x7f260c1e8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.410+0000 7f2614470640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c1e8750 con 0x7f260c0c1920 2024-01-25T15:06:16.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.410+0000 7f2614470640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c142860 con 0x7f260c14eb20 2024-01-25T15:06:16.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.410+0000 7f2614470640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c142ab0 con 0x7f260c1520d0 2024-01-25T15:06:16.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.410+0000 7f261220c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f260c0c1920 0x7f260c0ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.410+0000 7f261220c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f260c0c1920 0x7f260c0ab140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50702/0 (socket says 172.21.15.29:50702) 2024-01-25T15:06:16.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.410+0000 7f261220c640 1 -- 172.21.15.29:0/3992530626 learned_addr learned my addr 172.21.15.29:0/3992530626 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:16.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.410+0000 7f2612a0d640 1 --2- 172.21.15.29:0/3992530626 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f260c1520d0 0x7f260c1e8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.410+0000 7f2611a0b640 1 --2- 172.21.15.29:0/3992530626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f260c14eb20 0x7f260c1e7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.410+0000 7f261220c640 1 -- 172.21.15.29:0/3992530626 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f260c1520d0 msgr2=0x7f260c1e8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.410+0000 7f261220c640 1 --2- 172.21.15.29:0/3992530626 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f260c1520d0 0x7f260c1e8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.410+0000 7f261220c640 1 -- 172.21.15.29:0/3992530626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f260c14eb20 msgr2=0x7f260c1e7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.410+0000 7f261220c640 1 --2- 172.21.15.29:0/3992530626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f260c14eb20 0x7f260c1e7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.410+0000 7f261220c640 1 -- 172.21.15.29:0/3992530626 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2608009400 con 0x7f260c0c1920 2024-01-25T15:06:16.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.410+0000 7f261220c640 1 --2- 172.21.15.29:0/3992530626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f260c0c1920 0x7f260c0ab140 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f260802b7e0 tx=0x7f26080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:16.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.410+0000 7f2602ffd640 1 -- 172.21.15.29:0/3992530626 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26080339b0 con 0x7f260c0c1920 2024-01-25T15:06:16.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.410+0000 7f2602ffd640 1 -- 172.21.15.29:0/3992530626 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2608033b30 con 0x7f260c0c1920 2024-01-25T15:06:16.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.410+0000 7f2614470640 1 -- 172.21.15.29:0/3992530626 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260c1ebf30 con 0x7f260c0c1920 2024-01-25T15:06:16.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.410+0000 7f2602ffd640 1 -- 172.21.15.29:0/3992530626 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260803c400 con 0x7f260c0c1920 2024-01-25T15:06:16.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.410+0000 7f2614470640 1 -- 172.21.15.29:0/3992530626 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260c0ab680 con 0x7f260c0c1920 2024-01-25T15:06:16.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.411+0000 7f2614470640 1 -- 172.21.15.29:0/3992530626 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f260c0c4e00 con 0x7f260c0c1920 2024-01-25T15:06:16.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.412+0000 7f2602ffd640 1 -- 172.21.15.29:0/3992530626 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f260803a040 con 0x7f260c0c1920 2024-01-25T15:06:16.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.412+0000 7f2602ffd640 1 --2- 172.21.15.29:0/3992530626 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f25f006af00 0x7f25f006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.412+0000 7f2602ffd640 1 -- 172.21.15.29:0/3992530626 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f26080aaba0 con 0x7f260c0c1920 2024-01-25T15:06:16.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.412+0000 7f2602ffd640 1 --2- 172.21.15.29:0/3992530626 >> [v2:172.21.15.29:6816/2866381288,v1:172.21.15.29:6818/2866381288] conn(0x7f25f00712a0 0x7f25f00736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.412+0000 7f2602ffd640 1 -- 172.21.15.29:0/3992530626 --> [v2:172.21.15.29:6816/2866381288,v1:172.21.15.29:6818/2866381288] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f25f0073db0 con 0x7f25f00712a0 2024-01-25T15:06:16.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.412+0000 7f2602ffd640 1 -- 172.21.15.29:0/3992530626 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f260802f020 con 0x7f260c0c1920 2024-01-25T15:06:16.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.412+0000 7f2612a0d640 1 --2- 172.21.15.29:0/3992530626 >> [v2:172.21.15.29:6816/2866381288,v1:172.21.15.29:6818/2866381288] conn(0x7f25f00712a0 0x7f25f00736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.412+0000 7f2611a0b640 1 --2- 172.21.15.29:0/3992530626 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f25f006af00 0x7f25f006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.413+0000 7f2612a0d640 1 --2- 172.21.15.29:0/3992530626 >> [v2:172.21.15.29:6816/2866381288,v1:172.21.15.29:6818/2866381288] conn(0x7f25f00712a0 0x7f25f00736e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:16.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.413+0000 7f2611a0b640 1 --2- 172.21.15.29:0/3992530626 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f25f006af00 0x7f25f006d3c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f260c143500 tx=0x7f25fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:16.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.413+0000 7f2602ffd640 1 -- 172.21.15.29:0/3992530626 <== osd.3 v2:172.21.15.29:6816/2866381288 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f25f0073db0 con 0x7f25f00712a0 2024-01-25T15:06:16.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.427+0000 7f2614470640 1 -- 172.21.15.29:0/3992530626 --> [v2:172.21.15.29:6816/2866381288,v1:172.21.15.29:6818/2866381288] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f260c06e760 con 0x7f25f00712a0 2024-01-25T15:06:16.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.427+0000 7f2602ffd640 1 -- 172.21.15.29:0/3992530626 <== osd.3 v2:172.21.15.29:6816/2866381288 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f260400f040 con 0x7f25f00712a0 2024-01-25T15:06:16.428 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-25T15:06:16.428 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-25T15:06:16.428 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-25T15:06:16.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.427+0000 7f2614470640 1 -- 172.21.15.29:0/3992530626 >> [v2:172.21.15.29:6816/2866381288,v1:172.21.15.29:6818/2866381288] conn(0x7f25f00712a0 msgr2=0x7f25f00736e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.427+0000 7f2614470640 1 --2- 172.21.15.29:0/3992530626 >> [v2:172.21.15.29:6816/2866381288,v1:172.21.15.29:6818/2866381288] conn(0x7f25f00712a0 0x7f25f00736e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.427+0000 7f2614470640 1 -- 172.21.15.29:0/3992530626 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f25f006af00 msgr2=0x7f25f006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.427+0000 7f2614470640 1 --2- 172.21.15.29:0/3992530626 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f25f006af00 0x7f25f006d3c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f260c143500 tx=0x7f25fc009040 comp rx=0 tx=0).stop 2024-01-25T15:06:16.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.427+0000 7f2614470640 1 -- 172.21.15.29:0/3992530626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f260c0c1920 msgr2=0x7f260c0ab140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.427+0000 7f2614470640 1 --2- 172.21.15.29:0/3992530626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f260c0c1920 0x7f260c0ab140 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f260802b7e0 tx=0x7f26080046c0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.427+0000 7f2612a0d640 1 -- 172.21.15.29:0/3992530626 reap_dead start 2024-01-25T15:06:16.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.427+0000 7f2614470640 1 -- 172.21.15.29:0/3992530626 shutdown_connections 2024-01-25T15:06:16.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.427+0000 7f2614470640 1 -- 172.21.15.29:0/3992530626 >> 172.21.15.29:0/3992530626 conn(0x7f260c0c2a10 msgr2=0x7f260c154a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:16.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.427+0000 7f2614470640 1 -- 172.21.15.29:0/3992530626 shutdown_connections 2024-01-25T15:06:16.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.427+0000 7f2614470640 1 -- 172.21.15.29:0/3992530626 wait complete. 2024-01-25T15:06:16.438 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-01-25T15:06:16.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.539+0000 7f90690af640 1 Processor -- start 2024-01-25T15:06:16.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.539+0000 7f90690af640 1 -- start start 2024-01-25T15:06:16.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.540+0000 7f90690af640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f906406cf10 0x7f90641546c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.540+0000 7f90690af640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f906406d3a0 0x7f9064154c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.540+0000 7f90690af640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90640c30d0 con 0x7f9064151d30 2024-01-25T15:06:16.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.540+0000 7f90690af640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f906406ef80 con 0x7f906406cf10 2024-01-25T15:06:16.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.540+0000 7f90690af640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90640c3840 con 0x7f906406d3a0 2024-01-25T15:06:16.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.540+0000 7f9062d9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9064151d30 0x7f906406a6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44434/0 (socket says 172.21.15.29:44434) 2024-01-25T15:06:16.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.540+0000 7f9062d9d640 1 -- 172.21.15.29:0/891980204 learned_addr learned my addr 172.21.15.29:0/891980204 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:16.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.540+0000 7f906359e640 1 --2- 172.21.15.29:0/891980204 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f906406d3a0 0x7f9064154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.540+0000 7f906259c640 1 --2- 172.21.15.29:0/891980204 >> v2:172.21.15.52:3300/0 conn(0x7f906406cf10 0x7f90641546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.540+0000 7f9061d9b640 1 -- 172.21.15.29:0/891980204 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4185607374 0 0) 0x7f90640c30d0 con 0x7f9064151d30 2024-01-25T15:06:16.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.540+0000 7f9061d9b640 1 -- 172.21.15.29:0/891980204 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9050003520 con 0x7f9064151d30 2024-01-25T15:06:16.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.540+0000 7f906359e640 1 -- 172.21.15.29:0/891980204 >> v2:172.21.15.52:3300/0 conn(0x7f906406cf10 msgr2=0x7f90641546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:16.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.540+0000 7f906359e640 1 --2- 172.21.15.29:0/891980204 >> v2:172.21.15.52:3300/0 conn(0x7f906406cf10 0x7f90641546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.540+0000 7f906359e640 1 -- 172.21.15.29:0/891980204 >> v1:172.21.15.29:6789/0 conn(0x7f9064151d30 legacy=0x7f906406a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.540+0000 7f906359e640 1 -- 172.21.15.29:0/891980204 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9064152110 con 0x7f906406d3a0 2024-01-25T15:06:16.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.540+0000 7f906259c640 1 --2- 172.21.15.29:0/891980204 >> v2:172.21.15.52:3300/0 conn(0x7f906406cf10 0x7f90641546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:06:16.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.541+0000 7f906359e640 1 --2- 172.21.15.29:0/891980204 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f906406d3a0 0x7f9064154c00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f905c0097a0 tx=0x7f905c02b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38ed2cf3d2909839 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:16.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.541+0000 7f9061d9b640 1 -- 172.21.15.29:0/891980204 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c02f050 con 0x7f906406d3a0 2024-01-25T15:06:16.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.541+0000 7f9061d9b640 1 -- 172.21.15.29:0/891980204 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905c031700 con 0x7f906406d3a0 2024-01-25T15:06:16.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.541+0000 7f9061d9b640 1 -- 172.21.15.29:0/891980204 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c031a90 con 0x7f906406d3a0 2024-01-25T15:06:16.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.542+0000 7f90690af640 1 -- 172.21.15.29:0/891980204 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f906406d3a0 msgr2=0x7f9064154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.542+0000 7f90690af640 1 --2- 172.21.15.29:0/891980204 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f906406d3a0 0x7f9064154c00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f905c0097a0 tx=0x7f905c02b7a0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.542+0000 7f90690af640 1 -- 172.21.15.29:0/891980204 shutdown_connections 2024-01-25T15:06:16.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.542+0000 7f90690af640 1 --2- 172.21.15.29:0/891980204 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f906406d3a0 0x7f9064154c00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.542+0000 7f90690af640 1 --2- 172.21.15.29:0/891980204 >> v2:172.21.15.52:3300/0 conn(0x7f906406cf10 0x7f90641546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.542+0000 7f90690af640 1 -- 172.21.15.29:0/891980204 >> 172.21.15.29:0/891980204 conn(0x7f90640c39b0 msgr2=0x7f90640c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:16.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.542+0000 7f90690af640 1 -- 172.21.15.29:0/891980204 shutdown_connections 2024-01-25T15:06:16.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.542+0000 7f90690af640 1 -- 172.21.15.29:0/891980204 wait complete. 2024-01-25T15:06:16.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.543+0000 7f90690af640 1 Processor -- start 2024-01-25T15:06:16.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.543+0000 7f90690af640 1 -- start start 2024-01-25T15:06:16.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.544+0000 7f90690af640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f906406cf10 0x7f90641eccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.544+0000 7f90690af640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f906406d3a0 0x7f90641e9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.544+0000 7f90690af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9064151d30 0x7f90640c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.544+0000 7f90690af640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90641e9bb0 con 0x7f906406d3a0 2024-01-25T15:06:16.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.544+0000 7f90690af640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90641e9810 con 0x7f9064151d30 2024-01-25T15:06:16.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.544+0000 7f90690af640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9064149ee0 con 0x7f906406cf10 2024-01-25T15:06:16.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.544+0000 7f906259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f906406d3a0 0x7f90641e9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.544+0000 7f906259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f906406d3a0 0x7f90641e9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50706/0 (socket says 172.21.15.29:50706) 2024-01-25T15:06:16.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.544+0000 7f906259c640 1 -- 172.21.15.29:0/1935697821 learned_addr learned my addr 172.21.15.29:0/1935697821 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:16.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.544+0000 7f9062d9d640 1 --2- 172.21.15.29:0/1935697821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f906406cf10 0x7f90641eccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.544+0000 7f906359e640 1 --2- 172.21.15.29:0/1935697821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9064151d30 0x7f90640c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.545+0000 7f906259c640 1 -- 172.21.15.29:0/1935697821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f906406cf10 msgr2=0x7f90641eccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.545+0000 7f906259c640 1 --2- 172.21.15.29:0/1935697821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f906406cf10 0x7f90641eccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.545+0000 7f906259c640 1 -- 172.21.15.29:0/1935697821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9064151d30 msgr2=0x7f90640c5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.545+0000 7f906259c640 1 --2- 172.21.15.29:0/1935697821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9064151d30 0x7f90640c5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.545+0000 7f906259c640 1 -- 172.21.15.29:0/1935697821 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c009400 con 0x7f906406d3a0 2024-01-25T15:06:16.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.545+0000 7f906359e640 1 --2- 172.21.15.29:0/1935697821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9064151d30 0x7f90640c5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:06:16.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.545+0000 7f906259c640 1 --2- 172.21.15.29:0/1935697821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f906406d3a0 0x7f90641e9fd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f904c00e9b0 tx=0x7f904c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:16.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.545+0000 7f905b7fe640 1 -- 172.21.15.29:0/1935697821 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c00ca00 con 0x7f906406d3a0 2024-01-25T15:06:16.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.545+0000 7f905b7fe640 1 -- 172.21.15.29:0/1935697821 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c00cb60 con 0x7f906406d3a0 2024-01-25T15:06:16.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.545+0000 7f90690af640 1 -- 172.21.15.29:0/1935697821 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f905c009400 con 0x7f906406d3a0 2024-01-25T15:06:16.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.545+0000 7f905b7fe640 1 -- 172.21.15.29:0/1935697821 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c013470 con 0x7f906406d3a0 2024-01-25T15:06:16.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.545+0000 7f90690af640 1 -- 172.21.15.29:0/1935697821 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f906414a4a0 con 0x7f906406d3a0 2024-01-25T15:06:16.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.546+0000 7f90690af640 1 -- 172.21.15.29:0/1935697821 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9064074010 con 0x7f906406d3a0 2024-01-25T15:06:16.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.546+0000 7f905b7fe640 1 -- 172.21.15.29:0/1935697821 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f904c0135d0 con 0x7f906406d3a0 2024-01-25T15:06:16.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.547+0000 7f905b7fe640 1 --2- 172.21.15.29:0/1935697821 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f904406af00 0x7f904406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.547+0000 7f905b7fe640 1 -- 172.21.15.29:0/1935697821 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f904c089420 con 0x7f906406d3a0 2024-01-25T15:06:16.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.547+0000 7f9062d9d640 1 --2- 172.21.15.29:0/1935697821 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f904406af00 0x7f904406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.547+0000 7f9062d9d640 1 --2- 172.21.15.29:0/1935697821 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f904406af00 0x7f904406d3c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9054005c00 tx=0x7f9054009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:16.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.551+0000 7f905b7fe640 1 -- 172.21.15.29:0/1935697821 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f904c0544e0 con 0x7f906406d3a0 2024-01-25T15:06:16.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.729+0000 7f90690af640 1 -- 172.21.15.29:0/1935697821 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f9064158760 con 0x7f904406af00 2024-01-25T15:06:16.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.729+0000 7f905b7fe640 1 -- 172.21.15.29:0/1935697821 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f905400ec40 con 0x7f904406af00 2024-01-25T15:06:16.730 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 3 to deep-scrub 2024-01-25T15:06:16.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.731+0000 7f90690af640 1 -- 172.21.15.29:0/1935697821 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f904406af00 msgr2=0x7f904406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.731+0000 7f90690af640 1 --2- 172.21.15.29:0/1935697821 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f904406af00 0x7f904406d3c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9054005c00 tx=0x7f9054009040 comp rx=0 tx=0).stop 2024-01-25T15:06:16.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.731+0000 7f90690af640 1 -- 172.21.15.29:0/1935697821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f906406d3a0 msgr2=0x7f90641e9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.731+0000 7f90690af640 1 --2- 172.21.15.29:0/1935697821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f906406d3a0 0x7f90641e9fd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f904c00e9b0 tx=0x7f904c00ee70 comp rx=0 tx=0).stop 2024-01-25T15:06:16.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.731+0000 7f90690af640 1 -- 172.21.15.29:0/1935697821 shutdown_connections 2024-01-25T15:06:16.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.731+0000 7f90690af640 1 --2- 172.21.15.29:0/1935697821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9064151d30 0x7f90640c5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.731+0000 7f90690af640 1 --2- 172.21.15.29:0/1935697821 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f904406af00 0x7f904406d3c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.731+0000 7f90690af640 1 --2- 172.21.15.29:0/1935697821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f906406d3a0 0x7f90641e9fd0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.731+0000 7f90690af640 1 --2- 172.21.15.29:0/1935697821 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f906406cf10 0x7f90641eccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.731+0000 7f90690af640 1 -- 172.21.15.29:0/1935697821 >> 172.21.15.29:0/1935697821 conn(0x7f90640c39b0 msgr2=0x7f906414ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:16.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.731+0000 7f90690af640 1 -- 172.21.15.29:0/1935697821 shutdown_connections 2024-01-25T15:06:16.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.731+0000 7f90690af640 1 -- 172.21.15.29:0/1935697821 wait complete. 2024-01-25T15:06:16.742 INFO:tasks.ceph:Scrubbing osd.4 2024-01-25T15:06:16.743 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-01-25T15:06:16.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.847+0000 7f5d971f8640 1 Processor -- start 2024-01-25T15:06:16.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.847+0000 7f5d971f8640 1 -- start start 2024-01-25T15:06:16.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.848+0000 7f5d971f8640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5d9006b490 0x7f5d900c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.848+0000 7f5d971f8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5d90158b80 0x7f5d900c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.848+0000 7f5d971f8640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d900c8450 0x7f5d90151c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.848+0000 7f5d971f8640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d900c88c0 con 0x7f5d90158b80 2024-01-25T15:06:16.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.848+0000 7f5d971f8640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d900c6770 con 0x7f5d9006b490 2024-01-25T15:06:16.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.848+0000 7f5d971f8640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d90154f10 con 0x7f5d900c8450 2024-01-25T15:06:16.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.848+0000 7f5d8ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5d90158b80 0x7f5d900c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.848+0000 7f5d8ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5d90158b80 0x7f5d900c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50716/0 (socket says 172.21.15.29:50716) 2024-01-25T15:06:16.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.848+0000 7f5d8ffff640 1 -- 172.21.15.29:0/2554429776 learned_addr learned my addr 172.21.15.29:0/2554429776 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:16.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.848+0000 7f5d95795640 1 --2- 172.21.15.29:0/2554429776 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d900c8450 0x7f5d90151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.848+0000 7f5d94f94640 1 --2- 172.21.15.29:0/2554429776 >> v2:172.21.15.52:3300/0 conn(0x7f5d9006b490 0x7f5d900c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.848+0000 7f5d8ffff640 1 -- 172.21.15.29:0/2554429776 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d900c8450 msgr2=0x7f5d90151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:16.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.848+0000 7f5d8ffff640 1 --2- 172.21.15.29:0/2554429776 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d900c8450 0x7f5d90151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.848+0000 7f5d8ffff640 1 -- 172.21.15.29:0/2554429776 >> v2:172.21.15.52:3300/0 conn(0x7f5d9006b490 msgr2=0x7f5d900c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:16.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.848+0000 7f5d8ffff640 1 --2- 172.21.15.29:0/2554429776 >> v2:172.21.15.52:3300/0 conn(0x7f5d9006b490 0x7f5d900c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.848+0000 7f5d8ffff640 1 -- 172.21.15.29:0/2554429776 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d901551f0 con 0x7f5d90158b80 2024-01-25T15:06:16.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.848+0000 7f5d95795640 1 --2- 172.21.15.29:0/2554429776 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d900c8450 0x7f5d90151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:16.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.849+0000 7f5d8ffff640 1 --2- 172.21.15.29:0/2554429776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d90158b80 0x7f5d900c7f10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f5d900c7b60 tx=0x7f5d8402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2474551b112e137f server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:16.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.849+0000 7f5d8f7fe640 1 -- 172.21.15.29:0/2554429776 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d840317e0 con 0x7f5d90158b80 2024-01-25T15:06:16.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.849+0000 7f5d8f7fe640 1 -- 172.21.15.29:0/2554429776 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d84031940 con 0x7f5d90158b80 2024-01-25T15:06:16.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.849+0000 7f5d8f7fe640 1 -- 172.21.15.29:0/2554429776 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84031cd0 con 0x7f5d90158b80 2024-01-25T15:06:16.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.850+0000 7f5d971f8640 1 -- 172.21.15.29:0/2554429776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d90158b80 msgr2=0x7f5d900c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.850+0000 7f5d971f8640 1 --2- 172.21.15.29:0/2554429776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d90158b80 0x7f5d900c7f10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f5d900c7b60 tx=0x7f5d8402b880 comp rx=0 tx=0).stop 2024-01-25T15:06:16.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.850+0000 7f5d971f8640 1 -- 172.21.15.29:0/2554429776 shutdown_connections 2024-01-25T15:06:16.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.850+0000 7f5d971f8640 1 --2- 172.21.15.29:0/2554429776 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d900c8450 0x7f5d90151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.850+0000 7f5d971f8640 1 --2- 172.21.15.29:0/2554429776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d90158b80 0x7f5d900c7f10 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.850+0000 7f5d971f8640 1 --2- 172.21.15.29:0/2554429776 >> v2:172.21.15.52:3300/0 conn(0x7f5d9006b490 0x7f5d900c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.850+0000 7f5d971f8640 1 -- 172.21.15.29:0/2554429776 >> 172.21.15.29:0/2554429776 conn(0x7f5d900ca010 msgr2=0x7f5d900ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:16.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.850+0000 7f5d971f8640 1 -- 172.21.15.29:0/2554429776 shutdown_connections 2024-01-25T15:06:16.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.850+0000 7f5d971f8640 1 -- 172.21.15.29:0/2554429776 wait complete. 2024-01-25T15:06:16.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.851+0000 7f5d971f8640 1 Processor -- start 2024-01-25T15:06:16.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.851+0000 7f5d971f8640 1 -- start start 2024-01-25T15:06:16.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.852+0000 7f5d971f8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d9006b490 0x7f5d900c1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.852+0000 7f5d971f8640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d900c8450 0x7f5d901ee400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.852+0000 7f5d971f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d90158b80 0x7f5d900bcad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.852+0000 7f5d971f8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d901edf70 con 0x7f5d9006b490 2024-01-25T15:06:16.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.852+0000 7f5d971f8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900bd010 con 0x7f5d90158b80 2024-01-25T15:06:16.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.852+0000 7f5d971f8640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900ab390 con 0x7f5d900c8450 2024-01-25T15:06:16.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.852+0000 7f5d94f94640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d9006b490 0x7f5d900c1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.852+0000 7f5d94f94640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d9006b490 0x7f5d900c1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50732/0 (socket says 172.21.15.29:50732) 2024-01-25T15:06:16.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.852+0000 7f5d94f94640 1 -- 172.21.15.29:0/415614508 learned_addr learned my addr 172.21.15.29:0/415614508 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:16.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.852+0000 7f5d8ffff640 1 --2- 172.21.15.29:0/415614508 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d900c8450 0x7f5d901ee400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.852+0000 7f5d95795640 1 --2- 172.21.15.29:0/415614508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d90158b80 0x7f5d900bcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.852+0000 7f5d94f94640 1 -- 172.21.15.29:0/415614508 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d900c8450 msgr2=0x7f5d901ee400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.852+0000 7f5d94f94640 1 --2- 172.21.15.29:0/415614508 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5d900c8450 0x7f5d901ee400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.852+0000 7f5d94f94640 1 -- 172.21.15.29:0/415614508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d90158b80 msgr2=0x7f5d900bcad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.852+0000 7f5d94f94640 1 --2- 172.21.15.29:0/415614508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d90158b80 0x7f5d900bcad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.852+0000 7f5d94f94640 1 -- 172.21.15.29:0/415614508 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d840094d0 con 0x7f5d9006b490 2024-01-25T15:06:16.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.852+0000 7f5d95795640 1 --2- 172.21.15.29:0/415614508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d90158b80 0x7f5d900bcad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:16.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.852+0000 7f5d94f94640 1 --2- 172.21.15.29:0/415614508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d9006b490 0x7f5d900c1af0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5d88007ef0 tx=0x7f5d8800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:16.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.853+0000 7f5d8d7fa640 1 -- 172.21.15.29:0/415614508 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d88014620 con 0x7f5d9006b490 2024-01-25T15:06:16.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.853+0000 7f5d8d7fa640 1 -- 172.21.15.29:0/415614508 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d88014780 con 0x7f5d9006b490 2024-01-25T15:06:16.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.853+0000 7f5d971f8640 1 -- 172.21.15.29:0/415614508 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d900ab670 con 0x7f5d9006b490 2024-01-25T15:06:16.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.853+0000 7f5d8d7fa640 1 -- 172.21.15.29:0/415614508 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d88014b30 con 0x7f5d9006b490 2024-01-25T15:06:16.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.853+0000 7f5d971f8640 1 -- 172.21.15.29:0/415614508 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d901edc00 con 0x7f5d9006b490 2024-01-25T15:06:16.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.853+0000 7f5d971f8640 1 -- 172.21.15.29:0/415614508 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5d9006cf80 con 0x7f5d9006b490 2024-01-25T15:06:16.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.854+0000 7f5d8d7fa640 1 -- 172.21.15.29:0/415614508 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f5d88014c90 con 0x7f5d9006b490 2024-01-25T15:06:16.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.854+0000 7f5d8d7fa640 1 --2- 172.21.15.29:0/415614508 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5d7c06aed0 0x7f5d7c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.855+0000 7f5d8d7fa640 1 -- 172.21.15.29:0/415614508 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f5d88089d90 con 0x7f5d9006b490 2024-01-25T15:06:16.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.855+0000 7f5d8d7fa640 1 --2- 172.21.15.29:0/415614508 >> [v2:172.21.15.52:6800/2238001841,v1:172.21.15.52:6801/2238001841] conn(0x7f5d7c071270 0x7f5d7c0736b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.855+0000 7f5d8d7fa640 1 -- 172.21.15.29:0/415614508 --> [v2:172.21.15.52:6800/2238001841,v1:172.21.15.52:6801/2238001841] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d7c073d80 con 0x7f5d7c071270 2024-01-25T15:06:16.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.855+0000 7f5d8d7fa640 1 -- 172.21.15.29:0/415614508 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d8808c450 con 0x7f5d9006b490 2024-01-25T15:06:16.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.855+0000 7f5d8ffff640 1 --2- 172.21.15.29:0/415614508 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5d7c06aed0 0x7f5d7c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.855+0000 7f5d95795640 1 --2- 172.21.15.29:0/415614508 >> [v2:172.21.15.52:6800/2238001841,v1:172.21.15.52:6801/2238001841] conn(0x7f5d7c071270 0x7f5d7c0736b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.855+0000 7f5d8ffff640 1 --2- 172.21.15.29:0/415614508 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5d7c06aed0 0x7f5d7c06d390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5d84036000 tx=0x7f5d8403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:16.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.855+0000 7f5d95795640 1 --2- 172.21.15.29:0/415614508 >> [v2:172.21.15.52:6800/2238001841,v1:172.21.15.52:6801/2238001841] conn(0x7f5d7c071270 0x7f5d7c0736b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:16.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.856+0000 7f5d8d7fa640 1 -- 172.21.15.29:0/415614508 <== osd.4 v2:172.21.15.52:6800/2238001841 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5d7c073d80 con 0x7f5d7c071270 2024-01-25T15:06:16.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.869+0000 7f5d971f8640 1 -- 172.21.15.29:0/415614508 --> [v2:172.21.15.52:6800/2238001841,v1:172.21.15.52:6801/2238001841] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5d90158fe0 con 0x7f5d7c071270 2024-01-25T15:06:16.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.870+0000 7f5d8d7fa640 1 -- 172.21.15.29:0/415614508 <== osd.4 v2:172.21.15.52:6800/2238001841 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5d80009460 con 0x7f5d7c071270 2024-01-25T15:06:16.871 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-25T15:06:16.871 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-25T15:06:16.871 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-25T15:06:16.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.870+0000 7f5d971f8640 1 -- 172.21.15.29:0/415614508 >> [v2:172.21.15.52:6800/2238001841,v1:172.21.15.52:6801/2238001841] conn(0x7f5d7c071270 msgr2=0x7f5d7c0736b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.870+0000 7f5d971f8640 1 --2- 172.21.15.29:0/415614508 >> [v2:172.21.15.52:6800/2238001841,v1:172.21.15.52:6801/2238001841] conn(0x7f5d7c071270 0x7f5d7c0736b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.870+0000 7f5d971f8640 1 -- 172.21.15.29:0/415614508 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5d7c06aed0 msgr2=0x7f5d7c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.870+0000 7f5d971f8640 1 --2- 172.21.15.29:0/415614508 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f5d7c06aed0 0x7f5d7c06d390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5d84036000 tx=0x7f5d8403d040 comp rx=0 tx=0).stop 2024-01-25T15:06:16.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.870+0000 7f5d971f8640 1 -- 172.21.15.29:0/415614508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d9006b490 msgr2=0x7f5d900c1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.870+0000 7f5d971f8640 1 --2- 172.21.15.29:0/415614508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d9006b490 0x7f5d900c1af0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5d88007ef0 tx=0x7f5d8800e4b0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.871+0000 7f5d95795640 1 -- 172.21.15.29:0/415614508 reap_dead start 2024-01-25T15:06:16.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.871+0000 7f5d971f8640 1 -- 172.21.15.29:0/415614508 shutdown_connections 2024-01-25T15:06:16.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.871+0000 7f5d971f8640 1 -- 172.21.15.29:0/415614508 >> 172.21.15.29:0/415614508 conn(0x7f5d900ca010 msgr2=0x7f5d900c8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:16.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.871+0000 7f5d971f8640 1 -- 172.21.15.29:0/415614508 shutdown_connections 2024-01-25T15:06:16.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.871+0000 7f5d971f8640 1 -- 172.21.15.29:0/415614508 wait complete. 2024-01-25T15:06:16.881 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-01-25T15:06:16.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.983+0000 7f3ddd875640 1 Processor -- start 2024-01-25T15:06:16.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.983+0000 7f3ddd875640 1 -- start start 2024-01-25T15:06:16.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.984+0000 7f3ddd875640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3dd8151d80 0x7f3dd80c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.984+0000 7f3ddd875640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3dd806c370 0x7f3dd80c4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.984+0000 7f3ddd875640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd806bee0 con 0x7f3dd8155210 2024-01-25T15:06:16.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.984+0000 7f3ddd875640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd80c7400 con 0x7f3dd806c370 2024-01-25T15:06:16.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.984+0000 7f3ddd875640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd806b8d0 con 0x7f3dd8151d80 2024-01-25T15:06:16.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.984+0000 7f3dd77fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3dd806c370 0x7f3dd80c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.984+0000 7f3dd77fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3dd806c370 0x7f3dd80c4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50736/0 (socket says 172.21.15.29:50736) 2024-01-25T15:06:16.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.984+0000 7f3dd77fe640 1 -- 172.21.15.29:0/1350995600 learned_addr learned my addr 172.21.15.29:0/1350995600 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:16.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.984+0000 7f3dd6ffd640 1 --2- 172.21.15.29:0/1350995600 >> v2:172.21.15.52:3300/0 conn(0x7f3dd8151d80 0x7f3dd80c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.984+0000 7f3dd77fe640 1 -- 172.21.15.29:0/1350995600 >> v2:172.21.15.52:3300/0 conn(0x7f3dd8151d80 msgr2=0x7f3dd80c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:16.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.984+0000 7f3dd77fe640 1 --2- 172.21.15.29:0/1350995600 >> v2:172.21.15.52:3300/0 conn(0x7f3dd8151d80 0x7f3dd80c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.984+0000 7f3dd77fe640 1 -- 172.21.15.29:0/1350995600 >> v1:172.21.15.52:6789/0 conn(0x7f3dd8155210 legacy=0x7f3dd80c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:16.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.984+0000 7f3dd77fe640 1 -- 172.21.15.29:0/1350995600 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd80c7120 con 0x7f3dd806c370 2024-01-25T15:06:16.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.985+0000 7f3dd77fe640 1 --2- 172.21.15.29:0/1350995600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dd806c370 0x7f3dd80c4990 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80cb110 tx=0x7f3dd002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610d038d3695d98d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:16.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.985+0000 7f3dd5ffb640 1 -- 172.21.15.29:0/1350995600 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd00317e0 con 0x7f3dd806c370 2024-01-25T15:06:16.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.985+0000 7f3dd5ffb640 1 -- 172.21.15.29:0/1350995600 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd0031940 con 0x7f3dd806c370 2024-01-25T15:06:16.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.985+0000 7f3dd5ffb640 1 -- 172.21.15.29:0/1350995600 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0031cd0 con 0x7f3dd806c370 2024-01-25T15:06:16.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.986+0000 7f3ddd875640 1 -- 172.21.15.29:0/1350995600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dd806c370 msgr2=0x7f3dd80c4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.986+0000 7f3ddd875640 1 --2- 172.21.15.29:0/1350995600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dd806c370 0x7f3dd80c4990 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80cb110 tx=0x7f3dd002b880 comp rx=0 tx=0).stop 2024-01-25T15:06:16.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.986+0000 7f3ddd875640 1 -- 172.21.15.29:0/1350995600 shutdown_connections 2024-01-25T15:06:16.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.986+0000 7f3ddd875640 1 --2- 172.21.15.29:0/1350995600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dd806c370 0x7f3dd80c4990 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.986+0000 7f3ddd875640 1 --2- 172.21.15.29:0/1350995600 >> v2:172.21.15.52:3300/0 conn(0x7f3dd8151d80 0x7f3dd80c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.986+0000 7f3ddd875640 1 -- 172.21.15.29:0/1350995600 >> 172.21.15.29:0/1350995600 conn(0x7f3dd80abd80 msgr2=0x7f3dd80ac190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:16.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.986+0000 7f3ddd875640 1 -- 172.21.15.29:0/1350995600 shutdown_connections 2024-01-25T15:06:16.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.986+0000 7f3ddd875640 1 -- 172.21.15.29:0/1350995600 wait complete. 2024-01-25T15:06:16.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.987+0000 7f3ddd875640 1 Processor -- start 2024-01-25T15:06:16.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.987+0000 7f3ddd875640 1 -- start start 2024-01-25T15:06:16.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.988+0000 7f3ddd875640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd806c370 0x7f3dd8150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.988+0000 7f3ddd875640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dd8151d80 0x7f3dd80c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.988+0000 7f3ddd875640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dd8155210 0x7f3dd80c3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.988+0000 7f3ddd875640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd81ed230 con 0x7f3dd8151d80 2024-01-25T15:06:16.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.988+0000 7f3ddd875640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd81ed4d0 con 0x7f3dd8155210 2024-01-25T15:06:16.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.988+0000 7f3ddd875640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd81ed7b0 con 0x7f3dd806c370 2024-01-25T15:06:16.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.988+0000 7f3dd67fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dd8151d80 0x7f3dd80c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.988+0000 7f3dd67fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dd8151d80 0x7f3dd80c30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50738/0 (socket says 172.21.15.29:50738) 2024-01-25T15:06:16.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.988+0000 7f3dd67fc640 1 -- 172.21.15.29:0/234622651 learned_addr learned my addr 172.21.15.29:0/234622651 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:16.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.988+0000 7f3dd77fe640 1 --2- 172.21.15.29:0/234622651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dd8155210 0x7f3dd80c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.988+0000 7f3dd6ffd640 1 --2- 172.21.15.29:0/234622651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd806c370 0x7f3dd8150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.988+0000 7f3dd67fc640 1 -- 172.21.15.29:0/234622651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd806c370 msgr2=0x7f3dd8150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.988+0000 7f3dd67fc640 1 --2- 172.21.15.29:0/234622651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd806c370 0x7f3dd8150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.988+0000 7f3dd67fc640 1 -- 172.21.15.29:0/234622651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dd8155210 msgr2=0x7f3dd80c3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:16.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.988+0000 7f3dd67fc640 1 --2- 172.21.15.29:0/234622651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dd8155210 0x7f3dd80c3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:16.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.988+0000 7f3dd67fc640 1 -- 172.21.15.29:0/234622651 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd00094d0 con 0x7f3dd8151d80 2024-01-25T15:06:16.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.988+0000 7f3dd77fe640 1 --2- 172.21.15.29:0/234622651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dd8155210 0x7f3dd80c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:16.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.989+0000 7f3dd67fc640 1 --2- 172.21.15.29:0/234622651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dd8151d80 0x7f3dd80c30f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000c430 tx=0x7f3dc000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:16.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.989+0000 7f3dcffff640 1 -- 172.21.15.29:0/234622651 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0011790 con 0x7f3dd8151d80 2024-01-25T15:06:16.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.989+0000 7f3dcffff640 1 -- 172.21.15.29:0/234622651 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc00118f0 con 0x7f3dd8151d80 2024-01-25T15:06:16.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.989+0000 7f3ddd875640 1 -- 172.21.15.29:0/234622651 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd81eda90 con 0x7f3dd8151d80 2024-01-25T15:06:16.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.989+0000 7f3dcffff640 1 -- 172.21.15.29:0/234622651 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0011ce0 con 0x7f3dd8151d80 2024-01-25T15:06:16.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.989+0000 7f3ddd875640 1 -- 172.21.15.29:0/234622651 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd8150da0 con 0x7f3dd8151d80 2024-01-25T15:06:16.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.990+0000 7f3ddd875640 1 -- 172.21.15.29:0/234622651 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd81edfb0 con 0x7f3dd8151d80 2024-01-25T15:06:16.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.990+0000 7f3dcffff640 1 -- 172.21.15.29:0/234622651 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f3dc001c460 con 0x7f3dd8151d80 2024-01-25T15:06:16.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.991+0000 7f3dcffff640 1 --2- 172.21.15.29:0/234622651 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3db806aed0 0x7f3db806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:16.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.991+0000 7f3dcffff640 1 -- 172.21.15.29:0/234622651 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f3dc00893d0 con 0x7f3dd8151d80 2024-01-25T15:06:16.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.991+0000 7f3dd6ffd640 1 --2- 172.21.15.29:0/234622651 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3db806aed0 0x7f3db806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:16.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.991+0000 7f3dd6ffd640 1 --2- 172.21.15.29:0/234622651 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3db806aed0 0x7f3db806d390 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8003b80 tx=0x7f3dc80098d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:16.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:16.995+0000 7f3dcffff640 1 -- 172.21.15.29:0/234622651 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f3dd81edfb0 con 0x7f3dd8151d80 2024-01-25T15:06:17.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.177+0000 7f3ddd875640 1 -- 172.21.15.29:0/234622651 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f3dd8152160 con 0x7f3db806aed0 2024-01-25T15:06:17.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.177+0000 7f3dcffff640 1 -- 172.21.15.29:0/234622651 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3dc8004720 con 0x7f3db806aed0 2024-01-25T15:06:17.178 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 4 to deep-scrub 2024-01-25T15:06:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.180+0000 7f3ddd875640 1 -- 172.21.15.29:0/234622651 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3db806aed0 msgr2=0x7f3db806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.180+0000 7f3ddd875640 1 --2- 172.21.15.29:0/234622651 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3db806aed0 0x7f3db806d390 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8003b80 tx=0x7f3dc80098d0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.180+0000 7f3ddd875640 1 -- 172.21.15.29:0/234622651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dd8151d80 msgr2=0x7f3dd80c30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.180+0000 7f3ddd875640 1 --2- 172.21.15.29:0/234622651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dd8151d80 0x7f3dd80c30f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000c430 tx=0x7f3dc000c8f0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.180+0000 7f3ddd875640 1 -- 172.21.15.29:0/234622651 shutdown_connections 2024-01-25T15:06:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.180+0000 7f3ddd875640 1 --2- 172.21.15.29:0/234622651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dd8155210 0x7f3dd80c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.180+0000 7f3ddd875640 1 --2- 172.21.15.29:0/234622651 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f3db806aed0 0x7f3db806d390 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.180+0000 7f3ddd875640 1 --2- 172.21.15.29:0/234622651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dd8151d80 0x7f3dd80c30f0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.180+0000 7f3ddd875640 1 --2- 172.21.15.29:0/234622651 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3dd806c370 0x7f3dd8150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.180+0000 7f3ddd875640 1 -- 172.21.15.29:0/234622651 >> 172.21.15.29:0/234622651 conn(0x7f3dd80abd80 msgr2=0x7f3dd814d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:17.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.180+0000 7f3ddd875640 1 -- 172.21.15.29:0/234622651 shutdown_connections 2024-01-25T15:06:17.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.180+0000 7f3ddd875640 1 -- 172.21.15.29:0/234622651 wait complete. 2024-01-25T15:06:17.191 INFO:tasks.ceph:Scrubbing osd.5 2024-01-25T15:06:17.191 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-01-25T15:06:17.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.296+0000 7fc695670640 1 Processor -- start 2024-01-25T15:06:17.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.296+0000 7fc695670640 1 -- start start 2024-01-25T15:06:17.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.297+0000 7fc695670640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc6900c8620 0x7fc6900c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.297+0000 7fc695670640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc690158b80 0x7fc690151c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.297+0000 7fc695670640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc690159030 con 0x7fc69006b490 2024-01-25T15:06:17.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.297+0000 7fc695670640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6900c6770 con 0x7fc6900c8620 2024-01-25T15:06:17.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.297+0000 7fc695670640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc690154f10 con 0x7fc690158b80 2024-01-25T15:06:17.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.297+0000 7fc68e7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc6900c8620 0x7fc6900c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.297+0000 7fc68effd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc69006b490 0x7fc6900c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44448/0 (socket says 172.21.15.29:44448) 2024-01-25T15:06:17.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.297+0000 7fc68e7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc6900c8620 0x7fc6900c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50748/0 (socket says 172.21.15.29:50748) 2024-01-25T15:06:17.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.297+0000 7fc68effd640 1 -- 172.21.15.29:0/2026685842 learned_addr learned my addr 172.21.15.29:0/2026685842 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:17.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.297+0000 7fc68f7fe640 1 --2- 172.21.15.29:0/2026685842 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc690158b80 0x7fc690151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.297+0000 7fc68e7fc640 1 -- 172.21.15.29:0/2026685842 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc690158b80 msgr2=0x7fc690151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:17.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.297+0000 7fc68e7fc640 1 --2- 172.21.15.29:0/2026685842 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc690158b80 0x7fc690151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.297+0000 7fc68e7fc640 1 -- 172.21.15.29:0/2026685842 >> v1:172.21.15.29:6789/0 conn(0x7fc69006b490 legacy=0x7fc6900c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.297+0000 7fc68e7fc640 1 -- 172.21.15.29:0/2026685842 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6901551f0 con 0x7fc6900c8620 2024-01-25T15:06:17.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.298+0000 7fc68e7fc640 1 --2- 172.21.15.29:0/2026685842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6900c8620 0x7fc6900c6120 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc6780097a0 tx=0x7fc67802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9c494a3eafb4a1 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:17.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.298+0000 7fc68dffb640 1 -- 172.21.15.29:0/2026685842 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67802e070 con 0x7fc6900c8620 2024-01-25T15:06:17.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.298+0000 7fc68dffb640 1 -- 172.21.15.29:0/2026685842 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6780315a0 con 0x7fc6900c8620 2024-01-25T15:06:17.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.298+0000 7fc68dffb640 1 -- 172.21.15.29:0/2026685842 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc678031930 con 0x7fc6900c8620 2024-01-25T15:06:17.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.299+0000 7fc695670640 1 -- 172.21.15.29:0/2026685842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6900c8620 msgr2=0x7fc6900c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.299+0000 7fc695670640 1 --2- 172.21.15.29:0/2026685842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6900c8620 0x7fc6900c6120 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc6780097a0 tx=0x7fc67802b840 comp rx=0 tx=0).stop 2024-01-25T15:06:17.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.299+0000 7fc695670640 1 -- 172.21.15.29:0/2026685842 shutdown_connections 2024-01-25T15:06:17.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.299+0000 7fc695670640 1 --2- 172.21.15.29:0/2026685842 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc690158b80 0x7fc690151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.299+0000 7fc695670640 1 --2- 172.21.15.29:0/2026685842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6900c8620 0x7fc6900c6120 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.299+0000 7fc695670640 1 -- 172.21.15.29:0/2026685842 >> 172.21.15.29:0/2026685842 conn(0x7fc6900ca010 msgr2=0x7fc6900ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:17.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.299+0000 7fc695670640 1 -- 172.21.15.29:0/2026685842 shutdown_connections 2024-01-25T15:06:17.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.299+0000 7fc695670640 1 -- 172.21.15.29:0/2026685842 wait complete. 2024-01-25T15:06:17.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.300+0000 7fc695670640 1 Processor -- start 2024-01-25T15:06:17.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.300+0000 7fc695670640 1 -- start start 2024-01-25T15:06:17.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc695670640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc69006b490 0x7fc6900c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc695670640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6900c8620 0x7fc690157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc695670640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc690158b80 0x7fc6901ea4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc695670640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900c1920 con 0x7fc69006b490 2024-01-25T15:06:17.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc695670640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69014e3c0 con 0x7fc6900c8620 2024-01-25T15:06:17.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc695670640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900c1260 con 0x7fc690158b80 2024-01-25T15:06:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc68effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc69006b490 0x7fc6900c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc68effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc69006b490 0x7fc6900c3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50752/0 (socket says 172.21.15.29:50752) 2024-01-25T15:06:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc68effd640 1 -- 172.21.15.29:0/328967700 learned_addr learned my addr 172.21.15.29:0/328967700 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc68f7fe640 1 --2- 172.21.15.29:0/328967700 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc690158b80 0x7fc6901ea4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc68e7fc640 1 --2- 172.21.15.29:0/328967700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6900c8620 0x7fc690157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc68effd640 1 -- 172.21.15.29:0/328967700 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc690158b80 msgr2=0x7fc6901ea4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc68effd640 1 --2- 172.21.15.29:0/328967700 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc690158b80 0x7fc6901ea4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc68effd640 1 -- 172.21.15.29:0/328967700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6900c8620 msgr2=0x7fc690157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc68effd640 1 --2- 172.21.15.29:0/328967700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6900c8620 0x7fc690157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc68effd640 1 -- 172.21.15.29:0/328967700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc678009400 con 0x7fc69006b490 2024-01-25T15:06:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc68e7fc640 1 --2- 172.21.15.29:0/328967700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6900c8620 0x7fc690157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:06:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc68effd640 1 --2- 172.21.15.29:0/328967700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc69006b490 0x7fc6900c3d20 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc68800c400 tx=0x7fc68800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc6877fe640 1 -- 172.21.15.29:0/328967700 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688005ce0 con 0x7fc69006b490 2024-01-25T15:06:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc6877fe640 1 -- 172.21.15.29:0/328967700 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc688005e40 con 0x7fc69006b490 2024-01-25T15:06:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc695670640 1 -- 172.21.15.29:0/328967700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc690155b70 con 0x7fc69006b490 2024-01-25T15:06:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc6877fe640 1 -- 172.21.15.29:0/328967700 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6880072d0 con 0x7fc69006b490 2024-01-25T15:06:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.301+0000 7fc695670640 1 -- 172.21.15.29:0/328967700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc690157690 con 0x7fc69006b490 2024-01-25T15:06:17.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.302+0000 7fc695670640 1 -- 172.21.15.29:0/328967700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc6900c10e0 con 0x7fc69006b490 2024-01-25T15:06:17.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.303+0000 7fc6877fe640 1 -- 172.21.15.29:0/328967700 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fc6880074f0 con 0x7fc69006b490 2024-01-25T15:06:17.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.303+0000 7fc6877fe640 1 --2- 172.21.15.29:0/328967700 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc67006aed0 0x7fc67006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.303+0000 7fc6877fe640 1 -- 172.21.15.29:0/328967700 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fc688088b50 con 0x7fc69006b490 2024-01-25T15:06:17.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.303+0000 7fc6877fe640 1 --2- 172.21.15.29:0/328967700 >> [v2:172.21.15.52:6808/2258341795,v1:172.21.15.52:6810/2258341795] conn(0x7fc670071270 0x7fc6700736b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.303+0000 7fc6877fe640 1 -- 172.21.15.29:0/328967700 --> [v2:172.21.15.52:6808/2258341795,v1:172.21.15.52:6810/2258341795] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc670073d80 con 0x7fc670071270 2024-01-25T15:06:17.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.303+0000 7fc6877fe640 1 -- 172.21.15.29:0/328967700 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc68808d2a0 con 0x7fc69006b490 2024-01-25T15:06:17.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.303+0000 7fc68e7fc640 1 --2- 172.21.15.29:0/328967700 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc67006aed0 0x7fc67006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.304+0000 7fc68f7fe640 1 --2- 172.21.15.29:0/328967700 >> [v2:172.21.15.52:6808/2258341795,v1:172.21.15.52:6810/2258341795] conn(0x7fc670071270 0x7fc6700736b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.304+0000 7fc68e7fc640 1 --2- 172.21.15.29:0/328967700 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc67006aed0 0x7fc67006d390 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc678036000 tx=0x7fc67803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:17.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.304+0000 7fc68f7fe640 1 --2- 172.21.15.29:0/328967700 >> [v2:172.21.15.52:6808/2258341795,v1:172.21.15.52:6810/2258341795] conn(0x7fc670071270 0x7fc6700736b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:17.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.305+0000 7fc6877fe640 1 -- 172.21.15.29:0/328967700 <== osd.5 v2:172.21.15.52:6808/2258341795 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc670073d80 con 0x7fc670071270 2024-01-25T15:06:17.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.318+0000 7fc695670640 1 -- 172.21.15.29:0/328967700 --> [v2:172.21.15.52:6808/2258341795,v1:172.21.15.52:6810/2258341795] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc6901559f0 con 0x7fc670071270 2024-01-25T15:06:17.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.319+0000 7fc6877fe640 1 -- 172.21.15.29:0/328967700 <== osd.5 v2:172.21.15.52:6808/2258341795 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc680009ad0 con 0x7fc670071270 2024-01-25T15:06:17.319 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-25T15:06:17.320 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-25T15:06:17.320 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-25T15:06:17.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.319+0000 7fc695670640 1 -- 172.21.15.29:0/328967700 >> [v2:172.21.15.52:6808/2258341795,v1:172.21.15.52:6810/2258341795] conn(0x7fc670071270 msgr2=0x7fc6700736b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.319+0000 7fc695670640 1 --2- 172.21.15.29:0/328967700 >> [v2:172.21.15.52:6808/2258341795,v1:172.21.15.52:6810/2258341795] conn(0x7fc670071270 0x7fc6700736b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.319+0000 7fc695670640 1 -- 172.21.15.29:0/328967700 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc67006aed0 msgr2=0x7fc67006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.319+0000 7fc695670640 1 --2- 172.21.15.29:0/328967700 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc67006aed0 0x7fc67006d390 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc678036000 tx=0x7fc67803d040 comp rx=0 tx=0).stop 2024-01-25T15:06:17.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.319+0000 7fc695670640 1 -- 172.21.15.29:0/328967700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc69006b490 msgr2=0x7fc6900c3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.319+0000 7fc695670640 1 --2- 172.21.15.29:0/328967700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc69006b490 0x7fc6900c3d20 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc68800c400 tx=0x7fc68800c8c0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.319+0000 7fc68f7fe640 1 -- 172.21.15.29:0/328967700 reap_dead start 2024-01-25T15:06:17.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.319+0000 7fc695670640 1 -- 172.21.15.29:0/328967700 shutdown_connections 2024-01-25T15:06:17.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.319+0000 7fc695670640 1 -- 172.21.15.29:0/328967700 >> 172.21.15.29:0/328967700 conn(0x7fc6900ca010 msgr2=0x7fc6900c68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:17.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.319+0000 7fc695670640 1 -- 172.21.15.29:0/328967700 shutdown_connections 2024-01-25T15:06:17.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.319+0000 7fc695670640 1 -- 172.21.15.29:0/328967700 wait complete. 2024-01-25T15:06:17.330 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-01-25T15:06:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.431+0000 7f3002b26640 1 Processor -- start 2024-01-25T15:06:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.431+0000 7f3002b26640 1 -- start start 2024-01-25T15:06:17.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.432+0000 7f3002b26640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2ffc14fdd0 0x7f2ffc0c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.432+0000 7f3002b26640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2ffc0c1f90 0x7f2ffc152690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.432+0000 7f3002b26640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2ffc0ab700 0x7f2ffc152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.432+0000 7f3002b26640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ffc0ab180 con 0x7f2ffc0c1f90 2024-01-25T15:06:17.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.432+0000 7f3002b26640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ffc0c2860 con 0x7f2ffc14fdd0 2024-01-25T15:06:17.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.432+0000 7f3002b26640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc156610 con 0x7f2ffc0ab700 2024-01-25T15:06:17.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.432+0000 7f2ffbfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2ffc0c1f90 0x7f2ffc152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.432+0000 7f2ffbfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2ffc0c1f90 0x7f2ffc152690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50762/0 (socket says 172.21.15.29:50762) 2024-01-25T15:06:17.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.432+0000 7f2ffbfff640 1 -- 172.21.15.29:0/3981800953 learned_addr learned my addr 172.21.15.29:0/3981800953 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:17.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.432+0000 7f30010c3640 1 --2- 172.21.15.29:0/3981800953 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2ffc0ab700 0x7f2ffc152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.432+0000 7f2ffbfff640 1 -- 172.21.15.29:0/3981800953 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2ffc0ab700 msgr2=0x7f2ffc152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:17.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.432+0000 7f2ffbfff640 1 --2- 172.21.15.29:0/3981800953 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2ffc0ab700 0x7f2ffc152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.432+0000 7f2ffbfff640 1 -- 172.21.15.29:0/3981800953 >> v2:172.21.15.52:3300/0 conn(0x7f2ffc14fdd0 msgr2=0x7f2ffc0c1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:17.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.432+0000 7f2ffbfff640 1 --2- 172.21.15.29:0/3981800953 >> v2:172.21.15.52:3300/0 conn(0x7f2ffc14fdd0 0x7f2ffc0c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.432+0000 7f2ffbfff640 1 -- 172.21.15.29:0/3981800953 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc156b40 con 0x7f2ffc0c1f90 2024-01-25T15:06:17.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.432+0000 7f30010c3640 1 --2- 172.21.15.29:0/3981800953 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2ffc0ab700 0x7f2ffc152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:06:17.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.433+0000 7f2ffbfff640 1 --2- 172.21.15.29:0/3981800953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ffc0c1f90 0x7f2ffc152690 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0668d0 tx=0x7f2ff002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805f6e2770f61b7e server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:17.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.433+0000 7f2ffb7fe640 1 -- 172.21.15.29:0/3981800953 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0031740 con 0x7f2ffc0c1f90 2024-01-25T15:06:17.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.433+0000 7f2ffb7fe640 1 -- 172.21.15.29:0/3981800953 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff00318a0 con 0x7f2ffc0c1f90 2024-01-25T15:06:17.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.433+0000 7f2ffb7fe640 1 -- 172.21.15.29:0/3981800953 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0031c30 con 0x7f2ffc0c1f90 2024-01-25T15:06:17.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.434+0000 7f3002b26640 1 -- 172.21.15.29:0/3981800953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ffc0c1f90 msgr2=0x7f2ffc152690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.434+0000 7f3002b26640 1 --2- 172.21.15.29:0/3981800953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ffc0c1f90 0x7f2ffc152690 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0668d0 tx=0x7f2ff002b7e0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.434+0000 7f3002b26640 1 -- 172.21.15.29:0/3981800953 shutdown_connections 2024-01-25T15:06:17.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.434+0000 7f3002b26640 1 --2- 172.21.15.29:0/3981800953 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2ffc0ab700 0x7f2ffc152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.434+0000 7f3002b26640 1 --2- 172.21.15.29:0/3981800953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ffc0c1f90 0x7f2ffc152690 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.434+0000 7f3002b26640 1 --2- 172.21.15.29:0/3981800953 >> v2:172.21.15.52:3300/0 conn(0x7f2ffc14fdd0 0x7f2ffc0c1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.434+0000 7f3002b26640 1 -- 172.21.15.29:0/3981800953 >> 172.21.15.29:0/3981800953 conn(0x7f2ffc0a8410 msgr2=0x7f2ffc0a87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:17.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.434+0000 7f3002b26640 1 -- 172.21.15.29:0/3981800953 shutdown_connections 2024-01-25T15:06:17.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.434+0000 7f3002b26640 1 -- 172.21.15.29:0/3981800953 wait complete. 2024-01-25T15:06:17.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.435+0000 7f3002b26640 1 Processor -- start 2024-01-25T15:06:17.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.435+0000 7f3002b26640 1 -- start start 2024-01-25T15:06:17.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.436+0000 7f3002b26640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ffc0ab700 0x7f2ffc1eb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.436+0000 7f3002b26640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ffc0c1f90 0x7f2ffc154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.436+0000 7f3002b26640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2ffc14fdd0 0x7f2ffc154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.436+0000 7f3002b26640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc14c440 con 0x7f2ffc0ab700 2024-01-25T15:06:17.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.436+0000 7f3002b26640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc1543f0 con 0x7f2ffc0c1f90 2024-01-25T15:06:17.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.436+0000 7f3002b26640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc14a180 con 0x7f2ffc14fdd0 2024-01-25T15:06:17.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.436+0000 7f30008c2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ffc0ab700 0x7f2ffc1eb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.436+0000 7f30008c2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ffc0ab700 0x7f2ffc1eb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50778/0 (socket says 172.21.15.29:50778) 2024-01-25T15:06:17.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.436+0000 7f30008c2640 1 -- 172.21.15.29:0/1543650123 learned_addr learned my addr 172.21.15.29:0/1543650123 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:17.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.436+0000 7f30010c3640 1 --2- 172.21.15.29:0/1543650123 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2ffc14fdd0 0x7f2ffc154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.436+0000 7f2ffbfff640 1 --2- 172.21.15.29:0/1543650123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ffc0c1f90 0x7f2ffc154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.436+0000 7f30008c2640 1 -- 172.21.15.29:0/1543650123 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2ffc14fdd0 msgr2=0x7f2ffc154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.436+0000 7f30008c2640 1 --2- 172.21.15.29:0/1543650123 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2ffc14fdd0 0x7f2ffc154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.436+0000 7f30008c2640 1 -- 172.21.15.29:0/1543650123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ffc0c1f90 msgr2=0x7f2ffc154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.436+0000 7f30008c2640 1 --2- 172.21.15.29:0/1543650123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ffc0c1f90 0x7f2ffc154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.436+0000 7f30008c2640 1 -- 172.21.15.29:0/1543650123 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff00094d0 con 0x7f2ffc0ab700 2024-01-25T15:06:17.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.436+0000 7f2ffbfff640 1 --2- 172.21.15.29:0/1543650123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ffc0c1f90 0x7f2ffc154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:17.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.436+0000 7f30008c2640 1 --2- 172.21.15.29:0/1543650123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ffc0ab700 0x7f2ffc1eb3c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400ba50 tx=0x7f2ff400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:17.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.436+0000 7f2ff97fa640 1 -- 172.21.15.29:0/1543650123 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff400cbe0 con 0x7f2ffc0ab700 2024-01-25T15:06:17.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.436+0000 7f2ff97fa640 1 -- 172.21.15.29:0/1543650123 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff400cd60 con 0x7f2ffc0ab700 2024-01-25T15:06:17.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.436+0000 7f3002b26640 1 -- 172.21.15.29:0/1543650123 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ffc1ebc50 con 0x7f2ffc0ab700 2024-01-25T15:06:17.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.436+0000 7f2ff97fa640 1 -- 172.21.15.29:0/1543650123 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4014680 con 0x7f2ffc0ab700 2024-01-25T15:06:17.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.437+0000 7f3002b26640 1 -- 172.21.15.29:0/1543650123 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ffc06b900 con 0x7f2ffc0ab700 2024-01-25T15:06:17.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.438+0000 7f3002b26640 1 -- 172.21.15.29:0/1543650123 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ffc074010 con 0x7f2ffc0ab700 2024-01-25T15:06:17.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.438+0000 7f2ff97fa640 1 -- 172.21.15.29:0/1543650123 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2ff401d3b0 con 0x7f2ffc0ab700 2024-01-25T15:06:17.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.438+0000 7f2ff97fa640 1 --2- 172.21.15.29:0/1543650123 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2fe806aed0 0x7f2fe806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.438+0000 7f2ff97fa640 1 -- 172.21.15.29:0/1543650123 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f2ff4089340 con 0x7f2ffc0ab700 2024-01-25T15:06:17.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.438+0000 7f2ffbfff640 1 --2- 172.21.15.29:0/1543650123 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2fe806aed0 0x7f2fe806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.439+0000 7f2ffbfff640 1 --2- 172.21.15.29:0/1543650123 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2fe806aed0 0x7f2fe806d390 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0035000 tx=0x7f2ff0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:17.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.443+0000 7f2ff97fa640 1 -- 172.21.15.29:0/1543650123 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2ff40544b0 con 0x7f2ffc0ab700 2024-01-25T15:06:17.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.622+0000 7f3002b26640 1 -- 172.21.15.29:0/1543650123 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ffc156860 con 0x7f2fe806aed0 2024-01-25T15:06:17.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.624+0000 7f2ff97fa640 1 -- 172.21.15.29:0/1543650123 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2ff0031c60 con 0x7f2fe806aed0 2024-01-25T15:06:17.624 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 5 to deep-scrub 2024-01-25T15:06:17.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.625+0000 7f3002b26640 1 -- 172.21.15.29:0/1543650123 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2fe806aed0 msgr2=0x7f2fe806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.625+0000 7f3002b26640 1 --2- 172.21.15.29:0/1543650123 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2fe806aed0 0x7f2fe806d390 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0035000 tx=0x7f2ff0008030 comp rx=0 tx=0).stop 2024-01-25T15:06:17.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.625+0000 7f3002b26640 1 -- 172.21.15.29:0/1543650123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ffc0ab700 msgr2=0x7f2ffc1eb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.625+0000 7f3002b26640 1 --2- 172.21.15.29:0/1543650123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ffc0ab700 0x7f2ffc1eb3c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400ba50 tx=0x7f2ff400bf10 comp rx=0 tx=0).stop 2024-01-25T15:06:17.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.625+0000 7f3002b26640 1 -- 172.21.15.29:0/1543650123 shutdown_connections 2024-01-25T15:06:17.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.625+0000 7f3002b26640 1 --2- 172.21.15.29:0/1543650123 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2ffc14fdd0 0x7f2ffc154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.625+0000 7f3002b26640 1 --2- 172.21.15.29:0/1543650123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ffc0c1f90 0x7f2ffc154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.625+0000 7f3002b26640 1 --2- 172.21.15.29:0/1543650123 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2fe806aed0 0x7f2fe806d390 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.625+0000 7f3002b26640 1 --2- 172.21.15.29:0/1543650123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ffc0ab700 0x7f2ffc1eb3c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.625+0000 7f3002b26640 1 -- 172.21.15.29:0/1543650123 >> 172.21.15.29:0/1543650123 conn(0x7f2ffc0a8410 msgr2=0x7f2ffc0a9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:17.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.625+0000 7f3002b26640 1 -- 172.21.15.29:0/1543650123 shutdown_connections 2024-01-25T15:06:17.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.625+0000 7f3002b26640 1 -- 172.21.15.29:0/1543650123 wait complete. 2024-01-25T15:06:17.636 INFO:tasks.ceph:Scrubbing osd.6 2024-01-25T15:06:17.636 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-01-25T15:06:17.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.741+0000 7fbd0e8b6640 1 Processor -- start 2024-01-25T15:06:17.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.741+0000 7fbd0e8b6640 1 -- start start 2024-01-25T15:06:17.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.742+0000 7fbd0e8b6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbd0806b490 0x7fbd080c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.742+0000 7fbd0e8b6640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd080c6770 con 0x7fbd08158b80 2024-01-25T15:06:17.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.742+0000 7fbd0e8b6640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd08154f10 con 0x7fbd080c8620 2024-01-25T15:06:17.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.742+0000 7fbd0e8b6640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd081551f0 con 0x7fbd0806b490 2024-01-25T15:06:17.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.742+0000 7fbd077fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbd08158b80 0x7fbd080c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44458/0 (socket says 172.21.15.29:44458) 2024-01-25T15:06:17.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.742+0000 7fbd077fe640 1 -- 172.21.15.29:0/4126078170 learned_addr learned my addr 172.21.15.29:0/4126078170 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:17.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.742+0000 7fbd06ffd640 1 -- 172.21.15.29:0/4126078170 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748554240 0 0) 0x7fbd080c6770 con 0x7fbd08158b80 2024-01-25T15:06:17.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.742+0000 7fbd06ffd640 1 -- 172.21.15.29:0/4126078170 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcf4003520 con 0x7fbd08158b80 2024-01-25T15:06:17.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.742+0000 7fbd07fff640 1 --2- 172.21.15.29:0/4126078170 >> v2:172.21.15.52:3300/0 conn(0x7fbd0806b490 0x7fbd080c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.742+0000 7fbd06ffd640 1 -- 172.21.15.29:0/4126078170 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2447634095 0 0) 0x7fbcf4003520 con 0x7fbd08158b80 2024-01-25T15:06:17.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.742+0000 7fbd06ffd640 1 -- 172.21.15.29:0/4126078170 >> v2:172.21.15.52:3300/0 conn(0x7fbd0806b490 msgr2=0x7fbd080c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:17.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.742+0000 7fbd06ffd640 1 --2- 172.21.15.29:0/4126078170 >> v2:172.21.15.52:3300/0 conn(0x7fbd0806b490 0x7fbd080c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.742+0000 7fbd06ffd640 1 -- 172.21.15.29:0/4126078170 >> v1:172.21.15.52:6789/0 conn(0x7fbd080c8620 legacy=0x7fbd08151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.742+0000 7fbd06ffd640 1 -- 172.21.15.29:0/4126078170 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd081554d0 con 0x7fbd08158b80 2024-01-25T15:06:17.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.742+0000 7fbd06ffd640 1 -- 172.21.15.29:0/4126078170 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7fbcf8001670 con 0x7fbd08158b80 2024-01-25T15:06:17.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.743+0000 7fbd06ffd640 1 -- 172.21.15.29:0/4126078170 >> v1:172.21.15.29:6789/0 conn(0x7fbd08158b80 legacy=0x7fbd080c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.743+0000 7fbd06ffd640 1 --2- 172.21.15.29:0/4126078170 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf40039e0 0x7fbcf4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.743+0000 7fbd06ffd640 1 --2- 172.21.15.29:0/4126078170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcf40047c0 0x7fbcf4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.743+0000 7fbd06ffd640 1 --2- 172.21.15.29:0/4126078170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf40051f0 0x7fbcf400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.743+0000 7fbd06ffd640 1 -- 172.21.15.29:0/4126078170 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd081551f0 con 0x7fbcf40047c0 2024-01-25T15:06:17.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.743+0000 7fbd06ffd640 1 -- 172.21.15.29:0/4126078170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf400c150 con 0x7fbcf40051f0 2024-01-25T15:06:17.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.743+0000 7fbd06ffd640 1 -- 172.21.15.29:0/4126078170 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf400c310 con 0x7fbcf40039e0 2024-01-25T15:06:17.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.743+0000 7fbd077fe640 1 --2- 172.21.15.29:0/4126078170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcf40047c0 0x7fbcf4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.743+0000 7fbd07fff640 1 --2- 172.21.15.29:0/4126078170 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf40039e0 0x7fbcf4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.743+0000 7fbd0ce53640 1 --2- 172.21.15.29:0/4126078170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf40051f0 0x7fbcf400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.743+0000 7fbd077fe640 1 -- 172.21.15.29:0/4126078170 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf40039e0 msgr2=0x7fbcf4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:17.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.743+0000 7fbd077fe640 1 --2- 172.21.15.29:0/4126078170 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf40039e0 0x7fbcf4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.743+0000 7fbd077fe640 1 -- 172.21.15.29:0/4126078170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf40051f0 msgr2=0x7fbcf400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:17.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.743+0000 7fbd077fe640 1 --2- 172.21.15.29:0/4126078170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf40051f0 0x7fbcf400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.743+0000 7fbd077fe640 1 -- 172.21.15.29:0/4126078170 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf4003520 con 0x7fbcf40047c0 2024-01-25T15:06:17.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.743+0000 7fbd0ce53640 1 -- 172.21.15.29:0/4126078170 reap_dead start 2024-01-25T15:06:17.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.743+0000 7fbd07fff640 1 --2- 172.21.15.29:0/4126078170 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf40039e0 0x7fbcf4003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:17.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.744+0000 7fbd077fe640 1 --2- 172.21.15.29:0/4126078170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcf40047c0 0x7fbcf4004c40 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800c240 tx=0x7fbcf40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef7d4e465983ecf server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:17.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.744+0000 7fbd06ffd640 1 -- 172.21.15.29:0/4126078170 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8005ad0 con 0x7fbcf40047c0 2024-01-25T15:06:17.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.744+0000 7fbd06ffd640 1 -- 172.21.15.29:0/4126078170 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf8005c30 con 0x7fbcf40047c0 2024-01-25T15:06:17.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.744+0000 7fbd06ffd640 1 -- 172.21.15.29:0/4126078170 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf802caf0 con 0x7fbcf40047c0 2024-01-25T15:06:17.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.744+0000 7fbd0e8b6640 1 -- 172.21.15.29:0/4126078170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcf40047c0 msgr2=0x7fbcf4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.744+0000 7fbd0e8b6640 1 --2- 172.21.15.29:0/4126078170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcf40047c0 0x7fbcf4004c40 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800c240 tx=0x7fbcf40057f0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.744+0000 7fbd0e8b6640 1 -- 172.21.15.29:0/4126078170 shutdown_connections 2024-01-25T15:06:17.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.744+0000 7fbd0e8b6640 1 --2- 172.21.15.29:0/4126078170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcf40047c0 0x7fbcf4004c40 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.744+0000 7fbd0e8b6640 1 -- 172.21.15.29:0/4126078170 >> 172.21.15.29:0/4126078170 conn(0x7fbd080ca010 msgr2=0x7fbd080ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:17.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.744+0000 7fbd0e8b6640 1 -- 172.21.15.29:0/4126078170 shutdown_connections 2024-01-25T15:06:17.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.744+0000 7fbd0e8b6640 1 -- 172.21.15.29:0/4126078170 wait complete. 2024-01-25T15:06:17.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.745+0000 7fbd0e8b6640 1 Processor -- start 2024-01-25T15:06:17.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.746+0000 7fbd0e8b6640 1 -- start start 2024-01-25T15:06:17.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.746+0000 7fbd0e8b6640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf40047c0 0x7fbd080c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.746+0000 7fbd0e8b6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd080bd690 0x7fbd080aae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.746+0000 7fbd0e8b6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd080ab3c0 0x7fbd081eba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.746+0000 7fbd0e8b6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd081edb20 con 0x7fbd080bd690 2024-01-25T15:06:17.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.746+0000 7fbd0e8b6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd081ee630 con 0x7fbd080ab3c0 2024-01-25T15:06:17.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.746+0000 7fbd0e8b6640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd080c3e10 con 0x7fbcf40047c0 2024-01-25T15:06:17.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.746+0000 7fbd077fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd080bd690 0x7fbd080aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.746+0000 7fbd077fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd080bd690 0x7fbd080aae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50810/0 (socket says 172.21.15.29:50810) 2024-01-25T15:06:17.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.746+0000 7fbd077fe640 1 -- 172.21.15.29:0/2050971293 learned_addr learned my addr 172.21.15.29:0/2050971293 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:17.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.747+0000 7fbd07fff640 1 --2- 172.21.15.29:0/2050971293 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf40047c0 0x7fbd080c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.747+0000 7fbd0ce53640 1 --2- 172.21.15.29:0/2050971293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd080ab3c0 0x7fbd081eba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.747+0000 7fbd077fe640 1 -- 172.21.15.29:0/2050971293 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf40047c0 msgr2=0x7fbd080c38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.747+0000 7fbd077fe640 1 --2- 172.21.15.29:0/2050971293 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbcf40047c0 0x7fbd080c38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.747+0000 7fbd077fe640 1 -- 172.21.15.29:0/2050971293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd080ab3c0 msgr2=0x7fbd081eba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.747+0000 7fbd077fe640 1 --2- 172.21.15.29:0/2050971293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd080ab3c0 0x7fbd081eba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.747+0000 7fbd077fe640 1 -- 172.21.15.29:0/2050971293 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd08155b70 con 0x7fbd080bd690 2024-01-25T15:06:17.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.747+0000 7fbd077fe640 1 --2- 172.21.15.29:0/2050971293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd080bd690 0x7fbd080aae80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8001930 tx=0x7fbcf802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:17.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.747+0000 7fbd04ff9640 1 -- 172.21.15.29:0/2050971293 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf803c040 con 0x7fbd080bd690 2024-01-25T15:06:17.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.747+0000 7fbd04ff9640 1 -- 172.21.15.29:0/2050971293 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf802ccc0 con 0x7fbd080bd690 2024-01-25T15:06:17.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.747+0000 7fbd0e8b6640 1 -- 172.21.15.29:0/2050971293 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd081eeac0 con 0x7fbd080bd690 2024-01-25T15:06:17.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.747+0000 7fbd04ff9640 1 -- 172.21.15.29:0/2050971293 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8007290 con 0x7fbd080bd690 2024-01-25T15:06:17.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.747+0000 7fbd0e8b6640 1 -- 172.21.15.29:0/2050971293 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd081edd00 con 0x7fbd080bd690 2024-01-25T15:06:17.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.748+0000 7fbd0e8b6640 1 -- 172.21.15.29:0/2050971293 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbd081559f0 con 0x7fbd080bd690 2024-01-25T15:06:17.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.748+0000 7fbd04ff9640 1 -- 172.21.15.29:0/2050971293 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fbcf8032070 con 0x7fbd080bd690 2024-01-25T15:06:17.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.749+0000 7fbd04ff9640 1 --2- 172.21.15.29:0/2050971293 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbce806af00 0x7fbce806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.749+0000 7fbd04ff9640 1 -- 172.21.15.29:0/2050971293 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fbcf80aaa50 con 0x7fbd080bd690 2024-01-25T15:06:17.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.749+0000 7fbd04ff9640 1 --2- 172.21.15.29:0/2050971293 >> [v2:172.21.15.52:6824/2160170066,v1:172.21.15.52:6825/2160170066] conn(0x7fbce80712a0 0x7fbce80736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.749+0000 7fbd04ff9640 1 -- 172.21.15.29:0/2050971293 --> [v2:172.21.15.52:6824/2160170066,v1:172.21.15.52:6825/2160170066] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbce8073db0 con 0x7fbce80712a0 2024-01-25T15:06:17.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.749+0000 7fbd04ff9640 1 -- 172.21.15.29:0/2050971293 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbcf80af2c0 con 0x7fbd080bd690 2024-01-25T15:06:17.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.749+0000 7fbd07fff640 1 --2- 172.21.15.29:0/2050971293 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbce806af00 0x7fbce806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.749+0000 7fbd0ce53640 1 --2- 172.21.15.29:0/2050971293 >> [v2:172.21.15.52:6824/2160170066,v1:172.21.15.52:6825/2160170066] conn(0x7fbce80712a0 0x7fbce80736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.749+0000 7fbd07fff640 1 --2- 172.21.15.29:0/2050971293 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbce806af00 0x7fbce806d3c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbd080c0e70 tx=0x7fbcf0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:17.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.750+0000 7fbd0ce53640 1 --2- 172.21.15.29:0/2050971293 >> [v2:172.21.15.52:6824/2160170066,v1:172.21.15.52:6825/2160170066] conn(0x7fbce80712a0 0x7fbce80736e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:17.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.750+0000 7fbd04ff9640 1 -- 172.21.15.29:0/2050971293 <== osd.6 v2:172.21.15.52:6824/2160170066 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fbce8073db0 con 0x7fbce80712a0 2024-01-25T15:06:17.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.764+0000 7fbd0e8b6640 1 -- 172.21.15.29:0/2050971293 --> [v2:172.21.15.52:6824/2160170066,v1:172.21.15.52:6825/2160170066] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbd08158fe0 con 0x7fbce80712a0 2024-01-25T15:06:17.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.764+0000 7fbd04ff9640 1 -- 172.21.15.29:0/2050971293 <== osd.6 v2:172.21.15.52:6824/2160170066 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbd00005050 con 0x7fbce80712a0 2024-01-25T15:06:17.765 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-25T15:06:17.765 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-25T15:06:17.765 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-25T15:06:17.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.764+0000 7fbd0e8b6640 1 -- 172.21.15.29:0/2050971293 >> [v2:172.21.15.52:6824/2160170066,v1:172.21.15.52:6825/2160170066] conn(0x7fbce80712a0 msgr2=0x7fbce80736e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.764+0000 7fbd0e8b6640 1 --2- 172.21.15.29:0/2050971293 >> [v2:172.21.15.52:6824/2160170066,v1:172.21.15.52:6825/2160170066] conn(0x7fbce80712a0 0x7fbce80736e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.764+0000 7fbd0e8b6640 1 -- 172.21.15.29:0/2050971293 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbce806af00 msgr2=0x7fbce806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.764+0000 7fbd0e8b6640 1 --2- 172.21.15.29:0/2050971293 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fbce806af00 0x7fbce806d3c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbd080c0e70 tx=0x7fbcf0008040 comp rx=0 tx=0).stop 2024-01-25T15:06:17.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.764+0000 7fbd0e8b6640 1 -- 172.21.15.29:0/2050971293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd080bd690 msgr2=0x7fbd080aae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.764+0000 7fbd0e8b6640 1 --2- 172.21.15.29:0/2050971293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd080bd690 0x7fbd080aae80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8001930 tx=0x7fbcf802e070 comp rx=0 tx=0).stop 2024-01-25T15:06:17.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.764+0000 7fbd0ce53640 1 -- 172.21.15.29:0/2050971293 reap_dead start 2024-01-25T15:06:17.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.764+0000 7fbd0e8b6640 1 -- 172.21.15.29:0/2050971293 shutdown_connections 2024-01-25T15:06:17.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.764+0000 7fbd0e8b6640 1 -- 172.21.15.29:0/2050971293 >> 172.21.15.29:0/2050971293 conn(0x7fbd080ca010 msgr2=0x7fbd080c5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:17.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.765+0000 7fbd0e8b6640 1 -- 172.21.15.29:0/2050971293 shutdown_connections 2024-01-25T15:06:17.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.765+0000 7fbd0e8b6640 1 -- 172.21.15.29:0/2050971293 wait complete. 2024-01-25T15:06:17.775 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-01-25T15:06:17.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.877+0000 7fd409d3f640 1 Processor -- start 2024-01-25T15:06:17.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.877+0000 7fd409d3f640 1 -- start start 2024-01-25T15:06:17.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.877+0000 7fd409d3f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd4040c48d0 0x7fd4040c6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.877+0000 7fd409d3f640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd404155190 0x7fd4040c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.877+0000 7fd409d3f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd404158120 con 0x7fd404151f80 2024-01-25T15:06:17.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.877+0000 7fd409d3f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd404155640 con 0x7fd4040c48d0 2024-01-25T15:06:17.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.877+0000 7fd409d3f640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4040c4db0 con 0x7fd404155190 2024-01-25T15:06:17.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd4037fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd404151f80 0x7fd4041585b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44468/0 (socket says 172.21.15.29:44468) 2024-01-25T15:06:17.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd4037fe640 1 -- 172.21.15.29:0/2842131971 learned_addr learned my addr 172.21.15.29:0/2842131971 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:17.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd402ffd640 1 --2- 172.21.15.29:0/2842131971 >> v2:172.21.15.52:3300/0 conn(0x7fd4040c48d0 0x7fd4040c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd403fff640 1 --2- 172.21.15.29:0/2842131971 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd404155190 0x7fd4040c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd4027fc640 1 -- 172.21.15.29:0/2842131971 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892347857 0 0) 0x7fd404158120 con 0x7fd404151f80 2024-01-25T15:06:17.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd4027fc640 1 -- 172.21.15.29:0/2842131971 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3ec003520 con 0x7fd404151f80 2024-01-25T15:06:17.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd4027fc640 1 -- 172.21.15.29:0/2842131971 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3480210756 0 0) 0x7fd3ec003520 con 0x7fd404151f80 2024-01-25T15:06:17.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd4027fc640 1 -- 172.21.15.29:0/2842131971 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd404155190 msgr2=0x7fd4040c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:17.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd4027fc640 1 --2- 172.21.15.29:0/2842131971 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd404155190 0x7fd4040c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd4027fc640 1 -- 172.21.15.29:0/2842131971 >> v2:172.21.15.52:3300/0 conn(0x7fd4040c48d0 msgr2=0x7fd4040c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:17.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd4027fc640 1 --2- 172.21.15.29:0/2842131971 >> v2:172.21.15.52:3300/0 conn(0x7fd4040c48d0 0x7fd4040c6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd4027fc640 1 -- 172.21.15.29:0/2842131971 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4040c5090 con 0x7fd404151f80 2024-01-25T15:06:17.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd4027fc640 1 -- 172.21.15.29:0/2842131971 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1902322450 0 0) 0x7fd3f8001670 con 0x7fd404151f80 2024-01-25T15:06:17.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd403fff640 1 --2- 172.21.15.29:0/2842131971 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd404155190 0x7fd4040c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:06:17.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd402ffd640 1 --2- 172.21.15.29:0/2842131971 >> v2:172.21.15.52:3300/0 conn(0x7fd4040c48d0 0x7fd4040c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:06:17.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd4027fc640 1 -- 172.21.15.29:0/2842131971 >> v1:172.21.15.29:6789/0 conn(0x7fd404151f80 legacy=0x7fd4041585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd4027fc640 1 --2- 172.21.15.29:0/2842131971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3ec0039e0 0x7fd3ec003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd4027fc640 1 --2- 172.21.15.29:0/2842131971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3ec0047c0 0x7fd3ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd4027fc640 1 --2- 172.21.15.29:0/2842131971 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd404155190 0x7fd3ec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd4027fc640 1 -- 172.21.15.29:0/2842131971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd404155640 con 0x7fd3ec0047c0 2024-01-25T15:06:17.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd4027fc640 1 -- 172.21.15.29:0/2842131971 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4040c4db0 con 0x7fd3ec0039e0 2024-01-25T15:06:17.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd4027fc640 1 -- 172.21.15.29:0/2842131971 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec00b980 con 0x7fd404155190 2024-01-25T15:06:17.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd402ffd640 1 --2- 172.21.15.29:0/2842131971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3ec0047c0 0x7fd3ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd403fff640 1 --2- 172.21.15.29:0/2842131971 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd404155190 0x7fd3ec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.878+0000 7fd4037fe640 1 --2- 172.21.15.29:0/2842131971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3ec0039e0 0x7fd3ec003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.879+0000 7fd402ffd640 1 -- 172.21.15.29:0/2842131971 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd404155190 msgr2=0x7fd3ec005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:17.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.879+0000 7fd402ffd640 1 --2- 172.21.15.29:0/2842131971 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd404155190 0x7fd3ec005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.879+0000 7fd402ffd640 1 -- 172.21.15.29:0/2842131971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3ec0039e0 msgr2=0x7fd3ec003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:17.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.879+0000 7fd402ffd640 1 --2- 172.21.15.29:0/2842131971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3ec0039e0 0x7fd3ec003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.879+0000 7fd402ffd640 1 -- 172.21.15.29:0/2842131971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc009a70 con 0x7fd3ec0047c0 2024-01-25T15:06:17.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.879+0000 7fd403fff640 1 --2- 172.21.15.29:0/2842131971 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd404155190 0x7fd3ec005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:06:17.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.879+0000 7fd402ffd640 1 --2- 172.21.15.29:0/2842131971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3ec0047c0 0x7fd3ec004c40 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009c90 tx=0x7fd3ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22cb55a01b9bde6 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:17.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.879+0000 7fd4027fc640 1 -- 172.21.15.29:0/2842131971 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f402c980 con 0x7fd3ec0047c0 2024-01-25T15:06:17.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.880+0000 7fd4027fc640 1 -- 172.21.15.29:0/2842131971 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f402cae0 con 0x7fd3ec0047c0 2024-01-25T15:06:17.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.880+0000 7fd4027fc640 1 -- 172.21.15.29:0/2842131971 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f402ce90 con 0x7fd3ec0047c0 2024-01-25T15:06:17.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.880+0000 7fd409d3f640 1 -- 172.21.15.29:0/2842131971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3ec0047c0 msgr2=0x7fd3ec004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.880+0000 7fd409d3f640 1 --2- 172.21.15.29:0/2842131971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3ec0047c0 0x7fd3ec004c40 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009c90 tx=0x7fd3ec0057f0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.880+0000 7fd403fff640 1 -- 172.21.15.29:0/2842131971 reap_dead start 2024-01-25T15:06:17.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.880+0000 7fd409d3f640 1 -- 172.21.15.29:0/2842131971 shutdown_connections 2024-01-25T15:06:17.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.880+0000 7fd409d3f640 1 -- 172.21.15.29:0/2842131971 >> 172.21.15.29:0/2842131971 conn(0x7fd4040c7f10 msgr2=0x7fd4040c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:17.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.880+0000 7fd409d3f640 1 -- 172.21.15.29:0/2842131971 shutdown_connections 2024-01-25T15:06:17.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.880+0000 7fd409d3f640 1 -- 172.21.15.29:0/2842131971 wait complete. 2024-01-25T15:06:17.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.881+0000 7fd409d3f640 1 Processor -- start 2024-01-25T15:06:17.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.881+0000 7fd409d3f640 1 -- start start 2024-01-25T15:06:17.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.882+0000 7fd409d3f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3ec0047c0 0x7fd40414d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.882+0000 7fd409d3f640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4040ab870 0x7fd4041e9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.882+0000 7fd409d3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4041ea4f0 0x7fd4040ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.882+0000 7fd409d3f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd404099a30 con 0x7fd3ec0047c0 2024-01-25T15:06:17.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.882+0000 7fd409d3f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4040aad60 con 0x7fd4041ea4f0 2024-01-25T15:06:17.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.882+0000 7fd409d3f640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4041ea970 con 0x7fd4040ab870 2024-01-25T15:06:17.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.882+0000 7fd4037fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3ec0047c0 0x7fd40414d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.882+0000 7fd4037fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3ec0047c0 0x7fd40414d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50838/0 (socket says 172.21.15.29:50838) 2024-01-25T15:06:17.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.882+0000 7fd4037fe640 1 -- 172.21.15.29:0/3910788457 learned_addr learned my addr 172.21.15.29:0/3910788457 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:17.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.882+0000 7fd4037fe640 1 -- 172.21.15.29:0/3910788457 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4040ab870 msgr2=0x7fd4041e9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.882+0000 7fd4037fe640 1 --2- 172.21.15.29:0/3910788457 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4040ab870 0x7fd4041e9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.882+0000 7fd4037fe640 1 -- 172.21.15.29:0/3910788457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4041ea4f0 msgr2=0x7fd4040ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:17.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.882+0000 7fd4037fe640 1 --2- 172.21.15.29:0/3910788457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4041ea4f0 0x7fd4040ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:17.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.882+0000 7fd4037fe640 1 -- 172.21.15.29:0/3910788457 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd404099c80 con 0x7fd3ec0047c0 2024-01-25T15:06:17.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.883+0000 7fd4037fe640 1 --2- 172.21.15.29:0/3910788457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3ec0047c0 0x7fd40414d160 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8007340 tx=0x7fd3f8007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:17.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.883+0000 7fd3ebfff640 1 -- 172.21.15.29:0/3910788457 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f800f860 con 0x7fd3ec0047c0 2024-01-25T15:06:17.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.883+0000 7fd3ebfff640 1 -- 172.21.15.29:0/3910788457 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f800f9c0 con 0x7fd3ec0047c0 2024-01-25T15:06:17.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.883+0000 7fd409d3f640 1 -- 172.21.15.29:0/3910788457 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4040aafb0 con 0x7fd3ec0047c0 2024-01-25T15:06:17.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.883+0000 7fd3ebfff640 1 -- 172.21.15.29:0/3910788457 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f800fd70 con 0x7fd3ec0047c0 2024-01-25T15:06:17.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.883+0000 7fd409d3f640 1 -- 172.21.15.29:0/3910788457 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40414d6a0 con 0x7fd3ec0047c0 2024-01-25T15:06:17.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.884+0000 7fd409d3f640 1 -- 172.21.15.29:0/3910788457 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40404eb10 con 0x7fd3ec0047c0 2024-01-25T15:06:17.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.884+0000 7fd3ebfff640 1 -- 172.21.15.29:0/3910788457 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fd3f801e3b0 con 0x7fd3ec0047c0 2024-01-25T15:06:17.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.884+0000 7fd3ebfff640 1 --2- 172.21.15.29:0/3910788457 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd3f006aed0 0x7fd3f006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:17.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.885+0000 7fd3ebfff640 1 -- 172.21.15.29:0/3910788457 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fd3f8088f90 con 0x7fd3ec0047c0 2024-01-25T15:06:17.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.885+0000 7fd402ffd640 1 --2- 172.21.15.29:0/3910788457 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd3f006aed0 0x7fd3f006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:17.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.885+0000 7fd402ffd640 1 --2- 172.21.15.29:0/3910788457 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd3f006aed0 0x7fd3f006d390 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4036000 tx=0x7fd3f402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:17.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:17.889+0000 7fd3ebfff640 1 -- 172.21.15.29:0/3910788457 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fd3f80bc190 con 0x7fd3ec0047c0 2024-01-25T15:06:18.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.069+0000 7fd409d3f640 1 -- 172.21.15.29:0/3910788457 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fd404157db0 con 0x7fd3f006aed0 2024-01-25T15:06:18.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.069+0000 7fd3ebfff640 1 -- 172.21.15.29:0/3910788457 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd3f400f080 con 0x7fd3f006aed0 2024-01-25T15:06:18.070 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 6 to deep-scrub 2024-01-25T15:06:18.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.071+0000 7fd409d3f640 1 -- 172.21.15.29:0/3910788457 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd3f006aed0 msgr2=0x7fd3f006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:18.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.071+0000 7fd409d3f640 1 --2- 172.21.15.29:0/3910788457 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd3f006aed0 0x7fd3f006d390 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4036000 tx=0x7fd3f402e000 comp rx=0 tx=0).stop 2024-01-25T15:06:18.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.071+0000 7fd409d3f640 1 -- 172.21.15.29:0/3910788457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3ec0047c0 msgr2=0x7fd40414d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:18.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.071+0000 7fd409d3f640 1 --2- 172.21.15.29:0/3910788457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3ec0047c0 0x7fd40414d160 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8007340 tx=0x7fd3f8007800 comp rx=0 tx=0).stop 2024-01-25T15:06:18.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.071+0000 7fd409d3f640 1 -- 172.21.15.29:0/3910788457 shutdown_connections 2024-01-25T15:06:18.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.071+0000 7fd409d3f640 1 --2- 172.21.15.29:0/3910788457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4041ea4f0 0x7fd4040ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.071+0000 7fd409d3f640 1 --2- 172.21.15.29:0/3910788457 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd4040ab870 0x7fd4041e9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.071+0000 7fd409d3f640 1 --2- 172.21.15.29:0/3910788457 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fd3f006aed0 0x7fd3f006d390 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.071+0000 7fd409d3f640 1 --2- 172.21.15.29:0/3910788457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3ec0047c0 0x7fd40414d160 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.071+0000 7fd409d3f640 1 -- 172.21.15.29:0/3910788457 >> 172.21.15.29:0/3910788457 conn(0x7fd4040c7f10 msgr2=0x7fd404156880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:18.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.072+0000 7fd409d3f640 1 -- 172.21.15.29:0/3910788457 shutdown_connections 2024-01-25T15:06:18.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.072+0000 7fd409d3f640 1 -- 172.21.15.29:0/3910788457 wait complete. 2024-01-25T15:06:18.082 INFO:tasks.ceph:Scrubbing osd.7 2024-01-25T15:06:18.083 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-01-25T15:06:18.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.187+0000 7fa0ca114640 1 Processor -- start 2024-01-25T15:06:18.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.187+0000 7fa0ca114640 1 -- start start 2024-01-25T15:06:18.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.188+0000 7fa0ca114640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa0c406b490 0x7fa0c40c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:18.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.188+0000 7fa0ca114640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0c40c8620 0x7fa0c4151c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:18.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.188+0000 7fa0ca114640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c40c6770 con 0x7fa0c4158b80 2024-01-25T15:06:18.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.188+0000 7fa0ca114640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c4154f10 con 0x7fa0c406b490 2024-01-25T15:06:18.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.188+0000 7fa0ca114640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c41551f0 con 0x7fa0c40c8620 2024-01-25T15:06:18.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.188+0000 7fa0c37fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa0c406b490 0x7fa0c40c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:18.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.188+0000 7fa0c2ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa0c4158b80 0x7fa0c40c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44484/0 (socket says 172.21.15.29:44484) 2024-01-25T15:06:18.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.188+0000 7fa0c2ffd640 1 -- 172.21.15.29:0/1528555772 learned_addr learned my addr 172.21.15.29:0/1528555772 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:18.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.188+0000 7fa0c3fff640 1 --2- 172.21.15.29:0/1528555772 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0c40c8620 0x7fa0c4151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:18.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.188+0000 7fa0c37fe640 1 -- 172.21.15.29:0/1528555772 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0c40c8620 msgr2=0x7fa0c4151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:18.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.188+0000 7fa0c37fe640 1 --2- 172.21.15.29:0/1528555772 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0c40c8620 0x7fa0c4151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.188+0000 7fa0c37fe640 1 -- 172.21.15.29:0/1528555772 >> v1:172.21.15.29:6789/0 conn(0x7fa0c4158b80 legacy=0x7fa0c40c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:18.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.188+0000 7fa0c37fe640 1 -- 172.21.15.29:0/1528555772 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c41554d0 con 0x7fa0c406b490 2024-01-25T15:06:18.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.189+0000 7fa0c37fe640 1 --2- 172.21.15.29:0/1528555772 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0c406b490 0x7fa0c40c6120 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40097a0 tx=0x7fa0b402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe89721fe95ee76 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:18.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.189+0000 7fa0c27fc640 1 -- 172.21.15.29:0/1528555772 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b402e070 con 0x7fa0c406b490 2024-01-25T15:06:18.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.189+0000 7fa0c27fc640 1 -- 172.21.15.29:0/1528555772 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b40315a0 con 0x7fa0c406b490 2024-01-25T15:06:18.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.189+0000 7fa0c27fc640 1 -- 172.21.15.29:0/1528555772 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4031930 con 0x7fa0c406b490 2024-01-25T15:06:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.190+0000 7fa0ca114640 1 -- 172.21.15.29:0/1528555772 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0c406b490 msgr2=0x7fa0c40c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.190+0000 7fa0ca114640 1 --2- 172.21.15.29:0/1528555772 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0c406b490 0x7fa0c40c6120 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40097a0 tx=0x7fa0b402b840 comp rx=0 tx=0).stop 2024-01-25T15:06:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.190+0000 7fa0ca114640 1 -- 172.21.15.29:0/1528555772 shutdown_connections 2024-01-25T15:06:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.190+0000 7fa0ca114640 1 --2- 172.21.15.29:0/1528555772 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0c40c8620 0x7fa0c4151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.190+0000 7fa0ca114640 1 --2- 172.21.15.29:0/1528555772 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0c406b490 0x7fa0c40c6120 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.190+0000 7fa0ca114640 1 -- 172.21.15.29:0/1528555772 >> 172.21.15.29:0/1528555772 conn(0x7fa0c40ca010 msgr2=0x7fa0c40ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.190+0000 7fa0ca114640 1 -- 172.21.15.29:0/1528555772 shutdown_connections 2024-01-25T15:06:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.190+0000 7fa0ca114640 1 -- 172.21.15.29:0/1528555772 wait complete. 2024-01-25T15:06:18.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.191+0000 7fa0ca114640 1 Processor -- start 2024-01-25T15:06:18.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.191+0000 7fa0ca114640 1 -- start start 2024-01-25T15:06:18.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.192+0000 7fa0ca114640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0c406b490 0x7fa0c41eb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:18.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.192+0000 7fa0ca114640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0c40c8620 0x7fa0c41ee140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:18.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.192+0000 7fa0ca114640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0c4158b80 0x7fa0c414d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:18.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.192+0000 7fa0ca114640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c41ee680 con 0x7fa0c4158b80 2024-01-25T15:06:18.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.192+0000 7fa0ca114640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c4157730 con 0x7fa0c406b490 2024-01-25T15:06:18.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.192+0000 7fa0ca114640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c41579a0 con 0x7fa0c40c8620 2024-01-25T15:06:18.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.192+0000 7fa0c3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0c4158b80 0x7fa0c414d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:18.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.192+0000 7fa0c3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0c4158b80 0x7fa0c414d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50860/0 (socket says 172.21.15.29:50860) 2024-01-25T15:06:18.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.192+0000 7fa0c3fff640 1 -- 172.21.15.29:0/1905584747 learned_addr learned my addr 172.21.15.29:0/1905584747 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:18.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.192+0000 7fa0c37fe640 1 --2- 172.21.15.29:0/1905584747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0c406b490 0x7fa0c41eb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:18.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.192+0000 7fa0c2ffd640 1 --2- 172.21.15.29:0/1905584747 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0c40c8620 0x7fa0c41ee140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:18.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.192+0000 7fa0c3fff640 1 -- 172.21.15.29:0/1905584747 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0c40c8620 msgr2=0x7fa0c41ee140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:18.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.192+0000 7fa0c3fff640 1 --2- 172.21.15.29:0/1905584747 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0c40c8620 0x7fa0c41ee140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.192+0000 7fa0c3fff640 1 -- 172.21.15.29:0/1905584747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0c406b490 msgr2=0x7fa0c41eb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:18.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.192+0000 7fa0c3fff640 1 --2- 172.21.15.29:0/1905584747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0c406b490 0x7fa0c41eb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.192+0000 7fa0c3fff640 1 -- 172.21.15.29:0/1905584747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b4009400 con 0x7fa0c4158b80 2024-01-25T15:06:18.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.192+0000 7fa0c3fff640 1 --2- 172.21.15.29:0/1905584747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0c4158b80 0x7fa0c414d500 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc007e70 tx=0x7fa0bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:18.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.193+0000 7fa0abfff640 1 -- 172.21.15.29:0/1905584747 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc014620 con 0x7fa0c4158b80 2024-01-25T15:06:18.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.193+0000 7fa0abfff640 1 -- 172.21.15.29:0/1905584747 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0bc0147a0 con 0x7fa0c4158b80 2024-01-25T15:06:18.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.193+0000 7fa0ca114640 1 -- 172.21.15.29:0/1905584747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c4155b70 con 0x7fa0c4158b80 2024-01-25T15:06:18.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.193+0000 7fa0abfff640 1 -- 172.21.15.29:0/1905584747 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc014b50 con 0x7fa0c4158b80 2024-01-25T15:06:18.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.193+0000 7fa0ca114640 1 -- 172.21.15.29:0/1905584747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c41560b0 con 0x7fa0c4158b80 2024-01-25T15:06:18.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.193+0000 7fa0ca114640 1 -- 172.21.15.29:0/1905584747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa0c406cf80 con 0x7fa0c4158b80 2024-01-25T15:06:18.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.194+0000 7fa0abfff640 1 -- 172.21.15.29:0/1905584747 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fa0bc014cb0 con 0x7fa0c4158b80 2024-01-25T15:06:18.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.194+0000 7fa0abfff640 1 --2- 172.21.15.29:0/1905584747 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa0b006aed0 0x7fa0b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:18.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.194+0000 7fa0abfff640 1 -- 172.21.15.29:0/1905584747 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fa0bc089df0 con 0x7fa0c4158b80 2024-01-25T15:06:18.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.195+0000 7fa0abfff640 1 --2- 172.21.15.29:0/1905584747 >> [v2:172.21.15.52:6809/3231115782,v1:172.21.15.52:6811/3231115782] conn(0x7fa0b0071270 0x7fa0b00736b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:18.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.195+0000 7fa0abfff640 1 -- 172.21.15.29:0/1905584747 --> [v2:172.21.15.52:6809/3231115782,v1:172.21.15.52:6811/3231115782] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa0b0073d80 con 0x7fa0b0071270 2024-01-25T15:06:18.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.195+0000 7fa0abfff640 1 -- 172.21.15.29:0/1905584747 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0bc08c4b0 con 0x7fa0c4158b80 2024-01-25T15:06:18.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.195+0000 7fa0c37fe640 1 --2- 172.21.15.29:0/1905584747 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa0b006aed0 0x7fa0b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:18.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.195+0000 7fa0c2ffd640 1 --2- 172.21.15.29:0/1905584747 >> [v2:172.21.15.52:6809/3231115782,v1:172.21.15.52:6811/3231115782] conn(0x7fa0b0071270 0x7fa0b00736b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:18.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.195+0000 7fa0c37fe640 1 --2- 172.21.15.29:0/1905584747 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa0b006aed0 0x7fa0b006d390 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4036000 tx=0x7fa0b403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:18.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.195+0000 7fa0c2ffd640 1 --2- 172.21.15.29:0/1905584747 >> [v2:172.21.15.52:6809/3231115782,v1:172.21.15.52:6811/3231115782] conn(0x7fa0b0071270 0x7fa0b00736b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:18.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.196+0000 7fa0abfff640 1 -- 172.21.15.29:0/1905584747 <== osd.7 v2:172.21.15.52:6809/3231115782 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa0b0073d80 con 0x7fa0b0071270 2024-01-25T15:06:18.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.209+0000 7fa0ca114640 1 -- 172.21.15.29:0/1905584747 --> [v2:172.21.15.52:6809/3231115782,v1:172.21.15.52:6811/3231115782] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa0c4155f30 con 0x7fa0b0071270 2024-01-25T15:06:18.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.210+0000 7fa0abfff640 1 -- 172.21.15.29:0/1905584747 <== osd.7 v2:172.21.15.52:6809/3231115782 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa0b8004b00 con 0x7fa0b0071270 2024-01-25T15:06:18.211 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-01-25T15:06:18.211 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-25T15:06:18.211 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-01-25T15:06:18.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.210+0000 7fa0ca114640 1 -- 172.21.15.29:0/1905584747 >> [v2:172.21.15.52:6809/3231115782,v1:172.21.15.52:6811/3231115782] conn(0x7fa0b0071270 msgr2=0x7fa0b00736b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:18.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.210+0000 7fa0ca114640 1 --2- 172.21.15.29:0/1905584747 >> [v2:172.21.15.52:6809/3231115782,v1:172.21.15.52:6811/3231115782] conn(0x7fa0b0071270 0x7fa0b00736b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.210+0000 7fa0ca114640 1 -- 172.21.15.29:0/1905584747 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa0b006aed0 msgr2=0x7fa0b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:18.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.210+0000 7fa0ca114640 1 --2- 172.21.15.29:0/1905584747 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fa0b006aed0 0x7fa0b006d390 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4036000 tx=0x7fa0b403d040 comp rx=0 tx=0).stop 2024-01-25T15:06:18.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.210+0000 7fa0ca114640 1 -- 172.21.15.29:0/1905584747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0c4158b80 msgr2=0x7fa0c414d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:18.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.210+0000 7fa0ca114640 1 --2- 172.21.15.29:0/1905584747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0c4158b80 0x7fa0c414d500 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc007e70 tx=0x7fa0bc00e4b0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.210+0000 7fa0c3fff640 1 -- 172.21.15.29:0/1905584747 reap_dead start 2024-01-25T15:06:18.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.210+0000 7fa0ca114640 1 -- 172.21.15.29:0/1905584747 shutdown_connections 2024-01-25T15:06:18.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.210+0000 7fa0ca114640 1 -- 172.21.15.29:0/1905584747 >> 172.21.15.29:0/1905584747 conn(0x7fa0c40ca010 msgr2=0x7fa0c40c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:18.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.210+0000 7fa0ca114640 1 -- 172.21.15.29:0/1905584747 shutdown_connections 2024-01-25T15:06:18.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.210+0000 7fa0ca114640 1 -- 172.21.15.29:0/1905584747 wait complete. 2024-01-25T15:06:18.221 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-01-25T15:06:18.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.322+0000 7ff276505640 1 Processor -- start 2024-01-25T15:06:18.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.322+0000 7ff276505640 1 -- start start 2024-01-25T15:06:18.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.323+0000 7ff276505640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2700c6a20 0x7ff270155210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:18.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.323+0000 7ff276505640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27006bee0 con 0x7ff27006c370 2024-01-25T15:06:18.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.323+0000 7ff276505640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2700c7400 con 0x7ff270151d80 2024-01-25T15:06:18.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.323+0000 7ff276505640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff270155750 con 0x7ff2700c6a20 2024-01-25T15:06:18.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.323+0000 7ff274aa2640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff27006c370 0x7ff2700c4990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44500/0 (socket says 172.21.15.29:44500) 2024-01-25T15:06:18.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.323+0000 7ff274aa2640 1 -- 172.21.15.29:0/1199717945 learned_addr learned my addr 172.21.15.29:0/1199717945 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:18.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.323+0000 7ff26f7fe640 1 --2- 172.21.15.29:0/1199717945 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2700c6a20 0x7ff270155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:18.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.324+0000 7ff26effd640 1 -- 172.21.15.29:0/1199717945 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734034606 0 0) 0x7ff27006bee0 con 0x7ff27006c370 2024-01-25T15:06:18.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.324+0000 7ff26effd640 1 -- 172.21.15.29:0/1199717945 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff258003520 con 0x7ff27006c370 2024-01-25T15:06:18.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.324+0000 7ff26f7fe640 1 -- 172.21.15.29:0/1199717945 >> v1:172.21.15.52:6789/0 conn(0x7ff270151d80 legacy=0x7ff2700c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:18.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.324+0000 7ff26f7fe640 1 -- 172.21.15.29:0/1199717945 >> v1:172.21.15.29:6789/0 conn(0x7ff27006c370 legacy=0x7ff2700c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:18.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.324+0000 7ff26effd640 1 -- 172.21.15.29:0/1199717945 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840527161 0 0) 0x7ff2700c7400 con 0x7ff270151d80 2024-01-25T15:06:18.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.324+0000 7ff26f7fe640 1 -- 172.21.15.29:0/1199717945 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27006b8d0 con 0x7ff2700c6a20 2024-01-25T15:06:18.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.324+0000 7ff26f7fe640 1 --2- 172.21.15.29:0/1199717945 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2700c6a20 0x7ff270155210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff264009800 tx=0x7ff26402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=325ca84578e4eb8c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:18.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.325+0000 7ff26effd640 1 -- 172.21.15.29:0/1199717945 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff264031800 con 0x7ff2700c6a20 2024-01-25T15:06:18.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.325+0000 7ff26effd640 1 -- 172.21.15.29:0/1199717945 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff264031960 con 0x7ff2700c6a20 2024-01-25T15:06:18.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.325+0000 7ff26effd640 1 -- 172.21.15.29:0/1199717945 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff264031cf0 con 0x7ff2700c6a20 2024-01-25T15:06:18.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.325+0000 7ff276505640 1 -- 172.21.15.29:0/1199717945 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2700c6a20 msgr2=0x7ff270155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:18.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.325+0000 7ff276505640 1 --2- 172.21.15.29:0/1199717945 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2700c6a20 0x7ff270155210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff264009800 tx=0x7ff26402b8a0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.325+0000 7ff276505640 1 -- 172.21.15.29:0/1199717945 shutdown_connections 2024-01-25T15:06:18.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.325+0000 7ff276505640 1 --2- 172.21.15.29:0/1199717945 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2700c6a20 0x7ff270155210 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.325+0000 7ff276505640 1 -- 172.21.15.29:0/1199717945 >> 172.21.15.29:0/1199717945 conn(0x7ff2700abd80 msgr2=0x7ff2700ac190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:18.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.325+0000 7ff276505640 1 -- 172.21.15.29:0/1199717945 shutdown_connections 2024-01-25T15:06:18.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.325+0000 7ff276505640 1 -- 172.21.15.29:0/1199717945 wait complete. 2024-01-25T15:06:18.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.326+0000 7ff276505640 1 Processor -- start 2024-01-25T15:06:18.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.327+0000 7ff276505640 1 -- start start 2024-01-25T15:06:18.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.327+0000 7ff276505640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff27006c370 0x7ff2701ed680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:18.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.327+0000 7ff276505640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2700c6a20 0x7ff2701edbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:18.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.327+0000 7ff276505640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff270151d80 0x7ff2701e7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:18.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.327+0000 7ff276505640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff270152910 con 0x7ff270151d80 2024-01-25T15:06:18.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.327+0000 7ff276505640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2700c19f0 con 0x7ff27006c370 2024-01-25T15:06:18.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.327+0000 7ff276505640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2700c10e0 con 0x7ff2700c6a20 2024-01-25T15:06:18.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.327+0000 7ff274aa2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff270151d80 0x7ff2701e7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:18.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.327+0000 7ff274aa2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff270151d80 0x7ff2701e7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50866/0 (socket says 172.21.15.29:50866) 2024-01-25T15:06:18.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.327+0000 7ff274aa2640 1 -- 172.21.15.29:0/1806583984 learned_addr learned my addr 172.21.15.29:0/1806583984 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:18.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.327+0000 7ff26f7fe640 1 --2- 172.21.15.29:0/1806583984 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2700c6a20 0x7ff2701edbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:18.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.327+0000 7ff26ffff640 1 --2- 172.21.15.29:0/1806583984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff27006c370 0x7ff2701ed680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:18.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.328+0000 7ff274aa2640 1 -- 172.21.15.29:0/1806583984 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2700c6a20 msgr2=0x7ff2701edbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:18.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.328+0000 7ff274aa2640 1 --2- 172.21.15.29:0/1806583984 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2700c6a20 0x7ff2701edbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.328+0000 7ff274aa2640 1 -- 172.21.15.29:0/1806583984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff27006c370 msgr2=0x7ff2701ed680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:18.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.328+0000 7ff274aa2640 1 --2- 172.21.15.29:0/1806583984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff27006c370 0x7ff2701ed680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.328+0000 7ff274aa2640 1 -- 172.21.15.29:0/1806583984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff264009400 con 0x7ff270151d80 2024-01-25T15:06:18.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.328+0000 7ff274aa2640 1 --2- 172.21.15.29:0/1806583984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff270151d80 0x7ff2701e7030 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff26800cb40 tx=0x7ff26800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:18.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.328+0000 7ff26cff9640 1 -- 172.21.15.29:0/1806583984 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26800aca0 con 0x7ff270151d80 2024-01-25T15:06:18.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.328+0000 7ff26cff9640 1 -- 172.21.15.29:0/1806583984 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26800ae00 con 0x7ff270151d80 2024-01-25T15:06:18.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.328+0000 7ff276505640 1 -- 172.21.15.29:0/1806583984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2701ee200 con 0x7ff270151d80 2024-01-25T15:06:18.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.328+0000 7ff26cff9640 1 -- 172.21.15.29:0/1806583984 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff268012620 con 0x7ff270151d80 2024-01-25T15:06:18.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.328+0000 7ff276505640 1 -- 172.21.15.29:0/1806583984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2700c1680 con 0x7ff270151d80 2024-01-25T15:06:18.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.329+0000 7ff276505640 1 -- 172.21.15.29:0/1806583984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2700c1ba0 con 0x7ff270151d80 2024-01-25T15:06:18.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.329+0000 7ff26cff9640 1 -- 172.21.15.29:0/1806583984 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ff268007070 con 0x7ff270151d80 2024-01-25T15:06:18.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.330+0000 7ff26cff9640 1 --2- 172.21.15.29:0/1806583984 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff25c06af00 0x7ff25c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:18.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.330+0000 7ff26cff9640 1 -- 172.21.15.29:0/1806583984 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7ff2680893f0 con 0x7ff270151d80 2024-01-25T15:06:18.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.330+0000 7ff26ffff640 1 --2- 172.21.15.29:0/1806583984 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff25c06af00 0x7ff25c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:18.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.331+0000 7ff26ffff640 1 --2- 172.21.15.29:0/1806583984 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff25c06af00 0x7ff25c06d3c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff260000f60 tx=0x7ff260009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:18.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.334+0000 7ff26cff9640 1 -- 172.21.15.29:0/1806583984 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7ff2700c1ba0 con 0x7ff270151d80 2024-01-25T15:06:18.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.515+0000 7ff276505640 1 -- 172.21.15.29:0/1806583984 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2700c6e80 con 0x7ff25c06af00 2024-01-25T15:06:18.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.516+0000 7ff26cff9640 1 -- 172.21.15.29:0/1806583984 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff260001420 con 0x7ff25c06af00 2024-01-25T15:06:18.517 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 7 to deep-scrub 2024-01-25T15:06:18.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.518+0000 7ff276505640 1 -- 172.21.15.29:0/1806583984 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff25c06af00 msgr2=0x7ff25c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:18.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.518+0000 7ff276505640 1 --2- 172.21.15.29:0/1806583984 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff25c06af00 0x7ff25c06d3c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff260000f60 tx=0x7ff260009040 comp rx=0 tx=0).stop 2024-01-25T15:06:18.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.518+0000 7ff276505640 1 -- 172.21.15.29:0/1806583984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff270151d80 msgr2=0x7ff2701e7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:18.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.518+0000 7ff276505640 1 --2- 172.21.15.29:0/1806583984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff270151d80 0x7ff2701e7030 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff26800cb40 tx=0x7ff26800a060 comp rx=0 tx=0).stop 2024-01-25T15:06:18.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.518+0000 7ff276505640 1 -- 172.21.15.29:0/1806583984 shutdown_connections 2024-01-25T15:06:18.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.518+0000 7ff276505640 1 --2- 172.21.15.29:0/1806583984 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7ff25c06af00 0x7ff25c06d3c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.518+0000 7ff276505640 1 --2- 172.21.15.29:0/1806583984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff270151d80 0x7ff2701e7030 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.518+0000 7ff276505640 1 --2- 172.21.15.29:0/1806583984 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff2700c6a20 0x7ff2701edbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.518+0000 7ff276505640 1 --2- 172.21.15.29:0/1806583984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff27006c370 0x7ff2701ed680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.518+0000 7ff276505640 1 -- 172.21.15.29:0/1806583984 >> 172.21.15.29:0/1806583984 conn(0x7ff2700abd80 msgr2=0x7ff27014ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:18.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.519+0000 7ff276505640 1 -- 172.21.15.29:0/1806583984 shutdown_connections 2024-01-25T15:06:18.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.519+0000 7ff276505640 1 -- 172.21.15.29:0/1806583984 wait complete. 2024-01-25T15:06:18.530 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-25T15:06:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.631+0000 7f09a1490640 1 Processor -- start 2024-01-25T15:06:18.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.631+0000 7f09a1490640 1 -- start start 2024-01-25T15:06:18.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.631+0000 7f09a1490640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f099c151f90 0x7f099c0c5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:18.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.631+0000 7f09a1490640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f099c155700 0x7f099c0c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:18.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.631+0000 7f09a1490640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f099c155270 con 0x7f099c0c61d0 2024-01-25T15:06:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.631+0000 7f09a1490640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099c0c6940 con 0x7f099c155700 2024-01-25T15:06:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.631+0000 7f09a1490640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099c154a10 con 0x7f099c151f90 2024-01-25T15:06:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.631+0000 7f099b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f099c155700 0x7f099c0c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.631+0000 7f0993fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f099c0c61d0 0x7f099c06b220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44502/0 (socket says 172.21.15.29:44502) 2024-01-25T15:06:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.631+0000 7f0993fff640 1 -- 172.21.15.29:0/631909608 learned_addr learned my addr 172.21.15.29:0/631909608 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.632+0000 7f099affd640 1 --2- 172.21.15.29:0/631909608 >> v2:172.21.15.52:3300/0 conn(0x7f099c151f90 0x7f099c0c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.632+0000 7f099b7fe640 1 -- 172.21.15.29:0/631909608 >> v2:172.21.15.52:3300/0 conn(0x7f099c151f90 msgr2=0x7f099c0c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.632+0000 7f099b7fe640 1 --2- 172.21.15.29:0/631909608 >> v2:172.21.15.52:3300/0 conn(0x7f099c151f90 0x7f099c0c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.632+0000 7f099b7fe640 1 -- 172.21.15.29:0/631909608 >> v1:172.21.15.29:6789/0 conn(0x7f099c0c61d0 legacy=0x7f099c06b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:18.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.632+0000 7f099b7fe640 1 -- 172.21.15.29:0/631909608 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099c0c6660 con 0x7f099c155700 2024-01-25T15:06:18.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.632+0000 7f099a7fc640 1 -- 172.21.15.29:0/631909608 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1648427365 0 0) 0x7f099c155270 con 0x7f099c0c61d0 2024-01-25T15:06:18.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.633+0000 7f099b7fe640 1 --2- 172.21.15.29:0/631909608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f099c155700 0x7f099c0c7f00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f099c08b050 tx=0x7f099402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d053c1ad1454e930 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:18.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.633+0000 7f099a7fc640 1 -- 172.21.15.29:0/631909608 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099402cc80 con 0x7f099c155700 2024-01-25T15:06:18.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.633+0000 7f099a7fc640 1 -- 172.21.15.29:0/631909608 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099402cde0 con 0x7f099c155700 2024-01-25T15:06:18.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.633+0000 7f099a7fc640 1 -- 172.21.15.29:0/631909608 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994034660 con 0x7f099c155700 2024-01-25T15:06:18.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.633+0000 7f09a1490640 1 -- 172.21.15.29:0/631909608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f099c155700 msgr2=0x7f099c0c7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:18.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.633+0000 7f09a1490640 1 --2- 172.21.15.29:0/631909608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f099c155700 0x7f099c0c7f00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f099c08b050 tx=0x7f099402bed0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.633+0000 7f09a1490640 1 -- 172.21.15.29:0/631909608 shutdown_connections 2024-01-25T15:06:18.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.633+0000 7f09a1490640 1 --2- 172.21.15.29:0/631909608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f099c155700 0x7f099c0c7f00 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.633+0000 7f09a1490640 1 --2- 172.21.15.29:0/631909608 >> v2:172.21.15.52:3300/0 conn(0x7f099c151f90 0x7f099c0c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.633+0000 7f09a1490640 1 -- 172.21.15.29:0/631909608 >> 172.21.15.29:0/631909608 conn(0x7f099c0ca000 msgr2=0x7f099c0ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:18.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.633+0000 7f09a1490640 1 -- 172.21.15.29:0/631909608 shutdown_connections 2024-01-25T15:06:18.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.633+0000 7f09a1490640 1 -- 172.21.15.29:0/631909608 wait complete. 2024-01-25T15:06:18.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.634+0000 7f09a1490640 1 Processor -- start 2024-01-25T15:06:18.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.634+0000 7f09a1490640 1 -- start start 2024-01-25T15:06:18.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.635+0000 7f09a1490640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f099c151f90 0x7f099c14d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:18.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.635+0000 7f09a1490640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f099c155700 0x7f099c14dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:18.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.635+0000 7f09a1490640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f099c158640 0x7f099c0c1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:18.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.635+0000 7f09a1490640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c14d0d0 con 0x7f099c158640 2024-01-25T15:06:18.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.635+0000 7f09a1490640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c0ab6a0 con 0x7f099c151f90 2024-01-25T15:06:18.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.635+0000 7f09a1490640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099c0c3bb0 con 0x7f099c155700 2024-01-25T15:06:18.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.635+0000 7f099b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f099c158640 0x7f099c0c1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:18.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.635+0000 7f099b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f099c158640 0x7f099c0c1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50880/0 (socket says 172.21.15.29:50880) 2024-01-25T15:06:18.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.635+0000 7f099b7fe640 1 -- 172.21.15.29:0/2422593397 learned_addr learned my addr 172.21.15.29:0/2422593397 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:18.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.635+0000 7f099affd640 1 --2- 172.21.15.29:0/2422593397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f099c151f90 0x7f099c14d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:18.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.635+0000 7f0993fff640 1 --2- 172.21.15.29:0/2422593397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f099c155700 0x7f099c14dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:18.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.636+0000 7f099b7fe640 1 -- 172.21.15.29:0/2422593397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f099c155700 msgr2=0x7f099c14dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:18.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.636+0000 7f099b7fe640 1 --2- 172.21.15.29:0/2422593397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f099c155700 0x7f099c14dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.636+0000 7f099b7fe640 1 -- 172.21.15.29:0/2422593397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f099c151f90 msgr2=0x7f099c14d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:18.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.636+0000 7f099b7fe640 1 --2- 172.21.15.29:0/2422593397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f099c151f90 0x7f099c14d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.636+0000 7f099b7fe640 1 -- 172.21.15.29:0/2422593397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0994009a70 con 0x7f099c158640 2024-01-25T15:06:18.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.636+0000 7f099b7fe640 1 --2- 172.21.15.29:0/2422593397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f099c158640 0x7f099c0c1ae0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f0994037040 tx=0x7f0994004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:18.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.636+0000 7f09937fe640 1 -- 172.21.15.29:0/2422593397 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994040650 con 0x7f099c158640 2024-01-25T15:06:18.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.636+0000 7f09937fe640 1 -- 172.21.15.29:0/2422593397 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09940407b0 con 0x7f099c158640 2024-01-25T15:06:18.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.636+0000 7f09a1490640 1 -- 172.21.15.29:0/2422593397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099c0c3e90 con 0x7f099c158640 2024-01-25T15:06:18.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.636+0000 7f09937fe640 1 -- 172.21.15.29:0/2422593397 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994040b60 con 0x7f099c158640 2024-01-25T15:06:18.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.636+0000 7f09a1490640 1 -- 172.21.15.29:0/2422593397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099c14c8d0 con 0x7f099c158640 2024-01-25T15:06:18.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.637+0000 7f09a1490640 1 -- 172.21.15.29:0/2422593397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099c08be00 con 0x7f099c158640 2024-01-25T15:06:18.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.637+0000 7f09937fe640 1 -- 172.21.15.29:0/2422593397 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0994040cc0 con 0x7f099c158640 2024-01-25T15:06:18.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.638+0000 7f09937fe640 1 --2- 172.21.15.29:0/2422593397 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f097c06aed0 0x7f097c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:18.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.638+0000 7f09937fe640 1 -- 172.21.15.29:0/2422593397 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f09940ac290 con 0x7f099c158640 2024-01-25T15:06:18.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.638+0000 7f099affd640 1 --2- 172.21.15.29:0/2422593397 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f097c06aed0 0x7f097c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:18.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.639+0000 7f099affd640 1 --2- 172.21.15.29:0/2422593397 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f097c06aed0 0x7f097c06d390 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f098c006fd0 tx=0x7f098c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:18.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.642+0000 7f09937fe640 1 -- 172.21.15.29:0/2422593397 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f09940772b0 con 0x7f099c158640 2024-01-25T15:06:18.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.816+0000 7f09a1490640 1 -- 172.21.15.29:0/2422593397 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f099c154f00 con 0x7f097c06aed0 2024-01-25T15:06:18.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.819+0000 7f09937fe640 1 -- 172.21.15.29:0/2422593397 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50408 (secure 0 0 0) 0x7f098c00f830 con 0x7f097c06aed0 2024-01-25T15:06:18.820 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:06:18.821 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-25T15:06:18.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.821+0000 7f09a1490640 1 -- 172.21.15.29:0/2422593397 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f097c06aed0 msgr2=0x7f097c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:18.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.821+0000 7f09a1490640 1 --2- 172.21.15.29:0/2422593397 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f097c06aed0 0x7f097c06d390 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f098c006fd0 tx=0x7f098c008040 comp rx=0 tx=0).stop 2024-01-25T15:06:18.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.821+0000 7f09a1490640 1 -- 172.21.15.29:0/2422593397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f099c158640 msgr2=0x7f099c0c1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:18.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.821+0000 7f09a1490640 1 --2- 172.21.15.29:0/2422593397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f099c158640 0x7f099c0c1ae0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f0994037040 tx=0x7f0994004a40 comp rx=0 tx=0).stop 2024-01-25T15:06:18.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.821+0000 7f09a1490640 1 -- 172.21.15.29:0/2422593397 shutdown_connections 2024-01-25T15:06:18.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.821+0000 7f09a1490640 1 --2- 172.21.15.29:0/2422593397 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f097c06aed0 0x7f097c06d390 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.821+0000 7f09a1490640 1 --2- 172.21.15.29:0/2422593397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f099c158640 0x7f099c0c1ae0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.821+0000 7f09a1490640 1 --2- 172.21.15.29:0/2422593397 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f099c155700 0x7f099c14dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.821+0000 7f09a1490640 1 --2- 172.21.15.29:0/2422593397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f099c151f90 0x7f099c14d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:18.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.821+0000 7f09a1490640 1 -- 172.21.15.29:0/2422593397 >> 172.21.15.29:0/2422593397 conn(0x7f099c0ca000 msgr2=0x7f099c06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:18.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.821+0000 7f09a1490640 1 -- 172.21.15.29:0/2422593397 shutdown_connections 2024-01-25T15:06:18.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:18.821+0000 7f09a1490640 1 -- 172.21.15.29:0/2422593397 wait complete. 2024-01-25T15:06:18.832 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-01-25T15:06:16.943765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":255236,"kb_used_data":5768,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719484,"statfs":{"total":773094113280,"available":772832751616,"internally_reserved":0,"allocated":5906432,"data_stored":3302672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3794,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-48,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.998547"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":223,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-01-25T15:06:11.040763+0000","last_change":"2024-01-25T15:04:16.181635+0000","last_active":"2024-01-25T15:06:11.040763+0000","last_peered":"2024-01-25T15:06:11.040763+0000","last_clean":"2024-01-25T15:06:11.040763+0000","last_became_active":"2024-01-25T15:04:16.179890+0000","last_became_peered":"2024-01-25T15:04:16.179890+0000","last_unstale":"2024-01-25T15:06:11.040763+0000","last_undegraded":"2024-01-25T15:06:11.040763+0000","last_fullsized":"2024-01-25T15:06:11.040763+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T15:04:14.956188+0000","last_clean_scrub_stamp":"2024-01-25T15:04:14.956188+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:49:00.618327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1183744,"data_stored":855610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.439},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.499},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.65800000000000003}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.70999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31756,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":589824,"data_stored":265242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.441}]},{"osd":2,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jan 25 15:05:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31756,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":589824,"data_stored":265242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.62},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.751}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.68300000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31764,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":589824,"data_stored":265242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 25 15:05:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.73299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31760,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":589824,"data_stored":265242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":2.6230000000000002}]},{"osd":1,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":3.3559999999999999,"5min":3.3559999999999999,"15min":3.3559999999999999},"last":2.3250000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":2.3450000000000002}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":2.6539999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":3.4209999999999998,"5min":3.4209999999999998,"15min":3.4209999999999998},"last":2.3679999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":2.5379999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.4689999999999999,"5min":3.4689999999999999,"15min":3.4689999999999999},"last":2.1970000000000001}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":3.508,"5min":3.508,"15min":3.508},"last":2.2410000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":2.492}]},{"osd":7,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":2.4420000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":3.5449999999999999,"5min":3.5449999999999999,"15min":3.5449999999999999},"last":2.2839999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31764,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":589824,"data_stored":265242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.63}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31760,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":589824,"data_stored":265242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.495},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.622}]},{"osd":6,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 25 15:05:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.52900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1183744,"data_stored":855610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.42899999999999999}]},{"osd":3,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.80500000000000005}]},{"osd":6,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jan 25 15:05:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.753}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:06:18.836 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-01-25T15:04:14.956188+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=25, tm_hour=15, tm_min=4, tm_sec=14, tm_wday=3, tm_yday=25, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=25, tm_hour=15, tm_min=6, tm_sec=13, tm_wday=3, tm_yday=25, tm_isdst=0) 2024-01-25T15:06:18.836 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-25T15:06:31.092 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-25T15:06:31.095 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-25T15:06:38.837 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-25T15:06:38.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.950+0000 7f2c0d1e5640 1 Processor -- start 2024-01-25T15:06:38.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.950+0000 7f2c0d1e5640 1 -- start start 2024-01-25T15:06:38.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.951+0000 7f2c0d1e5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2c081520b0 0x7f2c08155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:38.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.951+0000 7f2c0d1e5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2c080c55e0 0x7f2c080c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:38.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.951+0000 7f2c0d1e5640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c080c66c0 con 0x7f2c080c4f00 2024-01-25T15:06:38.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.951+0000 7f2c0d1e5640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c0806cfc0 con 0x7f2c080c55e0 2024-01-25T15:06:38.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.951+0000 7f2c0d1e5640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c08152490 con 0x7f2c081520b0 2024-01-25T15:06:38.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.951+0000 7f2c0659c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2c080c55e0 0x7f2c080c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:38.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.951+0000 7f2c0659c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2c080c55e0 0x7f2c080c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41228/0 (socket says 172.21.15.29:41228) 2024-01-25T15:06:38.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.951+0000 7f2c0659c640 1 -- 172.21.15.29:0/3204463098 learned_addr learned my addr 172.21.15.29:0/3204463098 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:38.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.952+0000 7f2c0659c640 1 -- 172.21.15.29:0/3204463098 >> v2:172.21.15.52:3300/0 conn(0x7f2c081520b0 msgr2=0x7f2c08155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:38.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.952+0000 7f2c0659c640 1 --2- 172.21.15.29:0/3204463098 >> v2:172.21.15.52:3300/0 conn(0x7f2c081520b0 0x7f2c08155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:38.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.952+0000 7f2c0659c640 1 -- 172.21.15.29:0/3204463098 >> v1:172.21.15.52:6789/0 conn(0x7f2c080c4f00 legacy=0x7f2c080c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:38.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.952+0000 7f2c0659c640 1 -- 172.21.15.29:0/3204463098 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c080c6910 con 0x7f2c080c55e0 2024-01-25T15:06:38.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.952+0000 7f2c0659c640 1 --2- 172.21.15.29:0/3204463098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c080c55e0 0x7f2c080c8120 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2c0808bbe0 tx=0x7f2bf002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35886176c34ccb9c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:38.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.953+0000 7f2c05d9b640 1 -- 172.21.15.29:0/3204463098 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf00317e0 con 0x7f2c080c55e0 2024-01-25T15:06:38.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.953+0000 7f2c05d9b640 1 -- 172.21.15.29:0/3204463098 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf0031940 con 0x7f2c080c55e0 2024-01-25T15:06:38.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.953+0000 7f2c05d9b640 1 -- 172.21.15.29:0/3204463098 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0031cd0 con 0x7f2c080c55e0 2024-01-25T15:06:38.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.953+0000 7f2c0d1e5640 1 -- 172.21.15.29:0/3204463098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c080c55e0 msgr2=0x7f2c080c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:38.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.953+0000 7f2c0d1e5640 1 --2- 172.21.15.29:0/3204463098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c080c55e0 0x7f2c080c8120 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2c0808bbe0 tx=0x7f2bf002b880 comp rx=0 tx=0).stop 2024-01-25T15:06:38.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.953+0000 7f2c0d1e5640 1 -- 172.21.15.29:0/3204463098 shutdown_connections 2024-01-25T15:06:38.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.953+0000 7f2c0d1e5640 1 --2- 172.21.15.29:0/3204463098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c080c55e0 0x7f2c080c8120 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:38.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.953+0000 7f2c0d1e5640 1 --2- 172.21.15.29:0/3204463098 >> v2:172.21.15.52:3300/0 conn(0x7f2c081520b0 0x7f2c08155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:38.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.953+0000 7f2c0d1e5640 1 -- 172.21.15.29:0/3204463098 >> 172.21.15.29:0/3204463098 conn(0x7f2c080ca220 msgr2=0x7f2c080ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:38.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.953+0000 7f2c0d1e5640 1 -- 172.21.15.29:0/3204463098 shutdown_connections 2024-01-25T15:06:38.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.953+0000 7f2c0d1e5640 1 -- 172.21.15.29:0/3204463098 wait complete. 2024-01-25T15:06:38.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.955+0000 7f2c0d1e5640 1 Processor -- start 2024-01-25T15:06:38.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.955+0000 7f2c0d1e5640 1 -- start start 2024-01-25T15:06:38.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.955+0000 7f2c0d1e5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c080c4f00 0x7f2c081ea960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:38.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.955+0000 7f2c0d1e5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c081520b0 0x7f2c080aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:38.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.955+0000 7f2c0d1e5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c080aa970 0x7f2c08155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:38.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.955+0000 7f2c0d1e5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c080b00f0 con 0x7f2c080c4f00 2024-01-25T15:06:38.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.955+0000 7f2c0d1e5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c08157f10 con 0x7f2c081520b0 2024-01-25T15:06:38.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.955+0000 7f2c0d1e5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c081578e0 con 0x7f2c080aa970 2024-01-25T15:06:38.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.956+0000 7f2c06d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c080c4f00 0x7f2c081ea960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:38.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.956+0000 7f2c06d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c080c4f00 0x7f2c081ea960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41238/0 (socket says 172.21.15.29:41238) 2024-01-25T15:06:38.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.956+0000 7f2c06d9d640 1 -- 172.21.15.29:0/724017850 learned_addr learned my addr 172.21.15.29:0/724017850 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:38.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.956+0000 7f2c0659c640 1 --2- 172.21.15.29:0/724017850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c081520b0 0x7f2c080aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:38.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.956+0000 7f2c0759e640 1 --2- 172.21.15.29:0/724017850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c080aa970 0x7f2c08155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:38.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.956+0000 7f2c06d9d640 1 -- 172.21.15.29:0/724017850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c080aa970 msgr2=0x7f2c08155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:38.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.956+0000 7f2c06d9d640 1 --2- 172.21.15.29:0/724017850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c080aa970 0x7f2c08155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:38.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.956+0000 7f2c06d9d640 1 -- 172.21.15.29:0/724017850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c081520b0 msgr2=0x7f2c080aa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:38.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.956+0000 7f2c06d9d640 1 --2- 172.21.15.29:0/724017850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c081520b0 0x7f2c080aa430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:38.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.956+0000 7f2c06d9d640 1 -- 172.21.15.29:0/724017850 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf00094d0 con 0x7f2c080c4f00 2024-01-25T15:06:38.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.956+0000 7f2c06d9d640 1 --2- 172.21.15.29:0/724017850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c080c4f00 0x7f2c081ea960 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000ba80 tx=0x7f2c0000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:38.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.956+0000 7f2bff7fe640 1 -- 172.21.15.29:0/724017850 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0000cc00 con 0x7f2c080c4f00 2024-01-25T15:06:38.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.956+0000 7f2bff7fe640 1 -- 172.21.15.29:0/724017850 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0000cd80 con 0x7f2c080c4f00 2024-01-25T15:06:38.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.956+0000 7f2bff7fe640 1 -- 172.21.15.29:0/724017850 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c00014680 con 0x7f2c080c4f00 2024-01-25T15:06:38.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.956+0000 7f2c0d1e5640 1 -- 172.21.15.29:0/724017850 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c081eaea0 con 0x7f2c080c4f00 2024-01-25T15:06:38.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.956+0000 7f2c0d1e5640 1 -- 172.21.15.29:0/724017850 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c08158990 con 0x7f2c080c4f00 2024-01-25T15:06:38.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.957+0000 7f2c0d1e5640 1 -- 172.21.15.29:0/724017850 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c08158050 con 0x7f2c080c4f00 2024-01-25T15:06:38.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.958+0000 7f2bff7fe640 1 -- 172.21.15.29:0/724017850 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2c0001d3b0 con 0x7f2c080c4f00 2024-01-25T15:06:38.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.958+0000 7f2bff7fe640 1 --2- 172.21.15.29:0/724017850 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2be806aed0 0x7f2be806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:38.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.958+0000 7f2bff7fe640 1 -- 172.21.15.29:0/724017850 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f2c00089350 con 0x7f2c080c4f00 2024-01-25T15:06:38.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.959+0000 7f2c0659c640 1 --2- 172.21.15.29:0/724017850 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2be806aed0 0x7f2be806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:38.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.959+0000 7f2c0659c640 1 --2- 172.21.15.29:0/724017850 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2be806aed0 0x7f2be806d390 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0036000 tx=0x7f2bf003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:38.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:38.963+0000 7f2bff7fe640 1 -- 172.21.15.29:0/724017850 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2c08158050 con 0x7f2c080c4f00 2024-01-25T15:06:39.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.139+0000 7f2c0d1e5640 1 -- 172.21.15.29:0/724017850 --> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2c08154a20 con 0x7f2be806aed0 2024-01-25T15:06:39.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.141+0000 7f2bff7fe640 1 -- 172.21.15.29:0/724017850 <== mgr.4100 v2:172.21.15.52:6832/2152312734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50685 (secure 0 0 0) 0x7f2bf0031cd0 con 0x7f2be806aed0 2024-01-25T15:06:39.142 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:06:39.143 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-01-25T15:06:39.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.143+0000 7f2c0d1e5640 1 -- 172.21.15.29:0/724017850 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2be806aed0 msgr2=0x7f2be806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:39.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.143+0000 7f2c0d1e5640 1 --2- 172.21.15.29:0/724017850 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2be806aed0 0x7f2be806d390 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0036000 tx=0x7f2bf003d040 comp rx=0 tx=0).stop 2024-01-25T15:06:39.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.143+0000 7f2c0d1e5640 1 -- 172.21.15.29:0/724017850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c080c4f00 msgr2=0x7f2c081ea960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:39.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.143+0000 7f2c0d1e5640 1 --2- 172.21.15.29:0/724017850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c080c4f00 0x7f2c081ea960 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000ba80 tx=0x7f2c0000bf40 comp rx=0 tx=0).stop 2024-01-25T15:06:39.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.143+0000 7f2c0d1e5640 1 -- 172.21.15.29:0/724017850 shutdown_connections 2024-01-25T15:06:39.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.143+0000 7f2c0d1e5640 1 --2- 172.21.15.29:0/724017850 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2c080aa970 0x7f2c08155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.143+0000 7f2c0d1e5640 1 --2- 172.21.15.29:0/724017850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c081520b0 0x7f2c080aa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.143+0000 7f2c0d1e5640 1 --2- 172.21.15.29:0/724017850 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f2be806aed0 0x7f2be806d390 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.143+0000 7f2c0d1e5640 1 --2- 172.21.15.29:0/724017850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c080c4f00 0x7f2c081ea960 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.143+0000 7f2c0d1e5640 1 -- 172.21.15.29:0/724017850 >> 172.21.15.29:0/724017850 conn(0x7f2c080ca220 msgr2=0x7f2c080ab5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:39.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.143+0000 7f2c0d1e5640 1 -- 172.21.15.29:0/724017850 shutdown_connections 2024-01-25T15:06:39.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.143+0000 7f2c0d1e5640 1 -- 172.21.15.29:0/724017850 wait complete. 2024-01-25T15:06:39.155 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2024-01-25T15:06:38.947957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":255224,"kb_used_data":5768,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719496,"statfs":{"total":773094113280,"available":772832763904,"internally_reserved":0,"allocated":5906432,"data_stored":3302672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002277"},"pg_stats":[{"pgid":"1.0","version":"49'119","reported_seq":235,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-01-25T15:06:19.064119+0000","last_change":"2024-01-25T15:06:19.064155+0000","last_active":"2024-01-25T15:06:19.064119+0000","last_peered":"2024-01-25T15:06:19.064119+0000","last_clean":"2024-01-25T15:06:19.064119+0000","last_became_active":"2024-01-25T15:04:16.179890+0000","last_became_peered":"2024-01-25T15:04:16.179890+0000","last_unstale":"2024-01-25T15:06:19.064119+0000","last_undegraded":"2024-01-25T15:06:19.064119+0000","last_fullsized":"2024-01-25T15:06:19.064119+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'119","last_scrub_stamp":"2024-01-25T15:06:19.064025+0000","last_deep_scrub":"49'119","last_deep_scrub_stamp":"2024-01-25T15:06:19.064025+0000","last_clean_scrub_stamp":"2024-01-25T15:06:19.064025+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:23:35.900744+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1183744,"data_stored":855610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:06:17 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.50900000000000001,"15min":0.50700000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70699999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Jan 25 15:06:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jan 25 15:06:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55900000000000005,"15min":0.56299999999999994},"min":{"1min":0.36599999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71899999999999997,"5min":1.589,"15min":1.589},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.60099999999999998,"15min":0.59199999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.629}]},{"osd":3,"last update":"Thu Jan 25 15:06:17 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.436,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71699999999999997,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.62,"15min":0.61499999999999999},"min":{"1min":0.43099999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85599999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.73799999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:06:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36099999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68500000000000005,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.376}]},{"osd":5,"last update":"Thu Jan 25 15:06:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58899999999999997,"15min":0.59199999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.79900000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.625,"15min":0.625},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 25 15:06:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.626,"15min":0.622},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81100000000000005,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.52600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31756,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":589824,"data_stored":265242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.753,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78600000000000003,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66000000000000003,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.63600000000000001,"15min":0.64400000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81100000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.38200000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71599999999999997,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76600000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.69399999999999995}]},{"osd":3,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57999999999999996,"15min":0.58299999999999996},"min":{"1min":0.45200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85099999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.61899999999999999,"15min":0.626},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.71899999999999997,"5min":0.876,"15min":0.876},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.622,"15min":0.63},"min":{"1min":0.377,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82499999999999996,"5min":0.874,"15min":0.874},"last":0.497}]},{"osd":5,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58299999999999996,"15min":0.58899999999999997},"min":{"1min":0.33200000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.65300000000000002,"15min":0.66500000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80400000000000005,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.45000000000000001}]},{"osd":7,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64800000000000002,"15min":0.65800000000000003},"min":{"1min":0.40100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.72499999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.42999999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.52200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31756,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":589824,"data_stored":265242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":0.65100000000000002,"15min":0.56999999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":10.814,"5min":10.814,"15min":10.814},"last":0.746},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.327,"5min":2.327,"15min":2.327},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":0.65300000000000002,"15min":0.57899999999999996},"min":{"1min":0.438,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":10.016999999999999,"5min":10.016999999999999,"15min":10.016999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.40500000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":0.625}]},{"osd":2,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.57699999999999996,"15min":0.55400000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":3.8610000000000002,"5min":3.8610000000000002,"15min":3.8610000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.1930000000000001,"5min":0.72799999999999998,"15min":0.65000000000000002},"min":{"1min":0.44600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":10.221,"5min":10.221,"15min":10.221},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.61699999999999999,"15min":0.57599999999999996},"min":{"1min":0.41499999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":5.6440000000000001,"5min":5.6440000000000001,"15min":5.6440000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":1.1839999999999999,"5min":0.73599999999999999,"15min":0.66100000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":10.092000000000001,"5min":10.092000000000001,"15min":10.092000000000001},"last":0.70999999999999996}]},{"osd":4,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.625,"15min":0.58499999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.5970000000000004,"5min":5.5970000000000004,"15min":5.5970000000000004},"last":0.32800000000000001},{"interface":"front","average":{"1min":1.196,"5min":0.71599999999999997,"15min":0.63600000000000001},"min":{"1min":0.36899999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":10.124000000000001,"5min":10.124000000000001,"15min":10.124000000000001},"last":0.40500000000000003}]},{"osd":6,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.54700000000000004,"15min":0.52900000000000003},"min":{"1min":0.38200000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":0.36499999999999999},{"interface":"front","average":{"1min":1.252,"5min":0.752,"15min":0.66900000000000004},"min":{"1min":0.53700000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":10.057,"5min":10.057,"15min":10.057},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.61199999999999999,"15min":0.59099999999999997},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":1.129,"5min":0.70499999999999996,"15min":0.63400000000000001},"min":{"1min":0.47199999999999998,"5min":0.433,"15min":0.433},"max":{"1min":8.9179999999999993,"5min":8.9179999999999993,"15min":8.9179999999999993},"last":0.432}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31764,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":589824,"data_stored":265242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:06:14 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36399999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67700000000000005,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 25 15:06:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.497,"15min":0.49099999999999999},"min":{"1min":0.42099999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 25 15:06:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.51500000000000001,"15min":0.50800000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.47899999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.748}]},{"osd":3,"last update":"Thu Jan 25 15:06:14 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.39100000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.71699999999999997,"5min":0.751,"15min":0.751},"last":0.63},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.75900000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.77100000000000002}]},{"osd":5,"last update":"Thu Jan 25 15:06:14 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78100000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Jan 25 15:06:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59099999999999997,"15min":0.58499999999999996},"min":{"1min":0.374,"5min":0.318,"15min":0.318},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67400000000000004,"15min":0.67800000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.84199999999999997}]},{"osd":7,"last update":"Thu Jan 25 15:06:14 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61399999999999999,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89300000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64700000000000002,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88600000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.85899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31760,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":589824,"data_stored":265242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.40999999999999998,"15min":0.41999999999999998},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.72499999999999998,"5min":1.431,"15min":1.431},"last":0.307},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.52000000000000002,"15min":0.53300000000000003},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":2.6230000000000002,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":0.375}]},{"osd":1,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.53200000000000003,"15min":0.54700000000000004},"min":{"1min":0.245,"5min":0.224,"15min":0.224},"max":{"1min":2.3250000000000002,"5min":3.3559999999999999,"15min":3.3559999999999999},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.442,"5min":0.48599999999999999,"15min":0.49299999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48299999999999998,"15min":0.48399999999999999},"min":{"1min":0.28999999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":2.6539999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.60099999999999998,"15min":0.623},"min":{"1min":0.26300000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":2.3679999999999999,"5min":3.4209999999999998,"15min":3.4209999999999998},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.69799999999999995,"15min":0.70699999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.5379999999999998,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72299999999999998,"15min":0.73799999999999999},"min":{"1min":0.36399999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.1970000000000001,"5min":3.4689999999999999,"15min":3.4689999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.73399999999999999,"15min":0.754},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.2410000000000001,"5min":3.508,"15min":3.508},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.70799999999999996,"15min":0.72899999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79000000000000004,"5min":1.946,"15min":1.946},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.872,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.69499999999999995,"15min":0.70199999999999996},"min":{"1min":0.38500000000000001,"5min":0.375,"15min":0.375},"max":{"1min":2.492,"5min":2.492,"15min":2.492},"last":0.441}]},{"osd":7,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70599999999999996,"15min":0.71099999999999997},"min":{"1min":0.42699999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.77000000000000002,"15min":0.78800000000000003},"min":{"1min":0.42499999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.2839999999999998,"5min":3.5449999999999999,"15min":3.5449999999999999},"last":0.55600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31764,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":589824,"data_stored":265242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.41099999999999998,"15min":0.42399999999999999},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.47899999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.39700000000000002,"15min":0.40799999999999997},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.66900000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.435,"15min":0.44500000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.68899999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.42499999999999999,"15min":0.439},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58599999999999997,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.438,"15min":0.45200000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.51100000000000001,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.48699999999999999,"15min":0.503},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.60899999999999999,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83499999999999996,"5min":1.008,"15min":1.008},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.72699999999999998,"5min":1.113,"15min":1.113},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82099999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.65000000000000002,"15min":0.65800000000000003},"min":{"1min":0.38300000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.86499999999999999,"5min":1.222,"15min":1.222},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.63300000000000001,"15min":0.64000000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.87,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.65000000000000002,"15min":0.65900000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.79400000000000004,"5min":0.998,"15min":0.998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.69499999999999995,"15min":0.70899999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84399999999999997,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.61299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31760,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":589824,"data_stored":265242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:06:17 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.40699999999999997,"15min":0.41799999999999998},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.47699999999999998,"5min":1.7,"15min":1.7},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.39400000000000002,"15min":0.40699999999999997},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.44600000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 25 15:06:17 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.38300000000000001,"15min":0.39500000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.50700000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.46500000000000002,"15min":0.47799999999999998},"min":{"1min":0.311,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.49199999999999999,"5min":1.756,"15min":1.756},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 25 15:06:17 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.46700000000000003,"15min":0.47999999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.50700000000000001,"5min":1.728,"15min":1.728},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.437,"15min":0.44900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.496,"5min":1.569,"15min":1.569},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:06:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.65300000000000002,"15min":0.67100000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76700000000000002,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61699999999999999,"15min":0.625},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77700000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 25 15:06:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.61099999999999999,"15min":0.61699999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81499999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67300000000000004,"15min":0.68500000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77400000000000002,"5min":1.639,"15min":1.639},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 25 15:06:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.64900000000000002,"15min":0.66100000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76600000000000001,"5min":1.514,"15min":1.514},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.63500000000000001,"15min":0.64400000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.755,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.622}]},{"osd":7,"last update":"Thu Jan 25 15:06:17 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.70399999999999996,"15min":0.72099999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80400000000000005,"5min":1.671,"15min":1.671},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64000000000000001,"15min":0.64800000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73999999999999999,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.73899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1183744,"data_stored":855610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.313,"15min":0.315},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.432,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.317},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.33200000000000002,"15min":0.33000000000000002},"min":{"1min":0.245,"5min":0.22,"15min":0.22},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.36199999999999999},"min":{"1min":0.28599999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.50600000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.374},{"interface":"front","average":{"1min":0.37,"5min":0.372,"15min":0.372},"min":{"1min":0.28499999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.46700000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.34499999999999997,"15min":0.34699999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.51000000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.30199999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.48999999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.437}]},{"osd":4,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.51500000000000001,"15min":0.503},"min":{"1min":0.40200000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54400000000000004,"15min":0.53800000000000003},"min":{"1min":0.38700000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.76400000000000001}]},{"osd":5,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.54600000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.627},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.44800000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83099999999999996,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88500000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 25 15:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.42899999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.753,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.72699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:06:39.158 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-01-25T15:06:39.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.259+0000 7f79d4cd3640 1 Processor -- start 2024-01-25T15:06:39.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.259+0000 7f79d4cd3640 1 -- start start 2024-01-25T15:06:39.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.260+0000 7f79d4cd3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f79d0151ff0 0x7f79d0154860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:39.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.260+0000 7f79d4cd3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f79d00c5ef0 0x7f79d0158520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:39.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.260+0000 7f79d4cd3640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d0157db0 con 0x7f79d0158a60 2024-01-25T15:06:39.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.260+0000 7f79d4cd3640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d0158090 con 0x7f79d00c5ef0 2024-01-25T15:06:39.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.260+0000 7f79d4cd3640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d00c7390 con 0x7f79d0151ff0 2024-01-25T15:06:39.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.260+0000 7f79cdd9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f79d00c5ef0 0x7f79d0158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:39.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.260+0000 7f79cdd9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f79d00c5ef0 0x7f79d0158520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41248/0 (socket says 172.21.15.29:41248) 2024-01-25T15:06:39.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.260+0000 7f79cdd9b640 1 -- 172.21.15.29:0/281003695 learned_addr learned my addr 172.21.15.29:0/281003695 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:39.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.260+0000 7f79ce59c640 1 --2- 172.21.15.29:0/281003695 >> v2:172.21.15.52:3300/0 conn(0x7f79d0151ff0 0x7f79d0154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.260+0000 7f79cdd9b640 1 -- 172.21.15.29:0/281003695 >> v2:172.21.15.52:3300/0 conn(0x7f79d0151ff0 msgr2=0x7f79d0154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.260+0000 7f79cdd9b640 1 --2- 172.21.15.29:0/281003695 >> v2:172.21.15.52:3300/0 conn(0x7f79d0151ff0 0x7f79d0154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.260+0000 7f79cdd9b640 1 -- 172.21.15.29:0/281003695 >> v1:172.21.15.52:6789/0 conn(0x7f79d0158a60 legacy=0x7f79d00c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.260+0000 7f79cdd9b640 1 -- 172.21.15.29:0/281003695 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d00c7840 con 0x7f79d00c5ef0 2024-01-25T15:06:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.261+0000 7f79cdd9b640 1 --2- 172.21.15.29:0/281003695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79d00c5ef0 0x7f79d0158520 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f79d006b5e0 tx=0x7f79b802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4e14c99939760 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.261+0000 7f79cd59a640 1 -- 172.21.15.29:0/281003695 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b80317e0 con 0x7f79d00c5ef0 2024-01-25T15:06:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.261+0000 7f79cd59a640 1 -- 172.21.15.29:0/281003695 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b8031940 con 0x7f79d00c5ef0 2024-01-25T15:06:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.261+0000 7f79cd59a640 1 -- 172.21.15.29:0/281003695 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8031cd0 con 0x7f79d00c5ef0 2024-01-25T15:06:39.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.261+0000 7f79d4cd3640 1 -- 172.21.15.29:0/281003695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79d00c5ef0 msgr2=0x7f79d0158520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.261+0000 7f79d4cd3640 1 --2- 172.21.15.29:0/281003695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79d00c5ef0 0x7f79d0158520 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f79d006b5e0 tx=0x7f79b802b880 comp rx=0 tx=0).stop 2024-01-25T15:06:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.262+0000 7f79d4cd3640 1 -- 172.21.15.29:0/281003695 shutdown_connections 2024-01-25T15:06:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.262+0000 7f79d4cd3640 1 --2- 172.21.15.29:0/281003695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79d00c5ef0 0x7f79d0158520 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.262+0000 7f79d4cd3640 1 --2- 172.21.15.29:0/281003695 >> v2:172.21.15.52:3300/0 conn(0x7f79d0151ff0 0x7f79d0154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.262+0000 7f79d4cd3640 1 -- 172.21.15.29:0/281003695 >> 172.21.15.29:0/281003695 conn(0x7f79d00c7f80 msgr2=0x7f79d00c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.262+0000 7f79d4cd3640 1 -- 172.21.15.29:0/281003695 shutdown_connections 2024-01-25T15:06:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.262+0000 7f79d4cd3640 1 -- 172.21.15.29:0/281003695 wait complete. 2024-01-25T15:06:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.263+0000 7f79d4cd3640 1 Processor -- start 2024-01-25T15:06:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.263+0000 7f79d4cd3640 1 -- start start 2024-01-25T15:06:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.263+0000 7f79d4cd3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79d0151ff0 0x7f79d01eb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.263+0000 7f79d4cd3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79d009ce70 0x7f79d0152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.263+0000 7f79d4cd3640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79d009c650 0x7f79d01e7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.263+0000 7f79d4cd3640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d014ad10 con 0x7f79d009ce70 2024-01-25T15:06:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.263+0000 7f79d4cd3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d009c1c0 con 0x7f79d0151ff0 2024-01-25T15:06:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.263+0000 7f79d4cd3640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d01eb790 con 0x7f79d009c650 2024-01-25T15:06:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.264+0000 7f79cdd9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79d009ce70 0x7f79d0152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:39.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.264+0000 7f79cdd9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79d009ce70 0x7f79d0152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41256/0 (socket says 172.21.15.29:41256) 2024-01-25T15:06:39.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.264+0000 7f79cdd9b640 1 -- 172.21.15.29:0/4123158603 learned_addr learned my addr 172.21.15.29:0/4123158603 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:39.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.264+0000 7f79ced9d640 1 --2- 172.21.15.29:0/4123158603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79d009c650 0x7f79d01e7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:39.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.264+0000 7f79ce59c640 1 --2- 172.21.15.29:0/4123158603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79d0151ff0 0x7f79d01eb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:39.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.264+0000 7f79cdd9b640 1 -- 172.21.15.29:0/4123158603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79d009c650 msgr2=0x7f79d01e7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:39.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.264+0000 7f79cdd9b640 1 --2- 172.21.15.29:0/4123158603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79d009c650 0x7f79d01e7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.264+0000 7f79cdd9b640 1 -- 172.21.15.29:0/4123158603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79d0151ff0 msgr2=0x7f79d01eb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:39.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.264+0000 7f79cdd9b640 1 --2- 172.21.15.29:0/4123158603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79d0151ff0 0x7f79d01eb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.264+0000 7f79cdd9b640 1 -- 172.21.15.29:0/4123158603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b80094d0 con 0x7f79d009ce70 2024-01-25T15:06:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.264+0000 7f79cdd9b640 1 --2- 172.21.15.29:0/4123158603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79d009ce70 0x7f79d0152920 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f79b802b8c0 tx=0x7f79b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.264+0000 7f79c6ffd640 1 -- 172.21.15.29:0/4123158603 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8032880 con 0x7f79d009ce70 2024-01-25T15:06:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.264+0000 7f79c6ffd640 1 -- 172.21.15.29:0/4123158603 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b8032a00 con 0x7f79d009ce70 2024-01-25T15:06:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.264+0000 7f79d4cd3640 1 -- 172.21.15.29:0/4123158603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d00a0d10 con 0x7f79d009ce70 2024-01-25T15:06:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.264+0000 7f79c6ffd640 1 -- 172.21.15.29:0/4123158603 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8032db0 con 0x7f79d009ce70 2024-01-25T15:06:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.264+0000 7f79d4cd3640 1 -- 172.21.15.29:0/4123158603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d009bc00 con 0x7f79d009ce70 2024-01-25T15:06:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.265+0000 7f79d4cd3640 1 -- 172.21.15.29:0/4123158603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d009c370 con 0x7f79d009ce70 2024-01-25T15:06:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.266+0000 7f79c6ffd640 1 -- 172.21.15.29:0/4123158603 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f79b80453f0 con 0x7f79d009ce70 2024-01-25T15:06:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.266+0000 7f79c6ffd640 1 --2- 172.21.15.29:0/4123158603 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f79b006aed0 0x7f79b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:39.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.266+0000 7f79c6ffd640 1 -- 172.21.15.29:0/4123158603 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f79b80ab490 con 0x7f79d009ce70 2024-01-25T15:06:39.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.266+0000 7f79ce59c640 1 --2- 172.21.15.29:0/4123158603 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f79b006aed0 0x7f79b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:39.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.267+0000 7f79ce59c640 1 --2- 172.21.15.29:0/4123158603 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f79b006aed0 0x7f79b006d390 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f79c0003b80 tx=0x7f79c00098d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:39.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.270+0000 7f79c6ffd640 1 -- 172.21.15.29:0/4123158603 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f79d009c370 con 0x7f79d009ce70 2024-01-25T15:06:39.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.448+0000 7f79d4cd3640 1 -- 172.21.15.29:0/4123158603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f79d00a0d10 con 0x7f79d009ce70 2024-01-25T15:06:39.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.451+0000 7f79c6ffd640 1 -- 172.21.15.29:0/4123158603 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f79d00a0d10 con 0x7f79d009ce70 2024-01-25T15:06:39.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.452+0000 7f79c6ffd640 1 -- 172.21.15.29:0/4123158603 <== mon.0 v2:172.21.15.29:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f79b80765e0 con 0x7f79d009ce70 2024-01-25T15:06:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.454+0000 7f79d4cd3640 1 -- 172.21.15.29:0/4123158603 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f79b006aed0 msgr2=0x7f79b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.454+0000 7f79d4cd3640 1 --2- 172.21.15.29:0/4123158603 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f79b006aed0 0x7f79b006d390 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f79c0003b80 tx=0x7f79c00098d0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.454+0000 7f79d4cd3640 1 -- 172.21.15.29:0/4123158603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79d009ce70 msgr2=0x7f79d0152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.454+0000 7f79d4cd3640 1 --2- 172.21.15.29:0/4123158603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79d009ce70 0x7f79d0152920 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f79b802b8c0 tx=0x7f79b80046c0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.454+0000 7f79d4cd3640 1 -- 172.21.15.29:0/4123158603 shutdown_connections 2024-01-25T15:06:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.454+0000 7f79d4cd3640 1 --2- 172.21.15.29:0/4123158603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f79d009c650 0x7f79d01e7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.454+0000 7f79d4cd3640 1 --2- 172.21.15.29:0/4123158603 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7f79b006aed0 0x7f79b006d390 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.454+0000 7f79d4cd3640 1 --2- 172.21.15.29:0/4123158603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79d009ce70 0x7f79d0152920 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.454+0000 7f79d4cd3640 1 --2- 172.21.15.29:0/4123158603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79d0151ff0 0x7f79d01eb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.454+0000 7f79d4cd3640 1 -- 172.21.15.29:0/4123158603 >> 172.21.15.29:0/4123158603 conn(0x7f79d00c7f80 msgr2=0x7f79d00c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:39.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.454+0000 7f79d4cd3640 1 -- 172.21.15.29:0/4123158603 shutdown_connections 2024-01-25T15:06:39.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.454+0000 7f79d4cd3640 1 -- 172.21.15.29:0/4123158603 wait complete. 2024-01-25T15:06:39.465 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-25T15:06:39.466 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:06:39.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.566+0000 7fc31c1de640 1 Processor -- start 2024-01-25T15:06:39.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.566+0000 7fc31c1de640 1 -- start start 2024-01-25T15:06:39.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.567+0000 7fc31c1de640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc314151f90 0x7fc3140c5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:39.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.567+0000 7fc31c1de640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc3140c61d0 0x7fc31406b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:39.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.567+0000 7fc31c1de640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc314155270 con 0x7fc314155700 2024-01-25T15:06:39.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.567+0000 7fc31c1de640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3140c6940 con 0x7fc314151f90 2024-01-25T15:06:39.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.567+0000 7fc31c1de640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc314154a10 con 0x7fc3140c61d0 2024-01-25T15:06:39.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.567+0000 7fc319779640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc3140c61d0 0x7fc31406b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:39.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.567+0000 7fc319f7a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc314151f90 0x7fc3140c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:39.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.567+0000 7fc31a77b640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc314155700 0x7fc3140c7f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.29:33086/0 (socket says 172.21.15.29:33086) 2024-01-25T15:06:39.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.568+0000 7fc31a77b640 1 -- 172.21.15.29:0/2205570369 learned_addr learned my addr 172.21.15.29:0/2205570369 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-01-25T15:06:39.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.568+0000 7fc319779640 1 -- 172.21.15.29:0/2205570369 >> v2:172.21.15.52:3300/0 conn(0x7fc314151f90 msgr2=0x7fc3140c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:06:39.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.568+0000 7fc319779640 1 --2- 172.21.15.29:0/2205570369 >> v2:172.21.15.52:3300/0 conn(0x7fc314151f90 0x7fc3140c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.568+0000 7fc318f78640 1 -- 172.21.15.29:0/2205570369 <== mon.1 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878103912 0 0) 0x7fc314155270 con 0x7fc314155700 2024-01-25T15:06:39.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.568+0000 7fc319779640 1 -- 172.21.15.29:0/2205570369 >> v1:172.21.15.52:6789/0 conn(0x7fc314155700 legacy=0x7fc3140c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:39.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.568+0000 7fc319779640 1 -- 172.21.15.29:0/2205570369 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3140c6660 con 0x7fc3140c61d0 2024-01-25T15:06:39.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.569+0000 7fc319779640 1 --2- 172.21.15.29:0/2205570369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc3140c61d0 0x7fc31406b220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc3040097a0 tx=0x7fc30402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a401551617147d3 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:39.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.569+0000 7fc318f78640 1 -- 172.21.15.29:0/2205570369 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc304031830 con 0x7fc3140c61d0 2024-01-25T15:06:39.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.569+0000 7fc318f78640 1 -- 172.21.15.29:0/2205570369 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc304031990 con 0x7fc3140c61d0 2024-01-25T15:06:39.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.569+0000 7fc318f78640 1 -- 172.21.15.29:0/2205570369 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc304031d40 con 0x7fc3140c61d0 2024-01-25T15:06:39.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.569+0000 7fc31c1de640 1 -- 172.21.15.29:0/2205570369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc3140c61d0 msgr2=0x7fc31406b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:39.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.569+0000 7fc31c1de640 1 --2- 172.21.15.29:0/2205570369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc3140c61d0 0x7fc31406b220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc3040097a0 tx=0x7fc30402b8d0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.569+0000 7fc31c1de640 1 -- 172.21.15.29:0/2205570369 shutdown_connections 2024-01-25T15:06:39.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.569+0000 7fc31c1de640 1 --2- 172.21.15.29:0/2205570369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc3140c61d0 0x7fc31406b220 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.569+0000 7fc31c1de640 1 --2- 172.21.15.29:0/2205570369 >> v2:172.21.15.52:3300/0 conn(0x7fc314151f90 0x7fc3140c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.569+0000 7fc31c1de640 1 -- 172.21.15.29:0/2205570369 >> 172.21.15.29:0/2205570369 conn(0x7fc3140ca000 msgr2=0x7fc3140ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:39.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.570+0000 7fc31c1de640 1 -- 172.21.15.29:0/2205570369 shutdown_connections 2024-01-25T15:06:39.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.570+0000 7fc31c1de640 1 -- 172.21.15.29:0/2205570369 wait complete. 2024-01-25T15:06:39.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.571+0000 7fc31c1de640 1 Processor -- start 2024-01-25T15:06:39.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.571+0000 7fc31c1de640 1 -- start start 2024-01-25T15:06:39.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.571+0000 7fc31c1de640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc314151f90 0x7fc31414d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:39.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.571+0000 7fc31c1de640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc314155700 0x7fc3141ee3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:39.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.571+0000 7fc31c1de640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc314147590 0x7fc31414dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:39.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.571+0000 7fc31c1de640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3141579f0 con 0x7fc314151f90 2024-01-25T15:06:39.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.571+0000 7fc31c1de640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3141473c0 con 0x7fc314147590 2024-01-25T15:06:39.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.571+0000 7fc31c1de640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3141eafa0 con 0x7fc314155700 2024-01-25T15:06:39.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.571+0000 7fc319f7a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc314151f90 0x7fc31414d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:39.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.571+0000 7fc319f7a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc314151f90 0x7fc31414d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41262/0 (socket says 172.21.15.29:41262) 2024-01-25T15:06:39.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.571+0000 7fc319f7a640 1 -- 172.21.15.29:0/4252886888 learned_addr learned my addr 172.21.15.29:0/4252886888 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-01-25T15:06:39.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.571+0000 7fc319779640 1 --2- 172.21.15.29:0/4252886888 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc314155700 0x7fc3141ee3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:39.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.571+0000 7fc31a77b640 1 --2- 172.21.15.29:0/4252886888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc314147590 0x7fc31414dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:39.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.572+0000 7fc319f7a640 1 -- 172.21.15.29:0/4252886888 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc314155700 msgr2=0x7fc3141ee3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:39.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.572+0000 7fc319f7a640 1 --2- 172.21.15.29:0/4252886888 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc314155700 0x7fc3141ee3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.572+0000 7fc319f7a640 1 -- 172.21.15.29:0/4252886888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc314147590 msgr2=0x7fc31414dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:39.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.572+0000 7fc319f7a640 1 --2- 172.21.15.29:0/4252886888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc314147590 0x7fc31414dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.572+0000 7fc319f7a640 1 -- 172.21.15.29:0/4252886888 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc304009400 con 0x7fc314151f90 2024-01-25T15:06:39.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.572+0000 7fc319f7a640 1 --2- 172.21.15.29:0/4252886888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc314151f90 0x7fc31414d060 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc31000e9e0 tx=0x7fc31000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:39.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.572+0000 7fc30a7fc640 1 -- 172.21.15.29:0/4252886888 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310009670 con 0x7fc314151f90 2024-01-25T15:06:39.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.572+0000 7fc30a7fc640 1 -- 172.21.15.29:0/4252886888 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc31000c9d0 con 0x7fc314151f90 2024-01-25T15:06:39.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.572+0000 7fc31c1de640 1 -- 172.21.15.29:0/4252886888 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3141eb4d0 con 0x7fc314151f90 2024-01-25T15:06:39.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.572+0000 7fc30a7fc640 1 -- 172.21.15.29:0/4252886888 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31000cda0 con 0x7fc314151f90 2024-01-25T15:06:39.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.572+0000 7fc31c1de640 1 -- 172.21.15.29:0/4252886888 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31414c520 con 0x7fc314151f90 2024-01-25T15:06:39.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.573+0000 7fc31c1de640 1 -- 172.21.15.29:0/4252886888 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31408be00 con 0x7fc314151f90 2024-01-25T15:06:39.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.574+0000 7fc30a7fc640 1 -- 172.21.15.29:0/4252886888 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fc310013470 con 0x7fc314151f90 2024-01-25T15:06:39.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.574+0000 7fc30a7fc640 1 --2- 172.21.15.29:0/4252886888 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc2f806aed0 0x7fc2f806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:06:39.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.574+0000 7fc30a7fc640 1 -- 172.21.15.29:0/4252886888 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fc310089620 con 0x7fc314151f90 2024-01-25T15:06:39.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.574+0000 7fc319779640 1 --2- 172.21.15.29:0/4252886888 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc2f806aed0 0x7fc2f806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:06:39.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.575+0000 7fc319779640 1 --2- 172.21.15.29:0/4252886888 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc2f806aed0 0x7fc2f806d390 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc304036000 tx=0x7fc30403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:06:39.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.580+0000 7fc30a7fc640 1 -- 172.21.15.29:0/4252886888 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fc310054790 con 0x7fc314151f90 2024-01-25T15:06:39.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.797+0000 7fc31c1de640 1 -- 172.21.15.29:0/4252886888 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc314074080 con 0x7fc314151f90 2024-01-25T15:06:39.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.798+0000 7fc30a7fc640 1 -- 172.21.15.29:0/4252886888 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3699 (secure 0 0 0) 0x7fc310021e90 con 0x7fc314151f90 2024-01-25T15:06:39.799 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-25T15:06:39.799 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4841,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/3901576943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6835","nonce":3901576943},{"type":"v1","addr":"172.21.15.52:6837","nonce":3901576943}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6836/1878395580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1878395580},{"type":"v1","addr":"172.21.15.52:6836","nonce":1878395580}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5841,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1669682360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1669682360},{"type":"v1","addr":"172.21.15.29:6835","nonce":1669682360}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5922,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2129623513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2129623513},{"type":"v1","addr":"172.21.15.29:6834","nonce":2129623513}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[]} 2024-01-25T15:06:39.799 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 24 2024-01-25T15:06:39.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.800+0000 7fc31c1de640 1 -- 172.21.15.29:0/4252886888 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc2f806aed0 msgr2=0x7fc2f806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:39.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.800+0000 7fc31c1de640 1 --2- 172.21.15.29:0/4252886888 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc2f806aed0 0x7fc2f806d390 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc304036000 tx=0x7fc30403c040 comp rx=0 tx=0).stop 2024-01-25T15:06:39.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.800+0000 7fc31c1de640 1 -- 172.21.15.29:0/4252886888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc314151f90 msgr2=0x7fc31414d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:06:39.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.800+0000 7fc31c1de640 1 --2- 172.21.15.29:0/4252886888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc314151f90 0x7fc31414d060 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc31000e9e0 tx=0x7fc31000eea0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.800+0000 7fc31c1de640 1 -- 172.21.15.29:0/4252886888 shutdown_connections 2024-01-25T15:06:39.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.800+0000 7fc31c1de640 1 --2- 172.21.15.29:0/4252886888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc314147590 0x7fc31414dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.800+0000 7fc31c1de640 1 --2- 172.21.15.29:0/4252886888 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc314155700 0x7fc3141ee3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.800+0000 7fc31c1de640 1 --2- 172.21.15.29:0/4252886888 >> [v2:172.21.15.52:6832/2152312734,v1:172.21.15.52:6833/2152312734] conn(0x7fc2f806aed0 0x7fc2f806d390 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.800+0000 7fc31c1de640 1 --2- 172.21.15.29:0/4252886888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc314151f90 0x7fc31414d060 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:06:39.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.800+0000 7fc31c1de640 1 -- 172.21.15.29:0/4252886888 >> 172.21.15.29:0/4252886888 conn(0x7fc3140ca000 msgr2=0x7fc31414a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:06:39.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.800+0000 7fc31c1de640 1 -- 172.21.15.29:0/4252886888 shutdown_connections 2024-01-25T15:06:39.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-01-25T15:06:39.800+0000 7fc31c1de640 1 -- 172.21.15.29:0/4252886888 wait complete. 2024-01-25T15:06:39.811 DEBUG:tasks.cephfs.filesystem:already dead... 2024-01-25T15:06:39.811 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-25T15:06:39.812 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-25T15:06:39.812 INFO:teuthology.orchestra.run:waiting for 300 2024-01-25T15:06:39.820 INFO:tasks.ceph.mds.a:Stopped 2024-01-25T15:06:39.821 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-25T15:06:39.821 INFO:teuthology.orchestra.run:waiting for 300 2024-01-25T15:06:39.870 INFO:tasks.ceph.mds.c:Stopped 2024-01-25T15:06:39.870 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-25T15:06:39.870 INFO:teuthology.orchestra.run:waiting for 300 2024-01-25T15:06:39.881 INFO:tasks.ceph.mds.b:Stopped 2024-01-25T15:06:39.881 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-25T15:06:39.881 INFO:teuthology.orchestra.run:waiting for 300 2024-01-25T15:06:39.933 INFO:tasks.ceph.mds.d:Stopped 2024-01-25T15:06:39.933 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-25T15:06:39.933 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-25T15:06:39.934 INFO:teuthology.orchestra.run:waiting for 300 2024-01-25T15:06:39.965 INFO:tasks.ceph.osd.0:Stopped 2024-01-25T15:06:39.965 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-25T15:06:39.966 INFO:teuthology.orchestra.run:waiting for 300 2024-01-25T15:06:40.040 INFO:tasks.ceph.osd.1:Stopped 2024-01-25T15:06:40.041 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-25T15:06:40.041 INFO:teuthology.orchestra.run:waiting for 300 2024-01-25T15:06:40.111 INFO:tasks.ceph.osd.2:Stopped 2024-01-25T15:06:40.112 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-25T15:06:40.112 INFO:teuthology.orchestra.run:waiting for 300 2024-01-25T15:06:40.178 INFO:tasks.ceph.osd.3:Stopped 2024-01-25T15:06:40.178 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-01-25T15:06:40.178 INFO:teuthology.orchestra.run:waiting for 300 2024-01-25T15:06:40.219 INFO:tasks.ceph.osd.4:Stopped 2024-01-25T15:06:40.220 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-01-25T15:06:40.220 INFO:teuthology.orchestra.run:waiting for 300 2024-01-25T15:06:40.249 INFO:tasks.ceph.osd.5:Stopped 2024-01-25T15:06:40.249 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-01-25T15:06:40.249 INFO:teuthology.orchestra.run:waiting for 300 2024-01-25T15:06:40.317 INFO:tasks.ceph.osd.6:Stopped 2024-01-25T15:06:40.318 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-01-25T15:06:40.318 INFO:teuthology.orchestra.run:waiting for 300 2024-01-25T15:06:40.386 INFO:tasks.ceph.osd.7:Stopped 2024-01-25T15:06:40.386 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-25T15:06:40.386 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-25T15:06:40.387 INFO:teuthology.orchestra.run:waiting for 300 2024-01-25T15:06:40.411 INFO:tasks.ceph.mgr.y:Stopped 2024-01-25T15:06:40.412 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-25T15:06:40.412 INFO:teuthology.orchestra.run:waiting for 300 2024-01-25T15:06:40.456 INFO:tasks.ceph.mgr.x:Stopped 2024-01-25T15:06:40.456 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-25T15:06:40.456 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-25T15:06:40.456 INFO:teuthology.orchestra.run:waiting for 300 2024-01-25T15:06:40.467 INFO:tasks.ceph.mon.a:Stopped 2024-01-25T15:06:40.468 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-01-25T15:06:40.468 INFO:teuthology.orchestra.run:waiting for 300 2024-01-25T15:06:40.508 INFO:tasks.ceph.mon.b:Stopped 2024-01-25T15:06:40.508 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-01-25T15:06:40.508 INFO:teuthology.orchestra.run:waiting for 300 2024-01-25T15:06:40.560 INFO:tasks.ceph.mon.c:Stopped 2024-01-25T15:06:40.560 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-25T15:06:40.560 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-01-25T15:06:40.592 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi029.front.sepia.ceph.com 2024-01-25T15:06:40.592 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-01-25T15:06:40.857 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi029.front.sepia.ceph.com 2024-01-25T15:06:40.857 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-01-25T15:06:40.945 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi029.front.sepia.ceph.com 2024-01-25T15:06:40.946 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-01-25T15:06:41.004 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi029.front.sepia.ceph.com 2024-01-25T15:06:41.004 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-01-25T15:06:41.070 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi052.front.sepia.ceph.com 2024-01-25T15:06:41.070 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-01-25T15:06:41.177 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi052.front.sepia.ceph.com 2024-01-25T15:06:41.177 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-01-25T15:06:41.265 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi052.front.sepia.ceph.com 2024-01-25T15:06:41.266 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-01-25T15:06:41.339 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi052.front.sepia.ceph.com 2024-01-25T15:06:41.340 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-01-25T15:06:41.397 INFO:tasks.ceph:Archiving mon data... 2024-01-25T15:06:41.399 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531486/data/mon.a.tgz 2024-01-25T15:06:41.399 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-01-25T15:06:41.414 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.vugQ8kYEby 2024-01-25T15:06:41.415 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.vugQ8kYEby 2024-01-25T15:06:41.555 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.vugQ8kYEby 2024-01-25T15:06:41.640 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.vugQ8kYEby is 324KB 2024-01-25T15:06:41.736 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.vugQ8kYEby 2024-01-25T15:06:41.750 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531486/data/mon.b.tgz 2024-01-25T15:06:41.751 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-01-25T15:06:41.768 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.8Gi7bELlXI 2024-01-25T15:06:41.768 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.8Gi7bELlXI 2024-01-25T15:06:41.935 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.8Gi7bELlXI 2024-01-25T15:06:42.021 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.8Gi7bELlXI is 428KB 2024-01-25T15:06:42.089 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.8Gi7bELlXI 2024-01-25T15:06:42.103 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531486/data/mon.c.tgz 2024-01-25T15:06:42.104 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-01-25T15:06:42.158 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.XiDpKAx8Ww 2024-01-25T15:06:42.158 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.XiDpKAx8Ww 2024-01-25T15:06:42.306 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.XiDpKAx8Ww 2024-01-25T15:06:42.391 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.XiDpKAx8Ww is 428KB 2024-01-25T15:06:42.487 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.XiDpKAx8Ww 2024-01-25T15:06:42.502 INFO:tasks.ceph:Cleaning ceph cluster... 2024-01-25T15:06:42.502 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-25T15:06:42.505 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-25T15:06:42.588 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-01-25T15:06:42.623 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-01-25T15:06:42.623 INFO:tasks.ceph:Archiving crash dumps... 2024-01-25T15:06:42.625 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531486/remote/smithi029/crash 2024-01-25T15:06:42.626 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-25T15:06:42.657 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531486/remote/smithi052/crash 2024-01-25T15:06:42.657 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-25T15:06:42.689 INFO:tasks.ceph:Shutting down logrotate 2024-01-25T15:06:42.689 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-25T15:06:42.701 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-25T15:06:42.776 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-25T15:06:42.804 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-25T15:06:42.842 INFO:tasks.ceph:Compressing logs... 2024-01-25T15:06:42.842 DEBUG:teuthology.orchestra.run.smithi029:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-25T15:06:42.846 DEBUG:teuthology.orchestra.run.smithi052:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-25T15:06:42.940 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42984.log 2024-01-25T15:06:42.940 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-01-25T15:06:42.941 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.1.42984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36876.log 2024-01-25T15:06:42.941 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42984.log.gz 2024-01-25T15:06:42.941 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36916.log 2024-01-25T15:06:42.941 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.36876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36956.log 2024-01-25T15:06:42.942 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.36916.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36876.log.gz 2024-01-25T15:06:42.942 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-25T15:06:42.942 INFO:teuthology.orchestra.run.smithi052.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36916.log.gz 2024-01-25T15:06:42.942 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.36956.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-01-25T15:06:42.943 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.audit.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36956.log.gz 2024-01-25T15:06:42.943 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36996.log 2024-01-25T15:06:42.943 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36756.log 2024-01-25T15:06:42.943 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.36996.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-01-25T15:06:42.944 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36996.log.gz 2024-01-25T15:06:42.944 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.36756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36796.log 2024-01-25T15:06:42.944 INFO:teuthology.orchestra.run.smithi052.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-01-25T15:06:42.945 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-osd.4.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36756.log.gz 2024-01-25T15:06:42.945 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37036.log 2024-01-25T15:06:42.945 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.36796.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-01-25T15:06:42.945 INFO:teuthology.orchestra.run.smithi052.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36796.log.gz 2024-01-25T15:06:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.37036.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-01-25T15:06:42.946 INFO:teuthology.orchestra.run.smithi052.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-25T15:06:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5/var/log/ceph/ceph-osd.7.log: --verbose -- /var/log/ceph/ceph-client.1.43806.log 2024-01-25T15:06:42.947 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37036.log.gz 2024-01-25T15:06:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43499.log 2024-01-25T15:06:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.1.43806.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-01-25T15:06:42.947 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43806.log.gz 2024-01-25T15:06:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.1.43499.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-25T15:06:42.948 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43499.log.gz 2024-01-25T15:06:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-01-25T15:06:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-01-25T15:06:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36836.log 2024-01-25T15:06:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mds.d.log: 91.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-25T15:06:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-01-25T15:06:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.36836.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36836.log.gz 2024-01-25T15:06:42.950 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mon.c.log: 91.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-01-25T15:06:42.973 INFO:teuthology.orchestra.run.smithi052.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-01-25T15:06:43.017 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45147.log 2024-01-25T15:06:43.017 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44605.log 2024-01-25T15:06:43.017 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54873.log 2024-01-25T15:06:43.017 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44605.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45147.log.gz 2024-01-25T15:06:43.017 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48489.log 2024-01-25T15:06:43.018 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.54873.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44605.log.gz 2024-01-25T15:06:43.018 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53969.log 2024-01-25T15:06:43.018 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54873.log.gz 2024-01-25T15:06:43.018 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.48489.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-01-25T15:06:43.018 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.53969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47544.log 2024-01-25T15:06:43.018 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48489.log.gz 2024-01-25T15:06:43.018 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mon.a.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53969.log.gz 2024-01-25T15:06:43.018 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49503.log 2024-01-25T15:06:43.019 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42574.log 2024-01-25T15:06:43.019 INFO:teuthology.orchestra.run.smithi029.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47544.log.gz/var/log/ceph/ceph-client.admin.49503.log: 2024-01-25T15:06:43.019 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52924.log 2024-01-25T15:06:43.019 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48699.log 2024-01-25T15:06:43.019 INFO:teuthology.orchestra.run.smithi029.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49503.log.gz 2024-01-25T15:06:43.019 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.52924.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42574.log.gz 2024-01-25T15:06:43.019 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42428.log 2024-01-25T15:06:43.019 INFO:teuthology.orchestra.run.smithi029.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52924.log.gz 2024-01-25T15:06:43.020 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.48699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51348.log 2024-01-25T15:06:43.020 INFO:teuthology.orchestra.run.smithi029.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48699.log.gz 2024-01-25T15:06:43.020 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47712.log 2024-01-25T15:06:43.020 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51348.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42428.log.gz 2024-01-25T15:06:43.020 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55422.log 2024-01-25T15:06:43.020 INFO:teuthology.orchestra.run.smithi029.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51348.log.gz 2024-01-25T15:06:43.020 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53596.log 2024-01-25T15:06:43.020 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.55422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53050.log 2024-01-25T15:06:43.020 INFO:teuthology.orchestra.run.smithi029.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47712.log.gz 2024-01-25T15:06:43.021 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.53596.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55422.log.gz 2024-01-25T15:06:43.021 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50916.log 2024-01-25T15:06:43.021 INFO:teuthology.orchestra.run.smithi029.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53596.log.gz 2024-01-25T15:06:43.021 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.53050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43457.log 2024-01-25T15:06:43.021 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46896.log 2024-01-25T15:06:43.021 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53050.log.gz 2024-01-25T15:06:43.021 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43457.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50916.log.gz 2024-01-25T15:06:43.021 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44949.log 2024-01-25T15:06:43.022 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43457.log.gz 2024-01-25T15:06:43.022 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.46896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47292.log 2024-01-25T15:06:43.022 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44949.log: gzip 88.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.46896.log.gz 2024-01-25T15:06:43.022 INFO:teuthology.orchestra.run.smithi029.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46197.log 2024-01-25T15:06:43.022 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47292.log: gzip -5 88.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.44949.log.gz 2024-01-25T15:06:43.022 INFO:teuthology.orchestra.run.smithi029.stderr: /var/log/ceph/ceph-client.admin.49629.log 2024-01-25T15:06:43.022 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47292.log.gz 2024-01-25T15:06:43.022 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.46197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47754.log 2024-01-25T15:06:43.023 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.49629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49797.log 2024-01-25T15:06:43.023 INFO:teuthology.orchestra.run.smithi029.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.46197.log.gz 2024-01-25T15:06:43.023 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47754.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49629.log.gz 2024-01-25T15:06:43.023 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47166.log 2024-01-25T15:06:43.023 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53176.log 2024-01-25T15:06:43.023 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.49797.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47754.log.gz 2024-01-25T15:06:43.023 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49713.log 2024-01-25T15:06:43.023 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49797.log.gz 2024-01-25T15:06:43.023 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.53176.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47166.log.gz 2024-01-25T15:06:43.024 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55128.log 2024-01-25T15:06:43.024 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.49713.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53176.log.gz 2024-01-25T15:06:43.024 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50459.log 2024-01-25T15:06:43.024 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.55128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48321.log 2024-01-25T15:06:43.024 INFO:teuthology.orchestra.run.smithi029.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49713.log.gz 2024-01-25T15:06:43.024 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50459.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55128.log.gz 2024-01-25T15:06:43.024 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49841.log 2024-01-25T15:06:43.024 INFO:teuthology.orchestra.run.smithi029.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50459.log.gz 2024-01-25T15:06:43.025 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.48321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43767.log 2024-01-25T15:06:43.025 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.49841.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48321.log.gz 2024-01-25T15:06:43.025 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48033.log 2024-01-25T15:06:43.025 INFO:teuthology.orchestra.run.smithi029.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49841.log.gz 2024-01-25T15:06:43.025 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54095.log 2024-01-25T15:06:43.025 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.48033.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43767.log.gz 2024-01-25T15:06:43.025 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55086.log 2024-01-25T15:06:43.025 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.54095.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48033.log.gz 2024-01-25T15:06:43.026 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48243.log 2024-01-25T15:06:43.026 INFO:teuthology.orchestra.run.smithi029.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54095.log.gz 2024-01-25T15:06:43.026 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.55086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47022.log 2024-01-25T15:06:43.026 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.48243.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55086.log.gz 2024-01-25T15:06:43.026 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50958.log 2024-01-25T15:06:43.026 INFO:teuthology.orchestra.run.smithi029.stderr: 87.8%/var/log/ceph/ceph-client.admin.47022.log: -- replaced with /var/log/ceph/ceph-client.admin.48243.log.gz 2024-01-25T15:06:43.026 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50417.log 2024-01-25T15:06:43.026 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50958.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.47022.log.gz 2024-01-25T15:06:43.026 INFO:teuthology.orchestra.run.smithi029.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42088.log 2024-01-25T15:06:43.027 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44613.log 2024-01-25T15:06:43.027 INFO:teuthology.orchestra.run.smithi029.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50958.log.gz 2024-01-25T15:06:43.027 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42088.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50417.log.gz 2024-01-25T15:06:43.027 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44936.log 2024-01-25T15:06:43.027 INFO:teuthology.orchestra.run.smithi029.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42088.log.gz 2024-01-25T15:06:43.027 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46980.log 2024-01-25T15:06:43.027 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44936.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44613.log.gz 2024-01-25T15:06:43.027 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48405.log 2024-01-25T15:06:43.027 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.46980.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44936.log.gz 2024-01-25T15:06:43.028 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51854.log 2024-01-25T15:06:43.028 INFO:teuthology.orchestra.run.smithi029.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46980.log.gz 2024-01-25T15:06:43.028 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.48405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53843.log 2024-01-25T15:06:43.028 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51854.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48405.log.gz 2024-01-25T15:06:43.028 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50021.log 2024-01-25T15:06:43.028 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.53843.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51854.log.gz 2024-01-25T15:06:43.028 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50501.log 2024-01-25T15:06:43.028 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53843.log.gz 2024-01-25T15:06:43.029 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51434.log 2024-01-25T15:06:43.029 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50501.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50021.log.gz 2024-01-25T15:06:43.029 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48867.log 2024-01-25T15:06:43.029 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51434.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50501.log.gz 2024-01-25T15:06:43.029 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55254.log 2024-01-25T15:06:43.029 INFO:teuthology.orchestra.run.smithi029.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51434.log.gz 2024-01-25T15:06:43.029 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.48867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54612.log 2024-01-25T15:06:43.029 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.55254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53759.log 2024-01-25T15:06:43.029 INFO:teuthology.orchestra.run.smithi029.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48867.log.gz 2024-01-25T15:06:43.030 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.54612.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55254.log.gz 2024-01-25T15:06:43.030 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49885.log 2024-01-25T15:06:43.030 INFO:teuthology.orchestra.run.smithi029.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54612.log.gz 2024-01-25T15:06:43.030 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.53759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50796.log 2024-01-25T15:06:43.030 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.49885.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53759.log.gz 2024-01-25T15:06:43.030 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51518.log 2024-01-25T15:06:43.030 INFO:teuthology.orchestra.run.smithi029.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49885.log.gz 2024-01-25T15:06:43.030 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.50796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53512.log 2024-01-25T15:06:43.030 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50796.log.gz 2024-01-25T15:06:43.031 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50231.log 2024-01-25T15:06:43.031 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.53512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.52777.log 2024-01-25T15:06:43.031 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51518.log.gz 2024-01-25T15:06:43.031 INFO:teuthology.orchestra.run.smithi029.stderr: 87.8%/var/log/ceph/ceph-client.admin.50231.log: -- replaced with /var/log/ceph/ceph-client.admin.53512.log.gz 2024-01-25T15:06:43.031 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54570.log 2024-01-25T15:06:43.031 INFO:teuthology.orchestra.run.smithi029.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50231.log.gz 2024-01-25T15:06:43.031 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.testuser.52777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.52777.log.gz 2024-01-25T15:06:43.031 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46029.log 2024-01-25T15:06:43.032 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.54570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47586.log 2024-01-25T15:06:43.032 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.46029.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54570.log.gz 2024-01-25T15:06:43.032 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49295.log 2024-01-25T15:06:43.032 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46029.log.gz 2024-01-25T15:06:43.032 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43667.log 2024-01-25T15:06:43.032 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.49295.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47586.log.gz 2024-01-25T15:06:43.032 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45861.log 2024-01-25T15:06:43.032 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43667.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49295.log.gz 2024-01-25T15:06:43.032 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44265.log 2024-01-25T15:06:43.033 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43667.log.gz 2024-01-25T15:06:43.033 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52882.log 2024-01-25T15:06:43.033 INFO:teuthology.orchestra.run.smithi029.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45861.log.gz 2024-01-25T15:06:43.033 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45567.log 2024-01-25T15:06:43.033 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.52882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42130.log 2024-01-25T15:06:43.033 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44265.log.gz 2024-01-25T15:06:43.033 INFO:teuthology.orchestra.run.smithi029.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52882.log.gz 2024-01-25T15:06:43.033 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46325.log 2024-01-25T15:06:43.033 INFO:teuthology.orchestra.run.smithi029.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45567.log.gz 2024-01-25T15:06:43.034 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42850.log 2024-01-25T15:06:43.034 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.46325.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42130.log.gz 2024-01-25T15:06:43.034 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52840.log 2024-01-25T15:06:43.034 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42850.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46325.log.gz 2024-01-25T15:06:43.034 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51728.log 2024-01-25T15:06:43.034 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42850.log.gz 2024-01-25T15:06:43.034 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.52840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48075.log 2024-01-25T15:06:43.034 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51728.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52840.log.gz 2024-01-25T15:06:43.035 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44391.log 2024-01-25T15:06:43.035 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.48075.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51728.log.gz 2024-01-25T15:06:43.035 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42658.log 2024-01-25T15:06:43.035 INFO:teuthology.orchestra.run.smithi029.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48075.log.gz 2024-01-25T15:06:43.035 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49215.log 2024-01-25T15:06:43.035 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42658.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44391.log.gz 2024-01-25T15:06:43.035 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45777.log 2024-01-25T15:06:43.035 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.49215.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42658.log.gzgzip 2024-01-25T15:06:43.035 INFO:teuthology.orchestra.run.smithi029.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.46639.log 2024-01-25T15:06:43.036 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49215.log.gz 2024-01-25T15:06:43.036 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47502.log 2024-01-25T15:06:43.036 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.46639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53885.log 2024-01-25T15:06:43.036 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46639.log.gz 2024-01-25T15:06:43.036 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45777.log.gz 2024-01-25T15:06:43.036 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44223.log 2024-01-25T15:06:43.036 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47502.log.gz 2024-01-25T15:06:43.036 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.53885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49979.log 2024-01-25T15:06:43.037 INFO:teuthology.orchestra.run.smithi029.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53885.log.gz 2024-01-25T15:06:43.037 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48993.log 2024-01-25T15:06:43.037 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.49979.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44223.log.gz 2024-01-25T15:06:43.037 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44055.log 2024-01-25T15:06:43.037 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.48993.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49979.log.gz 2024-01-25T15:06:43.037 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46113.log 2024-01-25T15:06:43.037 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44055.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48993.log.gz 2024-01-25T15:06:43.037 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50874.log 2024-01-25T15:06:43.037 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.46113.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44055.log.gz 2024-01-25T15:06:43.038 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48657.log 2024-01-25T15:06:43.038 INFO:teuthology.orchestra.run.smithi029.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46113.log.gz 2024-01-25T15:06:43.038 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50874.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-25T15:06:43.038 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3%/var/log/ceph/ceph-client.admin.48657.log: -- replaced with /var/log/ceph/ceph-client.admin.50874.log.gz 2024-01-25T15:06:43.038 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48657.log.gz 2024-01-25T15:06:43.038 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51770.log 2024-01-25T15:06:43.038 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53008.log 2024-01-25T15:06:43.038 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51770.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31004.log 2024-01-25T15:06:43.038 INFO:teuthology.orchestra.run.smithi029.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51770.log.gz 2024-01-25T15:06:43.039 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.53008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51306.log 2024-01-25T15:06:43.039 INFO:teuthology.orchestra.run.smithi029.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53008.log.gz 2024-01-25T15:06:43.039 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53260.log 2024-01-25T15:06:43.039 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph.tmp-client.admin.31004.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31004.log.gz 2024-01-25T15:06:43.039 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52170.log 2024-01-25T15:06:43.039 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-25T15:06:43.039 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.53260.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51306.log.gz 2024-01-25T15:06:43.039 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51602.log 2024-01-25T15:06:43.039 INFO:teuthology.orchestra.run.smithi029.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53260.log.gz 2024-01-25T15:06:43.040 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.52170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54137.log 2024-01-25T15:06:43.040 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51602.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52170.log.gz 2024-01-25T15:06:43.040 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51980.log 2024-01-25T15:06:43.040 INFO:teuthology.orchestra.run.smithi029.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51602.log.gz 2024-01-25T15:06:43.040 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.54137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54831.log 2024-01-25T15:06:43.040 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47670.log 2024-01-25T15:06:43.040 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54137.log.gz 2024-01-25T15:06:43.040 INFO:teuthology.orchestra.run.smithi029.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51980.log.gz 2024-01-25T15:06:43.041 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.54831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42700.log 2024-01-25T15:06:43.041 INFO:teuthology.orchestra.run.smithi029.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54831.log.gz 2024-01-25T15:06:43.041 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51390.log 2024-01-25T15:06:43.041 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42700.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47670.log.gz 2024-01-25T15:06:43.041 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44433.log 2024-01-25T15:06:43.041 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42700.log.gz 2024-01-25T15:06:43.041 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48615.log 2024-01-25T15:06:43.041 INFO:teuthology.orchestra.run.smithi029.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51390.log.gz 2024-01-25T15:06:43.042 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54781.log 2024-01-25T15:06:43.042 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.48615.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44433.log.gz 2024-01-25T15:06:43.042 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50375.log 2024-01-25T15:06:43.042 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.54781.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48615.log.gz 2024-01-25T15:06:43.042 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42386.log 2024-01-25T15:06:43.042 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50375.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54781.log.gz 2024-01-25T15:06:43.042 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50189.log 2024-01-25T15:06:43.042 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42386.log: gzip -5 88.7% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.50375.log.gz 2024-01-25T15:06:43.042 INFO:teuthology.orchestra.run.smithi029.stderr: /var/log/ceph/ceph-client.admin.45286.log 2024-01-25T15:06:43.043 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50189.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42386.log.gz 2024-01-25T15:06:43.043 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45693.log 2024-01-25T15:06:43.043 INFO:teuthology.orchestra.run.smithi029.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50189.log.gz 2024-01-25T15:06:43.043 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50063.log 2024-01-25T15:06:43.043 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44615.log 2024-01-25T15:06:43.043 INFO:teuthology.orchestra.run.smithi029.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45286.log.gz 2024-01-25T15:06:43.043 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50063.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45693.log.gz 2024-01-25T15:06:43.043 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47064.log 2024-01-25T15:06:43.044 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8%/var/log/ceph/ceph-client.admin.44615.log: -- replaced with /var/log/ceph/ceph-client.admin.50063.log.gz 2024-01-25T15:06:43.044 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41922.log 2024-01-25T15:06:43.044 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52380.log 2024-01-25T15:06:43.044 INFO:teuthology.orchestra.run.smithi029.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44615.log.gz 2024-01-25T15:06:43.044 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.41922.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47064.log.gz 2024-01-25T15:06:43.044 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45609.log 2024-01-25T15:06:43.044 INFO:teuthology.orchestra.run.smithi029.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41922.log.gz 2024-01-25T15:06:43.044 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.52380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44307.log 2024-01-25T15:06:43.044 INFO:teuthology.orchestra.run.smithi029.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52380.log.gz 2024-01-25T15:06:43.045 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43541.log 2024-01-25T15:06:43.045 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45609.log: /var/log/ceph/ceph-client.admin.44307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45483.log 2024-01-25T15:06:43.045 INFO:teuthology.orchestra.run.smithi029.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45609.log.gz 2024-01-25T15:06:43.045 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43541.log: gzip 88.9% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.44307.log.gz 2024-01-25T15:06:43.045 INFO:teuthology.orchestra.run.smithi029.stderr: -- /var/log/ceph/ceph-client.admin.47838.log 2024-01-25T15:06:43.045 INFO:teuthology.orchestra.run.smithi029.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43541.log.gz 2024-01-25T15:06:43.047 INFO:teuthology.orchestra.run.smithi029.stderr:gzip/var/log/ceph/ceph-client.admin.45483.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43809.log 2024-01-25T15:06:43.047 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54366.log 2024-01-25T15:06:43.047 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45483.log.gz 2024-01-25T15:06:43.047 INFO:teuthology.orchestra.run.smithi029.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47838.log.gz 2024-01-25T15:06:43.047 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50105.log 2024-01-25T15:06:43.047 INFO:teuthology.orchestra.run.smithi029.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43809.log.gz 2024-01-25T15:06:43.047 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.54366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53344.log 2024-01-25T15:06:43.048 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44610.log 2024-01-25T15:06:43.048 INFO:teuthology.orchestra.run.smithi029.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54366.log.gz 2024-01-25T15:06:43.048 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50105.log.gz 2024-01-25T15:06:43.048 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.53344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44945.log 2024-01-25T15:06:43.048 INFO:teuthology.orchestra.run.smithi029.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53344.log.gz 2024-01-25T15:06:43.048 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45651.log 2024-01-25T15:06:43.048 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51212.log 2024-01-25T15:06:43.048 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44610.log.gz 2024-01-25T15:06:43.049 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44945.log.gz 2024-01-25T15:06:43.049 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45945.log 2024-01-25T15:06:43.049 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45651.log.gz 2024-01-25T15:06:43.049 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51212.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-01-25T15:06:43.049 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45945.log: gzip -5 88.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.51212.log.gz /var/log/ceph/ceph-client.admin.50333.log 2024-01-25T15:06:43.049 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-01-25T15:06:43.049 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.1.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45945.log.gz 2024-01-25T15:06:43.049 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45735.log 2024-01-25T15:06:43.049 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50273.log 2024-01-25T15:06:43.050 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45735.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50333.log.gz 2024-01-25T15:06:43.050 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53927.log 2024-01-25T15:06:43.050 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43851.log 2024-01-25T15:06:43.050 INFO:teuthology.orchestra.run.smithi029.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45735.log.gz 2024-01-25T15:06:43.050 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50273.log: /var/log/ceph/ceph-client.admin.53927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53134.log 2024-01-25T15:06:43.050 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50273.log.gz 2024-01-25T15:06:43.050 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53927.log.gz 2024-01-25T15:06:43.050 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45819.log 2024-01-25T15:06:43.050 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43851.log: /var/log/ceph/ceph-client.admin.53134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42045.log 2024-01-25T15:06:43.051 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53134.log.gz 2024-01-25T15:06:43.051 INFO:teuthology.orchestra.run.smithi029.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43851.log.gz 2024-01-25T15:06:43.051 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49376.log 2024-01-25T15:06:43.051 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54654.log 2024-01-25T15:06:43.051 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45819.log.gz 2024-01-25T15:06:43.051 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42045.log: /var/log/ceph/ceph-client.admin.49376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42003.log 2024-01-25T15:06:43.051 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42045.log.gz 2024-01-25T15:06:43.051 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.54654.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49376.log.gz 2024-01-25T15:06:43.051 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49545.log 2024-01-25T15:06:43.052 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54654.log.gz 2024-01-25T15:06:43.052 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51084.log 2024-01-25T15:06:43.052 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47106.log 2024-01-25T15:06:43.052 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.49545.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42003.log.gz 2024-01-25T15:06:43.052 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51084.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49545.log.gz 2024-01-25T15:06:43.052 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52254.log 2024-01-25T15:06:43.052 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51084.log.gz 2024-01-25T15:06:43.052 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49587.log 2024-01-25T15:06:43.052 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47106.log: /var/log/ceph/ceph-client.admin.52254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46812.log 2024-01-25T15:06:43.053 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47106.log.gz 2024-01-25T15:06:43.053 INFO:teuthology.orchestra.run.smithi029.stderr: 87.5%/var/log/ceph/ceph-client.admin.49587.log: -- replaced with /var/log/ceph/ceph-client.admin.52254.log.gz 2024-01-25T15:06:43.053 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50543.log 2024-01-25T15:06:43.053 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.46812.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49587.log.gz 2024-01-25T15:06:43.053 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48363.log 2024-01-25T15:06:43.053 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46812.log.gz 2024-01-25T15:06:43.053 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55296.log 2024-01-25T15:06:43.053 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45280.log 2024-01-25T15:06:43.053 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.48363.log: /var/log/ceph/ceph-client.admin.55296.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50543.log.gz 2024-01-25T15:06:43.054 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47922.log 2024-01-25T15:06:43.054 INFO:teuthology.orchestra.run.smithi029.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48363.log.gz 2024-01-25T15:06:43.054 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55296.log.gz 2024-01-25T15:06:43.054 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49935.log 2024-01-25T15:06:43.054 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43583.log 2024-01-25T15:06:43.054 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47922.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45280.log.gz 2024-01-25T15:06:43.054 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.49935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48531.log 2024-01-25T15:06:43.054 INFO:teuthology.orchestra.run.smithi029.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47922.log.gz 2024-01-25T15:06:43.055 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49935.log.gz 2024-01-25T15:06:43.055 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49755.log 2024-01-25T15:06:43.055 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43583.log: /var/log/ceph/ceph-client.admin.48531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49173.log 2024-01-25T15:06:43.055 INFO:teuthology.orchestra.run.smithi029.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43583.log.gz 2024-01-25T15:06:43.055 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.49755.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48531.log.gz 2024-01-25T15:06:43.055 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53716.log 2024-01-25T15:06:43.055 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.49173.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49755.log.gz 2024-01-25T15:06:43.055 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55482.log 2024-01-25T15:06:43.055 INFO:teuthology.orchestra.run.smithi029.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49173.log.gz 2024-01-25T15:06:43.056 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.53716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48573.log 2024-01-25T15:06:43.056 INFO:teuthology.orchestra.run.smithi029.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53716.log.gz 2024-01-25T15:06:43.056 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51938.log 2024-01-25T15:06:43.056 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.55482.log: /var/log/ceph/ceph-client.admin.48573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55002.log 2024-01-25T15:06:43.056 INFO:teuthology.orchestra.run.smithi029.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55482.log.gz 2024-01-25T15:06:43.056 INFO:teuthology.orchestra.run.smithi029.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48573.log.gz 2024-01-25T15:06:43.056 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48159.log 2024-01-25T15:06:43.056 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52296.log 2024-01-25T15:06:43.056 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.55002.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51938.log.gz 2024-01-25T15:06:43.057 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.48159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37306.log 2024-01-25T15:06:43.057 INFO:teuthology.orchestra.run.smithi029.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55002.log.gz 2024-01-25T15:06:43.057 INFO:teuthology.orchestra.run.smithi029.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48159.log.gz 2024-01-25T15:06:43.057 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55338.log 2024-01-25T15:06:43.057 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.52296.log: /var/log/ceph/ceph-client.admin.37306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54053.log 2024-01-25T15:06:43.057 INFO:teuthology.orchestra.run.smithi029.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52296.log.gz 2024-01-25T15:06:43.057 INFO:teuthology.orchestra.run.smithi029.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37306.log.gz 2024-01-25T15:06:43.057 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.55338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52212.log 2024-01-25T15:06:43.057 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44139.log 2024-01-25T15:06:43.058 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.54053.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55338.log.gz 2024-01-25T15:06:43.058 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.52212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53428.log 88.5% 2024-01-25T15:06:43.058 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54053.log.gz 2024-01-25T15:06:43.058 INFO:teuthology.orchestra.run.smithi029.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52212.log.gz 2024-01-25T15:06:43.058 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-01-25T15:06:43.058 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44139.log: /var/log/ceph/ceph-client.admin.53428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54450.log 2024-01-25T15:06:43.058 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44139.log.gz 2024-01-25T15:06:43.058 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.3.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53428.log.gz 2024-01-25T15:06:43.058 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49035.log 2024-01-25T15:06:43.059 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.54450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47334.log 2024-01-25T15:06:43.059 INFO:teuthology.orchestra.run.smithi029.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54450.log.gz 2024-01-25T15:06:43.059 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.49035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46770.log 2024-01-25T15:06:43.059 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45525.log 2024-01-25T15:06:43.059 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47334.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49035.log.gz 2024-01-25T15:06:43.059 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.46770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44951.log 2024-01-25T15:06:43.059 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47334.log.gz 2024-01-25T15:06:43.059 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45525.log: gzip -5 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46770.log.gz 2024-01-25T15:06:43.059 INFO:teuthology.orchestra.run.smithi029.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49671.log 2024-01-25T15:06:43.060 INFO:teuthology.orchestra.run.smithi029.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45525.log.gz 2024-01-25T15:06:43.060 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55380.log 2024-01-25T15:06:43.060 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7%/var/log/ceph/ceph-client.admin.49671.log: -- replaced with /var/log/ceph/ceph-client.admin.44951.log.gz 2024-01-25T15:06:43.060 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55522.log 2024-01-25T15:06:43.060 INFO:teuthology.orchestra.run.smithi029.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49671.log.gz 2024-01-25T15:06:43.060 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47376.log 2024-01-25T15:06:43.060 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.55380.log: /var/log/ceph/ceph-client.admin.55522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51686.log 2024-01-25T15:06:43.060 INFO:teuthology.orchestra.run.smithi029.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55380.log.gz 2024-01-25T15:06:43.061 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55522.log.gz 2024-01-25T15:06:43.061 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37203.log 2024-01-25T15:06:43.061 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44609.log 2024-01-25T15:06:43.061 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51686.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47376.log.gz 2024-01-25T15:06:43.061 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42532.log 2024-01-25T15:06:43.061 INFO:teuthology.orchestra.run.smithi029.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51686.log.gz 2024-01-25T15:06:43.061 INFO:teuthology.orchestra.run.smithi029.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37203.log.gz 2024-01-25T15:06:43.061 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43725.log 2024-01-25T15:06:43.061 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51644.log 2024-01-25T15:06:43.062 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44609.log.gz 2024-01-25T15:06:43.062 INFO:teuthology.orchestra.run.smithi029.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42532.log.gz 2024-01-25T15:06:43.062 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42616.log 2024-01-25T15:06:43.062 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54221.log 2024-01-25T15:06:43.062 INFO:teuthology.orchestra.run.smithi029.stderr: 89.5%/var/log/ceph/ceph-client.admin.51644.log: -- replaced with /var/log/ceph/ceph-client.admin.43725.log.gz 2024-01-25T15:06:43.062 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46071.log 2024-01-25T15:06:43.062 INFO:teuthology.orchestra.run.smithi029.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51644.log.gz 2024-01-25T15:06:43.062 INFO:teuthology.orchestra.run.smithi029.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42616.log.gz 2024-01-25T15:06:43.062 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.54221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49078.log 2024-01-25T15:06:43.063 INFO:teuthology.orchestra.run.smithi029.stderr:gzip/var/log/ceph/ceph-client.admin.46071.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44013.log 2024-01-25T15:06:43.063 INFO:teuthology.orchestra.run.smithi029.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54221.log.gz 2024-01-25T15:06:43.063 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.49078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43625.log 2024-01-25T15:06:43.063 INFO:teuthology.orchestra.run.smithi029.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46071.log.gz 2024-01-25T15:06:43.063 INFO:teuthology.orchestra.run.smithi029.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49078.log.gz 2024-01-25T15:06:43.063 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.44013.log: -- /var/log/ceph/ceph-client.admin.44950.log 2024-01-25T15:06:43.063 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44948.log 2024-01-25T15:06:43.063 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43625.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44013.log.gz 2024-01-25T15:06:43.063 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45278.log 2024-01-25T15:06:43.064 INFO:teuthology.orchestra.run.smithi029.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43625.log.gz 2024-01-25T15:06:43.064 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44948.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44950.log.gz 2024-01-25T15:06:43.064 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46854.log 2024-01-25T15:06:43.064 INFO:teuthology.orchestra.run.smithi029.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44948.log.gz 2024-01-25T15:06:43.064 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48741.log 2024-01-25T15:06:43.064 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54281.log 2024-01-25T15:06:43.064 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.46854.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45278.log.gz 2024-01-25T15:06:43.064 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.48741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42172.log 2024-01-25T15:06:43.065 INFO:teuthology.orchestra.run.smithi029.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46854.log.gz 2024-01-25T15:06:43.065 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.54281.log: gzip 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48741.log.gz 2024-01-25T15:06:43.065 INFO:teuthology.orchestra.run.smithi029.stderr: -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-01-25T15:06:43.065 INFO:teuthology.orchestra.run.smithi029.stderr: 89.3%/var/log/ceph/ceph-client.admin.42172.log: -- replaced with /var/log/ceph/ceph-client.admin.54281.log.gz 2024-01-25T15:06:43.065 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52128.log 2024-01-25T15:06:43.065 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42172.log.gz 2024-01-25T15:06:43.065 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42742.log 2024-01-25T15:06:43.065 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.52128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47418.log 2024-01-25T15:06:43.065 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42742.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52128.log.gz 2024-01-25T15:06:43.066 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54917.log 2024-01-25T15:06:43.066 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47418.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42742.log.gz 2024-01-25T15:06:43.066 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49418.log 2024-01-25T15:06:43.066 INFO:teuthology.orchestra.run.smithi029.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47418.log.gz 2024-01-25T15:06:43.066 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.54917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48783.log 2024-01-25T15:06:43.066 INFO:teuthology.orchestra.run.smithi029.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54917.log.gz 2024-01-25T15:06:43.066 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.49418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48825.log 2024-01-25T15:06:43.066 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.48783.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49418.log.gz 2024-01-25T15:06:43.066 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49130.log 2024-01-25T15:06:43.067 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48783.log.gz 2024-01-25T15:06:43.067 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.48825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51560.log 2024-01-25T15:06:43.067 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.49130.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48825.log.gzgzip 2024-01-25T15:06:43.067 INFO:teuthology.orchestra.run.smithi029.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55564.log 2024-01-25T15:06:43.067 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51476.log 2024-01-25T15:06:43.067 INFO:teuthology.orchestra.run.smithi029.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49130.log.gz 2024-01-25T15:06:43.067 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.55564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44943.log 2024-01-25T15:06:43.067 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51560.log.gz 2024-01-25T15:06:43.067 INFO:teuthology.orchestra.run.smithi029.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gzgzip 2024-01-25T15:06:43.068 INFO:teuthology.orchestra.run.smithi029.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51168.log 2024-01-25T15:06:43.068 INFO:teuthology.orchestra.run.smithi029.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55564.log.gz 2024-01-25T15:06:43.068 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51476.log: /var/log/ceph/ceph-client.admin.44943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50147.log 2024-01-25T15:06:43.068 INFO:teuthology.orchestra.run.smithi029.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51476.log.gz 2024-01-25T15:06:43.068 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51168.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44943.log.gz 2024-01-25T15:06:43.068 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42256.log 2024-01-25T15:06:43.068 INFO:teuthology.orchestra.run.smithi029.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51168.log.gz 2024-01-25T15:06:43.068 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52966.log 2024-01-25T15:06:43.068 INFO:teuthology.orchestra.run.smithi029.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50147.log.gz 2024-01-25T15:06:43.069 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51256.log 2024-01-25T15:06:43.069 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47796.log 2024-01-25T15:06:43.069 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.52966.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42256.log.gz 2024-01-25T15:06:43.069 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48201.log 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52966.log.gz 2024-01-25T15:06:43.069 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-01-25T15:06:43.069 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47796.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51256.log.gz 2024-01-25T15:06:43.069 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54324.log 2024-01-25T15:06:43.069 INFO:teuthology.orchestra.run.smithi029.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47796.log.gz 2024-01-25T15:06:43.070 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52474.log 2024-01-25T15:06:43.070 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.48201.log: /var/log/ceph/ceph-client.admin.54324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52022.log 2024-01-25T15:06:43.070 INFO:teuthology.orchestra.run.smithi029.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48201.log.gz 2024-01-25T15:06:43.070 INFO:teuthology.orchestra.run.smithi029.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54324.log.gz 2024-01-25T15:06:43.070 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.52474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53302.log 2024-01-25T15:06:43.070 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.52022.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52474.log.gz 2024-01-25T15:06:43.070 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45281.log 2024-01-25T15:06:43.070 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.53302.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52022.log.gz 2024-01-25T15:06:43.070 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47208.log 2024-01-25T15:06:43.071 INFO:teuthology.orchestra.run.smithi029.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53302.log.gz 2024-01-25T15:06:43.071 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44944.log 2024-01-25T15:06:43.071 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47208.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.45281.log.gz 2024-01-25T15:06:43.071 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-01-25T15:06:43.071 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47208.log.gz 2024-01-25T15:06:43.071 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45283.log 2024-01-25T15:06:43.071 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54696.log 2024-01-25T15:06:43.071 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44944.log.gz 2024-01-25T15:06:43.071 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55044.log 2024-01-25T15:06:43.072 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.54696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54408.log 2024-01-25T15:06:43.072 INFO:teuthology.orchestra.run.smithi029.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45283.log.gz 2024-01-25T15:06:43.072 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.55044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41745.log 2024-01-25T15:06:43.072 INFO:teuthology.orchestra.run.smithi029.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54696.log.gz 2024-01-25T15:06:43.072 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45284.log 2024-01-25T15:06:43.072 INFO:teuthology.orchestra.run.smithi029.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55044.log.gz 2024-01-25T15:06:43.072 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.54408.log: /var/log/ceph/ceph-client.admin.41745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53554.log 2024-01-25T15:06:43.072 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45284.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41745.log.gz 2024-01-25T15:06:43.072 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42344.log 2024-01-25T15:06:43.073 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54408.log.gz 2024-01-25T15:06:43.073 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.53554.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45284.log.gz 2024-01-25T15:06:43.073 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41826.log 2024-01-25T15:06:43.073 INFO:teuthology.orchestra.run.smithi029.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53554.log.gz 2024-01-25T15:06:43.073 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47628.log 2024-01-25T15:06:43.073 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42344.log: /var/log/ceph/ceph-client.admin.41826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51896.log 2024-01-25T15:06:43.073 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42344.log.gz 2024-01-25T15:06:43.073 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41826.log.gz 2024-01-25T15:06:43.074 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51812.log 2024-01-25T15:06:43.074 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47628.log: /var/log/ceph/ceph-client.admin.51896.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-25T15:06:43.074 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51812.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51896.log.gz 2024-01-25T15:06:43.074 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43893.log 2024-01-25T15:06:43.074 INFO:teuthology.orchestra.run.smithi029.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47628.log.gz 2024-01-25T15:06:43.074 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51000.log 2024-01-25T15:06:43.074 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51812.log.gz 2024-01-25T15:06:43.074 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45287.log 2024-01-25T15:06:43.074 INFO:teuthology.orchestra.run.smithi029.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43893.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54011.log 2024-01-25T15:06:43.075 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-01-25T15:06:43.075 INFO:teuthology.orchestra.run.smithi029.stderr: 85.4% -- replaced with /var/log/ceph/ceph.log.gz/var/log/ceph/ceph-client.admin.51000.log: 2024-01-25T15:06:43.075 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48447.log 2024-01-25T15:06:43.075 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45287.log.gz 2024-01-25T15:06:43.075 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51000.log.gz/var/log/ceph/ceph-client.admin.54011.log: 2024-01-25T15:06:43.075 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46155.log 2024-01-25T15:06:43.075 INFO:teuthology.orchestra.run.smithi029.stderr: 89.1%/var/log/ceph/ceph-client.admin.48447.log: -- replaced with /var/log/ceph/ceph-client.admin.54011.log.gz 2024-01-25T15:06:43.075 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-01-25T15:06:43.075 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48447.log.gz 2024-01-25T15:06:43.076 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.46155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48909.log 2024-01-25T15:06:43.076 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.2.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46155.log.gz 2024-01-25T15:06:43.076 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-01-25T15:06:43.076 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.48909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55212.log 2024-01-25T15:06:43.076 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7%/var/log/ceph/ceph-mds.c.log: -- replaced with /var/log/ceph/ceph-client.admin.48909.log.gz 2024-01-25T15:06:43.076 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51126.log 2024-01-25T15:06:43.076 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52338.log 2024-01-25T15:06:43.076 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.55212.log: /var/log/ceph/ceph-client.admin.51126.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55212.log.gz 2024-01-25T15:06:43.077 INFO:teuthology.orchestra.run.smithi029.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51126.log.gz 2024-01-25T15:06:43.077 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54739.log 2024-01-25T15:06:43.077 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.52338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55170.log 2024-01-25T15:06:43.077 INFO:teuthology.orchestra.run.smithi029.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52338.log.gz 2024-01-25T15:06:43.077 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.54739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47880.log 2024-01-25T15:06:43.077 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.55170.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54739.log.gz 2024-01-25T15:06:43.077 INFO:teuthology.orchestra.run.smithi029.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53801.log 2024-01-25T15:06:43.077 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55170.log.gz 2024-01-25T15:06:43.077 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50609.log 2024-01-25T15:06:43.078 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47880.log: /var/log/ceph/ceph-client.admin.53801.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47880.log.gz 2024-01-25T15:06:43.078 INFO:teuthology.orchestra.run.smithi029.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53801.log.gz 2024-01-25T15:06:43.078 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43499.log 2024-01-25T15:06:43.078 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44349.log 2024-01-25T15:06:43.078 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50609.log: /var/log/ceph/ceph-client.admin.43499.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50609.log.gz 2024-01-25T15:06:43.078 INFO:teuthology.orchestra.run.smithi029.stderr: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42472.log 2024-01-25T15:06:43.078 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43499.log.gz 2024-01-25T15:06:43.078 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42214.log 2024-01-25T15:06:43.078 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42472.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44349.log.gz 2024-01-25T15:06:43.079 INFO:teuthology.orchestra.run.smithi029.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42472.log.gz 2024-01-25T15:06:43.079 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42300.log 2024-01-25T15:06:43.079 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43268.log 2024-01-25T15:06:43.079 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42214.log: /var/log/ceph/ceph-client.admin.42300.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42214.log.gz 2024-01-25T15:06:43.079 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47460.log 2024-01-25T15:06:43.079 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42300.log.gz 2024-01-25T15:06:43.079 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46938.log 2024-01-25T15:06:43.079 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47460.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47460.log.gz 2024-01-25T15:06:43.080 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36953.log 2024-01-25T15:06:43.080 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.46938.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46938.log.gz 2024-01-25T15:06:43.080 INFO:teuthology.orchestra.run.smithi029.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.43268.log.gz 2024-01-25T15:06:43.080 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44097.log 2024-01-25T15:06:43.080 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53386.log 2024-01-25T15:06:43.080 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44097.log: /var/log/ceph/ceph-client.admin.36953.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36953.log.gz 2024-01-25T15:06:43.080 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44097.log.gz 2024-01-25T15:06:43.080 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44614.log 2024-01-25T15:06:43.081 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.53386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43935.log 2024-01-25T15:06:43.081 INFO:teuthology.orchestra.run.smithi029.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53386.log.gz 2024-01-25T15:06:43.081 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49460.log 2024-01-25T15:06:43.081 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43935.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44614.log.gz 2024-01-25T15:06:43.081 INFO:teuthology.orchestra.run.smithi029.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43935.log.gz 2024-01-25T15:06:43.081 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48117.log 2024-01-25T15:06:43.081 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.49460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47250.log 2024-01-25T15:06:43.081 INFO:teuthology.orchestra.run.smithi029.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49460.log.gz/var/log/ceph/ceph-client.admin.48117.log: 2024-01-25T15:06:43.082 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53656.log 2024-01-25T15:06:43.082 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47250.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48117.log.gz 2024-01-25T15:06:43.082 INFO:teuthology.orchestra.run.smithi029.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47250.log.gz 2024-01-25T15:06:43.082 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53218.log 2024-01-25T15:06:43.082 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54959.log 2024-01-25T15:06:43.082 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.53218.log: /var/log/ceph/ceph-client.admin.53656.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53218.log.gz 2024-01-25T15:06:43.082 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53656.log.gz 2024-01-25T15:06:43.082 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45987.log 2024-01-25T15:06:43.083 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.54959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53470.log 2024-01-25T15:06:43.083 INFO:teuthology.orchestra.run.smithi029.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54959.log.gz 2024-01-25T15:06:43.083 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44611.log 2024-01-25T15:06:43.083 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.53470.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45987.log.gz 2024-01-25T15:06:43.083 INFO:teuthology.orchestra.run.smithi029.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53470.log.gz 2024-01-25T15:06:43.083 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44181.log 2024-01-25T15:06:43.083 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54179.log 2024-01-25T15:06:43.083 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44611.log.gz/var/log/ceph/ceph-client.admin.44181.log: 2024-01-25T15:06:43.084 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45903.log 2024-01-25T15:06:43.084 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44181.log.gz/var/log/ceph/ceph-client.admin.54179.log: 2024-01-25T15:06:43.084 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54179.log.gz 2024-01-25T15:06:43.084 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44612.log 2024-01-25T15:06:43.084 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45903.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-01-25T15:06:43.084 INFO:teuthology.orchestra.run.smithi029.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-01-25T15:06:43.084 INFO:teuthology.orchestra.run.smithi029.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45903.log.gz 2024-01-25T15:06:43.084 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53092.log 2024-01-25T15:06:43.085 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44612.log.gz 2024-01-25T15:06:43.085 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42784.log 2024-01-25T15:06:43.085 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.53092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51042.log 2024-01-25T15:06:43.085 INFO:teuthology.orchestra.run.smithi029.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53092.log.gz 2024-01-25T15:06:43.085 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48951.log 2024-01-25T15:06:43.085 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51042.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51042.log.gz 2024-01-25T15:06:43.085 INFO:teuthology.orchestra.run.smithi029.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.42784.log.gz 2024-01-25T15:06:43.085 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.48951.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48951.log.gz 2024-01-25T15:06:43.085 INFO:teuthology.orchestra.run.smithi029.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-01-25T15:06:43.086 INFO:teuthology.orchestra.run.smithi052.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-01-25T15:06:43.086 INFO:teuthology.orchestra.run.smithi052.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-01-25T15:06:43.104 INFO:teuthology.orchestra.run.smithi029.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-01-25T15:06:43.625 INFO:teuthology.orchestra.run.smithi029.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-01-25T15:06:43.634 INFO:teuthology.orchestra.run.smithi052.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-01-25T15:06:43.659 INFO:teuthology.orchestra.run.smithi052.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-01-25T15:06:43.662 INFO:teuthology.orchestra.run.smithi052.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-01-25T15:06:43.667 INFO:teuthology.orchestra.run.smithi029.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-01-25T15:06:43.681 INFO:teuthology.orchestra.run.smithi029.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-01-25T15:06:43.727 INFO:teuthology.orchestra.run.smithi052.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-01-25T15:06:43.729 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-01-25T15:06:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:real 0m0.830s 2024-01-25T15:06:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:user 0m3.235s 2024-01-25T15:06:43.729 INFO:teuthology.orchestra.run.smithi052.stderr:sys 0m0.129s 2024-01-25T15:06:43.750 INFO:teuthology.orchestra.run.smithi029.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-01-25T15:06:43.752 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-01-25T15:06:43.752 INFO:teuthology.orchestra.run.smithi029.stderr:real 0m0.893s 2024-01-25T15:06:43.753 INFO:teuthology.orchestra.run.smithi029.stderr:user 0m3.321s 2024-01-25T15:06:43.753 INFO:teuthology.orchestra.run.smithi029.stderr:sys 0m0.267s 2024-01-25T15:06:43.753 INFO:tasks.ceph:Archiving logs... 2024-01-25T15:06:43.753 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531486/remote/smithi029/log 2024-01-25T15:06:43.754 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-25T15:06:44.514 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531486/remote/smithi052/log 2024-01-25T15:06:44.515 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-25T15:06:45.012 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-25T15:06:45.021 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-25T15:06:45.022 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-25T15:06:45.024 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-25T15:06:45.113 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-25T15:06:45.123 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-25T15:06:45.123 DEBUG:teuthology.orchestra.run.smithi029:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-25T15:06:45.126 DEBUG:teuthology.orchestra.run.smithi052:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-25T15:06:45.140 INFO:teuthology.orchestra.run.smithi029.stderr:bash: line 1: ntpq: command not found 2024-01-25T15:06:45.141 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-01-25T15:06:45.144 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-25T15:06:45.144 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2024-01-25T15:06:45.144 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 6 -110us[ -111us] +/- 83ms 2024-01-25T15:06:45.145 INFO:teuthology.orchestra.run.smithi029.stdout:^* hv02.front.sepia.ceph.com 3 6 377 4 +68us[ +66us] +/- 69ms 2024-01-25T15:06:45.145 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 +33us[ +31us] +/- 90ms 2024-01-25T15:06:45.145 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T15:06:45.148 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-25T15:06:45.148 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-01-25T15:06:45.148 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 5 -102us[ -100us] +/- 83ms 2024-01-25T15:06:45.149 INFO:teuthology.orchestra.run.smithi052.stdout:^* hv02.front.sepia.ceph.com 3 6 377 3 +60us[ +62us] +/- 69ms 2024-01-25T15:06:45.149 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 +39us[ +41us] +/- 90ms 2024-01-25T15:06:45.149 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T15:06:45.150 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-25T15:06:45.170 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-25T15:06:45.171 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-25T15:06:45.180 DEBUG:teuthology.orchestra.run.smithi029:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-25T15:06:45.269 DEBUG:teuthology.orchestra.run.smithi052:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-25T15:06:45.338 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-25T15:06:45.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T15:06:45.371 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-25T15:06:45.401 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T15:06:45.402 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-25T15:06:45.411 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-25T15:06:45.420 INFO:teuthology.task.internal:Duration was 590.668264 seconds 2024-01-25T15:06:45.421 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-25T15:06:45.435 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-25T15:06:45.435 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-25T15:06:45.438 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-25T15:06:45.480 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-25T15:06:45.486 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-25T15:06:45.793 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-25T15:06:45.794 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi029.front.sepia.ceph.com 2024-01-25T15:06:45.794 DEBUG:teuthology.orchestra.run.smithi029:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-25T15:06:45.814 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi052.front.sepia.ceph.com 2024-01-25T15:06:45.814 DEBUG:teuthology.orchestra.run.smithi052:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-25T15:06:45.839 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-25T15:06:45.840 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-25T15:06:45.857 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-25T15:06:45.909 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-25T15:06:45.909 DEBUG:teuthology.orchestra.run.smithi029:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-25T15:06:45.927 DEBUG:teuthology.orchestra.run.smithi052:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-25T15:06:46.046 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-25T15:06:46.056 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-25T15:06:46.056 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-25T15:06:46.083 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-25T15:06:46.109 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-25T15:06:46.121 DEBUG:teuthology.orchestra.run.smithi029:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-25T15:06:46.125 DEBUG:teuthology.orchestra.run.smithi052:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-25T15:06:46.148 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = core 2024-01-25T15:06:46.174 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = core 2024-01-25T15:06:46.190 DEBUG:teuthology.orchestra.run.smithi029:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-25T15:06:46.219 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T15:06:46.219 DEBUG:teuthology.orchestra.run.smithi052:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-25T15:06:46.244 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T15:06:46.244 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-25T15:06:46.254 INFO:teuthology.task.internal:Transferring archived files... 2024-01-25T15:06:46.254 DEBUG:teuthology.misc:Transferring archived files from smithi029:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531486/remote/smithi029 2024-01-25T15:06:46.255 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-25T15:06:46.295 DEBUG:teuthology.misc:Transferring archived files from smithi052:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531486/remote/smithi052 2024-01-25T15:06:46.295 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-25T15:06:46.330 INFO:teuthology.task.internal:Removing archive directory... 2024-01-25T15:06:46.330 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-25T15:06:46.332 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-25T15:06:46.379 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-25T15:06:46.389 INFO:teuthology.task.internal:Not uploading archives. 2024-01-25T15:06:46.390 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-25T15:06:46.400 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-25T15:06:46.400 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-25T15:06:46.402 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-25T15:06:46.414 INFO:teuthology.orchestra.run.smithi029.stdout: 262166 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jan 25 15:06 /home/ubuntu/cephtest 2024-01-25T15:06:46.414 INFO:teuthology.orchestra.run.smithi029.stdout: 393497 4 d--------- 2 ubuntu ubuntu 4096 Jan 25 15:05 /home/ubuntu/cephtest/mnt.0 2024-01-25T15:06:46.415 INFO:teuthology.orchestra.run.smithi029.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-01-25T15:06:46.415 INFO:teuthology.orchestra.run.smithi029.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-01-25T15:06:46.421 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T15:06:46.422 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-01-25T15:06:46.430 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-25T15:06:46.442 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-25T15:06:46.453 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi029 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-01-25T15:06:46.453 INFO:teuthology.nuke:Checking targets against current locks 2024-01-25T15:06:46.460 INFO:teuthology.orchestra.run.smithi052.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 25 15:06 /home/ubuntu/cephtest 2024-01-25T15:06:46.485 DEBUG:teuthology.nuke:shortname: smithi029 2024-01-25T15:06:46.485 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-25T15:06:46.508 DEBUG:teuthology.nuke:shortname: smithi052 2024-01-25T15:06:46.509 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-25T15:06:46.512 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531486', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-25 14:47:59.748700', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPh5hJ2R9FHK3+NsMdR3AgyHxkkEsnxPtPiQ8l6qvu/oE0SJX8++UVrWzsSQ3EfDctSFfFFX7sOGw7RRgLQAIqo='} 2024-01-25T15:06:46.533 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531486', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-25 14:47:59.750671', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUzhAxUidfqU8imDHbFUGBRHXVVI0YbSSg4pBnLQGVADVRqT6yDdKF1qMRXF5NWubV5/Xd9OgXmQo/77EmvWtE='} 2024-01-25T15:06:46.565 INFO:teuthology.orchestra.console.smithi029:Power off 2024-01-25T15:06:46.565 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-25T15:06:46.591 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2024-01-25T15:06:46.591 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T15:06:46.608 INFO:teuthology.orchestra.console.smithi052:Power off 2024-01-25T15:06:46.609 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-25T15:06:46.619 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2024-01-25T15:06:46.634 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off 2024-01-25T15:06:46.634 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T15:06:46.659 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2024-01-25T15:06:50.620 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T15:06:50.660 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T15:06:50.732 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2024-01-25T15:06:50.771 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2024-01-25T15:06:54.736 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T15:06:54.772 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T15:06:54.847 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-01-25T15:06:54.883 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2024-01-25T15:06:54.949 INFO:teuthology.orchestra.console.smithi029:Power off completed 2024-01-25T15:06:54.985 INFO:teuthology.orchestra.console.smithi052:Power off completed 2024-01-25T15:06:55.090 INFO:teuthology.run:Summary data: description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} duration: 590.6682641506195 failure_reason: 'Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=fae7829f7b8c457b83068fce3fe9a775 status: fail success: false 2024-01-25T15:06:55.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T15:06:55.181 INFO:teuthology.run:FAIL